{"id":195095,"date":"2023-10-20T19:39:29","date_gmt":"2023-10-20T19:39:29","guid":{"rendered":"https:\/\/tokenstalk.info\/?p=195095"},"modified":"2023-10-20T19:39:29","modified_gmt":"2023-10-20T19:39:29","slug":"ibms-new-ai-chip-offers-22x-speedup-with-mind-blowing-energy-efficiency","status":"publish","type":"post","link":"https:\/\/tokenstalk.info\/crypto\/ibms-new-ai-chip-offers-22x-speedup-with-mind-blowing-energy-efficiency\/","title":{"rendered":"IBM\u2019s new AI chip offers 22X speedup with \u2018mind-blowing\u2019 energy efficiency"},"content":{"rendered":"
IBM recently debuted a new prototype artificial intelligence (AI) chip purported to be both faster and far more energy efficient than any chip currently available.\u00a0<\/p>\n
According to research published in Science Magazine on Oct. 19, the new chip, dubbed NorthPole, \u201cachieves a 25 times higher energy metric\u201d on a relevant benchmark, \u201cand a 22 times lower time metric of latency.\u201d<\/p>\n
Ostensibly, this translates to the potential for post-GPU performance at a fraction of the cost in energy requirements.<\/p>\n
Damien Querlioz, a nanoelectronics researcher at the University of Paris-Saclay in Palaiseau, described NorthPole\u2019s energy efficiency as \u201cmind-blowing,\u201d in an article published on Nature. <\/p>\n
Per the IBM Research team\u2019s paper: <\/p>\n
\u201cNorthPole outperforms all prevalent architectures, even those that use more-advanced technology processes.\u201d<\/p><\/blockquote>\n
One of the major impediments to improving AI processing is called the \u201cvon Neumann bottleneck.\u201d Using currently available architecture, AI chips tend to have faster processing capabilities than the memory they require to run processes. As a result, latency is introduced whenever information is sent between the processing unit and random access memory.<\/p>\n
This is especially true at \u201cthe edge,\u201d where chips and data are stored together. Removing this bottleneck has long been considered by many experts to be the key to running powerful neural networks locally on devices. <\/p>\n
According to IBM Research, the new prototype chip built in the company\u2019s Alamaden, California laboratory bypasses the von Neumann bottleneck by, essentially, integrating the memory component onto the processing chip itself. <\/p>\n
As the chip\u2019s lead developer, Dharmendra Modha, puts it, NorthPole is \u201can entire network on a chip\u201d that \u201cforges a completely different path from the von Neumann architecture.\u201d<\/p>\n
<\/p>\n
The benchmark used to demonstrate the chip\u2019s effectiveness, ResNet50, is a 50-layer neural network primarily used to test computer vision tasks such as image classification. <\/p>\n
The NorthPole hardware\u2019s reported results on this benchmark indicate that it could perform exceptionally well at associated tasks such as autonomous surgery, operation of self-driving cars and other vehicles, and numerous robotics-related endeavors. <\/p>\n
IBM Research is already years into research on the next chip using the NorthPole architecture. According to the company blog, \u201cthis is just the start of the work for Modha on NorthPole.\u201d <\/p>\n