Samsung, the world’s largest memory chip manufacturer, announced that it has developed the world’s first HBM, high-bandwidth memory chip with integrated AI processing. The new chip not only improves AI processing performance but also lowers power consumption. Samsung named the new memory chip HBM-PIM, which PIM stands for “processing in memory”. Thanks to HBM-PIM, RAM of Galaxy phones can be entrusted to artificial intelligence.
The South Korean firm’s HBM2 Aquabolt memory chip, first launched in 2018, was used to develop the new HBM-PIM memory. The PIM part features advanced logic-based processing units and more than doubles AI processing performance. It also reduces power consumption by 70 percent. Samsung’s new memory chip will mostly be used in high-performance computing servers and artificial intelligence applications.
In the standard computer architecture, memory and processing are kept separate. This increases latency when too much data is carried between them. To overcome these lag issues, Samsung will launch the HBM-PIM. The new chip will also be compatible with the previous generation HBM interface. This means that compliance companies can install AI accelerators without modifying existing hardware and software.
Samsung said in a press release that it will supply HBM-PIM chips to customers for testing and validation in the first half of 2021, and then work with customers to standardize the PIM platform across the ecosystem.