CRAM-ER: Error-Resilient Spintronic Computational Random Access Memory for Scalable In-Memory Computation

· Source: Artificial Intelligence · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Expert, quick

Summary

The CRAM-ER architecture is proposed as an error-resilient spintronic Computational Random Access Memory designed for scalable in-memory matrix-vector multiplications (MVMs). This innovation addresses critical limitations of traditional Von Neumann architectures, including severe memory bottlenecks and significant peripheral overhead in existing near-memory and compute-in-memory solutions. While MRAM-based CRAM offers dense, energy-efficient in-situ logic, it suffers from probabilistic MRAM switching errors that hinder scalability and reliability, alongside slow sequential MRAM writes. CRAM-ER mitigates these issues through an error-aware hardware-software co-design, integrating a hybrid spintronic-CRAM with a CMOS adder-tree. It also incorporates error-aware model fine-tuning and fine-grained error correction. Evaluations on DNN benchmarks demonstrate near-lossless accuracy, up to 2 orders of magnitude reduction in CRAM latency, and superior energy efficiency and energy-delay product compared to CPU/GPU+high-bandwidth DRAM.

Key takeaway

For AI Hardware Engineers designing next-generation accelerators, CRAM-ER presents a compelling solution to overcome severe memory bottlenecks and enhance energy efficiency. You should investigate hybrid spintronic-CMOS architectures and error-aware hardware-software co-design to mitigate device-level errors. This approach can deliver near-lossless DNN accuracy while significantly reducing latency and improving energy-delay product compared to traditional CPU/GPU setups.

Key insights

CRAM-ER uses hybrid spintronic-CMOS design and error correction for scalable, energy-efficient in-memory DNN computation.

Principles

Method

CRAM-ER employs a hybrid spintronic-CRAM + CMOS adder-tree architecture with an error-aware hardware-software co-design framework, model fine-tuning, and fine-grained error correction.

In practice

Topics

Best for: Research Scientist, AI Hardware Engineer, AI Scientist, Machine Learning Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.