RRAM-DP: Device-Calibrated Differential Privacy for In-Memory Edge Learning

AI Safety / AI Ethics DPPDT AI Systems and Hardware TPU/NPU EDIO
2026年07月20日
边缘人工智能物联网(AIoT)系统通常在本地实时采集敏感数据,由此引发严重的隐私问题。阻变式随机存取存储器(RRAM)凭借其多比特存储能力与存内计算(CiM)特性,成为实现高效AIoT系统的理想硬件载体;同时,其固有的随机写入行为天然具备随机性,可被巧妙利用以实现差分隐私(DP)保护。然而,如何将这种通常被视为损害模型精度的器件级随机性,转化为具备理论保障的、可调控的随机化机制,同时兼顾模型效用,目前仍缺乏系统性探索。为此,我们提出RRAM-DP——一种软硬协同设计方法:通过放宽RRAM的写入-校验操作,在硬件层面注入经过精确校准的噪声,从而在形式化差分隐私分析框架下,原生地实现(ε, δ)-差分隐私;结合预训练技术,该方法构建了一种全新的、兼具高隐私保障与高模型效用的存内训练范式。在CIFAR-10/100、STS-B和SST-2等基准数据集上,RRAM-DP-SGD在满足(ε=2, δ=O(1/n))差分隐私约束的前提下,相比非私有SGD算法,最高仅造成3.8%的准确率下降。在同等隐私保护水平下,RRAM-DP-SGD相较A100 GPU和DiVa-GEMM加速器,分别实现了最高达57倍与3.2倍的能效提升,以及2.7倍与1.8倍的推理速度提升。上述结果表明,基于RRAM的边缘端高效、隐私保护型存内训练已具备切实可行的技术路径。
Edge Artificial Intelligence of Things (AIoT) systems often collect sensitive data in situ, raising serious privacy concerns. Resistive-switching random-access memory (RRAM) is an attractive substrate for efficient AIoT thanks to its multi-bit storage and compute-in-memory (CiM) capabilities, while its inherently stochastic write behavior provides a natural source of randomness that can be leveraged for differential privacy (DP) protection. Yet how to transform this device-level randomness-typically viewed as detrimental to accuracy-into a principled randomized mechanism while preserving model utility remains underexplored. We propose RRAM-DP, a hardware-algorithm co-design that relaxes RRAM write-verify operations to inject calibrated noise for inherently (epsilon, delta)-DP with formal DP analysis; together with pretraining techniques, it renders a novel private, high-utility CiM training paradigm. On CIFAR-10/100, STS-B, and SST-2, RRAM-DP-SGD incurs at best only a 3.8% accuracy drop at (epsilon=2, delta=O(1/n))-DP relative to non-private SGD. At the same privacy level, RRAM-DP-SGD delivers up to 57x and 3.2x energy savings and 2.7x and 1.8x speedups over A100 and DiVa-GEMM, respectively. These results point toward efficient, privacy-preserving in-memory training on RRAM at the edge.
许愿