Predictive Performance of Photonic SRAM-based In-Memory Computing for Tensor Decomposition

AI Systems and Hardware TPU/NPU Other AI Sys & HW
基于光子学的存内计算系统因其超快的工作频率和高数据带宽,已经显示出比传统基于晶体管的系统显著的速度提升。光子静态随机存取存储器(pSRAM)是实现超快光子存内计算系统目标的关键组件。在这项工作中,我们对一种新型光子SRAM阵列架构进行建模并评估其性能。此外,我们通过波分复用(WDM)技术研究了超光谱操作,以提高pSRAM阵列的吞吐量。我们将矩阵化张量与Khatri-Rao积(MTTKRP)这一常用的张量分解计算核映射到所提出的pSRAM阵列架构上。同时,我们开发了一个预测性能模型,用于估计不同配置下pSRAM阵列的持续性能。通过该预测性能模型,我们证明了在实际硬件配置中,pSRAM阵列在执行MTTKRP时能够达到17 PetaOps的性能。
Photonics-based in-memory computing systems have demonstrated a significant speedup over traditional transistor-based systems because of their ultra-fast operating frequencies and high data bandwidths. Photonic static random access memory (pSRAM) is a crucial component for achieving the objective of ultra-fast photonic in-memory computing systems. In this work, we model and evaluate the performance of a novel photonic SRAM array architecture in development. Additionally, we examine hyperspectral operation through wavelength division multiplexing (WDM) to enhance the throughput of the pSRAM array. We map Matricized Tensor Times Khatri-Rao Product (MTTKRP), a computational kernel commonly used in tensor decomposition, to the proposed pSRAM array architecture. We also develop a predictive performance model to estimate the sustained performance of different configurations of the pSRAM array. Using the predictive performance model, we demonstrate that the pSRAM array achieves 17 PetaOps while performing MTTKRP in a practical hardware configuration.
许愿