The Spectrum Strikes Back: Infrared POV Attacks on Traffic Sign Classification

AI Safety / AI Ethics PIAAP RA CV ODBO
2026年06月29日
交通标志分类是自动驾驶车辆的一项关键任务,目前已发现大量针对该任务的攻击手段。大多数物理对抗性攻击需在交通标志上粘贴干扰补丁或向其投射扰动图案;尽管这类攻击效果显著,但其干扰痕迹对人类肉眼而言清晰可见。与此同时,虽已知存在基于人眼不可见光谱(如红外光)的攻击方式,但其动态自适应能力存在明显局限。为此,我们提出一种基于“视觉暂留效应”(persistence-of-vision)的近红外光谱攻击方法:该方法支持动态内容显示,并可实现远程触发,从而构建出一种隐蔽性强的物理对抗攻击。我们首先通过数字仿真确定最优攻击位置,继而在真实场景中开展系统性评估——实验涵盖两种不同交通标志、来自多个算法族的12种机器学习模型、最远达20米的多种观测距离,以及多种光照条件。评估结果表明,在全部测试场景下,本攻击均取得了很高的成功率。为应对该威胁,我们提出了两类防御方案:一是采用近红外截止滤光片进行硬件防护,二是设计一种基于软件的检测机制;此外,为克服近红外视觉暂留显示装置在人眼可见性方面的固有局限,我们进一步研制了可在可见光波段(RGB)运行的原型系统。
Traffic sign classification is a crucial task for autonomous vehicles, and numerous attacks against it have been identified. A majority of physical adversarial attacks involve attaching patches to traffic signs or projecting perturbations on them. While they demonstrate high effectiveness, they are perceptible to humans. At the same time, light-based attacks outside the human visible spectrum are known but have limitations in their dynamic adaptability. We propose a persistence-of-vision-based attack that operates in the near-infrared light spectrum. With the possibility of showing dynamic, remotely triggered content, this allows a stealthy physical adversarial attack against traffic sign classification. By identifying the optimal position through digital simulation, we conduct extensive real-world evaluations using two different traffic signs, 12 machine learning models from different families, multiple distances up to 20 meters, and varying illumination conditions. Our evaluation shows high attack success rates across our test scenarios. We propose near-infrared cutoff filters and a software-based detection mechanism as defenses, and tackle limitations of the near-infrared persistence of vision display by prototyping a human-visible RGB version of it.
许愿