What the Eyes See, the LLMs Miss: Exploiting Human Perception for Adversarial Text Attacks

LLM HDFE Other LLM AI Safety / AI Ethics PIAAP AVAR
2026年06月08日
由大语言模型(LLM)驱动的内容审核系统已成为抵御有害网络内容的关键防线。然而,此类系统主要基于分词后的文本进行运作,很大程度上忽略了人类在理解内容时自然依赖的视觉线索。我们指出,这种差异导致了一种根本性的感知错配:对人类而言显而易见的有害内容,在自动化审核系统眼中却可能近乎“隐形”。为深入研究这一漏洞,我们提出一类“人类可感知的对抗性攻击”(Human-Perceptible Adversarial Attacks, HPAA)——通过具有显著视觉特征的排版操作,将有害表达嵌入原本无害的文本之中。我们的核心洞见在于:字间距、视觉强调(如加粗、斜体、大小写混用等)以及空间布局等排版特征,可被策略性地组合运用,在充分保障人类对有害内容识别能力的同时,大幅削弱机器系统的检测能力。该攻击在黑盒环境下运行,仅需极少的查询次数(query budget),即可自动生成规避性内容,且无需访问目标模型内部结构或梯度信息。我们在多个数据集及十种已部署的内容审核系统上对该攻击进行了评估,涵盖主流商业API及当前最先进的开源防护机制(guardrails)。实验结果揭示了人类感知与机器感知之间触目惊心的鸿沟:仅需三次检测器查询所生成的攻击样本,即可实现超过86%的人类识别率,而在全部受测系统中,其被检出率均低于1%。我们进一步开展消融实验,以识别驱动成功规避的关键排版因素;分析现有审核架构为何无法捕捉此类视觉信号;并探讨切实可行的防御方案。本研究揭示了当前基于大语言模型的内容审核生态体系中一个根本性的感知盲区,并凸显出构建更契合人类视觉认知规律、能对内容进行多模态协同理解的审核系统之迫切必要性。
Large language model (LLM)-powered content moderation systems have become a critical defense against harmful online content. However, these systems primarily operate on tokenized text and largely ignore the visual cues that humans naturally rely on when interpreting content. We show that this discrepancy creates a fundamental perceptual mismatch: content that is readily recognized as harmful by humans can become effectively invisible to automated moderation systems. To study this vulnerability, we introduce a class of Human-Perceptible Adversarial Attacks (HPAA), in which harmful expressions are embedded into otherwise benign text through visually salient typographic manipulations. Our key insight is that typographic features, including spacing, visual emphasis, and spatial arrangement, can be strategically combined to preserve human recognition of harmful content while substantially reducing machine detectability. Operating in black-box settings with only a small query budget, our attack automatically generates evasive content without requiring model access or gradient information. We evaluate the attack across multiple datasets and ten deployed moderation systems, including commercial APIs and state-of-the-art open-source guardrails. Results reveal a striking gap between human and machine perception: with only three detector queries, generated attacks achieve over 86\% human recognition while maintaining detection rates below 1\% across the evaluated systems. We further conduct ablation studies to identify the typographic factors driving successful evasion, analyze why current moderation architectures fail to capture these signals, and discuss practical defenses. Our findings expose a fundamental blind spot in today's LLM-based moderation ecosystem and highlight need for moderation systems that reason about content in a manner more consistent with human perceptual understanding.
许愿