Fractal basins trap latent reasoning

LLM Latent Reasoning CoT ML NNGTB NN
推理能力使人工智能模型能够重新审视并修正自身错误,从而推动了近期在数学定理证明、软件工程及自主任务规划等前沿领域的重大进展。人们普遍观察到,推理模型在处理更困难的任务时,其推理过程会显著延长;然而,导致这种“减速”现象的普适性机制迄今尚不清楚。本文发现,推理模型呈现出瞬态混沌行为——这是困难任务所固有的计算复杂性在物理层面的一种自然体现。由此,我们证明:当前多种主流推理模型本质上均为动力学系统,且其吸引域具有分形结构;而随着任务难度提升(如数独与迷宫求解、视觉谜题、数学逻辑推理等各类任务),该分形结构的复杂程度亦随之增强。我们进一步指出,瞬态混沌的产生源于推理过程在鞍点附近长时间滞留;而这些鞍点恰恰对应于原问题中那些“接近正确”的尝试性解答。我们的研究结果表明,在现代人工智能模型中,推理速度随问题难度增加而下降,这一现象并非偶然,而是问题本身难度所导致的必然结果;同时,本研究也确立了“推理轨迹”作为一种全新且内涵丰富的动力学系统类别。
Reasoning allows artificial intelligence models to revisit and correct their mistakes, enabling recent frontier advances in mathematical theorem solving, software engineering, and autonomous task planning. Reasoning models are widely observed to reason for longer on harder tasks, but the general mechanism responsible for these slowdowns is unknown. Here, we show that reasoning models exhibit transient chaos, a physical consequence of the computational complexity of difficult tasks. As a consequence, we show that diverse leading reasoning models are dynamical systems with fractal basins, with fractality increasing with task difficulty across diverse tasks like Sudoku and maze solving, visual puzzles, and mathematical logic. We show that transient chaos emerges due to reasoning becoming trapped for extended durations near saddle points, which we show correspond to nearly-correct attempted solutions of the underlying problem. Our results show that reasoning slowdowns are an inevitable consequence of problem hardness in modern artificial intelligence models, and establish reasoning traces as a rich new class of dynamical system.
许愿