Hierarchical Reasoning Model

LLM Latent Reasoning Agent Agent Planning ML RNN
推理是指设计和执行复杂的、以目标为导向的行为序列的过程,这在人工智能领域仍然是一个关键性的挑战。当前的大语言模型(LLMs)主要采用“思维链”(Chain-of-Thought, CoT)技术,但这种方法在任务分解上存在脆弱性、需要大量的训练数据,并且响应延迟较高。受人类大脑中分层且多时间尺度处理机制的启发,我们提出了一种新的循环架构——分层推理模型(Hierarchical Reasoning Model, HRM),该模型在实现显著计算深度的同时,保持了训练的稳定性与高效性。 HRM 通过两个相互依赖的循环模块,在一次前向传播过程中即可完成顺序推理任务,而无需对中间过程进行显式的监督。其中一个高层模块负责缓慢而抽象的规划,另一个低层模块则处理快速而具体的计算。HRM 在仅使用 1000 个训练样本的情况下,凭借仅仅 2700 万参数就在复杂推理任务中实现了卓越的性能表现。该模型无需预训练或 CoT 数据,却能在诸如复杂数独谜题和大型迷宫最优路径寻找等高难度任务上接近完美地完成任务。 此外,在衡量通用人工智能能力的关键基准——抽象与推理语料库(Abstraction and Reasoning Corpus, ARC)上,HRM 的表现优于许多规模更大、上下文窗口更长的模型。这些结果突显了 HRM 在通向通用计算和通用推理系统道路上所具备的重大变革潜力。
Reasoning, the process of devising and executing complex goal-oriented action sequences, remains a critical challenge in AI. Current large language models (LLMs) primarily employ Chain-of-Thought (CoT) techniques, which suffer from brittle task decomposition, extensive data requirements, and high latency. Inspired by the hierarchical and multi-timescale processing in the human brain, we propose the Hierarchical Reasoning Model (HRM), a novel recurrent architecture that attains significant computational depth while maintaining both training stability and efficiency. HRM executes sequential reasoning tasks in a single forward pass without explicit supervision of the intermediate process, through two interdependent recurrent modules: a high-level module responsible for slow, abstract planning, and a low-level module handling rapid, detailed computations. With only 27 million parameters, HRM achieves exceptional performance on complex reasoning tasks using only 1000 training samples. The model operates without pre-training or CoT data, yet achieves nearly perfect performance on challenging tasks including complex Sudoku puzzles and optimal path finding in large mazes. Furthermore, HRM outperforms much larger models with significantly longer context windows on the Abstraction and Reasoning Corpus (ARC), a key benchmark for measuring artificial general intelligence capabilities. These results underscore HRM's potential as a transformative advancement toward universal computation and general-purpose reasoning systems.
许愿