Can machines reason non-verbally?

Multimodal Intelligence ZSVR Other MMI ML ALG Heuristic Search CV SST MIAS
2026年10月09日
现代机器虽已能求解方程、遵循逻辑并借助语言进行推理,但在需要视觉性、非言语推理的问题上仍显乏力。这一局限性在DeepSeek、ChatGPT和Gemini等前沿系统中依然清晰可见——它们在完成抽象图案补全、界定模糊的兴趣区域等视觉任务上仍存在明显短板。与言语推理中可被逻辑推演或自动化测试所验证的显式中间步骤不同,视觉推理依赖大量隐式的中间步骤,而目前尚无明确、可靠的方法对其加以验证。因此,非言语推理建模难度极大,也由此成为当前机器智能的一项根本性瓶颈。 本文提出GenVerOpt——一种将生成(Generation)、验证(Verification)与优化(Optimization)三者统一于单一推理流程的通用框架。该框架通过生成候选解、验证其正确性,并迭代优化改进,实现面向单个样本的精细化优化,而非仅依赖模型训练过程中从数据集层面所习得的统计规律。这一过程高度模拟人类的问题求解方式:即先构想多种可能方案,再逐一评估、反复修正,直至得出正确答案。 在多个差异显著的应用领域中,GenVerOpt展现出超越现有系统的能力:在抽象智商测验题上表现优于人类;在前列腺癌病灶分割任务中达到与临床医生相当的水平;在肝脏血管三维重建任务中超过领域专家;在肿瘤边界精准对齐任务中亦优于当前最先进的方法。上述结果表明,机器推理能力完全可以突破语言的藩篱,而视觉性、非言语推理正可作为构建更灵活、更具泛化能力的人工智能之坚实基础。
Modern machines can solve equations, follow logic and reason through language, yet they still struggle with problems that require visual non-verbal reasoning. This is evident even in advanced systems such as DeepSeek, ChatGPT and Gemini, which remain limited on visual tasks such as completing abstract patterns or delineating ambiguous regions-of-interest. Unlike explicit intermediate steps in verbal reasoning which can be verified through logic or automated tests, visual reasoning involves implicit intermediate steps with no clear methods for verification. Non-verbal reasoning is therefore challenging to model and, as a result, remains a fundamental limitation of current machine intelligence. Here we introduce GenVerOpt, a general framework that unifies generation, verification and optimisation into a reasoning pipeline for machines. By generating candidate solutions, verifying their correctness, and iteratively refining them, GenVerOpt enables per-sample optimisation rather than relying solely on dataset-level trends captured during model training. This process mirrors human problem-solving where multiple possibilities are imagined, evaluated, and refined until a correct solution emerges. Across diverse domains, GenVerOpt demonstrates capabilities beyond existing systems: it surpasses humans on abstract IQ puzzles, matches clinicians in prostate cancer segmentation, exceeds experts in liver vessel reconstruction and outperforms state-of-the-art approaches in tumour boundary alignment. These results show that machine reasoning can extend beyond language, establishing visual non-verbal reasoning as a foundation for more flexible and generalisable intelligence.
许愿