RSI-Anything: Unlocking Recursive Self-Improvement with World Models

AK's Picks Embodied AI and Robotics World Models Agent Autonomous Workflows AI4S Other AI4S
递归式自我改进(RSI)旨在将交互经验转化为持续的性能提升,但外部反馈获取成本高昂,且随着策略不断演进,世界模型的预测结果可能逐渐失准。为此,我们提出RSI-Anything——一种基于JEPA-Anything构建的、适用于通用领域的框架,其核心是利用预测性世界模型来指导智能体行动与学习数据的选择。实际观测到的反馈既驱动策略或工作流的优化,也触发对世界模型的条件化适配;而组件功能验证与兼容性检查则共同决定更新后的策略—模型组合是否予以保留。在涵盖计算与科学领域的多样化任务中,RSI-Anything均展现出显著性能提升:在代码修复任务中,在编码器固定的前提下,采用静态验证器时成功率仅为26.3%,引入预测性数据选择后提升至29.2%,再经世界模型自适应优化后进一步达31.2%,且三者所消耗的测试资源基本相当;在图形用户界面(GUI)任务评估中,任务完成率明显提高,同时平均操作步数减少39.4%;在实验室规划任务中,历经五个连续策略版本迭代,任务得分由初始的21.80%跃升至46.01%,增幅逾一倍;在化学反应条件优化任务中,RSI-Anything在相同40次实验预算下,达到96.15%的平均最优观测产率,显著优于贝叶斯优化方法的82.16%;此外,一个端到端的免疫学科研应用实例进一步打通了工作流演化、预测建模与治疗假说生成之间的闭环。上述结果充分表明,借助预测性世界模型以及对系统更新的持续保留机制,RSI-Anything可在多种异构环境中实现稳健、可扩展的递归式自我改进。
Recursive self-improvement (RSI) aims to transform interaction experience into persistent improvements, yet external feedback is costly and world-model predictions may become unreliable as policies evolve. We introduce RSI-Anything, a domain-general framework built on JEPA-Anything that uses predictive world models to guide action and learning-data selection. Observed feedback drives policy or workflow improvement and conditional world-model adaptation, while component and compatibility checks govern the retention of updated policy-model pairs. Across diverse computational and scientific domains, RSI-Anything demonstrates substantial gains. In code repair, with the coder fixed, success increases from 26.3% with a static verifier to 29.2% through predictive selection and 31.2% after world-model adaptation, at comparable test usage. Graphical user interface (GUI) evaluations showed higher task completion, while average actions decrease by 39.4%. Across five successive policy versions, laboratory-planning scores more than double from 21.80% to 46.01%. In reaction optimization, RSI-Anything achieves 96.15% mean best observed yield versus 82.16% for Bayesian optimization under the same 40-experiment budget. An end-to-end immune-science application further connects workflow evolution and predictive modeling with therapeutic hypothesis generation. These results demonstrate how predictive world models and retained system updates enable recursive improvement across diverse environments.
许愿