Self-Optimizing Multi-Agent Systems for Deep Research

Agent Multi-agent Collaboration Autonomous Workflows ML PGPO MARL
面对用户复杂的信息需求,多智能体深度研究(Deep Research)系统能够迭代式地进行规划、检索,并在数百份文档中综合证据,从而生成高质量的答案。在一种可能的架构中,由一个协调智能体(Orchestrator Agent)统筹整个流程,而多个并行工作的智能体(Worker Agents)则分别执行具体任务。然而,当前的深度研究系统往往依赖人工精心设计的提示词(prompts)和静态固定的系统架构,导致系统优化过程脆弱、成本高昂且耗时漫长。因此,我们探索了多种多智能体优化方法,结果表明:赋予智能体自主对弈(self-play)能力,并使其能够主动探索不同提示词组合,即可构建出高质量的深度研究系统——其性能可媲美甚至超越专家手工编写的提示词方案。
Given a user's complex information need, a multi-agent Deep Research system iteratively plans, retrieves, and synthesizes evidence across hundreds of documents to produce a high-quality answer. In one possible architecture, an orchestrator agent coordinates the process, while parallel worker agents execute tasks. Current Deep Research systems, however, often rely on hand-engineered prompts and static architectures, making improvement brittle, expensive, and time-consuming. We therefore explore various multi-agent optimization methods to show that enabling agents to self-play and explore different prompt combinations can produce high-quality Deep Research systems that match or outperform expert-crafted prompts.
许愿