MECoBench: A Systematic Study of Multimodal Agent Collaboration in Embodied Environments

Embodied AI and Robotics MLMRD Multimodal Intelligence Visual Grounding Agent Multi-agent Collaboration Agent Eval Benchmarks
2026年06月30日
近期涌现的多模态大语言模型(MLLM)作为具身智能体展现出巨大潜力,但其在视觉接地环境中的协同协作能力仍鲜有探索。为填补这一研究空白,我们提出了MECoBench——一个面向多模态具身协作的评测基准,配套提供涵盖多样化真实世界任务、两种协作结构以及三种协作模式的综合评估平台。通过对多种MLLM开展大规模实验,我们总结出三项关键发现:(i)协作总体上有助于提升具身任务的完成效果,但其实际收益取决于协同增益与协调复杂度之间的平衡;(ii)有效沟通是实现协作增益的必要条件,而最优协作模式则随团队规模与模型自身能力的不同而变化;(iii)此外,协作还能显著增强系统在先验知识存在噪声及探索环境不确定等挑战性条件下的鲁棒性。总体而言,MECoBench为系统性探究多模态具身协作的内在机理与能力边界提供了坚实可靠的实验平台。相关代码与数据集已开源,获取地址为:https://github.com/q-i-n-g/MECoBench。
Recent multimodal large language models (MLLMs) have strong potential as embodied agents, but their ability to collaborate in visually grounded environments remains underexplored. To address this gap, we introduce MECoBench, a multimodal embodied cooperation benchmark with an evaluation platform spanning diverse real-world tasks, two cooperation structures, and three collaboration modes. Through extensive experiments across various MLLMs, we summarize three key findings: (i) Collaboration generally improves embodied task completion, but its benefits depend on balancing collaborative gains against coordination complexity. (ii) Communication is essential to collaboration gains, while the best collaboration mode depends on team size and model capability. (iii) Moreover, collaboration improves robustness under noisy priors and exploration conditions. Generally, MECoBench provides a systematic testbed for understanding the mechanisms and limits of multimodal embodied collaboration. Code and dataset are available at https://github.com/q-i-n-g/MECoBench.
许愿