BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion

Embodied AI and Robotics DMPA Imitation Learning SRT
从人类动作中学习技能为实现通用且灵活的人形机器人全身控制策略提供了一条有前景的路径,然而目前仍有两个关键基础尚未完善:(1)一个高质量的动作追踪框架,能够将大规模的运动学参考数据忠实转换为在真实硬件上稳定且极具动态性的动作;(2)一种蒸馏方法,能够有效学习这些动作基元,并将其组合起来以完成下游任务。我们提出了BeyondMimic,一个面向真实世界的人形机器人控制框架,通过引导扩散机制,从人类动作中学习出通用且自然的人体运动控制方式。我们的框架提供了一套动作追踪流程,能够实现诸如跳跃旋转、冲刺和侧手翻等高难度技能,其动作质量达到当前最优水平。BeyondMimic不仅限于对已有动作的简单模仿,还进一步引入了一种统一的扩散策略,使系统在测试阶段能够通过简单的代价函数实现零样本的任务特定控制。在实际硬件上的部署结果显示,BeyondMimic在测试阶段能够完成多种任务,包括路径点导航、操纵杆远程控制以及避障等,有效弥合了仿真到实物的动作追踪鸿沟,并实现了人体动作基元的灵活合成,用于全身控制。https://beyondmimic.github.io/
Learning skills from human motions offers a promising path toward generalizable policies for versatile humanoid whole-body control, yet two key cornerstones are missing: (1) a high-quality motion tracking framework that faithfully transforms large-scale kinematic references into robust and extremely dynamic motions on real hardware, and (2) a distillation approach that can effectively learn these motion primitives and compose them to solve downstream tasks. We address these gaps with BeyondMimic, a real-world framework to learn from human motions for versatile and naturalistic humanoid control via guided diffusion. Our framework provides a motion tracking pipeline capable of challenging skills such as jumping spins, sprinting, and cartwheels with state-of-the-art motion quality. Moving beyond simply mimicking existing motions, we further introduce a unified diffusion policy that enables zero-shot task-specific control at test time using simple cost functions. Deployed on hardware, BeyondMimic performs diverse tasks at test time, including waypoint navigation, joystick teleoperation, and obstacle avoidance, bridging sim-to-real motion tracking and flexible synthesis of human motion primitives for whole-body control. https://beyondmimic.github.io/.
许愿