HumanX: Toward Agile and Generalizable Humanoid Interaction Skills from Human Videos

Embodied AI and Robotics Imitation Learning SRT
赋予人形机器人执行敏捷且自适应的交互任务能力,长期以来一直是机器人学领域的核心挑战。当前方法受限于两个瓶颈:一是真实交互数据严重匮乏;二是需要人工精心设计、针对特定任务的奖励函数,这极大地制约了其可扩展性。为弥合这一差距,我们提出了HumanX——一个端到端的框架,能够将人类视频直接编译为人形机器人可泛化、可落地的真实世界交互技能,且全程无需任何任务专属的奖励信号。HumanX由两个协同设计的核心模块构成:其一是XGen,一个数据生成流水线,可从视频中合成种类丰富、物理上合理可信的人形机器人交互数据,并支持高效、可扩展的数据增强;其二是XMimic,一个统一的模仿学习框架,用于习得具备强泛化能力的交互技能。我们在篮球、足球、羽毛球、货物拾取与反应式格斗共五大不同领域开展评估,HumanX成功习得了10种各不相同的技能,并以零样本迁移方式,直接部署至实体Unitree G1人形机器人上。所习得的能力涵盖诸多复杂动作,例如在完全不依赖外部感知(如视觉或环境传感器)的情况下完成“假动作—转身—后仰跳投”整套连贯投篮动作;也包括高度交互性的任务,例如仅凭单段人类示范视频,即学会持续与人类进行长达10个完整循环的稳定传球协作。实验结果表明,HumanX的泛化成功率较现有方法提升逾8倍,展现出一条可扩展、任务无关的全新路径,为习得多样化、强实用性的真实世界机器人交互技能提供了坚实可行的技术范式。
Enabling humanoid robots to perform agile and adaptive interactive tasks has long been a core challenge in robotics. Current approaches are bottlenecked by either the scarcity of realistic interaction data or the need for meticulous, task-specific reward engineering, which limits their scalability. To narrow this gap, we present HumanX, a full-stack framework that compiles human video into generalizable, real-world interaction skills for humanoids, without task-specific rewards. HumanX integrates two co-designed components: XGen, a data generation pipeline that synthesizes diverse and physically plausible robot interaction data from video while supporting scalable data augmentation; and XMimic, a unified imitation learning framework that learns generalizable interaction skills. Evaluated across five distinct domains--basketball, football, badminton, cargo pickup, and reactive fighting--HumanX successfully acquires 10 different skills and transfers them zero-shot to a physical Unitree G1 humanoid. The learned capabilities include complex maneuvers such as pump-fake turnaround fadeaway jumpshots without any external perception, as well as interactive tasks like sustained human-robot passing sequences over 10 consecutive cycles--learned from a single video demonstration. Our experiments show that HumanX achieves over 8 times higher generalization success than prior methods, demonstrating a scalable and task-agnostic pathway for learning versatile, real-world robot interactive skills.
许愿