Data Scaling Laws in Imitation Learning for Robotic Manipulation

Embodied AI and Robotics RAKDM Imitation Learning
数据缩放已经革新了自然语言处理和计算机视觉等领域,为模型提供了卓越的泛化能力。在本文中,我们探讨了类似的数据缩放规律是否存在于机器人技术中,尤其是机器人操作领域,并研究适当的数据缩放是否可以生成单任务机器人策略,使其能够在任何环境中对同一类别中的任何物体进行零样本部署。为此,我们对模仿学习中的数据缩放进行了全面的实证研究。通过在多个环境和物体上收集数据,我们研究了策略的泛化性能如何随着训练环境、物体和演示的数量变化而变化。在整个研究过程中,我们收集了超过40,000个演示,并在严格的评估协议下执行了超过15,000次实际的机器人运行。我们的研究结果揭示了几个有趣的现象:策略的泛化性能与环境和物体数量之间大致呈幂律关系。环境和物体的多样性远比演示的绝对数量重要;一旦每个环境或物体的演示数量达到某个阈值,额外的演示对性能的提升就非常有限。基于这些见解,我们提出了一种高效的数据收集策略。四个数据收集者在一个下午的工作时间内,收集了足够的数据,使两个任务的策略在包含未见过物体的新环境中达到了约90%的成功率。
Data scaling has revolutionized fields like natural language processing and computer vision, providing models with remarkable generalization capabilities. In this paper, we investigate whether similar data scaling laws exist in robotics, particularly in robotic manipulation, and whether appropriate data scaling can yield single-task robot policies that can be deployed zero-shot for any object within the same category in any environment. To this end, we conduct a comprehensive empirical study on data scaling in imitation learning. By collecting data across numerous environments and objects, we study how a policy's generalization performance changes with the number of training environments, objects, and demonstrations. Throughout our research, we collect over 40,000 demonstrations and execute more than 15,000 real-world robot rollouts under a rigorous evaluation protocol. Our findings reveal several intriguing results: the generalization performance of the policy follows a roughly power-law relationship with the number of environments and objects. The diversity of environments and objects is far more important than the absolute number of demonstrations; once the number of demonstrations per environment or object reaches a certain threshold, additional demonstrations have minimal effect. Based on these insights, we propose an efficient data collection strategy. With four data collectors working for one afternoon, we collect sufficient data to enable the policies for two tasks to achieve approximately 90% success rates in novel environments with unseen objects.