Soft and Rigid Object Grasping With Cross-Structure Hand Using Bilateral Control-Based Imitation Learning

Embodied AI and Robotics Imitation Learning Dexterous Hands
2023年11月16日
物体抓取是各种机器人任务所需的重要能力。特别是那些需要在操作过程中进行精确力调整的任务,例如抓取未知物体或使用抓取的工具,对于人类预先编程来说是困难的。最近,基于人工智能的算法被积极探索作为解决方案,可以模仿人类的力技能。特别是,基于双边控制的模仿学习实现了具有环境适应性的人类级运动速度,只需要人类演示而无需编程。然而,由于硬件限制,它的抓取性能仍然有限,并且尚未实现涉及抓取各种物体的任务。在这里,我们开发了一种交叉结构手来抓取各种物体。我们实验证明,基于双边控制的模仿学习和交叉结构手的集成对于抓取各种物体和利用工具是有效的。
Object grasping is an important ability required for various robot tasks. In particular, tasks that require precise force adjustments during operation, such as grasping an unknown object or using a grasped tool, are difficult for humans to program in advance. Recently, AI-based algorithms that can imitate human force skills have been actively explored as a solution. In particular, bilateral control-based imitation learning achieves human-level motion speeds with environmental adaptability, only requiring human demonstration and without programming. However, owing to hardware limitations, its grasping performance remains limited, and tasks that involves grasping various objects are yet to be achieved. Here, we developed a cross-structure hand to grasp various objects. We experimentally demonstrated that the integration of bilateral control-based imitation learning and the cross-structure hand is effective for grasping various objects and harnessing tools.
许愿