Object- and Task-Aware Active Perception for Safe Navigation of Mobile Manipulators in Semi-Static Environments

Embodied AI and Robotics Robust MPC OAARTN Active Perception RP
移动操作机器人需在物流、制造及服务等应用场景中,于杂乱且部分未知的环境中安全导航。机器人两次访问之间发生的半静态变化,可能导致场景认知过时,从而增加碰撞风险。为此,我们提出一种主动感知框架,使具有高自由度(DoF)的移动操作机器人在导航过程中,能够利用其手部相机对存在不确定性或关乎安全的关键区域进行自主检测。该框架采用一种概率化、面向对象且兼顾任务需求的“下一最佳视角”(Next-Best-View, NBV)建模方法,优先选择靠近期望路径、以及围绕不确定物体或潜在动态变化物体的观测位姿。该感知目标被嵌入分层任务模型预测控制(Hierarchical-Task Model Predictive Control, HTMPC)架构中,在确保底盘轨迹跟踪这一更高优先级任务的前提下,充分利用机械臂的运动学冗余性实现视角调整。整个系统将导航、地图维护与主动感知三者闭环统一。真实环境实验表明,相较于被动感知或非任务驱动的基线方法,本系统显著提升了地图的一致性、降低了任务相关地图的熵值,并减小了导航过程中的风险。此外,补充的仿真与真实场景序列实验进一步验证了系统对受控半静态场景变化的有效响应能力。
Mobile manipulators must navigate safely in cluttered, partially unknown environments across logistics, manufacturing, and service applications. Semi-static changes between robot visits can lead to outdated scene knowledge and increased collision risk. We propose an active perception framework that enables a high degree-of-freedom (DoF) mobile manipulator to inspect uncertain or safety-critical regions with its hand camera during navigation. A probabilistic, object- and task-aware next-best-view (NBV) formulation prioritizes observations near the desired path and around uncertain or potentially changing objects. The perception objective is integrated into hierarchical-task model predictive control (HTMPC), exploiting kinematic redundancy for viewpoint adjustment while preserving the higher priority of base-trajectory tracking. The system unifies navigation, map maintenance, and active perception in a closed loop. Real-world tests show improved map consistency, reduced task-dependent map entropy, and lower navigation risk than passive or non-task-aware baselines. Additional simulation and real-world sequences demonstrate responses to controlled semi-static scene changes.
许愿