Chronos Policy: Learning Robot Policies on Physical Time

Embodied AI and Robotics RC IL ML TAVR DM
机器人策略通常将感知与控制转化为固定采样率的“观测–动作”序列,从而将物理时间隐式地编码在序列的位置索引中。然而,当观测采样率或传输延迟发生变化,或模型推理时延发生波动时,这一假设便会失效。为此,我们提出了“Chronos策略”(Chronos Policy),其核心思想是显式建模物理时间——即以观测的实际捕获时刻和动作的期望执行时刻作为条件输入。我们研究了两种将时间信息融入扩散型Transformer(diffusion transformer)的方法:一是将时间戳嵌入(timestamp embeddings)直接加到各token的特征上;二是通过“时序感知的旋转位置编码”(time-aware rotary positional encodings, time-aware RoPE)将物理时间编码进位置编码中。实验发现,时序感知RoPE更具鲁棒性:它使注意力机制可直接依赖于真实的物理时间,同时保持token所承载的内容信息不变。在训练过程中,我们对观测采样的时刻以及动作片段起始时刻进行随机化处理,从而使策略能够接触更广泛多样的感知与执行调度模式——这些模式均可能在实际部署中出现。该设计还使得模型能够直接从异步、多速率的传感器数据中学习,而无需强制将所有测量值对齐到统一的固定时间网格上。在仿真与真实世界实验中,Chronos策略在两类任务上均展现出显著提升:一是在动态性强、观测到动作的时间关系至关重要的任务中;二是在多模态感知任务中——此时不同传感器观测之间的时间相对关系至关重要。而在标准的准静态任务中,该策略则在维持原有性能水平的同时,显著增强了系统对感知延迟与推理时延变化的鲁棒性。
Robot policies often convert sensing and control into fixed-rate observation-action sequences, leaving physical time implicit in sequence position. This assumption breaks when observation rates or delays vary, or when inference latency changes. We introduce Chronos Policy, which makes physical time explicit by conditioning on observation capture times and desired action execution times. We study two ways to incorporate time into a diffusion transformer: adding timestamp embeddings to token features, or encoding physical time in positional encoding through time-aware rotary positional encodings (time-aware RoPE). We find that time-aware RoPE is more robust, allowing attention to depend directly on physical time while keeping token content unchanged. During training, we temporally randomize which observations are sampled and when the action chunk begins, exposing the policy to a wider range of sensing and execution schedules that may occur during deployments. This also enables learning from asynchronous, multi-rate data without forcing all measurements onto a fixed temporal grid. Across simulation and real-world experiments, Chronos Policy improves performance on dynamic tasks, where observation-to-action timing is critical, and on multisensory tasks, where the relative timing between observations matters. On standard quasi-static tasks, it preserves nominal performance while improving robustness to changes in sensing and inference timing.
许愿