Mask2Map: Vectorized HD Map Construction Using Bird's Eye View Segmentation Masks

Embodied AI and Robotics Semantic Mapping AD
2024年07月18日
本文介绍了一种新颖的端到端在线高清地图构建方法Mask2Map,专为自动驾驶应用而设计。我们的方法侧重于在鸟瞰图中预测场景内地图实例的类别和有序点集。Mask2Map由两个主要组件组成:实例级掩模预测网络(IMPNet)和掩模驱动的地图预测网络(MMPNet)。IMPNet生成掩模感知查询和BEV分割掩模,以全局方式捕获综合语义信息。随后,MMPNet通过两个子模块(位置查询生成器(PQG)和几何特征提取器(GFE))使用局部上下文信息增强这些查询特征。PQG通过将BEV位置信息嵌入掩模感知查询来提取实例级位置查询,而GFE利用BEV分割掩模生成点级几何特征。然而,我们观察到Mask2Map的性能受到了不同预测与Ground Truth(GT)匹配之间的网络不一致性的限制。为了解决这个挑战,我们提出了Inter-network Denoising Training方法,指导模型去除受到嘈杂的GT查询和扰动的GT分割掩模影响的输出。我们在nuScenes和Argoverse2基准测试上进行的评估表明,Mask2Map相对于先前的最先进方法取得了显着的性能提升,分别为10.1% mAP和4.1 mAP。我们的代码可在https://github.com/SehwanChoi0307/Mask2Map找到。
In this paper, we introduce Mask2Map, a novel end-to-end online HD map construction method designed for autonomous driving applications. Our approach focuses on predicting the class and ordered point set of map instances within a scene, represented in the bird's eye view (BEV). Mask2Map consists of two primary components: the Instance-Level Mask Prediction Network (IMPNet) and the Mask-Driven Map Prediction Network (MMPNet). IMPNet generates Mask-Aware Queries and BEV Segmentation Masks to capture comprehensive semantic information globally. Subsequently, MMPNet enhances these query features using local contextual information through two submodules: the Positional Query Generator (PQG) and the Geometric Feature Extractor (GFE). PQG extracts instance-level positional queries by embedding BEV positional information into Mask-Aware Queries, while GFE utilizes BEV Segmentation Masks to generate point-level geometric features. However, we observed limited performance in Mask2Map due to inter-network inconsistency stemming from different predictions to Ground Truth (GT) matching between IMPNet and MMPNet. To tackle this challenge, we propose the Inter-network Denoising Training method, which guides the model to denoise the output affected by both noisy GT queries and perturbed GT Segmentation Masks. Our evaluation conducted on nuScenes and Argoverse2 benchmarks demonstrates that Mask2Map achieves remarkable performance improvements over previous state-of-the-art methods, with gains of 10.1% mAP and 4.1 mAP, respectively. Our code can be found at https://github.com/SehwanChoi0307/Mask2Map.
许愿