RemDet: Rethinking Efficient Model Design for UAV Object Detection

CV ODBO AI Systems and Hardware EDIO
2024年12月13日
无人机图像中的目标检测已成为研究的焦点领域,这带来了两个主要挑战:i)目标通常在广阔的图像中很小且密集;ii)计算资源的限制使得大多数模型不适合实时部署。目前的实时目标检测器并未针对无人机图像进行优化,而专门设计用于小目标检测的复杂方法往往缺乏实时能力。为了解决这些挑战,我们提出了一种新的检测器,称为RemDet(重参数高效乘法检测器)。我们的贡献如下:1)重新思考现有检测器在处理小而密集的无人机图像时面临的挑战,并提出信息损失作为高效模型的设计准则。2)我们引入了ChannelC2f模块以增强小目标检测性能,证明高维表示可以有效减轻信息损失。3)我们设计了GatedFFN模块,不仅提供强大的性能,还具有低延迟,有效解决了实时检测的挑战。我们的研究表明,通过使用乘法,GatedFFN比前馈网络在高维表示上更具成本效益。4)我们提出了CED模块,结合了ViT和CNN下采样的优点,有效减少了信息损失。它特别增强了小而密集目标的上下文信息。在大型无人机数据集Visdrone和UAVDT上的大量实验验证了我们方法的实时效率和卓越性能。在具有挑战性的无人机数据集VisDrone上,我们的方法不仅提供了最先进的结果,检测性能提高了超过3.4%,而且在单个4090显卡上实现了110帧每秒的处理速度。代码可在以下网址获取:(https://github.com/HZAI-ZJNU/RemDet)。
Object detection in Unmanned Aerial Vehicle (UAV) images has emerged as a focal area of research, which presents two significant challenges: i) objects are typically small and dense within vast images; ii) computational resource constraints render most models unsuitable for real-time deployment. Current real-time object detectors are not optimized for UAV images, and complex methods designed for small object detection often lack real-time capabilities. To address these challenges, we propose a novel detector, RemDet (Reparameter efficient multiplication Detector). Our contributions are as follows: 1) Rethinking the challenges of existing detectors for small and dense UAV images, and proposing information loss as a design guideline for efficient models. 2) We introduce the ChannelC2f module to enhance small object detection performance, demonstrating that high-dimensional representations can effectively mitigate information loss. 3) We design the GatedFFN module to provide not only strong performance but also low latency, effectively addressing the challenges of real-time detection. Our research reveals that GatedFFN, through the use of multiplication, is more cost-effective than feed-forward networks for high-dimensional representation. 4) We propose the CED module, which combines the advantages of ViT and CNN downsampling to effectively reduce information loss. It specifically enhances context information for small and dense objects. Extensive experiments on large UAV datasets, Visdrone and UAVDT, validate the real-time efficiency and superior performance of our methods. On the challenging UAV dataset VisDrone, our methods not only provided state-of-the-art results, improving detection by more than 3.4%, but also achieve 110 FPS on a single 4090.Codes are available at (this URL)(https://github.com/HZAI-ZJNU/RemDet).
许愿