OpenGait: A Comprehensive Benchmark Study for Gait Recognition towards Better Practicality

2024年05月15日
步态识别是一种快速发展的视觉技术,可用于远距离人员识别,它在室内环境中取得了重大进展。然而,有证据表明,当应用于新发布的真实世界步态数据集时,现有方法往往产生不令人满意的结果。此外,从室内步态数据集得出的结论可能不容易推广到室外数据集中。因此,本研究的主要目标是提出一项全面的基准研究,旨在提高实用性,而不仅仅是关注性能的提高。为此,我们首先开发了一个灵活高效的步态识别平台OpenGait。利用OpenGait作为基础,我们进行了深入的消融实验,重新审视了步态识别领域的最新进展。令人惊讶的是,我们发现了某些先前方法的一些不完美之处,从而得出了一些关键但尚未被发现的见解。受这些发现的启发,我们开发了三个结构简单但经验丰富且实用强大的基线模型,即DeepGaitV2、SkeletonGait和SkeletonGait++,分别代表步态模式描述的基于外观、基于模型和多模态方法。除了达到SoTA的性能之外,更重要的是,我们的仔细探索为深度步态模型的建模经验、典型步态模态的表征能力等方面带来了新的启示。我们希望这项工作能够激发更多的步态识别研究和应用,以实现更好的实用性。代码可在https://github.com/ShiqiYu/OpenGait上获得。
Gait recognition, a rapidly advancing vision technology for person identification from a distance, has made significant strides in indoor settings. However, evidence suggests that existing methods often yield unsatisfactory results when applied to newly released real-world gait datasets. Furthermore, conclusions drawn from indoor gait datasets may not easily generalize to outdoor ones. Therefore, the primary goal of this work is to present a comprehensive benchmark study aimed at improving practicality rather than solely focusing on enhancing performance. To this end, we first develop OpenGait, a flexible and efficient gait recognition platform. Using OpenGait as a foundation, we conduct in-depth ablation experiments to revisit recent developments in gait recognition. Surprisingly, we detect some imperfect parts of certain prior methods thereby resulting in several critical yet undiscovered insights. Inspired by these findings, we develop three structurally simple yet empirically powerful and practically robust baseline models, i.e., DeepGaitV2, SkeletonGait, and SkeletonGait++, respectively representing the appearance-based, model-based, and multi-modal methodology for gait pattern description. Beyond achieving SoTA performances, more importantly, our careful exploration sheds new light on the modeling experience of deep gait models, the representational capacity of typical gait modalities, and so on. We hope this work can inspire further research and application of gait recognition towards better practicality. The code is available at https://github.com/ShiqiYu/OpenGait.
许愿