CS3: Cascade SAM for Sperm Segmentation

ML UL CV MIAS
2024年07月04日
自动化的精子形态分析在评估男性生育能力方面起着至关重要的作用,然而它的有效性常常受到准确分割精子图像的挑战所影响。现有的分割技术,包括Segment Anything Model(SAM),在处理精子重叠这一复杂问题方面明显不足,而这在临床样本中经常发生。我们的探索性研究表明,通过去除精子头和易于分割的区域,同时增强重叠区域的可见性,显著提高了SAM在分割复杂精子结构方面的效率。受到这些发现的启发,我们提出了Cascade SAM for Sperm Segmentation(CS3),这是一种针对精子重叠问题专门设计的无监督方法。该方法采用SAM的级联应用,分阶段分割精子头、简单尾巴和复杂尾巴。随后,这些分割掩模被精细地匹配和合并以构建完整的精子掩模。与领先的医疗机构合作,我们编制了一个包含约2,000个未标记的精子图像的数据集,以微调我们的方法,并为另外240个图像获得了专家注释,以便进行全面的模型评估。实验结果表明,与现有方法相比,CS3的性能更优。
Automated sperm morphology analysis plays a crucial role in the assessment of male fertility, yet its efficacy is often compromised by the challenges in accurately segmenting sperm images. Existing segmentation techniques, including the Segment Anything Model(SAM), are notably inadequate in addressing the complex issue of sperm overlap-a frequent occurrence in clinical samples. Our exploratory studies reveal that modifying image characteristics by removing sperm heads and easily segmentable areas, alongside enhancing the visibility of overlapping regions, markedly enhances SAM's efficiency in segmenting intricate sperm structures. Motivated by these findings, we present the Cascade SAM for Sperm Segmentation (CS3), an unsupervised approach specifically designed to tackle the issue of sperm overlap. This method employs a cascade application of SAM to segment sperm heads, simple tails, and complex tails in stages. Subsequently, these segmented masks are meticulously matched and joined to construct complete sperm masks. In collaboration with leading medical institutions, we have compiled a dataset comprising approximately 2,000 unlabeled sperm images to fine-tune our method, and secured expert annotations for an additional 240 images to facilitate comprehensive model assessment. Experimental results demonstrate superior performance of CS3 compared to existing methods.
许愿