A Unified Framework for Image-to-3D Part Generation via Variable Granularity

GenAI Other GenAI CV Other CV
2026年10月22日
可控的三维部件生成对于数字资产创作至关重要,然而现有方法缺乏足够的灵活性,难以适配用户多样化的实际工作流——这些工作流对控制粒度的要求各不相同。本文提出 FlexPart,一种统一的图像到三维部件生成框架,可在单一模型中支持可变粒度的几何条件输入。通过门控自适应调制(gated adaptive modulation)技术,FlexPart 无缝融合了异构输入——从稀疏点、密集包围盒,到语义掩码,从而激发出强大的跨模态协同效应。我们还设计了一种非对称几何引导机制,利用强空间先验知识,在不同粒度之间对齐特征表示,既提升了几何一致性,又促进了多任务间的协同优化。在 PartVerseXL 数据集上以掩码为条件进行评估时,FlexPart 相较于 TripoSG + SAM3D 将部件倒角距离(Part CD)相对降低了 16.6%,相较 OmniPart 降低了 10.5%,同时仍保持具有竞争力的整体网格质量。代码已开源,地址为:https://github.com/Gucci233/FlexPart
Controllable 3D part generation is pivotal for digital asset creation, yet existing methods lack the flexibility to accommodate diverse user workflows requiring varying levels of control. In this paper, we introduce FlexPart, a unified image-to-3D part generation framework that supports variable-granularity geometric conditions within a single model. By seamlessly integrating heterogeneous inputs, ranging from sparse points to dense bounding boxes and masks, via gated adaptive modulation, FlexPart unlocks a powerful cross-modal synergy. We also propose an asymmetric geometric guidance mechanism that leverages strong spatial priors to align representations across granularities, improving geometric consistency and facilitating inter-task synergy. Under mask conditioning on PartVerseXL, FlexPart reduces Part CD by 16.6% relative to TripoSG + SAM3D and by 10.5% relative to OmniPart, while maintaining competitive whole-mesh quality. The code can be found at https://github.com/Gucci233/FlexPart
许愿