SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation

GenAI Other GenAI ML Generative Models CV Other CV
2026年10月01日
高分辨率三维生成日益依赖体素隐变量(voxel latents)及多阶段流水线:先预测活跃结构,再合成局部几何。尽管该方法效果显著,却将连续曲面离散为大量局部标记(tokens),推高了生成开销,并常常削弱薄壁结构或高度连通形状的拓扑一致性。我们提出 SILSA——一种具备拓扑感知能力的三维生成框架,其以紧凑的滑动窗口切片隐变量(sliding-window slice latents)表征三维形状。与生成计算代价高昂的体素标记不同,SILSA 沿三个正交坐标轴固定部署一组重叠切片;每个切片标记汇总一个局部深度窗口的信息,从而保持横截面的连续性,并支持单阶段、经校正流(rectified-flow)驱动的生成过程。其中,“切片变分自编码器”(Slice VAE)将带方向的表面采样点编码为多轴切片隐变量,并通过稀疏体素解码器对其进行重建;而“体素锚点格网”(Volumetric Anchor Lattice)则借助共享的三维工作空间,协调来自不同方向的切片数据流。为保障结构正确性,我们引入切片层级的拓扑监督机制:通过匹配各相邻切片的持续同调图(persistence diagrams),并对其贝蒂数(Betti numbers)变化进行对齐。实验表明,SILSA 在显著降低生成开销的同时,有效提升了结构保真度。相较于最强基线方法,SILSA 将峰值信噪比(PSNR)提升 8.7%,覆盖率(Coverage)提高 5.96 个绝对百分点,贝蒂数误差(Betti error)降低 9.2%;同时,其所需标记数量比次紧凑基线减少 70.0%,更比各类稀疏型或分层式标记器减少逾 98%,从而将训练内存占用降低 40.4%,推理耗时缩短 58.5%。定性结果进一步证实,SILSA 在细长结构、重复部件以及长程连通性的保持方面均取得明显改善。
High-resolution 3D generation increasingly relies on voxel latents and multi-stage pipelines that first predict active structure and then synthesize local geometry. While effective, this design fragments continuous surfaces into many local tokens, inflates generation cost, and often weakens topological consistency for thin or highly connected shapes. We introduce SILSA, a topology-aware 3D generation framework that represents shapes with compact sliding-window slice latents. Instead of generating expensive voxel tokens, SILSA uses a fixed set of overlapping slices along the three canonical axes, where each token summarizes a local depth window to preserve cross-sectional continuity and support single-stage rectified-flow generation. A Slice VAE encodes oriented surface samples into multi-axis slice latents and reconstructs them with a sparse volumetric decoder, while a Volumetric Anchor Lattice coordinates directional slice streams through a shared 3D workspace. To preserve structural correctness, we introduce slice-level topology supervision that matches persistence diagrams and aligns Betti transitions across neighboring slices. Experiments show that SILSA improves structural fidelity while substantially reducing generation cost. SILSA improves PSNR by $8.7\%$, coverage by $5.96$ absolute points, and Betti error by $9.2\%$ over the strongest baseline, while using $70.0\%$ fewer tokens than the next-most compact baseline and over $98\%$ fewer tokens than sparse or hierarchical tokenizers, effectively reducing training memory by $40.4\%$ and inference time by $58.5\%$. Qualitative results further show improved preservation of thin structures, repeated components, and long-range connectivity.
许愿