Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data

AK's Picks LLM Latent Reasoning Agent Tool Learning AI Systems and Hardware Text-to-Code
计算机辅助设计(CAD)模型由其建模历史所定义:即一段参数化“配方”,用以编码设计意图。然而,当前主流的大规模3D数据集大多仅包含边界表示(B-Rep)或网格模型,从而完全丢失了这一关键的程序化信息。为应对该类数据的严重匮乏,我们提出“零起点生成CAD”(Zero-to-CAD)——一种可扩展的框架,用于合成可执行的CAD建模操作序列。我们将合成任务建模为一种具身智能体(agentic)搜索问题:将大语言模型(LLM)嵌入至具备反馈机制的CAD运行环境中,系统由此迭代式地生成代码、执行操作并验证结果;同时借助工具调用与文档检索能力,确保所生成几何体的正确性及建模操作类型的多样性。这种具身智能体方法成功合成了约一百万条可执行、可读、可编辑的CAD建模序列,涵盖远超传统“草图绘制—拉伸”流程的丰富操作语义。此外,我们还发布了一个精选子集,包含10万件高质量模型,这些模型经严格筛选,具有高度的几何多样性。为验证该数据集的实际效用,我们基于合成数据对一个视觉-语言模型进行微调,使其能够从多视角图像中重建出可编辑的CAD程序;实验结果显著优于包括GPT-5.2在内的多个强基线方法,并在无需任何真实建模历史数据的前提下,有效实现了CAD序列生成能力的冷启动。Zero-to-CAD弥合了几何规模与参数化可解释性之间的鸿沟,为下一代CAD人工智能提供了至关重要的基础资源。
Computer-Aided Design (CAD) models are defined by their construction history: a parametric recipe that encodes design intent. However, existing large-scale 3D datasets predominantly consist of boundary representations (B-Reps) or meshes, stripping away this critical procedural information. To address this scarcity, we introduce Zero-to-CAD, a scalable framework for synthesizing executable CAD construction sequences. We frame synthesis as an agentic search problem: by embedding a large language model (LLM) within a feedback-driven CAD environment, our system iteratively generates, executes, and validates code using tools and documentation lookup to promote geometric validity and operation diversity. This agentic approach enables the synthesis of approximately one million executable, readable, editable CAD sequences, covering a rich vocabulary of operations beyond sketch-and-extrude workflows. We also release a curated subset of 100,000 high-quality models selected for geometric diversity. To demonstrate the dataset's utility, we fine-tune a vision-language model on our synthetic data to reconstruct editable CAD programs from multi-view images, outperforming strong baselines, including GPT-5.2, and effectively bootstrapping sequence generation capabilities without real construction-history training data. Zero-to-CAD bridges the gap between geometric scale and parametric interpretability, offering a vital resource for the next generation of CAD AI.
许愿