ChipAgents 推出 Build-A-Chip-Bench:从工作负载规范到 GDS 的芯片设计智能体评测基准
Introducing Build-A-Chip-Bench: From Workload Specification to GDS
ChipAgents 联合 Nvidia 开发 Build-A-Chip-Bench 基准,用开源工具和开源 PDK 评测 AI 智能体从工作负载规范到 GDS 版图完成整个芯片设计流程的能力。
Evaluate AI agents from workload specification through GDS layout, using open-source tools and an open-source PDK to assess their ability to complete the chip-design workflow.
Existing chip design benchmarks test isolated steps, such as writing RTL from a specification, and are increasingly saturated. ChipAgents is developing Build-A-Chip-Bench with contributions from Nvidia to the benchmark suite and scoring rubric. The benchmark evaluates AI agents from workload specification through GDS layout, using open-source tools and an open-source PDK to assess their ability to complete the chip-design workflow. Each design must pass a hard gate, covering functional correctness against a hidden verification IP as well as routability, hold timing, and DRC, and designs that pass are scored on PPA against the task’s constraints. The best agent passes the hard gate on 65% of tasks and reaches an overall score of 16.6%. Frontier agents struggle to revisit earlier decisions, protect working behavior while optimizing, and plan around slow tool runs.
Read more here.
来源: Semiconductor Engineering 芯片与封装 · semiengineering.com