Key Takeaways
- • Nvidia and chip design automation startup ChipAgents released a benchmark evaluating how well AI models handle the end-to-end chip design process, according to The Information, which reported the launch on Wednesday.
- • Anthropic's Fable 5.1 powered the best-performing AI agent in the evaluation, but scored only 16.6%, per ChipAgents as cited by the report.
- • ChipAgents CEO William Wang said the benchmark covers the entire chip design workflow, making it more demanding than existing evaluations that test individual tasks.
- • ChipAgents, founded in 2024, has raised $134M from investors including B Capital, Micron, and MediaTek.
- • Wang declined to name customers or confirm whether Nvidia is an investor or customer of ChipAgents.
Summary
Nvidia and ChipAgents have released a benchmark designed to measure how well AI models perform across the chip design process, The Information reported on Wednesday. The evaluation is intended to test AI systems on the full design workflow rather than isolated tasks, which ChipAgents CEO William Wang said makes it more difficult than existing benchmarks that focus on individual steps.
According to ChipAgents, Anthropic's Fable 5.1 powered the best-performing AI agent in the evaluation, though it scored only 16.6% on the test. The result points to the gap between current model capabilities and the demands of end-to-end semiconductor design work.
ChipAgents develops software that applies AI agents, systems that can make decisions and carry out complex tasks with limited human supervision, to speed up and automate chip design. The company was founded in 2024 and has raised $134M from investors including B Capital, Micron, and MediaTek.
Wang declined to name the company's customers or say whether Nvidia is an investor in or customer of ChipAgents, leaving the nature of the Nvidia relationship unclear from the reporting.
According to ChipAgents, Anthropic's Fable 5.1 powered the best-performing AI agent in the evaluation, though it scored only 16.6% on the test. The result points to the gap between current model capabilities and the demands of end-to-end semiconductor design work.
ChipAgents develops software that applies AI agents, systems that can make decisions and carry out complex tasks with limited human supervision, to speed up and automate chip design. The company was founded in 2024 and has raised $134M from investors including B Capital, Micron, and MediaTek.
Wang declined to name the company's customers or say whether Nvidia is an investor in or customer of ChipAgents, leaving the nature of the Nvidia relationship unclear from the reporting.
Go deeper than the headline
Research every firm in this story, track the ones that matter and get the daily briefing — free for 7 days.