Skip to content
Sign in
Artwork for Epoch After Hours
Epoch After Hours · May 1 · 1 hr 5 min

Are AI benchmarks doomed?

AI benchmarks saturate quickly, struggle to capture what we care about, and cost more than ever to build. But are they doomed? Greg Burnham, who leads Epoch's benchmarking team, and Tom Adamczewski, who developed MirrorCode, push back on the pessimism and dig into what the next generation of AI benchmarks could look like.

0:00 · Preview-1:05:25
Play in
Transcript file

transcript

No transcript — this publisher did not publish one.

show notes

AI benchmarks saturate quickly, struggle to capture what we care about, and cost more than ever to build. But are they doomed? Greg Burnham, who leads Epoch's benchmarking team, and Tom Adamczewski, who developed MirrorCode, push back on the pessimism and dig into what the next generation of AI benchmarks could look like.

chapters

9 chapters

more episodes

All episodes