transcript
show notes
One AI model can win gold at the International Mathematical Olympiad while another leading model can only read an analog clock about half the time, so what do those record-breaking benchmark scores actually tell you? In this episode, host Emily Laird explains AI evals: how researchers test these systems, why leaderboards go stale within months, and why an AI agent saying “task complete” doesn’t prove the task got done. She also looks at the gap between feeling faster with AI and actually being faster. Then she gives you a simple way to run your own evaluation, so you can decide whether a tool is reliable enough for the work you actually do.
🎯 JOIN THE AI WEEKLY MEETUPS
https://www.uwstout.edu/ai-weekly-meetup
📩 EMAIL REMINDERS FOR THE MEETUPS
https://app.e2ma.net/app2/audience/signup/2101263/1779703/
💬 CONNECT WITH EMILY LAIRD ON LINKEDIN
