Skip to content
Artwork for AI Explained
AI Explained · Sunday · 32 min

GPT 4.5 - not so much wow

GPT 4.5 is here, and do you remember when AI lab CEOs like Sam Altman and Dario Amodei were betting everything on scaling up base models like this one? Well let’s find out what would have happened if the future of AI rested on models like GPT 4.5. You’ll see all the benchmarks, highlights of the paper, emotional intelligence and humor tests, Simple Bench results (reddit was an unreliable source), and why it’s not all bad news for OpenAI. https://www.emergentmind.com/ AI Insiders (now $9!): https://www.patreon.com/AIExplained Chapters 00:00 - Introduction 01:04 - Details and Benchmarks 03:04 - Emotional intelligence? 08:37 - Creative writing? 11:40 - Visual reasoning and Pricing 12:41 - Simple Performance 16:01 - End of Pretraining Scaling? 17:03 - CEO Hype 18:11 - System Card Highlights 23:32 - Karpathy Reaction GPT 4.5 System card: https://cdn.openai.com/gpt-4-5-system-card-2272025.pdf Release Notes: https://openai.com/index/gpt-4-5-system-card/ Altman Hype: https://x.com/sama/status/1891533802779910471 Details: https://openai.com/index/introducing-gpt-4-5/ https://x.com/OpenAI/status/1895219596317335792 End of an Era: https://x.com/wgussml/status/1895187231666774377 Anthropic Original Claim: https://techcrunch.com/2023/04/06/anthropics-5b-4-year-plan-to-take-on-openai/ Smell: https://x.com/rapha_gl/status/1895213014699385082 Bob McGrew: https://x.com/bobmcgrewai/status/1895228291981943265 Deep Research System Card: https://cdn.openai.com/deep-research-system-card.pdf Reddit: https://www.reddit.com/r/singularity/comments/1izu1t7/gpt45_crushes_simple_bench/ API Pricing: https://openai.com/api/pricing/ LiveStream: https://www.youtube.com/watch?v=cfRYp0nItZ8&t=1s https://simple-bench.com/ Karpathy Comparison: https://x.com/karpathy/status/1895213020982472863 https://x.com/karpathy/status/1895337579589079434 Non-hype Newsletter: https://signaltonoise.beehiiv.com/ Podcast: https://aiexplainedopodcast.buzzsprout.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

0:00-32:50

transcript

No transcript — this publisher did not publish one.

show notes

GPT 4.5 is here, and do you remember when AI lab CEOs like Sam Altman and Dario Amodei were betting everything on scaling up base models like this one? Well let’s find out what would have happened if the future of AI rested on models like GPT 4.5. You’ll see all the benchmarks, highlights of the paper, emotional intelligence and humor tests, Simple Bench results (reddit was an unreliable source), and why it’s not all bad news for OpenAI.

https://www.emergentmind.com/

AI Insiders (now $9!): https://www.patreon.com/AIExplained

Chapters
00:00 - Introduction
01:04 - Details and Benchmarks
03:04 - Emotional intelligence?
08:37 - Creative writing?
11:40 - Visual reasoning and Pricing
12:41 - Simple Performance
16:01 - End of Pretraining Scaling?
17:03 - CEO Hype
18:11 - System Card Highlights
23:32 - Karpathy Reaction

GPT 4.5 System card: https://cdn.openai.com/gpt-4-5-system-card-2272025.pdf
Release Notes: https://openai.com/index/gpt-4-5-system-card/
Altman Hype: https://x.com/sama/status/1891533802779910471
Details: https://openai.com/index/introducing-gpt-4-5/ https://x.com/OpenAI/status/1895219596317335792
End of an Era: https://x.com/wgussml/status/1895187231666774377
Anthropic Original Claim: https://techcrunch.com/2023/04/06/anthropics-5b-4-year-plan-to-take-on-openai/
Smell: https://x.com/rapha_gl/status/1895213014699385082
Bob McGrew: https://x.com/bobmcgrewai/status/1895228291981943265
Deep Research System Card: https://cdn.openai.com/deep-research-system-card.pdf
Reddit: https://www.reddit.com/r/singularity/comments/1izu1t7/gpt45_crushes_simple_bench/
API Pricing: https://openai.com/api/pricing/
LiveStream: https://www.youtube.com/watch?v=cfRYp0nItZ8&t=1s
https://simple-bench.com/


Karpathy Comparison: https://x.com/karpathy/status/1895213020982472863
https://x.com/karpathy/status/1895337579589079434


Non-hype Newsletter: https://signaltonoise.beehiiv.com/

Podcast: https://aiexplainedopodcast.buzzsprout.com/

Learn more about your ad choices. Visit megaphone.fm/adchoices

links21