
Why Codex Writes Code for a Dead API
transcript
show notes
A coding model confidently hands you a deprecated SDK. Claude denies a newer Claude exists. These aren't hallucinations — they're a knowledge cutoff problem wearing a costume. This episode digs into the "Know Thyself" study from the University of Chicago, where ten frontier models guessed who wrote a piece of text and landed at essentially random accuracy. We trace the two failures people keep lumping together: not knowing the current API surface, and not knowing itself. Then we look at what the labs actually built — Anthropic's published system prompts, OpenAI's Docs skill, and a new "context layer" startup wave — and a Superglue benchmark that scored 68% for the best general-purpose model against 91% for a purpose-built integration layer. If the fix lives outside the weights, what does that mean for everything we credit the model for?
Key sources:
• Anthropic . — https://platform.claude.com/docs/en/release-notes/system-prompts/claude-sonnet-4
• OpenAI . — https://developers.openai.com/codex/use-cases/api-integration-migrations
• OpenAI Codex SDK docs . — https://developers.openai.com/codex/sdk
Episode 6008 — myweirdprompts.com/n/6008 (permanent short link: myweirdprompts.com/041759)





