Skip to content
Artwork for Generative AI 101
Generative AI 101 · August 4 · 14 min

What is Model Distillation?

Elon Musk said under oath that xAI partly distills OpenAI's models, and the courtroom gasped. Host Emily Laird takes apart what model distillation actually is, why hiding chain of thought was never a real defense (fabricated reasoning traces deliver roughly 96.7 percent of the value of genuine internal access), and what 24,000 fraudulent accounts look like when no vulnerability was exploited and the product worked exactly as designed. The uncomfortable part is structural: every dollar spent making a model cleaner and safer makes it a better teacher for whoever is copying it. Capability transfers through distillation, safety does not, and nobody has ever un-released 2.8 trillion parameters. 🎯 JOIN THE AI WEEKLY MEETUPS https://www.uwstout.edu/ai-weekly-meetup 📩 EMAIL REMINDERS FOR THE MEETUPS https://app.e2ma.net/app2/audience/signup/2101263/1779703/ 💬 CONNECT WITH EMILY LAIRD ON LINKEDIN http://www.linkedin.com/in/meet-emily-laird

0:00-14:40

transcript

No transcript — this publisher did not publish one.

show notes

Elon Musk said under oath that xAI partly distills OpenAI's models, and the courtroom gasped. Host Emily Laird takes apart what model distillation actually is, why hiding chain of thought was never a real defense (fabricated reasoning traces deliver roughly 96.7 percent of the value of genuine internal access), and what 24,000 fraudulent accounts look like when no vulnerability was exploited and the product worked exactly as designed. The uncomfortable part is structural: every dollar spent making a model cleaner and safer makes it a better teacher for whoever is copying it. Capability transfers through distillation, safety does not, and nobody has ever un-released 2.8 trillion parameters.

 

🎯 JOIN THE AI WEEKLY MEETUPS

https://www.uwstout.edu/ai-weekly-meetup

 

📩 EMAIL REMINDERS FOR THE MEETUPS

https://app.e2ma.net/app2/audience/signup/2101263/1779703/

 

💬 CONNECT WITH EMILY LAIRD ON LINKEDIN

http://www.linkedin.com/in/meet-emily-laird

links3