Big Technology Podcast

Generative AI 101: Tokens, Pre-training, Fine-tuning, Reasoning — With Dylan Patel

Apr 23, 2025 · 41 min
0:00-41:39

Streams straight from the publisher. podnod never proxies or re-hosts episode audio.

Dylan Patel is the founder and CEO of SemiAnalysis. He joins Big Technology Podcast to explain how generative AI work, explaining the inner workings of tokens, pre-training, fine-tuning, open source, and reasoning. We also cover DeepSeek’s efficiency breakthrough, the race to build colossal AI data centers, and what GPT-5’s hybrid training approach could unlock. Hit play for a masterclass you’ll want to send to every friend puzzled (or excited) about the future of AI.


---

Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.


Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology


Questions? Feedback? Write to: bigtechnologypodcast@gmail.com

Learn more about your ad choices. Visit megaphone.fm/adchoices