S1E12. Sand and Statues: How Diffusion Makes a Picture

This episode is narrated using AI voice technology. The content and script are original. Sand and statues. You take a picture and add noise until it is sand. You train a model to take the noise away, one grain at a time, until a statue is standing there. That is diffusion. Rob keeps it in that picture. The model is a sand detector, not a painter with a plan. Classifier-free guidance is how a sentence steers the sand without a separate classifier. Latent diffusion does the work in the recipe instead of on every pixel, which is why it ran on ordinary hardware. The old backbone was drawn like the letter U. The new one is a diffusion transformer, DiT, and the argument is that it improves more predictably as it grows. Text to image is the demo. Video is the same idea with a clock. Takeaway: it is not drawing. it is taking noise away on purpose. Subscribe for the rest of the season, and visit cloudadorn.com.