AI Improves at Self-improving

AlphaEvolve is not the first system to exhibit self-improvement, but it may be the most impressive yet. AI is literally improving the hardware, architectures, data and training methods of AI itself. A deep dive into the paper, drawing on two previous interviews and 5 other papers. Plus a snippet on OpenAI’s new Codex system. Gray Swan: http://app.grayswan.ai/ai-explained AI Insiders ($9!): https://www.patreon.com/AIExplained Chapters: 00:00 - Introduction 00:27 - AlphaEvolve 05:23 - Limitation 06:10 - Achievements 08:21 - Future Improvements 13:30 - Quirks 16:34 - Final Thoughts AlphaEvolve release: https://deepmind.google/discover/blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/ Paper: https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/AlphaEvolve.pdf Terence Tao Quote: https://mathstodon.xyz/@tao/114508029896631083 Nature Article: https://www.nature.com/articles/s41586-022-05172-4 MIT Article: https://www.technologyreview.com/2025/05/14/1116438/google-deepminds-new-ai-uses-large-language-models-to-crack-real-world-problems/ AI Co-Scientist: https://arxiv.org/pdf/2502.18864 OpenAI Codex: https://openai.com/index/introducing-codex/ 70% of Pull Requests: https://x.com/slow_developer/status/1920920456393028027 Amodei Essay: https://www.darioamodei.com/essay/machines-of-loving-grace OpenAI Jason Wei Tweet: https://x.com/_jasonwei/status/1923091260354531612 PromptBreeder: https://arxiv.org/pdf/2309.16797 DrEureka: https://arxiv.org/pdf/2406.01967 FT DeepMind: https://www.ft.com/content/4e497a91-670a-4f69-be4a-18e247daba3e Non-hype Newsletter: https://signaltonoise.beehiiv.com/ Podcast: https://aiexplainedopodcast.buzzsprout.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices