“The Extinction Risk Preference Cascade: Quotes” by Zvi

These are quotes from OpenAI, Anthropic and Google employees, in the wake of Jacob Coxon's warnings, in which the employees confirm that they think AI might soon kill everyone. If more quotes come in over the next week or so, I will update this post accordingly. Preference Cascade Statements At OpenAI: Tomek Korbak Tomek Korbak (OpenAI): i’m late to the party but: from his time at OpenAI I remember Jacob as a very thoughtful researcher and he continues to be so in this thread. neither anthropic nor openai are on track to solve alignment to a degree sufficient for shipping superintelligence and we need to slow down Vie McCoy Vie McCoy (OpenAI): I think pacing progress and ensuring human enhancement is the only way that we don’t get out-evolved while retaining the dream of superintelligence. In this context, I see two paths before us. In the first, we race towards RSI without embedding human flourishing and human enhancement as a deep value within the models, and by and large either get left behind or suffer catastrophic losses. In the second, we set the pace of progress, focus on embedding human flourishing [...] --- Outline: (00:27) Preference Cascade Statements At OpenAI: Tomek Korbak (00:55) Vie McCoy (03:46) Adam Majmudar (05:05) Aidan Clark (05:46) Mo Bavarian (07:32) Boaz Barak (08:20) Micah Carroll (09:15) Roon (12:55) Confirmations At OpenAI: Dean Ball (14:39) Leo Gao (14:57) Anthropic's Evan Hubinger Confirms His Stance (15:50) Preference Cascade at Anthropic: Samuel Marks (17:36) Anna Wang (18:22) Ethan Perez (18:59) Dima Krasheninnikov (19:27) EigenGender (Anon Account) (19:58) Joe Benton (20:07) Confirmation at Anthropic: Drake Thomas (21:28) Jan Lieke (22:07) Sluggy (22:29) Preference Cascade at Google (22:56) Andreas Kirsch (23:39) Neel Nanda (24:15) Victoria Krakovna (25:26) Vishal Maini (27:01) Joe (OpenAI, ex-Google) (28:21) Josh Engels (28:39) Geoffrey Irving (29:30) Alex Turner and Geoffrey Hinton: Classic Examples (29:45) #NotAllMembersOfTechnicalStaff: Ted Sanders --- First published: September 11th, 2026 Source: https://www.lesswrong.com/posts/APGvWZtXEwkinvHDd/the-extinction-risk-preference-cascade-quotes --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.