Skip to content
Artwork for LessWrong posts by zvi
LessWrong posts by zvi · Yesterday · 59 min

“AI #193: Progress May Dramatically Accelerate” by Zvi

Anthropic is warning us. Its modified S-1 now says that ‘we may imminently meet our Responsible Scaling Policy's definition of ‘dramatically accelerated progress attributable to AI.’ That is a highly scary sentence to have a company put in its S-1. This could happen. For now I appreciate the relative quiet. Perhaps many were focused the election. I’m sure the quiet will not last long. We have a new biggest crypto hack, as Binance got taken for billions of dollars. The big debate of the week was covered in Scott Alexander's Against SURA Seems Deeply Confused. OpenAI updates its Model Spec. It's one for diehards only but yes I did cover this. Table of Contents Language Models Offer Mundane Utility. Rewrite all your legacy code. Language Models Don’t Offer Mundane Utility. Not if you can’t use it. Huh, Upgrades. Claude renames its tiers, with some rules changes. On Your Marks. Materials science. Get My Agent On The Line. Don’t upload it to the secure DoD network. Deepfaketown and Botpocalypse Soon. The battle over deepfakes was entirely lost. Copyright Confrontation. Recreating someone else's exact game is bad, actually. [...] --- Outline: (00:57) Language Models Offer Mundane Utility (01:47) Language Models Don't Offer Mundane Utility (03:18) Huh, Upgrades (03:45) On Your Marks (05:03) Get My Agent On The Line (06:54) Deepfaketown and Botpocalypse Soon (07:57) Copyright Confrontation (08:26) Cyber Lack of Security (09:45) The Hackening (17:10) A Young Lady's Illustrated Primer (20:08) They Took Our Jobs (20:43) Get Involved (21:42) Introducing (22:48) In Other AI News (24:03) Recursive Self-Improvement (RSI) (1) (26:57) Recursive Self-Improvement (2) (32:15) Show Me the Money (33:17) Quiet Speculations (36:06) The Quest for Sane Regulations (38:30) Chip City (41:07) The Week in Audio (41:56) People Just Say Things (43:24) Against Against Sura (44:00) Rhetorical Innovation (46:33) [Artificial Intelligence] (47:10) The OpenAI Foundation (48:07) Aligning a Smarter Than Human Intelligence is Difficult (53:38) Massive Fraudulent Distillation (55:16) Cooperative Alignment (57:10) The Lighter Side --- First published: November 5th, 2026 Source: https://www.lesswrong.com/posts/NrQGzNcicMThuGEEM/ai-193-progress-may-dramatically-accelerate --- Narrated by TYPE III AUDIO. --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

0:00-59:42

transcript

No transcript — this publisher did not publish one.

show notes

Anthropic is warning us. Its modified S-1 now says that ‘we may imminently meet our Responsible Scaling Policy's definition of ‘dramatically accelerated progress attributable to AI.’

That is a highly scary sentence to have a company put in its S-1. This could happen. For now I appreciate the relative quiet. Perhaps many were focused the election. I’m sure the quiet will not last long.

We have a new biggest crypto hack, as Binance got taken for billions of dollars.

The big debate of the week was covered in Scott Alexander's Against SURA Seems Deeply Confused.

OpenAI updates its Model Spec. It's one for diehards only but yes I did cover this.

Table of Contents

  1. Language Models Offer Mundane Utility. Rewrite all your legacy code.
  2. Language Models Don’t Offer Mundane Utility. Not if you can’t use it.
  3. Huh, Upgrades. Claude renames its tiers, with some rules changes.
  4. On Your Marks. Materials science.
  5. Get My Agent On The Line. Don’t upload it to the secure DoD network.
  6. Deepfaketown and Botpocalypse Soon. The battle over deepfakes was entirely lost.
  7. Copyright Confrontation. Recreating someone else's exact game is bad, actually.
  8. [...]

---

Outline:

(00:57) Language Models Offer Mundane Utility

(01:47) Language Models Don't Offer Mundane Utility

(03:18) Huh, Upgrades

(03:45) On Your Marks

(05:03) Get My Agent On The Line

(06:54) Deepfaketown and Botpocalypse Soon

(07:57) Copyright Confrontation

(08:26) Cyber Lack of Security

(09:45) The Hackening

(17:10) A Young Lady's Illustrated Primer

(20:08) They Took Our Jobs

(20:43) Get Involved

(21:42) Introducing

(22:48) In Other AI News

(24:03) Recursive Self-Improvement (RSI) (1)

(26:57) Recursive Self-Improvement (2)

(32:15) Show Me the Money

(33:17) Quiet Speculations

(36:06) The Quest for Sane Regulations

(38:30) Chip City

(41:07) The Week in Audio

(41:56) People Just Say Things

(43:24) Against Against Sura

(44:00) Rhetorical Innovation

(46:33) [Artificial Intelligence]

(47:10) The OpenAI Foundation

(48:07) Aligning a Smarter Than Human Intelligence is Difficult

(53:38) Massive Fraudulent Distillation

(55:16) Cooperative Alignment

(57:10) The Lighter Side

---

First published:
November 5th, 2026

Source:
https://www.lesswrong.com/posts/NrQGzNcicMThuGEEM/ai-193-progress-may-dramatically-accelerate

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Bar graph ranking AI models by score, cost per task, and output tokens.
Bar chart
Table titled
Flowchart of AI economic outcomes branching to scenarios like
Meme: waterskier
Forum post list with titles, authors, scores, and comments.
TIME magazine cover
Flowchart diagram titled
Bar graph titled

Woman in spiral dress beside OpenAI spiral graphic labeled

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

links14