Skip to content
Artwork for LessWrong (30+ Karma)
LessWrong (30+ Karma) · Saturday · 21 min

“Power — a guide for the perplexed” by djbinder

Whether AI systems could take power from humans matters a great deal for how much risk we face from them. Answering that requires a correct picture of how power works, which is what this guide tries to give. In short, power rests on self-reinforcing expectations. A ruler has power if everyone expects everyone else to enforce their commands, even if this is bad for almost everyone involved. But expectations can also shift suddenly, and when they do, change is rapid and chaotic. This can sometimes allow small, coordinated groups to seize control over much larger societies. Almost any rule can enforce itself Consider the classic tragedy of the commons. A village has a common green where everyone can graze their cows. Each villager gains from grazing as much as they can, but if everyone does, the grass dies and the green becomes useless. One solution is to privatize the green. But many societies have solved the problem differently, by punishing anyone who grazes more than custom allows. Their neighbors stop talking to them, trading with them, and marrying their children. In a village where everyone depends on everyone else, being shunned is very costly. [...] --- Outline: (00:47) Almost any rule can enforce itself (04:13) The centralization of violence (06:24) Dictatorship and democracy (11:12) Only individuals have interests (14:10) Coordination and coups (18:27) A sketch of implications for AI The original text contained 1 footnote which was omitted from this narration. --- First published: October 23rd, 2026 Source: https://www.lesswrong.com/posts/LCpSwJ5Eks2yJgStY/power-a-guide-for-the-perplexed --- Narrated by TYPE III AUDIO.

0:00-21:28

transcript

No transcript — this publisher did not publish one.

show notes

Whether AI systems could take power from humans matters a great deal for how much risk we face from them. Answering that requires a correct picture of how power works, which is what this guide tries to give.

In short, power rests on self-reinforcing expectations. A ruler has power if everyone expects everyone else to enforce their commands, even if this is bad for almost everyone involved. But expectations can also shift suddenly, and when they do, change is rapid and chaotic. This can sometimes allow small, coordinated groups to seize control over much larger societies.

Almost any rule can enforce itself

Consider the classic tragedy of the commons. A village has a common green where everyone can graze their cows. Each villager gains from grazing as much as they can, but if everyone does, the grass dies and the green becomes useless.

One solution is to privatize the green. But many societies have solved the problem differently, by punishing anyone who grazes more than custom allows. Their neighbors stop talking to them, trading with them, and marrying their children. In a village where everyone depends on everyone else, being shunned is very costly.

[...]

---

Outline:

(00:47) Almost any rule can enforce itself

(04:13) The centralization of violence

(06:24) Dictatorship and democracy

(11:12) Only individuals have interests

(14:10) Coordination and coups

(18:27) A sketch of implications for AI

The original text contained 1 footnote which was omitted from this narration.

---

First published:
October 23rd, 2026

Source:
https://www.lesswrong.com/posts/LCpSwJ5Eks2yJgStY/power-a-guide-for-the-perplexed

---

Narrated by TYPE III AUDIO.

links2