
AI: Autonomous or controllable? Pick one (with Anthony Aguirre)
Streams straight from the publisher. podnod never proxies or re-hosts episode audio.
Read the full transcript here.
Is AI that's both superintelligent and aligned even possible? Does increased intelligence necessarily entail decreased controllability? What's the difference between "safe" and "under control"? There seems to be a fundamental tension between autonomy and control, so is it conceivable that we could create superintelligent AIs that are both autonomous enough to do things that matter and also controllable enough for us to manage them? Is general intelligence needed for anything that matters? What kinds of regulations on AI might help to ensure a safe future? Should we stop working towards superintelligent AI completely? How hard would it be to implement a global ban on superintelligent AI development? What might good epistemic infrastructure look like? What's the right way to think about entropy? What kinds of questions are prediction markets best suited to answer? How can we move from having good predictions to making good decisions? Are we living in a simulation? Is it a good idea to make AI models open-source?
Anthony Aguirre is the Executive Director of the Future of Life Institute, an NGO examining the implications of transformative technologies, particularly AI. He is also the Faggin Professor of the Physics of Information at UC Santa Cruz, where his research spans foundational physics to AI policy. Aguirre co-founded Metaculus, a platform leveraging collective intelligence to forecast science and technology developments, and the Foundational Questions Institute, supporting fundamental physics research. Aguirre did his PhD at Harvard University and Postdoctoral work as a member at the Institute for Advanced Study in Princeton. Learn more about him at his website, anthony-aguirre.com; follow him on X / Twitter at @anthonynaguirre, or email him at contact@futureoflife.org.
Further reading
- Keep The Future Human
- The Future of Life Institute
- "Unification of observational entropy with maximum entropy principles" by Joseph Schindler, Philipp Strasberg, Niklas Galke, Andreas Winter, and Michael G. Jabbour
Staff
- Spencer Greenberg — Host / Director
- Josh Castle — Producer
- Ryan Kessler — Audio Engineer
- Uri Bram — Factotum
- WeAmplify — Transcriptionists
- Igor Scaldini — Marketing Consultant
Music
Affiliates
[Read more]Read the full transcript here.
podcast.clearerthinking.organthony-aguirre.com
anthony-aguirre.com@anthonynaguirre
x.comcontact@futureoflife.org
futureoflife.orgKeep The Future Human
keepthefuturehuman.aiThe Future of Life Institute
futureoflife.orgSpencer Greenberg
spencergreenberg.comJosh Castle
gmail.comRyan Kessler
tone.supportUri Bram
uribram.comWeAmplify
weamplify.infoIgor Scaldini
linkedin.comBroke for Free
freemusicarchive.orgJosh Woodward
joshwoodward.comLee Rosevere
archive.orgQuiet Music for Tiny Robots
freemusicarchive.orgwowamusic
gamesounds.xyzzapsplat.com
zapsplat.comClearer Thinking
clearerthinking.orgGuidedTrack
guidedtrack.comMind Ease
mindease.ioPositly
positly.comUpLift
uplift.appRead more
podcast.clearerthinking.org