Skip to content
Sign in
Artwork for Concerning AI | Existential Risk From Artificial Intelligence
Society & CulturePhilosophyReligion & SpiritualityTechnology

Concerning AI | Existential Risk From Artificial Intelligence

Brandon Sanders & Ted Sarvata

Is there an existential risk from Human-level (and beyond) Artificial Intelligence? If so, what can we do about it?

Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

Play
Open in
  • 20 episodes
  • English

Episodes 20

NewestOldestLongest
All20Unplayed20In progress0Played0
  • Oct 23, 2018 · length unknown

    0070: We Don’t Get to Choose

    Or do we? Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Sep 5, 2018 · length unknown

    0069: Will bias get us first?

    Ted interviews Jacob Ward, former editor of Popular Science, journalist at many outlets. Jake’s article about the book he’s writing: Black Box Jake’s website JacobWard.com Implicit bias tests at Harvard We discuss the idea that we’re currently using narrow AIs to inform all kinds of decisions, and that we’re trusting those AIs way more than we would trust a human process in the same position, ignoring the type of thinking unique to humans, the slow kind. What could go wrong? Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Jul 23, 2018 · length unknown

    0068: Sanityland: More on Assassination Squads

    https://en.wikipedia.org/wiki/Micromort https://blog.openai.com/openai-charter/ https://en.wikipedia.org/wiki/The_Dark_Forest Possible future topic: Is this like the Dark Forest? One way it might be different and thus avoid being nationalize and weaponized is if we think, I’m not only worried about you being first, I’m also worried about you getting it wrong, therefore, the best course of action is for us all to work in the open, so none of us gets it wrong. Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Jul 6, 2018 · length unknown

    0067: The OpenAI Charter (and Assassination Squads)

    We love the OpenAI Charter. This episode is an introduction to the document and gets pretty dark. Lots more to come on this topic! Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • May 3, 2018 · length unknown

    0066: The AI we have is not the AI we want

    Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Apr 19, 2018 · length unknown

    0065: AGI Fire Alarm

    There’s No Fire Alarm for Artificial General Intelligence by Eliezer Yudkowsky Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Apr 5, 2018 · length unknown

    0064: AI Go Foom

    We discuss Intelligence Explosion Microeconomics by Eliezer Yudkowsky Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Mar 26, 2018 · length unknown

    0063: Ted’s Talk

    Ted’s Talk slides Ted gave a live talk a few weeks ago. The audio is on the podcast feed and here are the slides. Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Mar 16, 2018 · length unknown

    0062: There’s No Room at the Top

    Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Mar 2, 2018 · length unknown

    0061: Collapse Will Save Us

    Fragility from Complexity Resource Exhaustion Diminishing Returns Global system with single points of failure Consumer culture turning earth into landfills Artificial Intelligence as a destabilizing force Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Feb 13, 2018 · length unknown

    0060: Peter Scott’s Timeline For Artificial Intelligence Risks

    Timeline For Artificial Intelligence Risks Peter’s Superintelligence Year predictions (5% chance, 50%, 95%): 2032/2044/2059 You can get in touch with Peter at HumanCusp.com and Peter@HumanCusp.com For reference (not discussed in this episode): Crisis of Control: How Artificial SuperIntelligences May Destroy Or Save the Human Race by Peter J. Scott Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Jan 30, 2018 · length unknown

    0059: Unboxing the Spectre of a Meltdown

    SpectreAttack.com Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Jan 16, 2018 · length unknown

    0058: Why Disregard the Risks?

    There are understandable reasons why accomplished leaders in AI disregard AI risks. We discuss what they might be. Wikipedia’s list of cognitive biases Alpha Zero Virtual Reality recorded January 7, 2017, originally posted to Concerning.AI Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Jan 2, 2018 · length unknown

    0057: Waymo is Everybody?

    If the Universe Is Teeming With Aliens, Where is Everybody? Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Dec 19, 2017 · length unknown

    0056: Julia Hu of Lark, an AI Health Coach

    Julia Hu, founder and CEO of Lark, an AI health coach, is our guest this episode. Her tech is really cool and clearly making a positive difference in lots of people’s lives right now. Longer term, she doesn’t see much to worry about. Julia’s AGI Prediction: 2087 / 2137 / ?? Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Dec 5, 2017 · length unknown

    0055: Sean Lane

    Ted had a fascinating conversation with Sean Lane, founder and CEO of Crosschx. After talking about the power of bots to scale humans, we speculated with a hammering nails analogy. If today we are all pounding in nails with rocks, the coming (next 2-5 years and beyond) democratization of AI will give everyone not just hammers, but nail guns. With these nail guns people will build as-yet unimaginable cities and those cities will be the base from which AGI gets built. Sean then played out “When will it happen?” game. Adding his answer to ours from last (0054) episode, here are our answers: Sean 2027/2045/2075 Ted 2027/2042/2099 Brandon 2040/2070/2110 When asked if we’re being alarmist on this show, calling out the existential risk from AGI, Sean posited that the alarm helps cause the conditions for the risk to be mitigated so we’ll never be right. The harm we’re alarmist about will never come to pass in part because we’re raising the alarm. Also, two new (to us) ways to think about why the paperclip maximizer thought experiment is important. Because all AI researchers know about the thought experiment, maximizing paperclips is now a variable applicable to all AI systems. The good guys then will: Make darn sure their own systems can’t turn the solar system into paperclips. Be on the lookout for bad actors who might be intentionally trying to maximize paperclips. Sean’s YouTube channel Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Nov 21, 2017 · length unknown

    0054: Predictions of When

    We often talk about how know one really knows when the singularity might happen (if it does), when human-level AI will exist (if ever), when we might see superintelligence, etc. Back in January, we made up a 3 number system for talking about our own predictions and asked our community on facebook to play along as well. What we said then was 3 numbers: How many years from now do you think is a 5% probability that super-human AI exists? How many years from now do you think there is a 50% probability that super-human AI exists? How many years from now do you think there is a 95% probability that super-human AI exists? At that time, Brandon was 5/30/70 and Ted was 15/30/50. On this show, without looking back on our previous predictions, we tried it again, this time instead of using years from now, we used dates, to avoid having to do the math each time. Here are our current predictions: Ted 2027/2042/2099 Brandon 2040/2070/2110 We would love to have you play along this time as well. References: Ramez Naam: The Singularity is Further Than it Appears Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Nov 7, 2017 · length unknown

    0053: Listener Feedback

    Great voice memos from listeners led to interesting conversations. Thank you Timo, Kevin, Eric, Bill and Ruth! Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Oct 24, 2017 · length unknown

    0052: Paths to AGI #4: Robots Revisited

    We continue our mini series about paths to AGI. Sam Harris’s podcast about the nature of consciousness Robot or Not podcast See also: 0050: Paths to AGI #3: Personal Assistants 0047: Paths to AGI #2: Robots 0046: Paths to AGI #1: Tools Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

  • Oct 10, 2017 · length unknown

    0051: Rodney Brooks Says Not To Worry

    We talked about Rodney Brooks Sept 2017 article [FoR&AI] The Seven Deadly Sins of Predicting the Future of AI Brooks is one of Brandon’s early AI heroes and Ted was ready to rail against the article. Listen in to see how it turned out. Subscribe in Overcast, iTunes, or through our feed. Please send your feedback for us to use on the show as a voice memo attachment in an email to ConcerningAI@gmail.com Concerning AI | Existential Risk From Artificial Intelligence is made with Jetpack Podcast. Full show notes and every episode at https://concerning.ai/

Showing 1–20 of 20 episodes