Concerning AI | Existential Risk From Artificial Intelligence: Recent Episodes
Brandon Sanders & Ted Sarvata
Is there an existential risk from Human-level (and beyond) Artificial Intelligence? If so, what can we do about it?
Or do we? http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0070-2018-09-30.mp3
Ted interviews Jacob Ward, former editor of Popular Science, journalist at many outlets. Jake’s article about the book he’s writing: Black Box Jake’s website JacobWard.com Implicit bias tests at Harvard We discuss the idea that we’re currently using narrow AIs to inform all kinds of decisions, and that we’re trusting those AIs way more than […]
We love the OpenAI Charter. This episode is an introduction to the document and gets pretty dark. Lots more to come on this topic!
There’s No Fire Alarm for Artificial General Intelligence by Eliezer Yudkowsky http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0065-2018-03-18.mp3
We discuss Intelligence Explosion Microeconomics by Eliezer Yudkowsky http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0064-2018-03-11.mp3
Some believe civilization will collapse before the existential AI risk has a chance to play out. Are they right?
Timeline For Artificial Intelligence Risks Peter’s Superintelligence Year predictions (5% chance, 50%, 95%): 2032/2044/2059 You can get in touch with Peter at HumanCusp.com and Peter@HumanCusp.com For reference (not discussed in this episode): Crisis of Control: How Artificial SuperIntelligences May Destroy Or Save the Human Race by Peter J. Scott http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0060-2018-01-21.mp3
SpectreAttack.com http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0059-2018-01-14.mp3
There are understandable reasons why accomplished leaders in AI disregard AI risks. We discuss what they might be. Wikipedia’s list of cognitive biases Alpha Zero Virtual Reality recorded January 7, 2017, originally posted to Concerning.AI http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0058-2018-01-07.mp3
If the Universe Is Teeming With Aliens, Where is Everybody? http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0057-2017-11-12.mp3
Julia Hu, founder and CEO of Lark, an AI health coach, is our guest this episode. Her tech is really cool and clearly making a positive difference in lots of people's lives right now. Longer term, she doesn't see much to worry about.
We often talk about how know one really knows when the singularity might happen (if it does), when human-level AI will exist (if ever), when we might see superintelligence, etc. Back in January, we made up a 3 number system for talking about our own predictions and asked our community on facebook to play along […]
We continue our mini series about paths to AGI. Sam Harris’s podcast about the nature of consciousness Robot or Not podcast See also: 0050: Paths to AGI #3: Personal Assistants 0047: Paths to AGI #2: Robots 0046: Paths to AGI #1: Tools http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0052-2017-10-08.mp3
This is our 2nd episode thinking about possible paths to superintelligence focusing on one kind of narrow AI each show. This episode is about embodiment and robots. It's possible we never really agreed about what we were talking about and need to come back to robots.
Future ideas for this series include:
personal assistants (Siri, Alexa, etc) non-player characters search engines (or maybe those just fall under tools social networks or other big data / working on completely different time / size scale from humans collective intelligence simulation whole-brain emulation augmentation (computer / brain interface) self-driving cars See also:
0046: Paths to AGI #1: Tools Robots learning to pick stuff up Roomba mapping
https://youtu.be/iZhEcRrMA-M
https://youtu.be/97hOaXJ5nGU
https://youtu.be/tynDYRtRrag
https://youtu.be/FUbpCuBLvWM
For show notes, please see https://concerning.ai/2017/08/29/0048-ai-xprize-and-thrival-festival-special-mini-episode/
We talked about the Nexus Trilogy of novels as a way to further our thinking about the wizard hat idea Tim Urban wrote about in his article about Elon Musk's Neuralink.
Tim Urban's article at Wait But Why: Elon Musk's Neuralink and the Brain’s Magical Future
We need better language to talk about these difficult technical topics. See https://concerning.ai/2017/03/31/0039-we-need-more-sparrow-fables/ for notes.
Listener Voicemail & Comments Eric’s voicemail Evan’s comment (Our interview with Evan: ep 0011: Evan Prodromou, AI practitioner (part 1), ep 0012: Evan Prodromou, AI practitioner (part 2) John’s comment Ted got the author’s name wrong Predictably Irrational by Dan Ariely (25:12) Moving on from Feedback into what’s going to get us from here to there Instantaneous Judgement (Stimulus-Response) Reinforcement […]
Wind up your propeller hats! This one is a doozy. Hopefully someone can explain it to me (Ted).
Too time constrained for show notes this time. If you want to send us notes to be added here, please do it! Best place to reach is is the Concerning AI group on Facebook. All of the listener feedback in this episode comes from that group. Thank you all! Subscribe in Overcast, iTunes, or through […]
We recorded this episode on Nov 6, 2016, two days before the US election. Sorry it’s taken so long to get out. Also, no show notes due to need to simply get it published and avoid further delay. Enjoy! http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0029-2016-11-06.mp3
Nick Bostrom’s Superintelligence Fiction from Liu Cixin: The Three Body Problem The Dark Forest Death’s End We’re a lot more beautiful if we try. (5:41) The Upward Spiral (9:45) Are we getting any wiser? (12:43) What are we trying for? To continue an aesthetic lineage. (13:55) Kurzweil. When the machines tell us they are human, […]
Korey’s comment: … one question you asked on ‘The Locality Principle’, was what other people are doing to avert a possible AIpocalypse; I’m starting a company! An entertainment venture with one driving purpose: to create a fully realized virtual world, one with as many complex and varied entities as the real world itself. … Links for […]
http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0026-2016-09-18.mp3 These notes won’t be much use without listening to the episode, but if you do listen, one or two of you might find one or two of them helpful. Lyle Cantor‘s comment (excerpt) in the Concerning AI Facebook group: Regarding the OpenAI strategy of making sure we have more than one superhuman AI, this is […]
Some things we talked about: Companies developing narrow AI, not giving one thought about AI safety, because just getting the thing to work at all is really hard. Self-driving cars and how fast they’re progressing Difference between Open AI and MIRI in approach Weaponized offense and defense Eliezer’s thought about that missing the point http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0025-2016-09-04.mp3
No notes this time, just a speculative conversation about some possible implications of the idea that we could be living in a simulation. Subscribe in Overcast, iTunes, or though our feed. To get in touch with us, visit the Concerning AI Facebook group. http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0024-2016-07-17.mp3 Post-Human Series by David Simpson
This episode, we talk about this paper: A Few Useful Things to Know about Machine Learning
Human augmentation may be a way for humans to advance on par with non-biological beings (AIs), but do ethical guidelines make that less likely to happen?
Throughout history there have been doomsayers, yet we're still here. What makes today's doomsday scenarios different?
What would it mean to entangle with technology rather than leave the biosphere behind? Could we just send the AI to the moon?
Brandon is back and we talk at length about how AlphaGo works and what the implications are, such that we can see with our feeble human minds.
http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0015-2016-03-13.mp3 Ted talks with special guest Eric Saumur about AlphaGo, compassion, desires and more.
From now on, we seek to come from a place or empathy on this show, even when it seems to not make sense. There's nothing to win here.
This episode is the 2nd (and final) part of our conversation with Evan Prodromou, software developer, open source advocate and AI practitioner extraordinaire. Hope you enjoy it as much as we did!
Evan's awesome. Great to talk with a bona fide AI practitioner. Just getting things started.
We haven't found strong arguments on the "Don't be worried. Here's why ..." side of things. We know the arguments must exist, but we can't find them (send them to us!). So, what to do? Make some arguments up, that's what!
How might we get to superintelligence? This episode explores some possible paths, or maybe simply directions.
Existential risk – One where an adverse outcome would either annihilate Earth- originating intelligent life or permanently and drastically curtail its potential
The “skeptic” position seems to be that, although we should probably get a couple of bright people to start working on preliminary aspects of the problem, we shouldn’t panic or start trying to ban AI research. The “believers”, meanwhile, insist that although we shouldn’t panic or start trying to ban AI research, we should probably get a couple of bright people to start working on preliminary aspects of the problem.
Following up on last episode's question, "What is intelligence?" this episode we attempt to unpack "consciousness."
Our goal on this episode is to establish a "good enough" definition of intelligence that we'll be able to refer back to in future episodes.
This is a reboot. After recording 4 episodes of what we thought would be the Friendly AI podcast, here is Episode 0000 of Concerning AI.
And So It Begins! We didn't used to be concerned about artificial intelligence, but now we are.