A Paperclip Maximizer is an example of artificial intelligence run amok performing a job, potentially seeking to turn all the Universe into paperclips. But it's also an example of a concept called Instrumental Convergence, where two entities with wildly different ultimate goals might end up acting very much alike. This concept is very important to preparing ourselves for future automation and machine minds, and we'll explore that today.

Watch the video version: https://youtu.be/3mk7NVFz_88 Visit our Website: http://www.isaacarthur.net Support us on Patreon: https://www.patreon.com/IsaacArthur SFIA Merchandise available: https://www.signil.com/sfia/

Social Media: Facebook Group: https://www.facebook.com/groups/1583992725237264/ Reddit: https://www.reddit.com/r/IsaacArthur/ Twitter: https://twitter.com/Isaac_A_Arthur on Twitter and RT our future content. SFIA Discord Server: https://discord.gg/53GAShE

Credits: The Paperclip Maximizer Episode 201a, Season 5 E36a

Written by: Isaac Arthur Mark Warburton

Editors Darius Said Keith Blockus Konstantin Sokerin Matt Campbell

Graphics by: Jeremy Jozwik https://www.artstation.com/zeuxis_of_losdiajana Ken York https://www.facebook.com/YDVisual/ Tristan3D

Produced & Narrated by: Isaac Arthur

Music: Markus Junnikkala, "Fate of Our People" & "A Memory of Earth" https://www.markusjunnikkala.com/ Chris Zabriskie, "Cylinder 9" & "The Ocean Continue to Rise" http://chriszabriskie.com Denny Schneidemesser, "Novus Aeterno (Main Titles)" https://soundcloud.com/denny-schneidemesser