https://astralcodexten.substack.com/p/mr-tries-the-safe-uncertainty-fallacy

The Safe Uncertainty Fallacy goes:

1. The situation is completely uncertain. We can’t predict anything about it. We have literally no idea how it could go.
2. Therefore, it’ll be fine.

You’re not missing anything. It’s not supposed to make sense; that’s why it’s a fallacy.

For years, people used the Safe Uncertainty Fallacy on AI timelines:

Since 2017, AI has moved faster than most people expected; GPT-4 sort of qualifies as an AGI, the kind of AI most people were saying was decades away. When you have ABSOLUTELY NO IDEA when something will happen, sometimes the answer turns out to be “soon”.