Michael and Dave discuss the meaning of the reward function, and its consequences for AI and human society.