Our brains are three times as large as our closest evolutionary relative. But the size of the human brain hasn't just continually grown during our evolution.