Most people say their earliest memory is from around the age of three, which led researchers to believe that children start forming long-term memories at around three and a half years old