Overfitting is when a statistical model fits exactly against its training data. This leads to the model failing to predict future observations accurately.