Check out a this article for a better understanding of activation functions.