Task Description: Non-linear activation functions are essential in obtaining expressive functions with neural networks. Some of these functions are better than others, and in most cases it is due to what they do to the gradients during backpropagation. Take a look at these functions, and if they have any adjustable parameters see the influence on the function and derivatives.