Experiment # $1$: Understanding Neural Networks

Write a code in Python $/$ R to achieve the following tasks:

$1.$ Implement a simple perceptron to understand the basic functioning of neural networks.

$2.$ Compare the performance of different activation functions $($ReLU$,$ Sigmoid, Tanh$)$ on a simple dataset.