a$)$ In Deep Learning Networks what are the aspects you should take into consideration in choosing an activation

function?

$($i$)$

$($ii$)$

b$)$ In light of your answer to $($a$)$ which one$($s$)$ of the following would you chose as an activation function $?$ Explain

your answer.

$($i$)f(x)=-$min$(2,x)$

$($ii$)f(x)=0\mathrm{.}9x+1$

$($iii$)f(x)=\{\begin{array}{ccc}\text{m}\text{i}\text{n}& (x,\mathrm{.}1x),& |x0\\ \text{m}\text{i}\text{n}& (x,\mathrm{.}1x),& |x<mn\; id="EditorElement\_8510927">0</mn>\end{array}$

$($iv$)f(x)=\{\begin{array}{ccc}\text{m}\text{a}\text{x}& (x,\mathrm{.}1x),& |x0\\ \text{m}\text{i}\text{n}& (x,\mathrm{.}1x),& |x<mn\; id="EditorElement\_8510760">0</mn>\end{array}$

$($v$)f(x)=\{\begin{array}{cc}1,& |x0\\ 0,& |x<mn\; id="EditorElement\_8510630">0</mn>\end{array}$