Consider the block with residual connection are input and output vectors of size of N: Wk is a weight matrix of shape NxN:

yk $=$ ReLU$($Wk $.$ xk$)+$ xk

Suppos you stack this block K times $($as one on top of the other$)$ and you get a final output vect$$r denoted by yk$.$

What is the $$yk $/$x$1?$ Where x$1$ is the initial input.

$($Assume all weights w and derivatives are always positive$)$

Hint: Jacobian matrix $$z$/$w where z and w are vector of size N is $...$ matrix image on the above.