With proposed technique one can build very deep neural networks (up to hundreds of layers). The key principle why this works is very simple: $$x_{n+1} = x_n + f(x_n),$$ where the second summand is small enough.