When an activation function is non-zero centered why it invokes zig-zag path?

https://rohanvarma.me/inputnormalization/

Downsides of the sigmiod activation and why you should center your inputs