Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Avoids vanishing gradients in deeper networks.

Also, most blocks with a residual approximate the identity function when initialised, so tend to be well behaved.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: