[转] 优化器汇总 Optimization for Deep Learning
几篇讲优化器的好文,mark一下
英文Optimizer overview
http://ruder.io/optimizing-gradient-descent/index.html#adam
http://ruder.io/deep-learning-optimization-2017/index.html
中文overview
https://www.jianshu.com/p/0acd30a23e4e
Adam讲解:
https://www.jianshu.com/p/aebcaf8af76e
多图汇总
https://blog.****.net/qsczse943062710/article/details/76763739