Deep learning tips & tricks

less than 1 minute read

Published: December 25, 2019

Must Know Tips/Tricks in Deep Neural Networks (by Xiu-Shen Wei):

http://www.weixiushen.com/project/CNNTricks/CNNTricks.html

An overview of gradient descent optimization algorithms:

https://ruder.io/optimizing-gradient-descent/index.html

Share on

Twitter Facebook LinkedIn

You May Also Enjoy

Columns of recommendation system

less than 1 minute read

Published: December 29, 2019

by Zhe Wang:

https://zhuanlan.zhihu.com/wangzhenotes

Deep understanding of sequential networks

less than 1 minute read

Published: December 24, 2019

Understanding LSTM Networks:

http://colah.github.io/posts/2015-08-Understanding-LSTMs/

Learning Long-Term Dependencies with Gradient Descent is Difficult:

http://ai.dinfo.unifi.it/paolo//ps/tnn-94-gradient.pdf

Minimal character-level RNN implementation:

https://gist.github.com/karpathy/d4dee566867f8291f086

An efficient, batched LSTM implementation:

https://gist.github.com/karpathy/587454dc0146a6ae21fc