Columns of recommendation system

Deep learning tips & tricks

less than 1 minute read

Published: December 25, 2019

• Must Know Tips/Tricks in Deep Neural Networks (by Xiu-Shen Wei):

http://www.weixiushen.com/project/CNNTricks/CNNTricks.html

• An overview of gradient descent optimization algorithms:

https://ruder.io/optimizing-gradient-descent/index.html

Deep understanding of sequential networks

less than 1 minute read

Published: December 24, 2019

• Understanding LSTM Networks:

http://colah.github.io/posts/2015-08-Understanding-LSTMs/

• Learning Long-Term Dependencies with Gradient Descent is Difficult:

http://ai.dinfo.unifi.it/paolo//ps/tnn-94-gradient.pdf

• Minimal character-level RNN implementation:

https://gist.github.com/karpathy/d4dee566867f8291f086

• An efficient, batched LSTM implementation:

https://gist.github.com/karpathy/587454dc0146a6ae21fc