See also

Below are some good links for different optimizers:

• https://arxiv.org/pdf/1609.04747.pdf: The paper provides a good overview of different optimization algorithms.
• https://www.tensorflow.org/api_guides/python/train#Optimizers: This is the TensorFlow.org link, which details how to use different optimizers included in TensorFlow.
• https://arxiv.org/pdf/1412.6980.pdf: The paper on Adam optimizer.