Improving DNNs Hyperparameter tuning-Regularization and Optimization（week2）Optimization Methods(示例代码

Posted douzujun

tags:

篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了Improving DNNs Hyperparameter tuning-Regularization and Optimization（week2）Optimization Methods(示例代码相关的知识，希望对你有一定的参考价值。

1. Optimization Methods

1.1 - Gradient Descent

1.2 - Mini-Batch Gradient descent

1.3 - Momentum

1.4 - Adam

2. Model with different optimization algorithms

2.1 - Mini-batch Gradient descent

2.2 - Mini-batch gradient descent with momentum

2.3 - Mini-batch with Adam mode

2.4 - Summary

以上是关于Improving DNNs Hyperparameter tuning-Regularization and Optimization（week2）Optimization Methods(示例代码的主要内容，如果未能解决你的问题，请参考以下文章

Improving DNNs Hyperparameter tuning-Regularization and Optimization（week1）GradientChecking

Improving DNNs Hyperparameter tuning-Regularization and Optimization（week2）Optimization Methods(示例代码

IMPROVING ADVERSARIAL ROBUSTNESS REQUIRES REVISITING MISCLASSIFIED EXAMPLES

Magnum Improving Solution

Improving the quality of the output

Consideration about improving mathematics study