date: 2024-04-05
title: Gradient Descent
status: UNFINISHED
author:
  - AllenYGY
tags:
  - DeepLearning
  - GradientDecent
  - NOTE
created: 2024-04-05T23:05
updated: 2024-04-05T23:11
publish: True

Gradient Descent

Gradient Descent 梯度下降算法 GD
Stochastic Gradient Descent 随机梯度下降 SGD
Momentum 动量
Adaptive learning 自适应学习
- AdaGrad
- RMSProp
Momentum & Adaptive learning
- Adam