Activation Functions and Their Derivatives
Posted rhyswang
tags:
篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了Activation Functions and Their Derivatives相关的知识，希望对你有一定的参考价值。
1. Sigmoid Function: when z=0,g‘(z)=0.25
2. tanh Function: when x=0,tanh‘(x)=1
3. Relu
以上是关于Activation Functions and Their Derivatives的主要内容，如果未能解决你的问题，请参考以下文章
[CS231n-CNN] Training Neural Networks Part 1 : activation functions, weight initialization, gradient