Show the derivative of an activation function

807 Views Asked by At

I am learning about neural networks and am using the sigmoid activation function

$$q(z)=\frac{1}{1+e^{-z}}.$$ The problem is that I need to use its derivative $q^{\prime}(z)$. Would anyone have any hints as to how I would go about calculating this?

1

There are 1 best solutions below

2
On BEST ANSWER

Hint: $$\left(\frac 1f\right)^{\prime}=-\frac{f^{\prime}}{f^2}$$ when $f$ is non zero and differentiable. This means $$q^{\prime}(z)=\left(\frac{1}{1+e^{-z}}\right)^{\prime}=-\frac{(1+e^{-z})^{\prime}}{(1+e^{-z})^2}$$