sigmoid > sigmoid(x): 1/(1+np.exp(-x))
derivate > deriv(x): sigmoid(x)*(1-sigmoid(x))
x = 10
sigmoid = 0.999954602131
derivate = 0.196616057953
I think I am correct about calculations. But can someone please explain to me, like to a five year old what derivate value tells us at all? I just know it is a change of something, but change of what? What does 0.196616057953 has to do with 0.999954602131?
What confuses me even more... If i put any number from -x to x, derivate is always about 0.19 up to 0.25 What is the point of this derivate?
I would appreciate your reply. Please do not reply in equations, because I can't not read those symbols :)
The derivative is to the function what speed is to distance.
To make it simpler, for $x=10$ you got $sigmoid = 0.999954602131$.
Repeat the calculation for $x=9.9$ to get $sigmoid = something$.
Now compute $$\frac{ 0.999954602131-something}{10 -9.9}=10(0.999954602131-something)$$
This should look like the number you got for $derivate$
Edit
After Henry's comment, what it seems is that you computed $\text{sigmoid}(10)=0.9999546021$ but $\text{deriv}(1)=0.1966119332$ while $\text{deriv}(10)=0.0000453958$.