I am trying to do simplified version of Levenberg-Marquardt alg. for NN with one hidden layer. I found this article: Efficient algorithm for training neural networks with one hidden layer
I am not very math-skilled, so I have problem with calculating Jacobian partial derivates for matrix (7) in article (that is simplified Jacobian matrix). Does anonyone know this algorithm, or its implementation ? Classic (full) Levenberg-Marquardt is no use for me, because of large memory footprint.