Taylor expansion on PRML(5.28)

34 Views Asked by At

I'm reading PRML and I have a question,don't solve by myself.
So, please anyone help me.

PRML


Q:Why following third time is not multiplied with $E(\boldsymbol{\hat{w}})$

$\cfrac{1}{2} (\boldsymbol{w} - \boldsymbol{\hat{w}} )^\mathrm{T} E(\boldsymbol{\hat{w}}) \boldsymbol{H}(\boldsymbol{w} - \boldsymbol{\hat{w}})$

$E(\boldsymbol{w}) \simeq E(\boldsymbol{\hat{w}}) + ( \boldsymbol{w} - \boldsymbol{\hat{w}} )^\mathrm{T} \boldsymbol{b} + \cfrac{1}{2} (\boldsymbol{w} - \boldsymbol{\hat{w}} )^\mathrm{T} \boldsymbol{H}(\boldsymbol{w} - \boldsymbol{\hat{w}}) \cdots(5.28) $

$ \boldsymbol{b} \equiv \nabla E \,|_{w=\hat{w}} \, \cdots(5.29)$



Taylor series

$f(\boldsymbol{x}) \approx f(\boldsymbol{a}) + Df(\boldsymbol{a}) (\boldsymbol{x}-\boldsymbol{a}) + \frac{1}{2} (\boldsymbol{x}-\boldsymbol{a})^T Hf(\boldsymbol{a}) (\boldsymbol{x}-\boldsymbol{a}).$