
Re: Nonlinear optimization
Posted:
Mar 7, 2013 4:51 PM


"Matt J" wrote in message <khb188$n3q$1@newscl01ah.mathworks.com>...
> That much, I understand. Maybe I didn't understand what you meant by quasiNewton being "quasiefficient".
Practical experimental shows that one does not need to compute the true Hessian. The gain in number of iteration for convergence is minor, yet more complex calculation for the second order requires a lot of overhead in many cases.
>It looks like finding lambda for quasiNewtonLM would be much more efficient than for true NewtonLM.
Not sure I understand your statement. In LM method, finding lambda is based on the same empirical rules that works equally well regardless which the Hessian approximation or true Hessian is chosen.
Bruno

