Date: Mar 7, 2013 5:52 PM
Author: Bruno Luong
Subject: Re: Non-linear optimization
"Matt J" wrote in message <firstname.lastname@example.org>...
> I don't see how that can be. For non-convex functions and non-posdef Hessians, an empirically chosen lambda could easily leave H+lambda*I singular, or at least, not positive definite and therefore non-descending. You would have to choose lambda>=min(eig(H)) to be sure that didn't happen, and that would require an eigen-analysis of H.
The strategy and rules to chose lambda is given by LM algorithm. You can check the textbook that explains all the details.
Again all that is well known.