Search All of the Math Forum:

Views expressed in these public forums are not endorsed by NCTM or The Math Forum.

Notice: We are no longer accepting new posts, but the forums will continue to be readable.

Topic: Non-linear optimization
Replies: 32   Last Post: Mar 8, 2013 2:22 AM

 Messages: [ Previous | Next ]
 Bruno Luong Posts: 9,822 Registered: 7/26/08
Re: Non-linear optimization
Posted: Mar 7, 2013 4:51 PM

"Matt J" wrote in message <khb188\$n3q\$1@newscl01ah.mathworks.com>...

> That much, I understand. Maybe I didn't understand what you meant by quasi-Newton being "quasi-efficient".

Practical experimental shows that one does not need to compute the true Hessian. The gain in number of iteration for convergence is minor, yet more complex calculation for the second order requires a lot of overhead in many cases.

>It looks like finding lambda for quasi-Newton-LM would be much more efficient than for true Newton-LM.

Not sure I understand your statement. In LM method, finding lambda is based on the same empirical rules that works equally well regardless which the Hessian approximation or true Hessian is chosen.

Bruno

Date Subject Author
3/4/13 Toan Cao
3/4/13 Steven Lord
3/4/13 Toan Cao
3/5/13 Steven Lord
3/5/13 Toan Cao
3/6/13 Matt J
3/6/13 Matt J
3/6/13 Toan Cao
3/6/13 Matt J
3/4/13 Matt J
3/4/13 Toan Cao
3/5/13 Matt J
3/5/13 Bruno Luong
3/6/13 Matt J
3/6/13 Bruno Luong
3/6/13 Matt J
3/6/13 Bruno Luong
3/6/13 Matt J
3/6/13 Bruno Luong
3/6/13 Matt J
3/7/13 Bruno Luong
3/7/13 Matt J
3/7/13 Bruno Luong
3/7/13 Matt J
3/7/13 Bruno Luong
3/7/13 Matt J
3/7/13 Bruno Luong
3/8/13 Matt J
3/8/13 Bruno Luong
3/7/13 Toan Cao
3/7/13 Matt J
3/7/13 Toan Cao
3/7/13 Matt J