Drexel dragonThe Math ForumDonate to the Math Forum



Search All of the Math Forum:

Views expressed in these public forums are not endorsed by Drexel University or The Math Forum.


Math Forum » Discussions » Software » comp.soft-sys.matlab

Topic: fminunc Hessian: good covariance matrix estimator?
Replies: 1   Last Post: Apr 12, 2013 11:19 AM

Advanced Search

Back to Topic List Back to Topic List Jump to Tree View Jump to Tree View   Messages: [ Previous | Next ]
Luca

Posts: 77
Registered: 6/6/12
Re: fminunc Hessian: good covariance matrix estimator?
Posted: Apr 12, 2013 11:19 AM
  Click to see the message monospaced in plain text Plain Text   Click to reply to this topic Reply

So,
I've tried comparing the hessian given by fminunc with two different others.
I tried multiplying the function jacobian with its transpose. (I expect it to be equal to the hessian in a chi^2 minimization problem, near the minimum).
If I take the ratio of this hessian to the fminunc one I get a matrix of ones, with a 0.1% agreement in the worst case, usually much better. And that's very fine.
(I've tried with the same fitting function but with independent datasets)

Then, suspecting that fminunc uses the same approximation, I also tried to estimate the hessian without approximations but using finite differences.
If I do so and compute the ratio of this hessian to one of the other two I get a matrix of values spread around 1.... (-20%,+50%!!!!)
Which is not fine!!
I wonder which method is correct now, as I know that computing second derivatives with finite differences is not trivial.



Point your RSS reader here for a feed of the latest messages in this topic.

[Privacy Policy] [Terms of Use]

© Drexel University 1994-2014. All Rights Reserved.
The Math Forum is a research and educational enterprise of the Drexel University School of Education.