The Math Forum

Search All of the Math Forum:

Views expressed in these public forums are not endorsed by NCTM or The Math Forum.

Math Forum » Discussions » Software » comp.soft-sys.matlab

Notice: We are no longer accepting new posts, but the forums will continue to be readable.

Topic: fminunc Hessian: good covariance matrix estimator?
Replies: 1   Last Post: Apr 12, 2013 11:19 AM

Advanced Search

Back to Topic List Back to Topic List Jump to Tree View Jump to Tree View   Messages: [ Previous | Next ]

Posts: 77
Registered: 6/6/12
Re: fminunc Hessian: good covariance matrix estimator?
Posted: Apr 12, 2013 11:19 AM
  Click to see the message monospaced in plain text Plain Text   Click to reply to this topic Reply

I've tried comparing the hessian given by fminunc with two different others.
I tried multiplying the function jacobian with its transpose. (I expect it to be equal to the hessian in a chi^2 minimization problem, near the minimum).
If I take the ratio of this hessian to the fminunc one I get a matrix of ones, with a 0.1% agreement in the worst case, usually much better. And that's very fine.
(I've tried with the same fitting function but with independent datasets)

Then, suspecting that fminunc uses the same approximation, I also tried to estimate the hessian without approximations but using finite differences.
If I do so and compute the ratio of this hessian to one of the other two I get a matrix of values spread around 1.... (-20%,+50%!!!!)
Which is not fine!!
I wonder which method is correct now, as I know that computing second derivatives with finite differences is not trivial.

Point your RSS reader here for a feed of the latest messages in this topic.

[Privacy Policy] [Terms of Use]

© The Math Forum at NCTM 1994-2018. All Rights Reserved.