Search All of the Math Forum:
Views expressed in these public forums are not endorsed by
Drexel University or The Math Forum.


JoeCL
Posts:
8
Registered:
5/17/13


Q: Statistical Significance  Neural Networks?
Posted:
Feb 22, 2014 7:46 PM


Hello Everyone,
I'm working with artificial neural networks and I need to derive some indication of how well the networks are identifying intended targets versus nontargets.
The thing is that all targets are definitely not created equal. Some targets are much more important than others to get right, while others are of lower importance.
I looked at this problem from a cointoss perspective and used an online binomial calculator (http://stattrek.com/onlinecalculator/binomial.aspx#TopPage) to try to say that the chances of the neural network identifying targets by dumb luck was exceedingly unlikely. But this is based on all targets being of equal value and assuming a simple correctness measure (fraction right out of the total targets the network thought it found).
If, as I said, the targets are of unequal value, then a correctness measure is only part of what's needed and some kind of weighting is involved.
Do you have any thoughts about how to derive statistics that demonstrate the statistical significance of a neural network's "correctness" versus sheer chance when the targets are of unequal importance? And then, how would I state the results?
With much appreciation for any insights?
Kindest regards,
Joe



