The Math Forum

Ask Dr. Math - Questions and Answers from our Archives
Associated Topics || Dr. Math Home || Search Dr. Math

Why Is the Least Squares Line the Best Choice?

Date: 11/03/2005 at 17:42:08
From: Jane
Subject: Least sqares: probability

When obtaining a prediction line for the relationship between certain 
variables, one method which may be used to identify the best line is 
to find the least-squares line.  The least squares line minimizes the 
error between the two variables.  What about the least squares line 
makes it best?

Thank you for your help, Dr. Math.

Date: 11/04/2005 at 14:41:14
From: Doctor George
Subject: Re: Least sqares: probability

Hi Jane,

Thanks for writing to Doctor Math.

If you plot your data it should be approximately straight, otherwise
there is no sense in looking for a best fit line.

There is nothing about least squares that makes it intrinsically THE
best fit.  A best fit line is only "best" based on some criterion, and
there are other possible criteria to use besides least squares.

The criterion is usually a matter of minimizing some quantity.  Least
squares minimizes a sum of squared distances.  Every other possible
line will have a greater sum of squared distances.  Other not uncommon
criteria are minimizing the sum of absolute distances, or minimizing
the maximum of the distances.

Does that make sense?  Write again if you need more help.

- Doctor George, The Math Forum 
Associated Topics:
College Statistics
High School Statistics

Search the Dr. Math Library:

Find items containing (put spaces between keywords):
Click only once for faster results:

[ Choose "whole words" when searching for a word like age.]

all keywords, in any order at least one, that exact phrase
parts of words whole words

Submit your own question to Dr. Math

[Privacy Policy] [Terms of Use]

Math Forum Home || Math Library || Quick Reference || Math Forum Search

Ask Dr. MathTM
© 1994- The Math Forum at NCTM. All rights reserved.