PDA

View Full Version : minimize parameter for Least Absolute Deviation LAD


dabd
Jun9-10, 10:20 AM
How to compute \beta = arg min_\beta \sum_{i=1}^N {|y_i - x_i^T \beta|

statdad
Jun9-10, 11:22 AM
There is no closed-form solution for this (contrary to the situation with least squares). The software you use (R, SAS, etc) use a variety of methods. check the relevant documentation for those programs.

dabd
Jun9-10, 12:20 PM
There is no closed-form solution for this (contrary to the situation with least squares). The software you use (R, SAS, etc) use a variety of methods. check the relevant documentation for those programs.

I was just interested in the calculation not in applying it to real data.
The estimate is the median of the data x1,...,xn and I wanted to see how they derived that result.

statdad
Jun9-10, 12:30 PM
No, the estimates are not the medians of the x values - if that were the case we would have a "closed form" method of calculation.

Where you may be confused is this: if you want to minimize


\sum_{i=1}^n |x_i - a|


as a function of a , the solution is the sample median. This does not generalize to regression.