Minimize parameter for Least Absolute Deviation LAD

Join the discussion
Registration is free. Ask a follow-up in this thread, or start your own.
3 replies · 4K views
dabd
Messages
25
Reaction score
0
How to compute [tex]\beta = arg min_\beta \sum_{i=1}^N {|y_i - x_i^T \beta|[/tex]
 
Physics news on Phys.org
There is no closed-form solution for this (contrary to the situation with least squares). The software you use (R, SAS, etc) use a variety of methods. check the relevant documentation for those programs.
 
statdad said:
There is no closed-form solution for this (contrary to the situation with least squares). The software you use (R, SAS, etc) use a variety of methods. check the relevant documentation for those programs.

I was just interested in the calculation not in applying it to real data.
The estimate is the median of the data x1,...,xn and I wanted to see how they derived that result.
 
No, the estimates are not the medians of the x values - if that were the case we would have a "closed form" method of calculation.

Where you may be confused is this: if you want to minimize

[tex] \sum_{i=1}^n |x_i - a|[/tex]

as a function of [itex]a[/itex], the solution is the sample median. This does not generalize to regression.