Constrained Least Square Optimization

Click For Summary
The discussion focuses on solving the constrained least squares optimization problem defined by the equation involving the minimization of a quadratic loss function with a regularization term. The user is familiar with standard least squares but seeks clarification on how the regularization term, represented by α ||a||^2, alters the optimization model. There is also a request for clarification on the notation used, specifically the transpose operation and the double absolute value marks, which indicate a matrix norm. The user is uncertain if this topic falls under Calculus III and seeks guidance on the type of matrix norm applicable in this context. Understanding these elements is crucial for effectively applying the inverse operator in the presence of constraints.
ahmadnajeeb
Messages
1
Reaction score
0
Hi,
I want to know the solution of the following equation.
<br /> a = argmin_{a}[\sum{||a^Tx_i - y_i||^2}+\alpha ||a||^2] \\<br />
where x_i, y_i are column vectors of dimensions m and n respectively where m&gt;n. \alpha is a scalar and
Y = a^T X where X=[x_1 x_2 ... x_k], Y = [y_1 y_2 ... y_k]

I know that without this constraint \alpha ||a||^2, its a simple least square optimization problem and I can solve it using Matlab's inverse operator. I want to use the same inverse operator but don't know how this constraint changes my original model.
 
Physics news on Phys.org
Sorry, but I'm curious- What is this? I don't recognize the aT thing or the double absolute value marks. Could you tell me what type of math is this? Is it Calculus III?
 
What matrix norm are you using for your constraint?
 

Similar threads

  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 18 ·
Replies
18
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 3 ·
Replies
3
Views
1K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 11 ·
Replies
11
Views
1K
Replies
5
Views
2K
  • · Replies 12 ·
Replies
12
Views
2K