How Does MATLAB Solve Linear Algebra Problems with Multiple Solutions?

Click For Summary
SUMMARY

This discussion focuses on solving linear algebra problems with multiple solutions using MATLAB, specifically through the use of Linear Matrix Inequalities (LMIs). The problem presented involves the equation A_I Y_I = b, where A_I is not invertible, leading to infinite solutions constrained by Y_I1 > 0 and Y_I2 > 0. The discussion highlights that MATLAB consistently outputs a specific solution for given inputs, demonstrating the application of convex optimization techniques and the Schur's complement lemma. Users are encouraged to explore MATLAB's Optimization Toolbox for effective problem-solving.

PREREQUISITES
  • Understanding of Linear Algebra concepts, particularly infinite solutions and constraints.
  • Familiarity with MATLAB and its Optimization Toolbox.
  • Knowledge of Linear Matrix Inequalities (LMIs) and their applications.
  • Basic understanding of convex optimization principles.
NEXT STEPS
  • Explore MATLAB's Optimization Toolbox, specifically the linprog function for linear programming.
  • Study the Schur's complement lemma and its applications in convex optimization.
  • Learn about Linear Matrix Inequalities (LMIs) and their role in solving constrained optimization problems.
  • Investigate different algorithms used in MATLAB for solving linear algebra problems, focusing on their impact on solution variability.
USEFUL FOR

This discussion is beneficial for mathematicians, engineers, and researchers working with linear algebra, optimization problems, and MATLAB users seeking to understand the nuances of solving systems with multiple solutions.

mihir_iit
Messages
1
Reaction score
0
Hello,

My question is to with a specific Linear Algebra problem being solved in MATLAB:

[1 2]Y_I = 3 ------------ (i), Y_I1 > 0 , Y_I2 > 0; where Y_I = [Y_I1 Y_I2]^T is the unknown to be found in the above equation (^T stands for transpose of a vector).

Let A_I = [1 2] and b= 3. Thus we have A_I Y_I = b. A_I is not invertible.

(i) has infinite solutions, subject to the constraints specified. This problem can be solved by framing the following LMI's:

Minimize v
Subject to

||A_I Y_I - b|| < v

Y_I1 > 0

Y_I2 > 0

|| . || stands for Euclidean 2-norm. Because this is in convex optimization framework, the Schur's compliment Lemma can be applied to the first LMI and thus the LMI's to be solved are:

[v* I (A_I Y_I - b)^T;(A_I Y_I - b) I] > 0 ------ (ii)

Y_I1 > 0 ------- (iii)

Y_I2 > 0 ------ (iv)

I represents Identity matrix. v, Y_I are the LMI variables.

If I solve the above LMI's, MATLAB will give one out of infinite solutions. E.g., for the specified A_I, MATLAB gives Y_I = [2.2808 0.3596]^T. It is important to note that MATLAB ALWAYS outputs the same solution for the give A_I.

Upon manipulation, (i) can be written as: [10 20]Y_I = 30 ---- (v) Y_I1 > 0, Y_I2 > 0. If (v) is solved by framing the appropriate LMIs, MATLAB outputs Y_I = [0.5827 1.2086]^T.

Thus by changing the coefficients of Y_I and the RHS constant, I get different solutions. The coefficients can be altered in infinite different ways.

So I have the following questions:

1. What algorithm does MATLAB use to solve this problem. How is this algorithm giving different results each time?

2. I do not think the results will vary with the algorithm being used. The results are different because of some concept in Linear Algebra itself. It has to do with how the problems of the kind Ax = b are solved (subject to constraints). If anyone knows better, please throw some light on what concept I am missing and why I am getting a different solution with different coefficients.


Any inputs are appreciated. Thanks.
 
Physics news on Phys.org
Hey mihir_iit and welcome to the forums.

I'm just wondering if you are looking at the Optimization toolbox for MATLAB, so that you can use the most appropriate tool given the generality of your constraints. The mathworks site gives this good reference which I think you'll find very useful:

http://www.mathworks.com.au/help/toolbox/optim/ug/linprog.html
 

Similar threads

  • · Replies 5 ·
Replies
5
Views
4K
  • · Replies 3 ·
Replies
3
Views
5K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 6 ·
Replies
6
Views
4K
  • · Replies 3 ·
Replies
3
Views
5K
  • · Replies 2 ·
Replies
2
Views
2K
Replies
3
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 41 ·
2
Replies
41
Views
10K
Replies
1
Views
7K