Probability of a matrix having full rank

Click For Summary
SUMMARY

The discussion focuses on determining the probability that a K*N matrix has full rank, specifically when the first K columns are linearly independent and the remaining N-K columns are linear combinations of these. The user outlines a method involving random selection of columns and the relationship between the rank of the submatrix and the span of selected columns. A key insight is that the probability of selecting a singular matrix from the space of matrices is zero, emphasizing that the set of full-rank matrices is dense in the space of all matrices over real numbers.

PREREQUISITES
  • Understanding of linear algebra concepts such as matrix rank and linear independence.
  • Familiarity with combinatorial mathematics, specifically combinations and selections.
  • Knowledge of scalar fields, particularly the properties of real numbers in matrix theory.
  • Basic understanding of the General Linear Group (GL) and its significance in matrix theory.
NEXT STEPS
  • Research the properties of matrix rank and linear independence in linear algebra.
  • Study combinatorial selection methods and their applications in probability theory.
  • Explore the concept of dense sets in topology, particularly in relation to GL(n, ℝ).
  • Learn about the implications of singular matrices and determinants in matrix analysis.
USEFUL FOR

Mathematicians, statisticians, and data scientists interested in linear algebra, probability theory, and matrix analysis will benefit from this discussion.

anu914
Messages
3
Reaction score
0
Hi all,

I am trying to find the probability that a matrix has full rank.

Consider a K*N matrix where the first K columns are linearly independent columns and the next N-K columns are linear combinations of these K columns.

I want to find the probability that a sub matrix formed by randomly selecting columns of this matrix has full rank. (or all the columns of this sub matrix are linearly independent).

My logic is as follows,

Step 1 : Select u1 number of columns randomly from the first K columns. Then rank(Gu) = u1.
No. of ways to select = K choose u1

Step 2: Now I select one column from the N-K columns and check whether this belong to the span of u1 columns. If not then I increase rank by one.
span of u1 contain 2^u1 possibilities.
So ideally I have to select 1 from 2^K - 2^u1 columns in order to have rank(Gu) = u1 + 1

But my problem is that, N-K < 2^K so the total number of columns I have to make the selection is N-K and not 2^K.

I'm finding it really difficult to interpret this in mathematical formulas using combinations.

Really appreciate if someone can help.

Thanks in advance.
 
Physics news on Phys.org
This depends on which scalar field you use. As you haven't specified it, I assume we are talking about real numbers. The distinction ##k \times n## is only for confusion. We can equally ask: How are the chances a randomly chosen ##k \times k## matrix is regular, since this is what you are looking for. This probability is ##1## as the chances to randomly choose a singular matrix are zero. Singular means the determinant is equal to zero. Now how are the chances to pick zero out of all reals?
 
There is a result that GL(V) is dense in ##\mathbb R^{n^2}## , i.e., you're given a matrix## A=(a_ij) \rightarrow ( a_{11}, a_{12},..., a_{nn})## as an ##n^2-##ple , the set ##Gl(n,\mathbb R)## is dense in ##\mathbb R^{n^2}##
 

Similar threads

  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 14 ·
Replies
14
Views
4K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 14 ·
Replies
14
Views
4K
  • · Replies 9 ·
Replies
9
Views
5K
  • · Replies 7 ·
Replies
7
Views
3K
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 8 ·
Replies
8
Views
2K