# Linear dependence of vectors

1. Aug 28, 2014

### "Don't panic!"

Hi all,

I was asked by someone today to explain the notion of linear independence of a set of vectors and I would just like to check that I explained it correctly.

A set of vectors $S$ is said to be linearly dependent if there exists distinct vectors $\mathbf{v}_{1}, \ldots , \mathbf{v}_{m}$ in $S$ and scalars $c_{1},\ldots c_{m}$, not all of which are zero, such that $$c_{1}\mathbf{v}_{1} + \cdots + c_{m}\mathbf{v}_{m} = \sum_{i=1}^{m} c_{i}\mathbf{v}_{i} = \mathbf{0}$$

What this means is that at least one vector in $S$ can be completely specified in terms of the other vectors in the set and hence it is dependent on the particular form of those vectors. However, if the only case for which $\sum_{i=1}^{m} c_{i}\mathbf{v}_{i} = \mathbf{0}$ is the trivial case, in which $c_{i} = 0 \; \forall \; i=1, \ldots , m$, then the set is said to be linearly independent, as none of the vectors contained within it can be specified in terms of the other vectors in $S$.

Is this a valid description of the concept?

2. Aug 28, 2014

### mathman

Minor quibble. Usually $S=(\mathbf{v}_{1}, \ldots , \mathbf{v}_{m})$

3. Aug 28, 2014

### micromass

Staff Emeritus
Yes, I think that is a very good way of describing it.

4. Aug 28, 2014

### Fredrik

Staff Emeritus
Edit: Never mind, I read the OP wrong.

Last edited: Aug 28, 2014
5. Aug 28, 2014

### WWGD

Do you mean the basis is ordered?

6. Aug 28, 2014

### micromass

Staff Emeritus
I don't see how this is correct. For example, $S$ can be infinite and then your correction doesn't apply. The definition in the OP is entirely correct.

7. Aug 28, 2014

### "Don't panic!"

Thanks for your help on the matter guys, much appreciated.

8. Aug 28, 2014

### "Don't panic!"

Also, in addition is this reasoning correct for proving that the representation of a given vector $\mathbf{v}$ in a vector space $V$, with respect to a given basis $\mathcal{B}=\lbrace \mathbf{e}_{i} \rbrace_{i=1, \ldots , n}$, is unique? :

Let $V$ be an $n$-dimensional vector space and $\mathcal{B}=\lbrace \mathbf{e}_{i} \rbrace_{i=1, \ldots , n}$ be a given basis for $V$. Suppose that a given vector $\mathbf{v} \in V$ can be represented in terms of the basis $\mathcal{B}$ as two linear combinations $\sum_{i=1}^{n}a_{i} \mathbf{e}_{i}$ and $\sum_{i=1}^{n}b_{i} \mathbf{e}_{i}$. Then, $$\sum_{i=1}^{n}a_{i} \mathbf{e}_{i} = \sum_{i=1}^{n}b_{i} \mathbf{e}_{i}$$ such that $$\sum_{i=1}^{n} \left( a_{i}-b_{i} \right) \mathbf{e}_{i} = \mathbf{0}$$ As the vectors $\lbrace \mathbf{e}_{i} \rbrace_{i=1, \ldots , n}$ form a basis they are, by definition, linearly independent. Hence, this implies that $a_{i} = b_{i} \; \forall \; i= 1, \ldots n$. The coefficients $a_{i}$ and $b_{i}$ must satisfy the condition that their linear combination (along with the basis vectors) describe the vector $\mathbf{v}$, but are otherwise arbitrary, and hence we must conclude that in fact there is only one, unique, set of scalars $\lbrace a_{i} \rbrace$ that satisfy $\mathbf{v} = \sum_{i=1}^{n}a_{i} \mathbf{e}_{i}$.

9. Aug 28, 2014

### Fredrik

Staff Emeritus
Yes, that proof is fine.

If you had been using a definition of "basis" that doesn't make it clear that every basis is a linearly independent set, you would also have had to prove linear independence.

10. Aug 28, 2014

### "Don't panic!"

Thanks. Is the argument I gave at the end about why $a_{i} =b_{i}$ for arbitrary scalars $a_{i}, b_{i}$, satisfying the required properties, requires that there is actually only one set of scalars?

11. Aug 28, 2014

### Fredrik

Staff Emeritus
Yes, this is the standard way to prove uniqueness. If you know that x has property P, and you want to prove that nothing else does, you show that for all y with property P, we have y=x.

12. Aug 28, 2014

### "Don't panic!"

Ok, cool. Thanks for your help.

13. Aug 29, 2014

### mathman

The statement talks about one particular set of vectors. In the case S is infinite, the statement would have to say for every finite set of basis vectors.
-------------------------------------------------------------------

No. I just meant S was the given set. In general, when talking about vector spaces, ordering is not relevant.

14. Aug 29, 2014

### micromass

Staff Emeritus
The OP never even mentioned basis vectors

15. Aug 30, 2014

### mathman

You are right. However his question was about a particular (finite) set of vectors, which was the question I was addressing.

16. Aug 30, 2014

### WWGD

-------------------------------------------------------------------

No. I just meant S was the given set. In general, when talking about vector spaces, ordering is not relevant.[/QUOTE]

You're right for f.d case, or for Hamel bases, where sums are finite, which is the case here. I know this is absurdly far-off for this post, but for the sake of a broader context , order does matter for Schauder bases, where convergence is conditional. And order matters when defining an iso. between linear maps and their representation as matrices.