How to augment a machine learning matrix?

  • Context: Graduate 
  • Thread starter Thread starter strat468
  • Start date Start date
Click For Summary

Discussion Overview

The discussion revolves around the process of augmenting a matrix in the context of a machine learning equation involving linear algebra. Participants are exploring how to manipulate the equation to solve for the unknown variables w and b, while clarifying the mathematical operations involved.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant presents an equation and seeks guidance on augmenting w and b into a single matrix for solving.
  • Another participant suggests computing w · x + b to derive an expression involving w1, w2, and b1.
  • There is a discussion about the nature of w · x being a scalar, with some participants questioning this interpretation.
  • A participant expresses confusion about how to solve for two unknowns with only one equation and mentions the professor's advice to augment w and b.
  • One participant notes the formatting of the equation and clarifies the dimensions of the matrices involved.
  • Another participant mentions encountering issues with LaTeX formatting while trying to present their work.
  • A later reply indicates that the matrix in question may be singular, which introduces further complications in solving the problem.

Areas of Agreement / Disagreement

Participants express differing views on the interpretation of the equation and the nature of the matrices involved. There is no consensus on how to proceed with the augmentation or the implications of the matrix being singular.

Contextual Notes

Participants have noted limitations in their understanding of the problem and the mathematical operations required. There are unresolved questions about the assumptions underlying the equation and the implications of matrix singularity.

Who May Find This Useful

This discussion may be useful for individuals studying linear algebra, particularly in the context of machine learning applications, as well as those seeking to understand matrix operations and augmentation techniques.

strat468
Messages
7
Reaction score
1
TL;DR
augmenting a machine learning matrix
I have this equation which my professor has told me is correct so far.

##0 = -2*x^T(y-2(w*x+b))##

where
##x=\begin{bmatrix}
1 \\
2
\end{bmatrix}##
##y = 6##
##w =
\begin{bmatrix}
w1 & w2
\end{bmatrix}
##
##b = [b1]##

He told me to then augment w and b into one matrix in order to solve for both w and b.

How on earth do I do that?
 
Last edited:
Physics news on Phys.org
Start by computing ##w \cdot x + b## to get an expression in w1, w2 and b1 and go from there.

I'm assuming you meant to solve:

##0 = −2 \cdot x^T (y−2(w \cdot x+b)##

Also please use Latex to enter your expressions and show us your work. Our site uses Mathjax to render Latex and wew have a small guide to help you. See the link in my signature below.
 
jedishrfu said:
Start by computing ##w \cdot x + b## to get an expression in w1, w2 and b1 and go from there.

I'm assuming you meant to solve:

##0 = −2 \cdot x^T (y−2(w \cdot x+b)##

Also please use Latex to enter your expressions and show us your work. Our site uses Mathjax to render Latex and we have a small guide to help you. See the link in my signature below.
Yes! Sorry Im new, I didnt know
 
Ill check out that resource.

Im not trying to be negative but Im reading that LaTeX guide, and Im putting delimiters in and its not doing anything
 
Ok got LaTeX working! Now I just need to figure out how to augment this
 
Last edited:
  • Like
Likes   Reactions: jedishrfu
The equation in your first post is somewhat confusing. ##w \cdot x## is a scalar and so wx+b is also a scalar leading to the conclusion that ##0## must be the zero row vector [0 0] ?
 
How is ##w*x## a scalar? x is a 2x1 matrix and w is a 1x2 matrix


I changed the formatting a bit so its easier to read
 
I see what youre implying. ##w*x## would be a scalar because it ends up being a 1x1 matrix. Youre correct.

All he told me was to set my equation to 0 and then solve for w and b. I then asked him how I solve for two unknown variables with only one equation and his reply was to augment w and b into one matrix.
 
  • #10
strat468 said:
TL;DR Summary: augmenting a machine learning matrix

I have this equation which my professor has told me is correct so far.
##0 = -2*x^T(y-2(w*x+b))##

where
##x=\begin{bmatrix} 1 \\ 2 \end{bmatrix}##
##y = 6##
##w = \begin{bmatrix} w1 & w2 \end{bmatrix}##
##b = [b1]##
I'm a bit confused by this. x is defined as a 2 x 1 column vector. In the first equation, ##x^T## would therefore have to be a 1 x 2 row vector. Is this correct?

It would be useful to see the actual problem description as given by your professor.
 
  • #11
1712540919130.png


I am currently on part 3
After pestering him over and over about this he finally gave me this....
1712541102996.png


But now the problem Im running into is
1712541130314.png

is a singular matrix making
1712541180938.png

impossible
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 33 ·
2
Replies
33
Views
2K
  • · Replies 4 ·
Replies
4
Views
4K
  • · Replies 24 ·
Replies
24
Views
2K
  • · Replies 5 ·
Replies
5
Views
1K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 27 ·
Replies
27
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K