Find the Inverse of a Vector: Solve for x in Terms of b

  • Context: MHB 
  • Thread starter Thread starter OhMyMarkov
  • Start date Start date
  • Tags Tags
    Inverse Vector
Click For Summary
SUMMARY

The discussion focuses on solving the equation $\sum _{j=1} ^K (x_j - b_j) = 0$, which simplifies to $e^T x = e^T b$. The original problem involves minimizing the function $T(x) = ||y - Ax||^2 + ||x - b||^2$, where $y = Ax$ is overdetermined. The user seeks a closed-form solution for the second norm, having already derived the first norm's solution through differentiation and setting it to zero. The challenge lies in finding the explicit expression for $x$ in terms of $b$.

PREREQUISITES
  • Understanding of linear algebra concepts, particularly vector norms.
  • Familiarity with optimization techniques, specifically least squares methods.
  • Knowledge of matrix operations and properties of overdetermined systems.
  • Proficiency in calculus, particularly differentiation of functions.
NEXT STEPS
  • Research closed-form solutions for linear least squares problems.
  • Explore differentiation techniques for vector-valued functions.
  • Study the properties of overdetermined systems in linear algebra.
  • Learn about the implications of vector norms in optimization problems.
USEFUL FOR

Mathematicians, data scientists, and engineers involved in optimization problems, particularly those working with linear systems and seeking to minimize vector norms.

OhMyMarkov
Messages
81
Reaction score
0
Hello Everyone!

I've been trying to solve an equation and got to this place: $\sum _{j=1} ^K (x_j - b_j) = 0$ which gives $e^T x = e^T b$. Now I need to solve for $x$ i.e. find $x$ in terms of the b. How can I do that?

Thank you for the help!
 
Physics news on Phys.org
OhMyMarkov said:
Hello Everyone!

I've been trying to solve an equation and got to this place: $\sum _{j=1} ^K (x_j - b_j) = 0$ which gives $e^T x = e^T b$. Now I need to solve for $x$ i.e. find $x$ in terms of the b. How can I do that?

Thank you for the help!

Can we have some more context, or perhaps the original problem?

CB
 
Definitely,

The original problem is to find the minimum of the following function: $T(x) = ||y-Ax||^2 + ||x-b||^2$ where the system y = Ax is overdetermined. Of course we already know the closed form solution of the first norm (linear least squares). My question was regarding the second norm. What I want to do is to try to find a closed form solution for the minimum of the second norm, and add the two solutions up. What I did was, similar to the approach of finding the linear least squares solution, differentiate the second norm with respect to $x_j$s and set to zero. I got what is there in my first post, and now I'm stuck there.

Thank you.
 

Similar threads

  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 0 ·
Replies
0
Views
995
  • · Replies 26 ·
Replies
26
Views
1K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 23 ·
Replies
23
Views
2K
  • · Replies 4 ·
Replies
4
Views
4K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K