Linear system of exponential equations

In summary, Ray Vickson suggests solving for p and q separately, and then combining them using the last equation.
  • #1
tjackson3
150
0

Homework Statement



Consider the system of equations

[tex]
\begin{eqnarray*}
e_1 &=& Ak^p + Bh^q \\
e_2 &=& A(k/2)^p + Bh^q \\
e_3 &=& Ak^p + B(h/2)^q \\
e_4 &=& A(k/2)^p + B(h/2)^q
\end{eqnarray*}
[/tex]

Suppose that the [itex]e_i[/itex] are known, as well as k and h. Find A, B, p, and q.

Homework Equations



It's worth noting that a simpler case of this is

[tex]
\begin{eqnarray*}
e_1&=& Ak^p \\
e_2 &=& A(k/2)^p
\end{eqnarray*}[/tex]

Then to get the solution, you divide [itex]e_1/e_2 = 2^p[/itex], allowing you to solve for p.

The Attempt at a Solution



I've tried a bunch of different combinations of the [itex]e_i[/itex]'s, but I always seem to have something like [itex]Ak^p(1-1/2^p)[/itex] attached to each other, preventing me from solving for one. For example,

[tex]
\begin{eqnarray*}
e_1-e_2 &=&Ak^p(1-1/2^p) \\
&=&e_3-e_4 \\
e_2-e_4 & = & Bh^q(1-1/2^q) \\
&=&e_1-e_3 \\
(e_1-e_2)(e_2-e_4)&=& Ak^pBh^q(1-1/2^p)(1-1/2^q) \\
p &=& \log_2\frac{e_1-Bh^q}{e_2-Bh^q}
\end{eqnarray*}
[/tex]

So I basically keep getting expressions that are useless, since you can't really solve for one in terms of the others. Does anyone have any ideas or experience with this sort of thing? Thanks in advance!
 
Physics news on Phys.org
  • #2
Absent some magical combination of known values of k and h, iteration is one way to obtain a solution. Another might be use of Newton-Raphson.
 
  • #3
Hi tjackson3! :smile:

The generic method is to pick an equation, and isolate one of the variables.
Then you substitute that in the other equations.
And repeat.

Each time you will have one equation less and one variable less, since that will have been eliminated.For instance, in your example:
\begin{eqnarray*}
e_1&=& Ak^p \\
e_2 &=& A(k/2)^p
\end{eqnarray*}

Rewrite the first equation to [itex]A=e_1 k^{-p}[/itex] and substitute in the second:
[itex]e_2 = (e_1 k^{-p})(k/2)^p[/itex]
[itex]e_2 = e_1 2^{-p}[/itex]
This leaves you with 1 equation and 1 unknown (p).
After you have solved it, you go back and calculate A.
 
  • #4
Prof. Forman Acton of Princeton, in the "What Not To Compute" section of his book "Numerical Methods That Work" writes concerning the equation,

[tex]
\begin{eqnarray*}
e_1 &=& Ak^p + Bh^q \\

\end{eqnarray*}
[/tex]
"Unfortunately there is a companion problem [it's the one you just described] that looks only slightly more complicated -- until you try it! We again have several readings from a radioactive sample, but the decaying materials are not known, hence the decay rates p and q must also be fitted. The answer to this problem lies in the chemical rather than the computer laboratory, and the sooner the hopeful innocent can be sent there and away from the computer room, the better off everyone will be. For it is well known that an exponential equation of this type in which all four parameters are to be fitted is extremely ill conditioned. That is, there are many combinations of (p, q, A, B) that will fit most exact data quite well indeed (will you believe four significant figures?) and when experimental noise is thrown into the pot, the entire operation becomes hopeless."

A word to the wise: You can certainly solve the system, but be very, very cautious about drawing any conclusions from your solutions. It would be a good idea to run a series of numerical experiments varying the e's slightly in order to get a handle on the sensitivity of the system.
 
  • #5
Set x1=Ak^p, x2=Bh^q, x3=A(k/2)^p and x4 = B(h/2)^q. Solve for x1,...,x4. Now your problem reduces to one you have already solved.

RGV
 
Last edited:
  • #6
SteamKing: Unfortunately, I need to find an analytic solution to this.

I Like Serena: Hi! :) The problem I run into there is the fact that there are two exponents, which makes solving for the last one difficult. Here's what I did. I started off by solving for A: [itex]A = (e_1-Bh^q)k^{-p},[/itex] using the first equation. Then I used the second equation to get

[tex]B = \frac{(e_1-e_3)h^{-q}}{1-1/2^q}[/tex]

Then using the fourth equation, I get

[tex]p = -\log_2\left[\left(1-1/2^q)\frac{e_4-e_1}{e_1-e_3}-\frac{1}{2^q}\right][/tex]

But then I have no clue about now to get q from that.

obafgkmrns: That's a very interesting quote, and it's something that has been brought up in my numerical PDE class. Of course, that was right after he asked us to solve it for homework, so take what you will from that. As an aside, that seems like a very interesting book.

Ray Vickson: I just tried that, but that linear system doesn't have a solution.
 
  • #7
tjackson3 said:
I Like Serena: Hi! :) The problem I run into there is the fact that there are two exponents, which makes solving for the last one difficult. Here's what I did. I started off by solving for A: [itex]A = (e_1-Bh^q)k^{-p},[/itex] using the first equation. Then I used the second equation to get

[tex]B = \frac{(e_1-e_3)h^{-q}}{1-1/2^q}[/tex]

Then using the fourth equation, I get

[tex]p = -\log_2\left[(1-1/2^q)\frac{e_4-e_1}{e_1-e_3}-\frac{1}{2^q}\right][/tex]

But then I have no clue about now to get q from that.

Uhh... :uhh: You're supposed to have 2 equations left, each with p and q.
Isolate p, what you apparently did, and substitute in the last equation.
Btw, I recommend solving for u=2-p and v=2-q instead. It's easier on the powers and logs.
It also helps to introduce extra constants for complex sub-expressions to keep things manageable.
 
  • #8
That was the best tip. I am concerned because I never really used the fourth equation except in passing, but I'm less worried than I might be because I know all of the e's are related by the equations I posted in the OP. So please tell me if this sounds right. I started off solving for A in the same way as I did previously. For B, I used equation 2 to get that

[tex]B = \frac{(e_2-e_1u)h^{-q}}{1-u}[/tex]

However, I also figured out last time that we also had

[tex]B = \frac{(e_1-e_3)h^{-q}}{1-u}[/tex]

Setting these equal to each other, I get that

[tex]u = \frac{e_2+e_3-e_1}{e_1}[/tex]

In terms of this, then,

[tex]
\begin{eqnarray*}
A & = & (e_1 - x)k^{-p} \\
B & = & xh^{-q} \\
x & = & \frac{e_1-e_3}{e_1-e_4}
\end{eqnarray*}
[/tex]

x was originally [itex](e_1-e_3)/(2e_1-e_2-e_3)[/itex], but I used the relations in the OP to clean up slightly. Now using the third equation,

[tex]e_3 = (e_1-x) + xv \Rightarrow v = \frac{e_3-e_1+x}{x}[/tex]

So now I have an expression for the unknowns (A,B,q,p,u,v) in terms of the e's. Does all that seem right? I'm still worried about not using equation 4 or making any sort of reference to k and h in the final solution, but maybe that's supposed to be right. This equation refers to the error in a numerical method for solving a PDE, where k is the space step and h is the time step.
 
  • #9
I didn't check your calculations.
But it's not possible to solve all 4 unknowns without using all 4 equations.

You did pluck an equation out of the air without any reference to how you got it...
Is there any chance you made a mistake?

Btw, your final solution (at least for A and B) should contain h and k.
 
  • #10
Which equation are you referring to? Also, the only reason I think it might be possible to solve this system without using all three equations is that they're not linearly independent (for example, the fourth equation is [itex]e_2 + e_3 - e_1[/itex])

edit: Haha also I just noticed that A and B do have h and k. Silly me. Sorry about that
 
  • #11
tjackson3 said:
Which equation are you referring to? Also, the only reason I think it might be possible to solve this system without using all three equations is that they're not linearly independent (for example, the fourth equation is [itex]e_2 + e_3 - e_1[/itex])

edit: Haha also I just noticed that A and B do have h and k. Silly me. Sorry about that

You have 2 different equations for B that are both apparently derived from equation 2.
That does not seem right.

Btw, if the equations would be linearly dependent, you can not solve it at all.
That is, then there won't be a unique solution.
 
  • #12
I am starting to wonder about the second one. It makes reference to [itex]e_3[/itex], but I apparently derived it from the second equation. I'll rework that.

Is that true for equations with nonlinear terms though? I know it's true for typical linear equations, but this seems to be sort of a mix. It is linearly dependent, though.
 
  • #13
Ah, I see what you mean about dependent.
That is why you didn't follow RGV's suggestion.
But then I don't think you can solve the set of equations.
I think you'll find that if you do the final substitution in the 4th equation, that the equation disappears and leaves something like 0=0.
 
  • #14
tjackson3 said:
SteamKing: Unfortunately, I need to find an analytic solution to this.

I Like Serena: Hi! :) The problem I run into there is the fact that there are two exponents, which makes solving for the last one difficult. Here's what I did. I started off by solving for A: [itex]A = (e_1-Bh^q)k^{-p},[/itex] using the first equation. Then I used the second equation to get

[tex]B = \frac{(e_1-e_3)h^{-q}}{1-1/2^q}[/tex]

Then using the fourth equation, I get

[tex]p = -\log_2\left[\left(1-1/2^q)\frac{e_4-e_1}{e_1-e_3}-\frac{1}{2^q}\right][/tex]

But then I have no clue about now to get q from that.

obafgkmrns: That's a very interesting quote, and it's something that has been brought up in my numerical PDE class. Of course, that was right after he asked us to solve it for homework, so take what you will from that. As an aside, that seems like a very interesting book.

Ray Vickson: I just tried that, but that linear system doesn't have a solution.

Well, in that case the original system does not have a solution, either! That fact suggests you seek a "best fit" solution, of least-squares or least-absolute deviation type.

RGV
 
  • #15
Serena: Alright, I see where the second equation for B came from. It came from the fact that [itex]e_2 - e_4 = Bh^q(1-u) \Rightarrow (e_2-e_4)h^{-q}/(1-u) = e_1 - e_3[/itex].

Ray: I thought that might be the case too, but we are seeking exact, analytical solutions to this.
 
  • #16
tjackson3 said:
Serena: Alright, I see where the second equation for B came from. It came from the fact that [itex]e_2 - e_4 = Bh^q(1-u) \Rightarrow (e_2-e_4)h^{-q}/(1-u) = e_1 - e_3[/itex].

Ray: I thought that might be the case too, but we are seeking exact, analytical solutions to this.

If e1+e4=e2+e3 there are solutions (not unique): x1 = e3-x4, x2 = e1-e3+x4, x3 = e2+e3-e1-x4, so everything can be done in terms of x4, considered as a freely-chosen parameter. These are the solutions of the first three equations for x1,x2,x3 as functions of x4. (The 4th equation also holds if e1+e4=e2+e3.)

So, if the ei-condition above holds, we can choose x4 to be anything convenient, and then get analytical solutions for A, B, p and q. If the ei-condition fails, there is NO solution, whether analytical or otherwise.

RGV
 
  • #17
Hmm... that's not good. And yet I can't figure out any way for this problem to give good, unique solutions
 
  • #18
Actually A and B shouldn't depend on k or h
 
  • #19
I can change the fourth equation to make it anything of the form

[tex]e_4 = A(\alpha h)^p + B(\beta k)^q[/tex]

Is there any choice of [itex]\alpha,\beta[/itex] that would help do you think?
 

1. What is a linear system of exponential equations?

A linear system of exponential equations is a set of equations where one or more of the variables are raised to a power. These equations can be solved simultaneously to find the values of the variables that satisfy all of the equations.

2. How do you solve a linear system of exponential equations?

To solve a linear system of exponential equations, you can use the substitution method or the elimination method. In the substitution method, you solve for one variable in one equation and then substitute that value into the other equations. In the elimination method, you manipulate the equations to eliminate one variable and then solve for the remaining variable.

3. Can a linear system of exponential equations have more than one solution?

Yes, a linear system of exponential equations can have one solution, no solution, or infinitely many solutions. It depends on the specific equations and how they are related to each other.

4. Why are linear systems of exponential equations important?

Linear systems of exponential equations are important in many fields of science and engineering, including physics, chemistry, and economics. They are used to model real-world situations and can help predict outcomes and make decisions.

5. What are some real-life applications of linear systems of exponential equations?

Linear systems of exponential equations are commonly used in finance to calculate compound interest and growth rates. They are also used in population growth models, radioactive decay, and chemical reactions. Additionally, they are used in engineering to design systems that involve exponential growth or decay, such as in electronics or environmental systems.

Similar threads

  • Calculus and Beyond Homework Help
Replies
14
Views
1K
Replies
4
Views
978
  • Quantum Physics
Replies
1
Views
739
  • Calculus and Beyond Homework Help
Replies
0
Views
69
  • Calculus and Beyond Homework Help
Replies
3
Views
783
  • Calculus and Beyond Homework Help
Replies
13
Views
1K
  • Calculus and Beyond Homework Help
Replies
6
Views
195
  • Calculus and Beyond Homework Help
Replies
1
Views
888
  • Advanced Physics Homework Help
Replies
3
Views
999
  • Calculus and Beyond Homework Help
Replies
1
Views
1K
Back
Top