Why does separation of variables work?

Click For Summary

Discussion Overview

The discussion revolves around the method of separation of variables in solving ordinary differential equations (ODEs), particularly focusing on the underlying mechanics and notational conventions involved in the process. Participants explore the implications of manipulating differentials and the integration techniques used in this context.

Discussion Character

  • Exploratory
  • Technical explanation
  • Conceptual clarification
  • Debate/contested

Main Points Raised

  • Some participants propose that the simplification of the left-hand side of the equation involves multiplying by dx and integrating, but acknowledge that this is not rigorously justified.
  • Others argue that the simplification can be understood through the chain rule in integral form, suggesting that it is a matter of notation rather than a strict mathematical operation.
  • A participant mentions that integration by parts can be applied to derive the result, indicating that the process is more complex than simply canceling differentials.
  • Another viewpoint emphasizes the confusion caused by the informal use of differentials in introductory calculus, suggesting that this leads to misunderstandings in solving separable ODEs.
  • Some participants express appreciation for the theoretical background provided, while others question the clarity of the statements made regarding the integration process.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the best way to understand the simplification involved in separation of variables. Multiple competing views remain regarding the validity and interpretation of the manipulations of differentials and the integration techniques used.

Contextual Notes

There are limitations in the discussion regarding the rigor of the mathematical justifications provided for the manipulations of differentials and the integration process. Some participants highlight the informal nature of the notation and its implications for understanding the underlying mathematics.

Who May Find This Useful

This discussion may be useful for students and educators in mathematics and engineering who are grappling with the concepts of differential equations and the methods used to solve them, particularly those interested in the theoretical foundations of calculus.

Kaylee!
Messages
5
Reaction score
0
To solve a separable ODE like this I would simply multiply each side by dx and then integrate both sides. However, I know that it is only notational convenience that allows me to do this, and what's really going on is slightly more complicated.


Take this DE for example:

y^{2}\frac{dy}{dx}=x+1

\int{(y^{2}\frac{dy}{dx})}dx=\int{(x+1)}dx

\int{y^{2}}dy=\int{(x+1)}dx

\frac{y^{3}}{3} = \frac{x^{2}}{2} + x + c


What I don't understand, is how the LHS simplified like this:
\int{(y^{2}\frac{dy}{dx})}dx = \int{y^{2}}dy

I'm sorry for asking such a basic questions, but my book does not explain this well at all :(
 
Physics news on Phys.org
You simplify multiply the dx by the dx in the denominator of dy/dx. Of course, it's not rigorously mathematically legal but i as well have never found out why we can actually do that.
 
Kaylee! said:
To solve a separable ODE like this I would simply multiply each side by dx and then integrate both sides. However, I know that it is only notational convenience that allows me to do this, and what's really going on is slightly more complicated.


Take this DE for example:

y^{2}\frac{dy}{dx}=x+1

\int{(y^{2}\frac{dy}{dx})}dx=\int{(x+1)}dx

\int{y^{2}}dy=\int{(x+1)}dx

\frac{y^{3}}{3} = \frac{x^{2}}{2} + x + c


What I don't understand, is how the LHS simplified like this:
\int{(y^{2}\frac{dy}{dx})}dx = \int{y^{2}}dy

I'm sorry for asking such a basic questions, but my book does not explain this well at all :(

What you need to do is do an integration by parts. It is not simply canceling out the dx on the numerator and denominator, although it does give the same answer.

\int{(y^{2}\frac{dy}{dx})}dx = y^2 y - \int{2 y \frac{dy}{dx}y}dx.
\Rightarrow 3 \int{(y^{2}\frac{dy}{dx})}dx = y^3
\Rightarrow \int{(y^{2}\frac{dy}{dx})}dx = \frac{y^3}{3}
 
  • Like
Likes   Reactions: Philethan
It is simply the chain rule (in integral form). Consider f(x) = g(h(x)).
We then have f'(x) = g'(h(x))*h'(x). In Leibnitz notation, we thus have df/dx = (dg/dh)(dh/dx). By the Fundamental Theorem of Calculus, we then have
\int g'(h(x))*h'(x) = \int f'(x) = f(x) + C
In Leibnitz notation:
\int \frac{dg}{dh} \frac{dh}{dx} = f(x) + C = g(h(x)) + C
Suppressing the dependency of h on x, we get the abusive notation:
\int \frac{dg}{dh} dh = g(h) + C
It is common for physics and engineering oriented texts to gloss over this and rely on an often undefined algebra of differentials.
 
Last edited:
Kaylee! said:
To solve a separable ODE like this I would simply multiply each side by dx and then integrate both sides. However, I know that it is only notational convenience that allows me to do this, and what's really going on is slightly more complicated.

It seems that most of calculus and DE is based on some amazing notational conveniences which magically work. The underlying mechanics is a little more annoying.

If you restate the problem, what you really have is an equation of an unknown function of x called y. Your goal is to figure out what values y can take on to make the equation true for ALL real x.

y^2(x) y'(x) = x + 1

Both sides of this equation are a function of x, so we can take the anti-derivative of both sides. The right is easy, \int(x + 1)dx = \frac{1}{2} x^2 + x.

The other side is a pain: \int y^2(x) y'(x) dx. Use integration by parts, you can prove \int y^2(x) y'(x) dx = y(x)^3 - \int y(x)^2 y'(x) dx, and moving over the common expression to one side, and dividing by the 3, you get \int y^2(x) y'(x) dx = \frac{1}{3} y(x)^3.

So our equation is now \frac{1}{3} y^3(x) = \frac{1}{2} x^2 + x

All these steps are legal, so the final equation there is a true statement, but it's not the answer to the question asked. This is a SINGLE solution to the DE. To arrive at the family of solutions, we recognize that one of our steps (the anti-derivative) is not one-to-one, and with a little informal rationalization, you can also see where the hell the stupid constant of integration comes in. If you really wanted to formalize away the constant as well, you can think of the result of an anti-derivative as a set-valued operation instead of a function-valued one.

And that's how we can reduce separable ODE to first-year calculus =-) How the hell the notation works is nothing short of miraculous. Infinitesimal "dx's" are not how it works under the hood. What the hell is a "dx" anyway? It's not quite a number. Not quite a function. It's not well-typed. Infinitesimal calculus is amazing at explaining derivation (dividing by one zero is easy) but it sucks at integration (summing an infinite number of zeroes is hard!)

I'm sorry for asking such a basic questions, but my book does not explain this well at all :(
Too many people do this kind of math without really understanding how it really works, so it's good to ask such things ;-)
 
  • Like
Likes   Reactions: Philethan
There is no need to integrate by parts. As slider142 pointed out, is simply the chain rule. Suppose you have the separable differential equation

f\bigl(y(x)\bigr)y'(x) = g(x),

Let F(\eta) be the primitive of f(\eta). Then, by the chain rule

\frac{d}{d x} F\bigl(y(x)\bigr)=f\bigl(y(x)\bigr)y'(x),

now, integrating both sides of the separable ode,

\int_{x_0}^x f\bigl(y(\xi)\bigr)y'(\xi)dx = \int_{x_0}^x \frac{d}{d\xi} F\bigl(y(\xi)\bigr)d\ix = F\bigl(y(x)\bigr)- F\bigl(y(x_0)\bigr),

so

F\bigl(y(x)\bigr) = F\bigl(y(x_0)\bigr) + \int_{x_0}^x g(\xi) d\xi,

which is the solution of the ode in implicit form.
 
This is one reason why I hate the way that many introductions to calculus encourage sloppy interpretations of the symbols dx and dy and so forth. It leads to much confusion when one tries to actually prove the change of variables theorem; it leads to confusion in solving separable ODEs; and it leads to confusion if one still hasn't figured it out by the time one studies calculus on manifolds.

In my opinion, which may be somewhat rare, the differential symbols dx and so on should simply not be used ever in introductory calculus and differential equations except to form the symbol d/dx for derivatives. The reason is simply that this would avoid many sources of confusion, such as the one that prompted this thread, and it would make the transition to calculus on manifolds less annoying, which is often the first time that these symbols are given actual meanings.

In the case of separable first-order ODEs, the general first-order equation is

<br /> \frac{dy}{dx} = f(x,y)<br />

Any such equation can be rewritten in the form

<br /> M(x,y) + N(x,y) \frac{dy}{dx} = 0<br />

Choose, for example, M = -f(x,y) and N = 1. However, if M and N turn out to be functions of only x and y, respectively, then we obtain

<br /> M(x) + N(y)\frac{dy}{dx} = 0<br />

Now suppose that A and B are any antiderivatives of M and N. Then the equation is

<br /> A&#039;(x) + B&#039;(y) \frac{dy}{dx} = 0<br />

By the chain rule,

<br /> B&#039;(y) \frac{dy}{dx} = \frac{d}{dx} B(y)<br />

Thus, the equation can be written as

<br /> \frac{d}{dx} (A(x) + B(y)) = 0<br />

Integrating yields the implicit solution

<br /> A(x) + B(y) = c<br />
 
Last edited:
  • Like
Likes   Reactions: Philethan and davidbenari
thanks a lot for the description of the theory behind the method of separable ODE's zpconn, much appreciated.
 
  • Like
Likes   Reactions: Philethan
Kaylee! said:
To solve a separable ODE like this I would simply multiply each side by dx and then integrate both sides. However, I know that it is only notational convenience that allows me to do this, and what's really going on is slightly more complicated.


Take this DE for example:

y^{2}\frac{dy}{dx}=x+1

\int{(y^{2}\frac{dy}{dx})}dx=\int{(x+1)}dx

\int{y^{2}}dy=\int{(x+1)}dx

\frac{y^{3}}{3} = \frac{x^{2}}{2} + x + c


What I don't understand, is how the LHS simplified like this:
\int{(y^{2}\frac{dy}{dx})}dx = \int{y^{2}}dy

I'm sorry for asking such a basic questions, but my book does not explain this well at all :(

I don't understand why it is so difficult to understand the statement.
\int{y^{2}}dy=\int{(x+1)}dx

Is the statement incorrect? Attempt to elaborate it further makes life more difficult.
 
  • #10
matematikawan said:
I don't understand why it is so difficult to understand the statement.
\int{y^{2}}dy=\int{(x+1)}dx

Is the statement incorrect? Attempt to elaborate it further makes life more difficult.

Is not exactly incorrect, but is an abuse of notation (as we say in my country).
 
  • #11
AiRAVATA said:
Is not exactly incorrect, but is an abuse of notation (as we say in my country).

Um, which country would that be? (just curious . . . I know, I know, curiosity killed the cat :> *bites tongue*)
I think in my country they say something like that too :P
 
  • #12
Well, as y = y(x), then

dy = \frac{dy}{dx} dx,

so

<br /> \int y^2 dy=\int y^2(x) y&#039;(x) dx = \int \frac{d}{dx} \left(\frac{y^3(x)}{3}\right) dx = \frac{y^3(x)}{3} + C<br />
 
  • #13
Oh it is the abuse of notation. Did you meant

y2 dy = (x+1) dx ?

I hate Machiavellian ( you know The End Justifies The Means). But I think I can tolerate this one. It is not a sin to be hypocrite in mathematics. :approve:
 
  • #14
Thats right, because if you don't specify what are x and y, then that equality is ambiguous (in the context of the ode you want to solve).

P.S. You can also see separation of variables as an example of the implicit function theorem.
 

Similar threads

Replies
2
Views
2K
  • · Replies 16 ·
Replies
16
Views
4K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 3 ·
Replies
3
Views
4K
  • · Replies 10 ·
Replies
10
Views
2K
Replies
4
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 3 ·
Replies
3
Views
1K