Understanding the Chain Rule Proof: Explained with Examples

[Дьявол]

Hello! I got one question for you.

How come that (f \circ g)'(x) = f'(g(x)) g'(x) ?

Since (f \circ g)'(x)=f(g(x))' , f'(g(x))=f'(g(x)) g'(x). And now we can rewrite the equation like 1=g'(x)

I don't understand that part.

Also I don't understand why the flawed proof of the chain rule is incorrect?

y'=\lim_{dx \rightarrow 0}\frac {dy}{dx} = \lim_{dx \rightarrow 0}\frac {dy} {du} \cdot\frac {du}{dx}=\lim_{du \rightarrow 0}\frac {dy}{du} \cdot \lim_{dx \rightarrow 0}\frac {du}{dx}=f'(u)\cdot u'(x)

Thanks in advance.

Regards.

 

[CompuChip]

Hello!

Hi Dyawol.

How come that (f \circ g)'(x) = f'(g(x)) g'(x) ?

That's precisely what the chain rule says, I will prove it below for you.

Since (f \circ g)'(x)=f(g(x))' , f'(g(x))=f'(g(x)) g'(x). And now we can rewrite the equation like 1=g'(x)

I don't understand that part.

I don't really understand either... what are you trying to do here? Your notation is confusing you, the f'(g(x)) on the left hand side is not the same as that on the right hand side...

Also I don't understand why the flawed proof of the chain rule is incorrect?

y'=\lim_{dx \rightarrow 0}\frac {dy}{dx} = \lim_{dx \rightarrow 0}\frac {dy} {du} \cdot\frac {du}{dx}=\lim_{du \rightarrow 0}\frac {dy}{du} \cdot \lim_{dx \rightarrow 0}\frac {du}{dx}=f'(u)\cdot u'(x)

Thanks in advance.

Regards.

Well actually it gives the correct formula (y' = f'(u) u'(x)) assuming y(x) = f(u(x)), although what is written down is nonsense.
y' = \frac{dy}{dx} = \frac{dy}{du} \frac{du}{dx}
is correct but I don't see what the limits are doing there, and actually it is just another way of writing f'(u) u'(x); so there is no proof here, you are just stating the chain rule.

Perhaps it is helpful to first consider an example of how the chain rule works. Suppose you have
f(x) = (3x^2 + 6x - 9)^2
and you are asked for f'(x).
Then you note that you don't know how to do this derivative (after going through your familiar list of derivatives of elementary functions, product rule and quotient rule) but that it looks a lot like a quadratic function. If you set u = u(x) = 3x^2 + 6x - 9 then you can simply write f(x) = f(u(x)) = u(x)^2, which we usually in a slight shorthand / notational abuse write as f(u(x)) = u^2 or f(x) = u^2 (which is slightly confusing perhaps, because it is not clear that there is still an x involved). Now this we know how to differentiate: the derivative of u^2 is just 2 u. So we would write
\frac{df}{du} = 2u
to indicate that if u were the variable we were interested in, the derivative of f would be 2u. But we don't want df/du, we want df/dx. The chain rule tells us, that what we wanted to calculate, df/dx, is given by
\frac{df}{dx} = \frac{df}{du} \cdot \frac{du}{dx},
i.e. we still have to multiply 2u by the derivative of u with x as the variable. Recalling that u was 3x^2 + 6x - 9, we can apply our standard repertoire of derivation tricks and get
\frac{du}{dx} = 6 x + 6

So, putting it all together, the answer we wanted it
f'(x) = \frac{df}{dx} = \frac{df}{du} \frac{du}{dx} = (2u) \cdot (6x + 6)
where we now have to write u back in terms of x:
f'(x) = (3x^2 + 6x - 9) \cdot (6x + 6)
which you could simplify to
f'(x) = 18(x^2 + 2x - 3)(x + 6).

Do you understand now the derivations with respect to x and u, and the notation
\frac{df}{du} \text{ and } \frac{df}{dx}?
Then you have to get used to the "mathematical" shorthand, where we usually write f'(x) if we mean df/du, u'(x) for du/dx; we can make up notations like f'(u) for df/du but I urge you to use the d.../d... notation, because f'(u(x)) is very ambiguous (this is what was confusing you in the first post: does the prime in f'(u(x)) indicate derivation with respect to u or x? That is, do you mean df/dx or df/du here?)

 

[Fredrik]

f'(u(x)) is very ambiguous (this is what was confusing you in the first post: does the prime in f'(u(x)) indicate derivation with respect to u or x? That is, do you mean df/dx or df/du here?)

I disagree with this. f'(u(x)) can only mean df/du, since the prime is on f. If you differentiate with respect to x, the function you're taking the derivative of isn't f. It's f\circ u, so you must write (f\circ u)'(x) (or \frac{d}{dx}f(u(x)) )

 

[Дьявол]

Hi Dyawol.


That's precisely what the chain rule says, I will prove it below for you.


I don't really understand either... what are you trying to do here? Your notation is confusing you, the f'(g(x)) on the left hand side is not the same as that on the right hand side...


Well actually it gives the correct formula (y' = f'(u) u'(x)) assuming y(x) = f(u(x)), although what is written down is nonsense.
y' = \frac{dy}{dx} = \frac{dy}{du} \frac{du}{dx}
is correct but I don't see what the limits are doing there, and actually it is just another way of writing f'(u) u'(x); so there is no proof here, you are just stating the chain rule.

Perhaps it is helpful to first consider an example of how the chain rule works. Suppose you have
f(x) = (3x^2 + 6x - 9)^2
and you are asked for f'(x).
Then you note that you don't know how to do this derivative (after going through your familiar list of derivatives of elementary functions, product rule and quotient rule) but that it looks a lot like a quadratic function. If you set u = u(x) = 3x^2 + 6x - 9 then you can simply write f(x) = f(u(x)) = u(x)^2, which we usually in a slight shorthand / notational abuse write as f(u(x)) = u^2 or f(x) = u^2 (which is slightly confusing perhaps, because it is not clear that there is still an x involved). Now this we know how to differentiate: the derivative of u^2 is just 2 u. So we would write
\frac{df}{du} = 2u
to indicate that if u were the variable we were interested in, the derivative of f would be 2u. But we don't want df/du, we want df/dx. The chain rule tells us, that what we wanted to calculate, df/dx, is given by
\frac{df}{dx} = \frac{df}{du} \cdot \frac{du}{dx},
i.e. we still have to multiply 2u by the derivative of u with x as the variable. Recalling that u was 3x^2 + 6x - 9, we can apply our standard repertoire of derivation tricks and get
\frac{du}{dx} = 6 x + 6

So, putting it all together, the answer we wanted it
f'(x) = \frac{df}{dx} = \frac{df}{du} \frac{du}{dx} = (2u) \cdot (6x + 6)
where we now have to write u back in terms of x:
f'(x) = (3x^2 + 6x - 9) \cdot (6x + 6)
which you could simplify to
f'(x) = 18(x^2 + 2x - 3)(x + 6).

Do you understand now the derivations with respect to x and u, and the notation
\frac{df}{du} \text{ and } \frac{df}{dx}?
Then you have to get used to the "mathematical" shorthand, where we usually write f'(x) if we mean df/du, u'(x) for du/dx; we can make up notations like f'(u) for df/du but I urge you to use the d.../d... notation, because f'(u(x)) is very ambiguous (this is what was confusing you in the first post: does the prime in f'(u(x)) indicate derivation with respect to u or x? That is, do you mean df/dx or df/du here?)

Thank you very much for the help CompuChip. It really helped me understand what it mean.

But I didn't understand one thing (the notation one), since f o g (x) = f(g(x))
So (f o g) ' (x) would probably mean f(g(x))'. Am I right?

< where we usually write f'(x) if we mean df/du

I think that you thought about f'(x)=df/dx

Also I think that you missed to multiply by 2, since there is 2u. So it would be f&#039;(x) = 36(x^2 + 2x - 3)(x + 6)

Thanks again for the help.

Regards.

 

[NoMoreExams]

Why do you have x + 6, if anything it should be x + 1 if you are taking the 6 out.

 

[Fredrik]

But I didn't understand one thing (the notation one), since f o g (x) = f(g(x))
So (f o g) ' (x) would probably mean f(g(x))'. Am I right?

You're right, assuming that what you mean by f(g(x))' is the value at x of the derivative of the function that takes any number y in the domain of g to f(g(y)). But you should never write f(g(x))'. The prime symbol should only appear on a function, and f(g(x)) is not a function. It's a number. The function that you have in mind can be written as x\mapsto f(g(x)) or f\circ g.

The derivative of that function can be written as (f\circ g)&#039;(x) or \frac{d}{dx}f(g(x)). Note that the dx in the denominator tells us that the function we're taking the derivative of is f\circ g. If we had been interested in the derivative of f at the point g(x), we would have written it as f&#039;(g(x)) or \frac{d}{dg}f(g(x)).

 

[Vid]

The real proof of the chain rule requires a bit more than canceling differentials.

http://en.wikipedia.org/wiki/Chain_rule#Proof_of_the_chain_rule
This is the basic proof that is taught in undergrad analysis.

 

[Fredrik]

See also #4 and the beginning of #3 in this thread for more about differentials.

 

[MathematicalPhysicist]

I don't see what's the problem here:
f(g(x))'=df/dx=(df/dg)(dg/dx)

The way you prove it is by looking at [f(g(x+h))-f(g(x))/(g(x+h)-g(x))][(g(x+h)-g(x))/h], where h->0.

 

[Fredrik]

I'm not sure if you're talking to me or the OP, but the issue in this thread isn't just how to prove it, but to understand why you can't prove it just by canceling differentials in the expression

\frac{df}{dx}=\frac{df}{dg}\frac{dg}{dx}

 

[shaggymoods]

You can't just cancel differentials because dg may in fact be 0, in which case the above is nonsensical. Thus the use of differentials is only a heuristic, not a proof.

 

[dimension10]

You can't just cancel differentials because dg may in fact be 0, in which case the above is nonsensical. Thus the use of differentials is only a heuristic, not a proof.

\lim_{\delta x \rightarrow dx}\frac{\delta y}{\delta u}\frac{\delta u}{\delta x}=\lim_{\delta x \rightarrow dx}\frac{\delta y}{\delta x}=\frac{dy}{dx}