Use the definition of E[g(Y)] to derive E[Y^2]


by mathmajor23
Tags: definition, derive
mathmajor23
mathmajor23 is offline
#1
Feb21-12, 09:24 AM
P: 29
Let Y ~ Bi(m,q).

Use the definition of E[g(Y)] to derive E[Y^2].

Hint: Write Y^2 as Y(Y-1) + Y. You do not have to re-derive E[Y].

Not sure where to start with this; my initial reaction was to use the moment generating function?
Phys.Org News Partner Science news on Phys.org
Going nuts? Turkey looks to pistachios to heat new eco-city
Space-tested fluid flow concept advances infectious disease diagnoses
SpaceX launches supplies to space station (Update)
micromass
micromass is offline
#2
Feb21-12, 10:45 AM
Mentor
micromass's Avatar
P: 16,583
Please post such questions in the homework forum. I moved it for you.
Ray Vickson
Ray Vickson is offline
#3
Feb21-12, 10:49 AM
HW Helper
Thanks
P: 4,670
Quote Quote by mathmajor23 View Post
Let Y ~ Bi(m,q).

Use the definition of E[g(Y)] to derive E[Y^2].

Hint: Write Y^2 as Y(Y-1) + Y. You do not have to re-derive E[Y].

Not sure where to start with this; my initial reaction was to use the moment generating function?
Try it and see!

RGV

Stephen Tashi
Stephen Tashi is offline
#4
Feb21-12, 01:46 PM
Sci Advisor
P: 3,173

Use the definition of E[g(Y)] to derive E[Y^2]


Quote Quote by mathmajor23 View Post
my initial reaction was to use the moment generating function?
But the directions say to use the definition of the expectation of a function of a random variable.
Ray Vickson
Ray Vickson is offline
#5
Feb21-12, 02:53 PM
HW Helper
Thanks
P: 4,670
Quote Quote by Stephen Tashi View Post
But the directions say to use the definition of the expectation of a function of a random variable.
A moment-generating function IS the expectation of a function of the RV; it just happens to be a particularly useful function.

RGV
Stephen Tashi
Stephen Tashi is offline
#6
Feb21-12, 07:29 PM
Sci Advisor
P: 3,173
Quote Quote by Ray Vickson View Post
A moment-generating function IS the expectation of a function of the RV; it just happens to be a particularly useful function.

RGV
Yes, it "is", in the same sense that the derivative "is" a limit. The definition of a moment generating function is an example of an expectation of a function of a random variable; it isn't logically equivalent to the definition of the expectation of a function of a random variable.

The meaning of the direction to "use the definition of E(g(y))" would be clearer if mathmajor23 explained how "E(g(y))" has been used in his course materials.
mathmajor23
mathmajor23 is offline
#7
Feb21-12, 10:12 PM
P: 29
By definition, E[g(Y)] = the summation over all values of y of [g(y)p(y)]
Stephen Tashi
Stephen Tashi is offline
#8
Feb22-12, 02:14 AM
Sci Advisor
P: 3,173
I speculate that the problem wants you to show your virtuosity with sums and binomial coefficients. (That's my attempt to mind-read what its author wants. If this problem is from the chapter on moment generating functions, it might want you to use them or it might want you do things "the hard way" so you'll appreciate moment generating functions!)

If we begin from the definition:

[itex] E(Y^2) = \sum_{k = 0}^m \ k^2 \ \binom{m}{k} q^k (1-q)^{m-k} [/itex]

and use the hint:

[itex] = \sum_{k=0}^m \ (k(k-1) + k) \ \binom{m}{k} q^k (1-q)^{m-k} [/itex]

[itex] = \sum_{k=0}^m \ k(k-1) \binom{m}{k} q^k (1-q)^{m-k} + \sum_{k=0}^m \ k \binom{m}{k} q^k (1-q)^{m-k} [/itex]

[itex] = \sum_{k=0}^m \ k(k-1) \ \frac{m!}{(m-k)! k!} q^k (1-q)^{m-k} + mq [/itex]

Does canceling the factors of [itex] k [/itex] let us rewrite the factors [itex] k(k-1) \binom{m}{k} q^k (1-q)^{m-k} [/itex] as [itex] q (1-q) m(k-1) \binom{m-1}{k-1} q^{k-1} (1-q)^{m-1-k}[/itex] ?

If, so the summation begins to look like a linear expression in the expectation of a binomial with parmeters [itex] m-1, q [/itex]. (Edit, This morning, I think that we should only factor out one of the factors [itex] q [/itex] and [itex](1-q) [/itex] to get a Bi[itex](m-1,q) [/itex].) It probably won't be that simple since you can't "cancel" out [itex] k [/itex] when [itex] k = 0 [/itex], but since the term is 0 you can leave it out of the summation. We'll have to pay attention to what the indexes of summation are. We might get an expression that involves the mean of bi(m-1,q) minus a few terms.

I began looking at this problem before it got moved to the homework section. I suppose now there's an excuse to leave it to you to see if that idea works.
mathmajor23
mathmajor23 is offline
#9
Feb22-12, 11:22 AM
P: 29
You're right! My professor "loves" MGF and says she will make us appreciate them, and this is like the third proof we have to do with these nasty summations. I follow you all the way up to the point where you try canceling the factors of k, that's where I am getting confused. I will try rewriting the factors as you recommend and see where I go from there.
Ray Vickson
Ray Vickson is offline
#10
Feb22-12, 12:30 PM
HW Helper
Thanks
P: 4,670
What methods are you permitted to use? If I were not allowed to use an MGF I would, instead, assume a form like EN^2 = a*n^2 + b*n + c, then find a, b, c by looking at explicit values of EN^2 for small values of n, such as n = 1, 2, 3. Then I would try to _prove_ correctness of the result, by induction, for example. As regards induction: if we let b[n,k] = C(n,k)*p^k (1-p)^(n-k), then we have k*b[n,k] = n*p* b[n-1,k-1], etc.

RGV
mathmajor23
mathmajor23 is offline
#11
Feb22-12, 10:32 PM
P: 29
My professor wants us to use just definitions and summations.

As to the last step of the ∑mk=0 k(k−1) m!(m−k)!k!qk(1−q)m−k+mq , the next thing to do is to cancel out the k's


Edit: I can't seem to get the summation symbol to agree with me on here :p
Ray Vickson
Ray Vickson is offline
#12
Feb22-12, 10:40 PM
HW Helper
Thanks
P: 4,670
Quote Quote by mathmajor23 View Post
My professor wants us to use just definitions and summations.

As to the last step of the ∑mk=0 k(k−1) m!(m−k)!k!qk(1−q)m−k+mq , the next thing to do is to cancel out the k's


Edit: I can't seem to get the summation symbol to agree with me on here :p
What does it mean to use "just summations"? Are you not allowed to use modern summation tools? Are you not allowed to recognize that k*b[n,k] is the same as n*p*b[n-1,k-1]? If you are not allowed to use *anything*, what on Earth are you left with?

RGV
Applejacks01
Applejacks01 is offline
#13
Feb24-12, 11:18 PM
P: 26
You can derive E(Y^2) easily:

let f(x) = ƩC(m,x)*q^x * (1-q)^(m-x)
E(X^2) = ƩC(m,x)*x^2 *q^x * (1-q)^(m-x)

Observe that this is equivalent to ƩC(m-1,x-1)*(m/x)*q^x*(1-q)^(m-x)*x^2
This becomes:
ƩC(m-1,x-1)*(m)*q^x*(1-q)^(m-x)*x

Let y = x-1
x = y+1
ƩC(m-1,y)*m*q^(y+1)*(1-q)^(m-1-y)*(y+1)
This equals
ƩC(m-1,y)*m*q*q^(y)*(1-q)^(m-1-y)*(y+1)

This equals mq*ƩC(m-1,y)*q^(y)*(1-q)^(m-1-y)*(y+1)
Expand via factor (y+1)

mq*ƩC(m-1,y)*q^(y)*(1-q)^(m-1-y)*(y) + mq*ƩC(m-1,y)*q^(y)*(1-q)^(m-1-y)*(1)

The term on the right is simply mq, because the sum itself is equal to 1

The term on the left can be solved easily:

mq*ƩC(m-1,y)*q^(y)*(1-q)^(m-1-y)*(y) becomes..
mq*ƩC(m-2,y-1)*((m-1)/y)*q^(y)*(1-q)^(m-1-y)*(y)
=mq*ƩC(m-2,y-1)*(m-1)*q^(y)*(1-q)^(m-1-y)
=(m-1)*mq*ƩC(m-2,y-1)*q^(y)*(1-q)^(m-1-y)

Let z = y-1
z+1=y
(m-1)*mq*ƩC(m-2,z)*q^(z+1)*(1-q)^(m-2-z)
=(m-1)*mq^2*ƩC(m-2,z)*q^(z)*(1-q)^(m-2-z)
= (m-1)*mq^2
So we have..

ƩC(m,x)*x^2 *q^x * (1-q)^(m-x) = (m-1)*mq^2 + mq
Ray Vickson
Ray Vickson is offline
#14
Feb25-12, 09:36 AM
HW Helper
Thanks
P: 4,670
Quote Quote by Applejacks01 View Post
You can derive E(Y^2) easily:

let f(x) = ƩC(m,x)*q^x * (1-q)^(m-x)
E(X^2) = ƩC(m,x)*x^2 *q^x * (1-q)^(m-x)

Observe that this is equivalent to ƩC(m-1,x-1)*(m/x)*q^x*(1-q)^(m-x)*x^2
This becomes:
ƩC(m-1,x-1)*(m)*q^x*(1-q)^(m-x)*x

Let y = x-1
x = y+1
ƩC(m-1,y)*m*q^(y+1)*(1-q)^(m-1-y)*(y+1)
This equals
ƩC(m-1,y)*m*q*q^(y)*(1-q)^(m-1-y)*(y+1)

This equals mq*ƩC(m-1,y)*q^(y)*(1-q)^(m-1-y)*(y+1)
Expand via factor (y+1)

mq*ƩC(m-1,y)*q^(y)*(1-q)^(m-1-y)*(y) + mq*ƩC(m-1,y)*q^(y)*(1-q)^(m-1-y)*(1)

The term on the right is simply mq, because the sum itself is equal to 1

The term on the left can be solved easily:

mq*ƩC(m-1,y)*q^(y)*(1-q)^(m-1-y)*(y) becomes..
mq*ƩC(m-2,y-1)*((m-1)/y)*q^(y)*(1-q)^(m-1-y)*(y)
=mq*ƩC(m-2,y-1)*(m-1)*q^(y)*(1-q)^(m-1-y)
=(m-1)*mq*ƩC(m-2,y-1)*q^(y)*(1-q)^(m-1-y)

Let z = y-1
z+1=y
(m-1)*mq*ƩC(m-2,z)*q^(z+1)*(1-q)^(m-2-z)
=(m-1)*mq^2*ƩC(m-2,z)*q^(z)*(1-q)^(m-2-z)
= (m-1)*mq^2
So we have..

ƩC(m,x)*x^2 *q^x * (1-q)^(m-x) = (m-1)*mq^2 + mq
That is more-or-less what I suggested to him a few postings back, but he seemed to think he was not allowed to use such results.

RGV


Register to reply

Related Discussions
how to derive tan(2x) using the definition of the derivative ? Calculus & Beyond Homework 4
How do you derive E2= (pc)2 + (mc2)2 Special & General Relativity 12
"Definition" of Curl. Can anyone derive the gradient operator? General Math 5
Derive Ohm's law? General Physics 16
In QM: How to derive <x|f> from f_n(x)? Advanced Physics Homework 4