Sum of independent random variables and Normalization

Click For Summary

Discussion Overview

The discussion revolves around the properties of the sum of independent random variables, specifically whether the resulting variable follows a normalized probability distribution. Participants explore various scenarios, including cases where the individual random variables may not be identically distributed and the implications of the Central Limit Theorem.

Discussion Character

  • Exploratory
  • Debate/contested
  • Technical explanation

Main Points Raised

  • Some participants question whether the sum of independent random variables, defined as $$Y=Σ^{N}_{i=0} X_{i}$$, follows a normalized probability distribution.
  • One participant states that if each $$X_i$$ is normally distributed, then the sum $$Y$$ will also be normally distributed, with mean and variance derived from the individual variables.
  • Another participant emphasizes the generalized case where the $$X_i$$ can come from any valid probability distribution, suggesting that no general conclusion can be drawn about the distribution of $$Y$$.
  • Some participants note that the concept of normalization may be confused with standardization and highlight the importance of finite variances for normalization.
  • The Central Limit Theorem is mentioned as a condition under which the sum of normalized variables converges to a normal distribution, but this is contingent on certain assumptions.
  • There is a clarification that the term "normalized" does not refer to a specific family of probability distributions, and the question may need to be reframed to address whether $$Y$$ is normally distributed.

Areas of Agreement / Disagreement

Participants express differing views on the implications of summing independent random variables, with some asserting that no definitive conclusion can be made without additional information about the distributions involved. The discussion remains unresolved regarding the conditions under which the sum follows a normalized distribution.

Contextual Notes

Participants highlight the need for assumptions about the distributions of the individual random variables, such as finite variances, to discuss normalization and convergence to a normal distribution. There is also a distinction made between normalized and standardized variables.

joshthekid
Messages
46
Reaction score
1
Hi,

Lets say I have N independent, not necessarily identical, random variable. I define a new random variable as

$$Y=Σ^{N}_{i=0} X_{i}$$

does Y follow a normalized probability distribution?
 
Physics news on Phys.org
What is the distribution of the Xs?
 
joshthekid said:
Hi,

Lets say I have N independent, not necessarily identical, random variable. I define a new random variable as

$$Y=Σ^{N}_{i=0} X_{i}$$

does Y follow a normalized probability distribution?

If each of the ##X_i's## is normally distributed, then yes. It will have mean sum of the means and variance sum of the variances.
 
Math_QED said:
If each of the ##X_i's## is normally distributed, then yes. It will have mean sum of the means and variance sum of the variances.

I'm talking about the generalized case where Xi can literally come from any valid probability distribution and the Xi do not have to be the same.
 
joshthekid said:
I'm talking about the generalized case where Xi can literally come from any valid probability distribution and the Xi do not have to be the same.

Then there is no general conclusion to be made.
 
  • Like
Likes   Reactions: Dale
joshthekid said:
I'm talking about the generalized case where Xi can literally come from any valid probability distribution and the Xi do not have to be the same.
I agree with @Math_QED, and in fact for any valid probability distribution there may not even be a sensible sum operation, e.g. what if one X is the outcome of a coin toss and another X is gender.
 
Math_QED said:
Note that there are no squares in the sum, so your statement is not true.

Well, note that my statement is true, just was referring to the similarity to chi-squared

Would have to assume that the underlying distributions have finite variances so can be normalized (seems some confusion in the OP between normalized / standardized and normal) Normalized means the variable is rescaled to 0 mean and variance of 1. The Central Limit Theorem states that if you then sum these normalized variables the distribution of the sum converges to the normal distribution.
 
  • Like
Likes   Reactions: member 587159
  • #10
BWV said:
Well, note that my statement is true, just was referring to the similarity to chi-squared

Would have to assume that the underlying distributions have finite variances so can be normalized (seems some confusion in the OP between normalized / standardized and normal) Normalized means the variable is rescaled to 0 mean and variance of 1. The Central Limit Theorem states that if you then sum these normalized variables the distribution of the sum converges to the normal distribution.

Misread your post then. Sorry!
 
  • #11
joshthekid said:
does Y follow a normalized probability distribution?

I think what you mean to ask is "does Y have a normal distribution?" or "Is Y normally distributed?" The adjective "normalized" doesn't refer to a specific family of probability distributions.

I'm talking about the generalized case where Xi can literally come from any valid probability distribution and the Xi do not have to be the same.

Perhaps you also mean to say that the Xi are mutually independent?

As others indicated, given only those facts we cannot conclude that the distribution of Y is a normal distribution.

If you do a web search on "generalized central limit theorem" you may be able to find theorems that give conditions where the sum of independent non-identically distributed random variables can be shown to be approxmately a normal distribution. This is a very technical topic. I don't know the details.
 

Similar threads

  • · Replies 30 ·
2
Replies
30
Views
5K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 39 ·
2
Replies
39
Views
4K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 10 ·
Replies
10
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K