What is the Paradox of Probability Density Functions?

Click For Summary
SUMMARY

The discussion clarifies the concept of Probability Density Functions (PDFs) in relation to specific outcomes. It establishes that for a random variable X with a PDF, the probability P(X=c) for any specific outcome c is 0. However, the probability of X taking on any value within an interval [a,b] is not 0, as it involves an uncountably infinite set of outcomes. The confusion arises from attempting to sum individual probabilities of points within the interval, which is not valid in the context of continuous distributions.

PREREQUISITES
  • Understanding of Probability Density Functions (PDFs)
  • Familiarity with continuous random variables
  • Knowledge of uncountably infinite sets
  • Basic concepts of measure theory
NEXT STEPS
  • Study the properties of Probability Density Functions in detail
  • Learn about continuous random variables and their distributions
  • Explore measure theory and its application in probability
  • Investigate the concept of Lebesgue integration
USEFUL FOR

Students and professionals in statistics, data science, and mathematics who are looking to deepen their understanding of Probability Density Functions and continuous probability distributions.

Peter G.
Messages
439
Reaction score
0
Hi!

I am currently studying Probability Density Functions and I am having a hard time wrapping my head around something.

So, from what I have read, P(X=c), i.e. probability that the random variable X takes on any specific outcome, is equal to 0. Yet, the probability X takes on any outcome between a and b is not 0. Isn't the probability that X takes on any value between a and b equal to the probability X takes on each individual outcome between a and b added together? In other words, would not that be equal to summing several probabilities = 0?

I hope I made my doubt somewhat clear,

Thank you in advance!
 
Physics news on Phys.org
Peter G. said:
So, from what I have read, P(X=c), i.e. probability that the random variable X takes on any specific outcome, is equal to 0. Yet, the probability X takes on any outcome between a and b is not 0. Isn't the probability that X takes on any value between a and b equal to the probability X takes on each individual outcome between a and b added together? In other words, would not that be equal to summing several probabilities = 0?
You are correct that if ##X## has a probability density function then ##P(X = c) = 0## for any specific outcome ##c##. Your confusion stems from the fact that if you consider an uncountably infinite set of outcomes, such as the interval ##[a,b]##, then you cannot simply add the probabilities of the individual points. This only works for a finite or countably infinite number of outcomes.

Forget about probability for a moment and consider the interval ##[0,1]##. This interval has length 1 even though each point in the interval has length zero. There's no contradiction here, it's just a fact of life: we can't add the lengths (or probabilities, or more generally, the measures) of an uncountably infinite number of objects.
 
  • Like
Likes   Reactions: 1 person
Got it! Thank you very much jbunniii!
 

Similar threads

  • · Replies 19 ·
Replies
19
Views
4K
  • · Replies 6 ·
Replies
6
Views
2K
Replies
2
Views
2K
Replies
6
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
Replies
1
Views
1K