Most probable value of a random variable?

In summary, SW VandeCarr says that a random variable is not a random variable if it has a "most probable value."
  • #1
denjay
77
0
A problem in this book asks for the most probable value of a random variable [itex]x[/itex]. As far as I know, if a random variable has "most probable value" then it isn't a random variable.

The problem is attached. It is the second question in part b.

Could the answer be that there is no most probable value? Or do I not understand exactly what a random variable is.

If it's asking at what value of [itex]x[/itex] is [itex]p(x)[/itex] greatest, that would of course be at [itex]x = 0[/itex] but I don't think that is what the question is asking.
 

Attachments

  • Untitled.png
    Untitled.png
    11.2 KB · Views: 2,000
Last edited:
Physics news on Phys.org
  • #2
Thought about it more.

Could it be that it is asking for [itex]p(\bar{x})[/itex] since it asked me to find the mean value of [itex]x[/itex]?
 
  • #3
denjay said:
A problem in this book asks for the most probable value of a random variable [itex]x[/itex]. As far as I know, if a random variable has "most probable value" then it isn't a random variable.

The problem is attached. It is the second question in part b.

Could the answer be that there is no most probable value? Or do I not understand exactly what a random variable is.

If it's asking at what value of [itex]x[/itex] is [itex]p(x)[/itex] greatest, that would of course be at [itex]x = 0[/itex] but I don't think that is what the question is asking.

The most probable value is the x where p(x) is maximum.
 
  • #4
mathman said:
The most probable value is the x where p(x) is maximum.

denjay said:
Thought about it more.

Could it be that it is asking for [itex]p(\bar{x})[/itex] since it asked me to find the mean value of [itex]x[/itex]?

The "most probable value" should not be confused with the "expectation": [itex]E(x) = \bar {x} [/itex]. The uniform distribution has an expectation but no "most probable value" since all values over a discrete range are equally probable. Also, in many distributions the expectation is not the most probable value when such a value exists. In a unimodal distibution, the most probable value is the mode. For the normal distribution, the mean, median and mode are located at the same point.

EDIT: I'm speaking in terms of discrete distributions where n approaches infinity, but we can still talk about mapping from a point x to a probability space. In a true continuum, the probability of any point x is zero. For symmetric continuous probability distributions, we can usually use the half distribution probability density.
 
Last edited:
  • #5
SW VandeCarr said:
In a true continuum, the probability of any point x is zero.

That's true. But then we can use the maximum of the probability density function, which is a fancy way of saying we draw the graph of the probability and find the highest point on that. So it is intuitively very similar.
 
  • #6
ImaLooser said:
That's true. But then we can use the maximum of the probability density function, which is a fancy way of saying we draw the graph of the probability and find the highest point on that. So it is intuitively very similar.

Well, strictly speaking the maximum probability density is always 1. You have to find the upper limit of integration (the maximum point) analytically afaik. For multimodal functions, it becomes more difficult. Of course you can always plot the function to obtain an approximate result by inspection or use the plot to find the upper limit of integration (the global maximum point).
 
Last edited:
  • #7
SW VandeCarr said:
Well, strictly speaking the maximum probability density is always 1.
No, it can be anything > 0, even greater than 1.
For a continuous distribution, it doesn't really make sense to ask for the most probable value, for the reasons already discussed. The max of p(x) is the most reasonable interpretation. Denjay, why do you think that makes it not a random variable? A thing is random if it is not deterministic.
 
Last edited:
  • #8
haruspex said:
No, it can be anything > 0, even greater than 1.
For a continuous distribution, it doesn't really make sense to ask for the most probable value, for the reasons already discussed.

The maximum probability density on a PDF is one for the purposes of the OP. The uniform distribution has no mode.

It may make sense to find the mode or the maximum mode of the PDF.
 
Last edited:
  • #9
haruspex said:
No, it can be anything > 0, even greater than 1.
For a continuous distribution, it doesn't really make sense to ask for the most probable value, for the reasons already discussed. The max of p(x) is the most reasonable interpretation. Denjay, why do you think that makes it not a random variable? A thing is random if it is not deterministic.

In statistics we have a thing called Highest Posterior Density and in the context of what SW VandeCarr said, this makes sense for a non-zero interval where you have an actual probability and not just a point estimate for MLE estimation (or a similar technique to get maximum values).
 
  • #10
SW VandeCarr said:
The maximum probability density on a PDF is one for the purposes of the OP. The uniform distribution has no mode.
I said nothing about uniform distributions. In the context of the OP, the max density is A, which can be > 1.
 
  • #11
haruspex said:
I said nothing about uniform distributions. In the context of the OP, the max density is A, which can be > 1.

Please give an example in terms of actual probabilities..
 
Last edited:
  • #12
2e-2x, x>=0; 0 for x<0.
 
  • #13
haruspex said:
2e-2x, x>=0; 0 for x<0.

That's not an actual probability. A probability cannot be greater than one. So called probability densities greater than one are not actual probabilities and have no relevance to the OP's question.
 
  • #14
SW VandeCarr said:
That's not an actual probability. A probability cannot be greater than one. So called probability densities greater than one are not actual probabilities and have no relevance to the OP's question.

The probability density is not a probability. It is the value of the PDF at that x value. Since the agreed(?) interpretation of the OP question is in terms of probability density, not actual probabilities, it is relevant. If it is not to be interpreted as max prob density then the OP question is meaningless for a continuous distribution.
 
  • #15
haruspex said:
The probability density is not a probability..

Agreed. The OP asked for the maximum value of p(x) which means the probability of x.
 
Last edited:
  • #16
SW VandeCarr said:
Agreed. The OP asked for the maximum value of p(x) which means the probability of x.

No, the OP asked for the most probable value, and it defined p(x) to be the pdf.
 
  • #17
haruspex said:
No, the OP asked for the most probable value, and it defined p(x) to be the pdf.

It's a very reasonable assumption that the OP was thinking in terms of the standard distributions that are used in statistical applications. Integrating the PDFs of these distributions from negative to positive infinity must yield 1 in order to satisfy the axioms of probability theory. You know this. The kinds of distributions you refer to would not appear to have any applications in the kinds of statistical/probability problems that are generally discussed in this forum.

Given we are referring to these kinds of standard distributions, the probability density is a useful tool when dealing with PDFs. Even when dealing with discrete distributions with large n, using the continuous approximation is often considered preferable.

Finding the mode of a unimodal standard PDF is a straightforward analytic procedure. You know this too. I don't think the line you're pursuing is helpful to the OP. If you persist, I will refer this thread to the moderators.
 
Last edited:
  • #18
SW VandeCarr said:
It's a very reasonable assumption that the OP was thinking in terms of the standard distributions that are used in statistical applications. Integrating the PDFs of these distributions from negative to positive infinity must yield 1 in order to satisfy the axioms of probability theory. You know this. The kinds of distributions you refer to would not appear to have any applications in the kinds of statistical/probability problems that are generally discussed in this forum.

Given we are referring to these kinds of standard distributions, the probability density is a useful tool when dealing with PDFs. Even when dealing with discrete distributions with large n, using the continuous approximation is often considered preferable.

Finding the mode of a unimodal standard PDF is a straightforward analytic procedure. You know this too. I don't think the line you're pursuing is helpful to the OP. If you persist, I will refer this thread to the moderators.

No, you are wrong and haruspex is correct. The attachment in the OP explicitly states that ##p(x)## is a probability density. It is NOT a probability.

So, this should clear up the miscommunication, unless you also happen to mistakenly believe that a probability density cannot have a maximum value greater than one. I cannot tell from your post if you believe that or if there is just a misunderstanding of what ##p(x)## meant, but in case it is the former: A valid probability density function can absolutely have a maximum value greater than 1. The total area under the curve must be 1, but that does not at all imply the function itself cannot be greater than 1.

Consider a uniform distribution of random variables that can take value only within a very tiny range, say 0.9 to 1.1. The probability density function is p(x) = 5. The area under this curve is 1:

$$\int_{0.9}^{1.1} dx~p(x) = 5 \int_{0.9}^{1.1} dx = 5 (1.1-0.9) = 5 (0.2) = 1.$$

This is a perfectly valid, normalized probability density function. Because the width is so small, the height has to be large in order for the area to come out to 1.

Similarly, take any Gaussian and give it a very small standard deviation. You will find the probability density function exceeds 1 when x is equal to the mean, but the area under the curve will never exceed 1. Again, this is because the peak height has to compensate for the fact that there is very little area under the tails of the Gaussian curve when the standard deviation is very small.

To the OP:

I would interpret the question as expecting you to give the answer "x=0" as the "most probable value" or the "most likely value". Although strictly speaking the probability of getting the value is 0 for any given point, if you draw from this distribution many, many times and generate a histogram which approximates the (unnormalized) distribution, then you will see that you drew many more points in your "x~0" bin than any other points. If you drew from the distribution infinitely many times so that you could make your bins infinitely thin, the greatest fraction of the points that you drew will correspond to "x=0". So, in this sense, the value "x=0" is the most probable value.

Another way to see it is to realize that if you draw from the probability density ##p(x)## infinitely many times, ##f(x_1,x_2) = (Ae^{-\lambda x_1})/(Ae^{-\lambda x_2}) = e^{-\lambda(x_1-x_2)}## is the fraction of times you drew ##x_1## compared to ##x_2##. For ##x_1 = 0 \neq x_2##, you can see that this fraction is always greater than 1, so there are always more draws of "x=0" than any other point. (You don't have to make this argument for every problem like this, it's just to illustrate the sense in which the value of x that maximizes p(x) is the "most probable value").
 
Last edited:

What is the most probable value of a random variable?

The most probable value of a random variable is the value that is most likely to occur in a given set of data. It is calculated by finding the mode, or the most frequently occurring value, in the data set.

How is the most probable value of a random variable different from the mean?

The most probable value is the value that is most likely to occur, while the mean is the average of all the values in the data set. The mean can be affected by extreme values, while the most probable value is not.

Can the most probable value be a decimal or fraction?

Yes, the most probable value can be a decimal or fraction if it is the mode of a continuous data set. In a discrete data set, the most probable value will always be a whole number.

How is the most probable value used in probability distributions?

In probability distributions, the most probable value is often used as the center of the distribution. This value is used to calculate other important values, such as the standard deviation and confidence intervals.

Is the most probable value always the same as the maximum value in a data set?

No, the most probable value is not always the same as the maximum value. It is possible for a data set to have multiple maximum values, or for the maximum value to be an outlier. The most probable value is the value that occurs the most frequently, not necessarily the highest value.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
7
Views
333
  • Set Theory, Logic, Probability, Statistics
Replies
6
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
30
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
9
Views
436
  • Set Theory, Logic, Probability, Statistics
Replies
7
Views
909
  • Set Theory, Logic, Probability, Statistics
Replies
4
Views
821
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
3
Views
612
  • Set Theory, Logic, Probability, Statistics
Replies
3
Views
1K
Back
Top