Pdf of exponetial distribution

[hassman]

I am confused as hell. If you look at exponential distribution at wikipedia or elsewhere, you can see that the pdf can attain values larger than 1.

How is it possible? This basically implies that probability density of some value is larger than 1?

 

[statdad]

I am confused as hell. If you look at exponential distribution at wikipedia or elsewhere, you can see that the pdf can attain values larger than 1.

How is it possible? This basically implies that probability density of some value is larger than 1?

Why is that a problem? All that is needed is for the density to be continuous and

$$\int_0^\infty p(x) \, dx = 1$$

(0 to infinity here since the exponential r.v. only takes on positive values)

 

[hassman]

I think I get it.PDF refers to probability DENSITY function. So one cannot say the PDF of X, if X is discrete random variable, right?

 

[statdad]

well if u take all the points of the pdf of discrete distribution you add up to one. which is intuitive.

but if i take all the points on the pdf of exponential pdf, I will get more than 1. how is probability of more than one possible?

No, you won't get a probability of more than one. If you look at the form of the distribution function (the c.d.f), you will see it is

$$1 - \text{ non-zero expression}$$

so the probability is never above one.

 

[hassman]

sorry for the ninja edit above

 

[hassman]

So a discrete random variable does not have a probability density function, right? How is it called then? Probability mass function?

 

[statdad]

So a discrete random variable does not have a probability density function, right? How is it called then? Probability mass function?

I'm not sure we're on the same thought here.
a) An exponential distribution is continuous, and it has a density and cumulative distribution function. it is possible for the density to have a maximum that is larger than one, as long as
it still integrates to one. the density function values are not probabilities - those come from the distribution function. If $$p(x)$$ is the density, then the distribution function is

$$P(x) = P(X \le x) = \int_{-\infty}^x p(t) \, dt$$
b) A discrete distribution has a mass function (the discrete analog of a density). the individual values of the mass function are probabilities; each one of them must be smaller than one, and the sum of all values of the mass function has to equal one. If $$m(x)$$ is the mass function, then for each value of the random variable

$$m(a) = P(X = a)$$

A discrete distribution also has distribution function. If $$t$$ is a real number,

$$M(t) = P(X \le t) = \sum_{x_i \le t} m(x_i)$$

where I mean the sum extends over all values that are $$\le t$$.

Primary differences:

1) the density for a continuous random variable doesn't give probability directly - the distribution function does that
2) the density for a continuous random variable can be larger than one, as long as it integrates to one
3) the mass function for a discrete random variable does give probability for individual values, and must always be $$\le 1$$
4) a discrete random variable also has a distribution function

does this help?

 

[hassman]

Yes, totally clear now. Thanks a lot.