Sum of independent Random Variables

Click For Summary

Homework Help Overview

The discussion revolves around calculating the 95% Value at Risk (VaR) of the minimum loss from three independent yearly losses, where the first loss follows an exponential distribution and the second and third losses follow Weibull distributions.

Discussion Character

  • Mixed

Approaches and Questions Raised

  • Participants explore the cumulative distribution function (CDF) of the total loss, questioning the validity of their initial probability expressions for independent random variables. There is an attempt to derive the CDF through integration and convolution methods.

Discussion Status

Some participants have provided insights into the integration approach for finding the CDF, while others express skepticism about the feasibility of an analytical solution, suggesting that numerical methods may be necessary. There is recognition of the complexity involved in deriving the probability distributions for the sums of these independent random variables.

Contextual Notes

Participants note the challenge of deriving a closed-form solution for the density of the sum of the Weibull random variables, indicating that certain cases may not yield finite formulas in elementary terms.

mrkb80
Messages
40
Reaction score
0

Homework Statement


Three yearly losses.
First: Exponential
Second & Third: Weibull

Losses are independent.
Find the 95% VaR of the min loss


Homework Equations





The Attempt at a Solution


My first thought was:
Let L be total loss, A be first Loss, B be second loss, C be third loss

Pr(L<x) = Pr(A<x) * Pr(B<x) * Pr(C<x)

But logically this seems wrong to me, because if Pr(A<x) = 100% then Pr(L<x) should be 100%.

So then I thought maybe:

Pr(L<x) = a_1 Pr(A<x) + a_2 Pr(B<x) + a_3 Pr(C<x)

but how do I choose a_1, a_2,a_3? Seems like these would change based on the values of A,B,C which makes them r.v. themselves!

The prof hinted that we just need to find the CDF and that to find the CDF we first should find the survival function keeping in mind the r.v. are independent.

I'm sort of out of ideas.
 
Physics news on Phys.org
mrkb80 said:

Homework Statement


Three yearly losses.
First: Exponential
Second & Third: Weibull

Losses are independent.
Find the 95% VaR of the min loss


Homework Equations





The Attempt at a Solution


My first thought was:
Let L be total loss, A be first Loss, B be second loss, C be third loss

Pr(L<x) = Pr(A<x) * Pr(B<x) * Pr(C<x)

But logically this seems wrong to me, because if Pr(A<x) = 100% then Pr(L<x) should be 100%.

So then I thought maybe:

Pr(L<x) = a_1 Pr(A<x) + a_2 Pr(B<x) + a_3 Pr(C<x)

but how do I choose a_1, a_2,a_3? Seems like these would change based on the values of A,B,C which makes them r.v. themselves!

The prof hinted that we just need to find the CDF and that to find the CDF we first should find the survival function keeping in mind the r.v. are independent.

I'm sort of out of ideas.

You say that you think Pr(L<x) = a_1 Pr(A<x) + a_2 Pr(B<x) + a_3 Pr(C<x).

Why on Earth would you ever think that? There are perfectly standard formulas for the probability distribution of a sum of independent random variables. These formulas are found in every probability textbook, or even in hundreds of on-line articles.

BTW: what you have written is not the standard cdf, which would be Pr(L <= x), with a non-strict inequality. What you wrote was long ago abandoned as the definition of a cdf.
 
Point taken. I'm going down this path now:
F_{A+B+C} = P(A+B+C \le x)
= \int_{-\infty}^{\infty} \int_{-\infty}^{\infty} \int_{-\infty}^{x-b-c} f_A(a) f_B(b) f_C(c) da db dc

= \int_{-\infty}^{\infty} \int_{-\infty}^{\infty} F_A(x-b-c) f_B(b) f_C(c) db dc
Not sure where to go next...
 
Last edited:
mrkb80 said:
Point taken. I'm going down this path now:
F_{A+B+C} = P(A+B+C \le x)
= \int_{-\infty}^{\infty} \int_{-\infty}^{\infty} \int_{-\infty}^{x-b-c} f_A(a) f_B(b) f_C(c) da db dc

= \int_{-\infty}^{\infty} \int_{-\infty}^{\infty} F_A(x-b-c) f_B(b) f_C(c) db dc
Not sure where to go next...

I doubt that the task is 'doable' analytically. Probably you need to resort to a numerical method.

Probably the easiest way is through successive convolution: if X = B+C, then its density is
f_X(x) = \int_0^x f_B(y) f_C(x-y) \, dy.
Then the density of S = A+B+C = A + X is
f_S(x) = \int_0^x f_A(y) f_X(x-y) \, dy
Note that the integrations only go from 0 to x, not from -∞ to +∞; this is because the random variables are all ≥ 0.

However, at this point I think you are stuck: you probably need to compute and store the values of ##f_X(x)## on a grid of x-values, or maybe come up with a convenient approximate formula for it, because in some cases at least we can prove that there is no finite formula for ##f_X## in terms of elementary functions. We can establish this by example: suppose B and C are iid Weibull with parameters k = 2 and λ = 1, so that the density of B (and C) is
f_B(x) = f_C(x) = 2x e^{-x^2}.
We can actually do the integral to get ##f_X##:
f_X(x) = x e^{-x^2} + \sqrt{\frac{\pi}{2}}\,(x^2-1)\, e^{ -x^2 /2}\, \text{erf}(x/\sqrt{2}).
It is impossible to give a finite, closed-form formula for this in terms of elementary functions, because if we could do it, we would have a finite, closed-form expression for 'erf', and that has been shown to be impossible. Of course, you can give non-finite expressions, such as infinite series and the like.

Anyway, that special case proves to be un-doable in simple terms, so the general case must also be un-doable.

All I can suggest is some type of numerical approximation when actual numerical inputs are specified. However, quantities like the mean and variance of S = A+B+C are easily obtained using standard result about moments of sums of independent random variables.
 

Similar threads

  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 1 ·
Replies
1
Views
9K
  • · Replies 12 ·
Replies
12
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 10 ·
Replies
10
Views
4K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 1 ·
Replies
1
Views
5K
  • · Replies 1 ·
Replies
1
Views
1K