Sums of Independent (but not identically distributed) Random Variables

Click For Summary

Discussion Overview

The discussion centers on finding a tail bound for the sum of independent, but not identically distributed, random variables, specifically independent exponential random variables with distinct rates. The focus is on identifying results that provide tighter bounds than those offered by Markov's and Chebyshev's inequalities.

Discussion Character

  • Exploratory, Technical explanation, Debate/contested

Main Points Raised

  • One participant seeks a Hoeffding-type result for bounding the tail of the sum of independent exponential random variables with distinct rates.
  • Another participant questions whether the parameters of the random variables are all distinct, suggesting that this would simplify the analysis.
  • A participant confirms that the parameters are distinct and mentions the relevance of the Hypoexponential distribution in this context, seeking a usable tail inequality.
  • Another participant suggests that while there may not be simpler inequalities than the matrix exponential formula, Bernstein inequalities could be relevant, noting the complexity of determining the central moment growth rate.
  • This participant also references tail probability inequalities that involve integrals of the characteristic function over a small neighborhood of zero.

Areas of Agreement / Disagreement

Participants have not reached a consensus on the existence of simpler inequalities for bounding the tail of the sum, and multiple competing views and suggestions remain in the discussion.

Contextual Notes

There are limitations regarding the assumptions about the distributions and the complexity of deriving certain inequalities, particularly concerning the central moment growth rate and the applicability of various inequalities.

sv79
Messages
2
Reaction score
0
I am looking for a Hoeffding-type result that bounds the tail of a sum of independent, but not identically distributed random variables. Let X_1,..,X_n be independent exponential random variables with rates k_1,...,k_n. (Note: X_i's are unbounded unlike the case considered by Hoeffding)

Let S= \sum_{i=1}^{n} X_i. I am interested in bounding P(S>a). I am looking for tighter bounds than Markov's Inequality and Chebyshev's Inequality. Is anyone here aware of well-known results in this direction?
 
Last edited:
Physics news on Phys.org
sv79 said:
independent exponential random variables

Are the parameters all distinct? (this would simplify the analysis considerably)
 
Bpet:
Yes, the parameters are all distinct. Perhaps, you are thinking of a Hypoexponential distribution (also called a Generalized Erlang distribution, I think), which in my case it certainly is. The question is can we get a clean (easily usable like the Hoeffding, Chernoff bounds etc.) tail inequality for the sum?
 
I don't know if there are any simple inequalities (simpler than the matrix exponential formula) but maybe some of the Bernstein inequalities (tricky bit is working out the central moment growth rate). Also from memory there are some tail prob inequalities involving an integral of the characteristic function over some small neighbourhood of zero. Sorry I couldn't be of more help but I'm keen to hear how it goes.
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 10 ·
Replies
10
Views
3K
  • · Replies 0 ·
Replies
0
Views
2K
  • · Replies 6 ·
Replies
6
Views
5K
  • · Replies 10 ·
Replies
10
Views
6K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
Replies
3
Views
3K