Are the epsilons independent from each other?

  • Context: Graduate 
  • Thread starter Thread starter St41n
  • Start date Start date
  • Tags Tags
    Independent
Click For Summary
SUMMARY

The discussion centers on the independence of the random variables ε_t, defined as ε_t = z_t σ_t, where z_t follows an IID normal distribution N(0,1) and σ_t^2 is a function of previous values. It is concluded that ε_t are not independent due to their dependence on σ_t and z_t, as shown by the probability density functions. The integral representation of joint probabilities indicates that the joint distribution cannot be factored into the product of individual distributions, confirming their dependence.

PREREQUISITES
  • Understanding of stochastic processes and random variables
  • Familiarity with probability density functions and Dirac delta distribution
  • Knowledge of IID (Independent and Identically Distributed) random variables
  • Basic concepts of conditional probability and joint distributions
NEXT STEPS
  • Study the properties of stochastic processes in detail
  • Learn about the Dirac delta function and its applications in probability theory
  • Explore the implications of conditional independence in statistical models
  • Investigate the role of functions in defining variance in time series analysis
USEFUL FOR

Statisticians, data scientists, and researchers in quantitative fields who are analyzing time series data and exploring the dependencies between random variables.

St41n
Messages
32
Reaction score
0
[tex]\varepsilon _t = z_t \sigma _t[/tex]

[tex] z_t \sim IID\,N\left( {0,1} \right)[/tex]

[tex] \sigma _t^2 = f\left( {\sigma _{t - 1} ,z_{t - 1} } \right)[/tex]Are the epsilons independent from each other? Why?
 
Last edited:
Physics news on Phys.org


St41n said:
[tex]\varepsilon _t = z_t \sigma _t[/tex]

[tex] z_t \sim IID\,N\left( {0,1} \right)[/tex]

[tex] \sigma _t^2 = f\left( {\sigma _{t - 1} ,z_{t - 1} } \right)[/tex]


Are the epsilons independent from each other? Why?


I can't see that they could be independent in the general case of [itex]f (\sigma ,z)[/itex] being any real-valued function, since [itex]p(\varepsilon_{t+1} | \sigma_t ,z_t)[/itex] is dependent on [itex]\sigma_t[/itex] and [itex]z_t[/itex], just like [itex]p(\varepsilon_{t} | \sigma_t ,z_t) = \delta(\varepsilon_{t} - \sigma_t z_t)[/itex] ([itex]p[/itex] representing probability densities and [itex]\delta[/itex] the Dirac delta distribution). This implies that

[tex] p(\varepsilon _t,\varepsilon _{t+1}) = \int\int{<br /> p(\varepsilon_{t} | \sigma_t ,z_t) <br /> p(\varepsilon_{t+1} | \sigma_t ,z_t)<br /> p(\sigma_t)p(z_t)<br /> d\sigma_t dz_t}[/tex]

cannot, in general, be written as a product [itex]p(\varepsilon _t,\varepsilon _{t+1}) = p(\varepsilon_{t})p(\varepsilon_{t+1})[/itex] as is the case for independent variables.

-Emanuel
 


Ok, this makes sense
Thank you very much
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 14 ·
Replies
14
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
Replies
1
Views
4K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K