Conditionally independent with a Random Chain.

Click For Summary
SUMMARY

The discussion focuses on deriving a recursion for alpha_N(i) in a Markov Chain context, specifically for conditionally independent discrete random variables Y_n given X. The user presents their initial solution and questions the correctness of their approach, particularly in step (1). The correct recursion is identified as alpha_N(i) = Sum_k {f(Y(N), i) * P_ki * alpha_(N-1)(k)}, indicating that the user's misunderstanding lies in the application of conditional independence across the entire chain versus individual samples.

PREREQUISITES
  • Understanding of Markov Chains and their properties
  • Knowledge of conditional independence in probability theory
  • Familiarity with discrete random variables and their distributions
  • Experience with recursive functions in probabilistic models
NEXT STEPS
  • Study the properties of Markov Chains and their applications in probabilistic models
  • Learn about conditional independence and its implications in statistical inference
  • Explore recursive algorithms in probability, focusing on dynamic programming techniques
  • Investigate the use of Bayesian networks for modeling conditional dependencies
USEFUL FOR

Mathematicians, statisticians, data scientists, and anyone working with probabilistic models and Markov Chains will benefit from this discussion.

fortune
Messages
3
Reaction score
0
I found this post somewhere on the net. I am also getting a similar problem. Can you all please help?


+++++++++++++++

I have a problem, I try to solve but still get stuck.
Can you please read my solution and point out what my wrong points are?

Xn is a Markov Chain . n=1...M. with P(X(0)=i)=a_i. and P(X(n+1)=i|X(n)=j)=Pji.
Yn n=1..M are discrete random variables which are conditionally independent
given X with

P(Y(n)=i|X(n)=j)=f(i,j)


I need to find a recursion for alpha_N(i)= P(Y(N),Y(N-1),...,Y(0), and X(N)=i).

where P(.) is the probability of (.)


My solution is that:


alpha_N(i)= P(Y(N),Y(N-1),...,Y(0), and X(N)=i)

=P(Y(N),Y(N-1),...,Y(0)|X(N)=i)P(X(N)=i)
=P(Y(N)|X(N)=1)*P(Y(N-1),..,Y(0)|X(N)=i)P(X(N)=i) (1)


***question*******
Is (1) correct? I am confused because as the provided information
Yn n=1..M are discrete random variables which are conditionally independent
given X. That means P(Y(0),...Y(N)|X)=P(Y(0)|X)*...P(Y(N)|X)
where X is a whole chain, not only one sample X(n).
Does it still guarantee P(Y(0),...Y(N)|X(N))=P(Y(0)|X(N))*...P(Y(N)|X(N))? ?

***end question****


=f(y(n),i)*Sum_k{P(X(N)=i|P(X(N-1)=k)P(X(N-1)=k}*P(Y(N-1),...,Y(0)|X(N)=i)

=f(y(n),i)*Sum_k{P_ki*P(X(N-1)=k}*P(Y(N-1),...,Y(0)|X(N)=i)

I get stuck here. The answer is wrong While the correct answer should be as:

alpha_N(i)=f(y(N),i)*Sum_k{P_ki*P(X(N-1)=k*P(Y(N-1),...,Y(0)|X(N-1)=k)}

=Sum_k {f(Y(N),i)*P_ki*alpha_(N-1)(k); where Sum_k means summary for k=1 to M.

I think the problem that I can not get the correct answer is the step (1).


Can you please help me out?

Thanks
 
Physics news on Phys.org
anyone can help please!
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 3 ·
Replies
3
Views
4K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 29 ·
Replies
29
Views
6K
  • · Replies 0 ·
Replies
0
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K