Register to reply

Linear Algebra Matrix Limits/Stochastic Process

by lutheranian
Tags: linear algebra, matrix limits, probability
Share this thread:
lutheranian
#1
Jul18-11, 01:36 PM
P: 1
1. The problem statement, all variables and given/known data

A diaper liner is placed in each diaper worn by a baby. If, after a diaper change, the liner is soiled, then it is discarded and replaced by a new liner. Otherwise, the liner is washed with the diapers and reused, except that each liner is discarded and replaced after its third use (even if it has never been soiled). The probability that the baby will soil any diaper liner is one third. If there are only new diaper liners at first, eventually what proportions of the diaper liners being used will be new, once used, and twice used? Hint: Assume that a diaper liner ready for use is in one of the three states: new, once used, or twice used. After its use, it then transforms into one of the three states described

2. Relevant equations


If A is a transition matrix and v is the initial state vector and

lim Am = L as m -->[itex]\infty[/itex] then eventual state is Lv

3. The attempt at a solution

I set up the transition matrix with the first column/row corresponding to new liners, the second to once-used, and the third to twice-used, resulting in the following:

A= (1/3, 1/3, 1| 2/3, 0, 0 | 0, 2/3, 0)

The initial vector is v= (1, 0, 0)

I tried finding the limit of Am as m --> [itex]\infty[/itex] using wolframalpha (which is allowed because the homework problems have messy numbers) but the computation times out every time.
Phys.Org News Partner Science news on Phys.org
New model helps explain how provisions promote or reduce wildlife disease
Stress can make hard-working mongooses less likely to help in the future
Grammatical habits in written English reveal linguistic features of non-native speakers' languages
Ray Vickson
#2
Jul18-11, 01:56 PM
Sci Advisor
HW Helper
Thanks
P: 4,939
You can get the limiting state-probabilities by setting up and solving a linear system of 3 equations in 3 unknowns. Using the standard convention (with the ROWS summing to 1---not the columns, as you have chosen), the limiting (row) vector, u, satisfies u = u.A and sum u(j) = 1. Omit one of the three equations u(j) = sum_{k} u(k)*A(k,j), j=1,2,3, and replace it by the normalizing condition sum u = 1.

RGV


Register to reply

Related Discussions
Stochastic Process Calculus & Beyond Homework 0
Stochastic Process - Creating a Probability Transition Matrix Calculus & Beyond Homework 0
Stochastic process (renewal process) Calculus & Beyond Homework 0
Linear Algebra; Stochastic matrix and Steady State vectors Calculus & Beyond Homework 2
Proof that a stochastic process isn't a Markov Process Set Theory, Logic, Probability, Statistics 4