1. Limited time only! Sign up for a free 30min personal tutor trial with Chegg Tutors
    Dismiss Notice
Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Homework Help: Markov Chain Problem

  1. Mar 4, 2010 #1
    A water distribution company in southern California gets its water supply from the north and sell it back to its customers in Orange county. Assume the following simplified scheme: 3 MG (millions of gallons) of water arrives from the north at the beginning of the month. The company can store up to 4 MG. If it has any excess beyond that, it sells it immediately to another distributor for agricultural usage. The monthly usage in Orange county varies randomly: it is

    1 MG with probability .2
    2 MG ” ” .3
    3 MG ” ” .4
    4 MG ” ” .1

    I need to set up a Markov Chain to model this problem, but I can't think of a way to define the states. Any ideas?
  2. jcsd
  3. Mar 5, 2010 #2
    What are the possible amounts of water the distributor has?
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook