web2.0calc
 
+0  
 

 Markov Chain Problem - Find the transition diagram

+10
1355
3
avatar+250 

 

I need to find the limiting distribution for this however to do that I need to  first find its transition diagram and I'm just stuck on thinking about how this M.C works.

                                I'm not even sure on the state space for this chain $$X_n=(L_n,R_n)$$Any help with the transition diagram is appreciated =)

 Sep 1, 2015

Best Answer 

 #1
avatar+33661 
+8

Does this help:

 

Markov

.

 Sep 2, 2015

3+0 Answers

 #1
avatar+33661 
+8
Best Answer

Does this help:

 

Markov

.

Alan Sep 2, 2015
 #2
avatar+33661 
0

Not sure that my answer is correct as my states wouldn't consist of just 1s and 0s.

 Sep 2, 2015
edited by Alan  Sep 7, 2015
 #3
avatar+250 
0

Kind of late reply as I havn't been on but that's what I ended up doing so your answer agrees with me -> The M.C consists of 4 states (0,0) , (1,0) , (0,1) , (1,1) and then you find the transition probabilities for each state using what you've given.

 Sep 7, 2015

3 Online Users

avatar
avatar

Top Users

avatar+118673 Melody moderator
avatar+37146 ElectricPavlov
avatar+33661 Alan moderator
avatar+14995 asinus moderator
avatar+2489 GingerAle
avatar+1908 NotThatSmart
avatar+1839 ABJeIIy
avatar+1768 bader
avatar+1537 parmen
avatar+1443 blackpanther
avatar+1439 kittykat

Sticky Topics