cth2016/week5/markov-chain/notes.md

#### (working) notes

![](https://en.wikipedia.org/wiki/Markov_chain#/media/File:AAMarkov.jpg)

![](http://i.stack.imgur.com/avtO6.jpg)

![](http://4.bp.blogspot.com/-u9XslQrACb8/VK71Cym3zQI/AAAAAAAAAA0/DAxkKTcCKvc/s1600/markovdiag.png)