> For the complete documentation index, see [llms.txt](https://cs70.bencuan.me/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://cs70.bencuan.me/probability/markov-chains.md).

# Markov Chains

Markov Chains are a type of **stochastic process** (a collection of random variables that evolves over time) that satisfy the **Markov property** (the future state $$n+1$$ only depends on the current state $$n$$, and not any of the past states).

Markov chains are often used to model transitions between discrete states.

<http://prob140.org/textbook/content/Chapter_10/00_Markov_Chains.html>