**[1]** Hint: First show that if $ P $ and $ Q $ are stochastic matrices then so is their product — to check the row sums, try post multiplying by a column vector of ones. Finally, argue that $ P^n $ is a stochastic matrix using induction."
]
}
],
"metadata": {
"date": 1714442505.0143325,
"filename": "finite_markov.md",
"kernelspec": {
"display_name": "Python",
"language": "python3",
"name": "python3"
},
"title": "Finite Markov Chains"
},
"nbformat": 4,
"nbformat_minor": 5
}