Introduction to Markov Chains

The aims of this book are threefold: We start with a naive description of a Markov chain as a memoryless random walk on a finite set. This is complemented by a rigorous definition in the framework of