Markov Chains

Aimed at advanced undergraduate or MSc students with some background in basic probability theory, this textbook focuses on Markov chains and quickly develops a ... » 

Aimed at advanced undergraduate or MSc students with some background in basic probability theory, this textbook focuses on Markov chains and quickly develops a coherent and rigorous theory whilst showing also how actually to apply it. Both discrete-time and continuous-time chains are studied. «