Further Topics on Discrete-Time Markov Control Processes

A Markov process is a sequence in which the probability of a given state depends on the even or state immediately preceding it. This discussion is of Markov pro... » 

A Markov process is a sequence in which the probability of a given state depends on the even or state immediately preceding it. This discussion is of Markov processes in discrete time, and is confined to Markov processes with Borel state and control spaces. «