Markov Processes for Stochastic Modeling by