1st Edition

Markov Chains and Decision Processes for Engineers and Managers

By Theodore J. Sheskin Copyright 2011
492 Pages
by CRC Press

492 Pages
by CRC Press

492 Pages
by CRC Press

Recognized as a powerful tool for dealing with uncertainty, Markov modeling can enhance your ability to analyze complex production and service systems. However, most books on Markov chains or decision processes are often either highly theoretical, with few examples, or highly prescriptive, with little justification for the steps of the algorithms used to solve Markov models. Providing a unified... Read more

Markov Chain Structure and Models. Regular Markov Chains. Reducible Markov Chains. A Markov Chain with Rewards (MCR). A Markov Decision Process (MDP). Special Topics: State Reduction and Hidden Markov Chains. Index.

Biography

Sheskin, Theodore J.