1st Edition

Markov Models & Optimization

By M.H.A. Davis Copyright 1993
316 Pages
by Chapman & Hall

308 Pages
by Routledge

This book presents a radically new approach to problems of evaluating and optimizing the performance of continuous-time stochastic systems. This approach is based on the use of a family of Markov processes called Piecewise-Deterministic Processes (PDPs) as a general class of stochastic system models. A PDP is a Markov process that follows deterministic trajectories between random jumps, the latter... Read more
Preface, 1 Analysis, probability and stochastic processes, 2 Piecewise-deterministic Markov processes, 3 Distributions and expectations, 4 Control theory, 5 Control by intervention, Appendix: Jump processes and their martingales, Bibliography, Index of notation, Subject index

Biography

Davis, M.H.A.

"The book gives an excellent compact treatment of Markov models and their control. It is highly recommended to anybody who is interested in the control of systems subject to random occurrences at discrete times."
-Short Book Reviews

"It...should be welcomed by students and researchers. The book will also appeal to practising actuaries with a desire to get in touch with what modern methods can do."
-Scandinavian Acturial

"The book is very well written and is a substantial contribution to stochastic processes theory. Furthermore, the author not only provides conditions for existence and uniqueness of solutions to the problems in the book, but also works toward finding unifying approach to most nondiffusion probabilistic problems."
-Journal of the American Statistical Association

"This excellent book is a comprehensive introduction to the theory of piecewise-detrministic processes (PDPs) and their applications...Hopefully this book will inspire research in applications of PDPs in new directions."
-SIAM Reviews