Publisher of Humanities, Social Science & STEM Books

View All Book Series


Stochastic Modeling Series

4 Series Titles

Per Page

Constrained Markov Decision Processes

Constrained Markov Decision Processes

1st Edition

By Eitan Altman
March 30, 1999

This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays ...

Markov Processes for Stochastic Modeling

Markov Processes for Stochastic Modeling

1st Edition

By Masaaki Kijima
January 01, 1997

This book presents an algebraic development of the theory of countable state space Markov chains with discrete and continuous time parameters....

Algorithmic Probability A Collection of Problems

Algorithmic Probability: A Collection of Problems

1st Edition

By Marcel F. Neuts
July 01, 1995

This unique text collects more than 400 problems in combinatorics, derived distributions, discrete and continuous Markov chains, and models requiring a computer experimental approach. The first book to deal with simplified versions of models encountered in the contemporary statistical or ...

Stable Non-Gaussian Random Processes Stochastic Models with Infinite Variance

Stable Non-Gaussian Random Processes: Stochastic Models with Infinite Variance

1st Edition

By Gennady Samoradnitsky, M.S. Taqqu
June 01, 1994

This book presents similarity between Gaussian and non-Gaussian stable multivariate distributions and introduces the one-dimensional stable random variables. It discusses the most basic sample path properties of stable processes, namely sample boundedness and continuity....

AJAX loader