248 Pages
13 B/W Illustrations
by
Chapman & Hall
248 Pages
13 B/W Illustrations
by
Chapman & Hall
Also available as eBook on:
Emphasizing fundamental mathematical ideas rather than proofs, Introduction to Stochastic Processes, Second Edition provides quick access to important foundations of probability theory applicable to problems in many fields. Assuming that you have a reasonable level of computer literacy, the ability to write simple programs, and the access to software for linear algebra computations, the author... Read more
Preface to Second Edition
Preface to First Edition
PRELIMINARIES
Introduction
Linear Differential Equations
Linear Difference Equations
Exercises
FINITE MARKOV CHAINS
Definitions and Examples
Large-Time Behavior and Invariant Probability
Classification of States
Return Times
Transient States
Examples
Exercises
COUNTABLE MARKOV CHAINS
Introduction
Recurrence and Transience
Positive Recurrence and Null Recurrence
Branching Process
Exercises
CONTINUOUS-TIME MARKOV CHAINS
Poisson Process
Finite State Space
Birth-and-Death Processes
General Case
Exercises
OPTIMAL STOPPING
Optimal Stopping of Markov Chains
Optimal Stopping with Cost
Optimal Stopping with Discounting
Exercises
MARTINGALES
Conditional Expectation
Definition and Examples
Optional Sampling Theorem
Uniform Integrability
Martingale Convergence Theorem
Maximal Inequalities
Exercises
RENEWAL PROCESSES
Introduction
Renewal Equation
Discrete Renewal Processes
M/G/1 and G/M/1 Queues
Exercises
REVERSIBLE MARKOV CHAINS
Reversible Processes
Convergence to Equilibrium
Markov Chain Algorithms
A Criterion for Recurrence
Exercises
BROWNIAN MOTION
Introduction
Markov Property
Zero Set of Brownian Motion
Brownian Motion in Several Dimensions
Recurrence and Transience
Fractal Nature of Brownian Motion
Scaling Rules
Brownian Motion with Drift
Exercises
STOCHASTIC INTEGRATION
Integration with Respect to Random Walk
Integration with Respect to Brownian Motion
Itô's Formula
Extensions if Itô's Formula
Continuous Martingales
Girsanov Transformation
Feynman-Kac Formula
Black-Scholes Formula
Simulation
Exercises
Suggestions for Further Reading
Index
Preface to First Edition
PRELIMINARIES
Introduction
Linear Differential Equations
Linear Difference Equations
Exercises
FINITE MARKOV CHAINS
Definitions and Examples
Large-Time Behavior and Invariant Probability
Classification of States
Return Times
Transient States
Examples
Exercises
COUNTABLE MARKOV CHAINS
Introduction
Recurrence and Transience
Positive Recurrence and Null Recurrence
Branching Process
Exercises
CONTINUOUS-TIME MARKOV CHAINS
Poisson Process
Finite State Space
Birth-and-Death Processes
General Case
Exercises
OPTIMAL STOPPING
Optimal Stopping of Markov Chains
Optimal Stopping with Cost
Optimal Stopping with Discounting
Exercises
MARTINGALES
Conditional Expectation
Definition and Examples
Optional Sampling Theorem
Uniform Integrability
Martingale Convergence Theorem
Maximal Inequalities
Exercises
RENEWAL PROCESSES
Introduction
Renewal Equation
Discrete Renewal Processes
M/G/1 and G/M/1 Queues
Exercises
REVERSIBLE MARKOV CHAINS
Reversible Processes
Convergence to Equilibrium
Markov Chain Algorithms
A Criterion for Recurrence
Exercises
BROWNIAN MOTION
Introduction
Markov Property
Zero Set of Brownian Motion
Brownian Motion in Several Dimensions
Recurrence and Transience
Fractal Nature of Brownian Motion
Scaling Rules
Brownian Motion with Drift
Exercises
STOCHASTIC INTEGRATION
Integration with Respect to Random Walk
Integration with Respect to Brownian Motion
Itô's Formula
Extensions if Itô's Formula
Continuous Martingales
Girsanov Transformation
Feynman-Kac Formula
Black-Scholes Formula
Simulation
Exercises
Suggestions for Further Reading
Index
Biography
Greogory F. Lawler
