Pattern Theory: The Stochastic Analysis of Real-World Signals, 1st Edition (Hardback) book cover

Pattern Theory

The Stochastic Analysis of Real-World Signals, 1st Edition

By David Mumford, Agnès Desolneux

A K Peters/CRC Press

375 pages

Purchasing Options:$ = USD
Hardback: 9781568815794
pub: 2010-08-09
eBook (VitalSource) : 9780429108440
pub: 2010-08-09
from $28.98

FREE Standard Shipping!


Pattern theory is a distinctive approach to the analysis of all forms of real-world signals. At its core is the design of a large variety of probabilistic models whose samples reproduce the look and feel of the real signals, their patterns, and their variability. Bayesian statistical inference then allows you to apply these models in the analysis of new signals.

This book treats the mathematical tools, the models themselves, and the computational algorithms for applying statistics to analyze six representative classes of signals of increasing complexity. The book covers patterns in text, sound, and images. Discussions of images include recognizing characters, textures, nature scenes, and human faces. The text includes online access to the materials (data, code, etc.) needed for the exercises.


required reading for any mathematician [involved] in the modeling complex and realistic signals

—Marco Loog, Nieuw Archief voor Wiskunde, December 2011

The book comes with a large number of exercises and problems, some requiring computer programming. Thanks to these, it can be used as a textbook to support a quite original course that could be offered by a department of applied mathematics, computer science or electrical engineering. In fact, this excellent book targets and deserves a broad readership. It will provide precious and interesting material to anyone who would like to discover pattern theory and how it traverses across geometry, probability and signal processing.

—Laurent Younes, Mathematical Reviews, Issue 2011m

… a masterpiece. It is one of the best books I have ever read. … What singles out this outstanding book is an extremely original subject development. … This book is so exciting. It is a detective fiction. It is an inquiry into ‘real-world signals.’ In contrast to most detective stories, the beauty of the style is exceptional and meets the standards of the best writers. Art and beauty are present everywhere in this marvelous book. … The overall organisation of the book is also marvelous. … The authors are leaders in signal and image processing and this book is based on their extremely innovative research. Reading this book is like entering David Mumford’s office and beginning a friendly and informal scientific discussion with him and Agnès. That is a good approximation to paradise.

—Yves Meyer, EMS Newsletter, September 2011

Pattern Theory covers six classic attempts at modeling signals from the human and natural world: natural language (written), music, character recognition, texture modeling, face recognition, and natural scenes. These applications, appealing to students and researchers alike, include fourteen 'crash courses' giving all the needed basics, exercises, and numerical simulations. … a complete pedagogic tool at master or first-year graduate level. I endorse the publication of Pattern Theory, and will actually use it and recommend it to other researchers.

—Jean-Michel Morel, CMLA

This book is fascinating. It develops a statistic approach to finding the patterns in the signals generated by the world. The style is lucid. I’m reminded of Mumford’s exposition of Theta functions and Abelian varieties in his Tata lectures. The exposition is thorough. The authors provide the necessary mathematical tools allowing scientists to pursue an exciting subject. I’ve been running a seminar at MIT entitled ‘New Opportunities for the Interactions of Mathematics and Other Disciplines’ because I’m convinced that mathematics will move in surprising new directions. Pattern Theory, a decade’s effort, is a prime example.

—I.M. Singer, Institute Professor, MIT

Table of Contents



What Is Pattern Theory?

The Manifesto of Pattern Theory

The Basic Types of Patterns

Bayesian Probability Theory: Pattern Analysis

and Pattern Synthesis

English Text and Markov Chains

Basics I: Entropy and Information

Measuring the n-gram Approximation with Entropy

Markov Chains and the n-gram Models


Word Boundaries via Dynamic Programming and Maximum Likelihood

Machine Translation via Bayes’ Theorem


Music and Piece wise Gaussian Models

Basics III: Gaussian Distributions

Basics IV: Fourier Analysis

Gaussian Models for Single Musical Notes

Discontinuities in One-Dimensional Signals

The Geometric Model for Notes via Poisson Processes

Related Models


Character Recognition and Syntactic Grouping

Finding Salient Contours in Images

Stochastic Models of Contours

The Medial Axis for Planar Shapes

Gestalt Laws and Grouping Principles

Grammatical Formalisms



Image Texture, Segmentation and Gibbs Models

Basics IX: Gibbs Fields

(u + v)-Models for Image Segmentation

Sampling Gibbs Fields

Deterministic Algorithms to Approximate the Mode of a Gibbs Field

Texture Models

Synthesizing Texture via Exponential Models

Texture Segmentation


Faces and Flexible Templates

Modeling Lighting Variations

Modeling Geometric Variations by Elasticity

Basics XI: Manifolds, Lie Groups, and Lie Algebras

Modeling Geometric Variations by Metrics on Diff

Comparing Elastic and Riemannian Energies

Empirical Data on Deformations of Faces

The Full Face Model

Appendix: Geodesics in Diff and Landmark Space


Natural Scenes and their Multiscale Analysis

High Kurtosis in the Image Domain

Scale Invariance in the Discrete and Continuous Setting

The Continuous and Discrete Gaussian Pyramids

Wavelets and the "Local" Structure of Images

Distributions Are Needed

Basics XIII: Gaussian Measures on Function Spaces

The Scale -Rotation- and Translation-Invariant Gaussian Distribution

Mode lII: Images Made Up of Independent Objects

Further Models

Appendix: A Stability Property of the Discrete

Gaussian Pyramid




About the Authors

David Mumford is a professor emeritus of applied mathematics at Brown University. His contributions to mathematics fundamentally changed algebraic geometry, including his development of geometric invariant theory and his study of the moduli space of curves. In addition, Dr. Mumford’s work in computer vision and pattern theory introduced new mathematical tools and models from analysis and differential geometry. He has been the recipient of many prestigious awards, including U.S. National Medal of Science (2010), the Wolf Foundation Prize in Mathematics (2008), the Steele Prize for Mathematical Exposition (2007), the Shaw Prize in Mathematical Sciences (2006), a MacArthur Foundation Fellowship (1987-1992), and the Fields Medal (1974).

Agnès Desolneux is a researcher at CNRS/Université Paris Descartes. A former student of David Mumford’s, she earned her Ph.D. in applied mathematics from CMLA, ENS Cachan. Dr. Desolneux’s research interests include statistical image analysis, Gestalt theory, mathematical modeling of visual perception, and medical imaging.

Subject Categories

BISAC Subject Codes/Headings:
COMPUTERS / Machine Theory