Manifold Learning Theory and Applications: 1st Edition (Hardback) book cover

Manifold Learning Theory and Applications

1st Edition

Edited by Yunqian Ma, Yun Fu

CRC Press

314 pages | 128 B/W Illus.

Purchasing Options:$ = USD
Hardback: 9781439871096
pub: 2011-12-20
SAVE ~$26.00
$130.00
$104.00
x
eBook (VitalSource) : 9780429251368
pub: 2011-12-20
from $65.00


FREE Standard Shipping!

Description

Trained to extract actionable information from large volumes of high-dimensional data, engineers and scientists often have trouble isolating meaningful low-dimensional structures hidden in their high-dimensional observations. Manifold learning, a groundbreaking technique designed to tackle these issues of dimensionality reduction, finds widespread application in machine learning, neural networks, pattern recognition, image processing, and computer vision.

Filling a void in the literature, Manifold Learning Theory and Applications incorporates state-of-the-art techniques in manifold learning with a solid theoretical and practical treatment of the subject. Comprehensive in its coverage, this pioneering work explores this novel modality from algorithm creation to successful implementation—offering examples of applications in medical, biometrics, multimedia, and computer vision. Emphasizing implementation, it highlights the various permutations of manifold learning in industry including manifold optimization, large scale manifold learning, semidefinite programming for embedding, manifold models for signal acquisition, compression and processing, and multi scale manifold.

Beginning with an introduction to manifold learning theories and applications, the book includes discussions on the relevance to nonlinear dimensionality reduction, clustering, graph-based subspace learning, spectral learning and embedding, extensions, and multi-manifold modeling. It synergizes cross-domain knowledge for interdisciplinary instructions, offers a rich set of specialized topics contributed by expert professionals and researchers from a variety of fields. Finally, the book discusses specific algorithms and methodologies using case studies to apply manifold learning for real-world problems.

Table of Contents

Spectral Embedding Methods for Manifold Learning

Introduction

Spaces and Manifolds

Data on Manifolds

Linear Manifold Learning

Nonlinear Manifold Learning

Summary

Acknowledgment

Robust Laplacian Eigenmaps Using Global Information

Introduction

Graph Laplacian

Global Information of Manifold

Laplacian Eigenmaps with Global Information

Experiments

Summary

Bibliographical and Historical Remarks

Density Preserving Maps

Introduction

The Existence of Density Preserving Maps

Density Estimation on Submanifolds

Preserving the Estimated Density: The Optimization

Summary

Bibliographical and Historical Remarks

Sample Complexity in Manifold Learning

Introduction

Sample Complexity of Classification on a Manifold

Learning Smooth Class Boundaries

Sample Complexity of Testing the Manifold Hypothesis

Connections and Related Work

Sample Complexity of Empirical Risk Minimization

Relating Bounded Curvature to Covering Number

Class of Manifolds with a Bounded Covering Number

Fat-Shattering Dimension and Random Projections

Minimax Lower Bounds on the Sample Complexity

Algorithmic Implications

Summary

Manifold Alignment

Introduction

Formalization and Analysis

Variants of Manifold Alignment

Application Examples

Summary

Bibliographical and Historical Remarks

Acknowledgments

Large-scale Manifold Learning

Introduction

Background

Comparison of Sampling Methods

Large-Scale Manifold Learning

Summary

Bibliography and Historical Remarks

Metric and Heat Kernel

Introduction

Theoretic Background

Discrete Heat Kernel

Heat Kernel Simplification

Numerical Experiments

Applications

Summary

Bibliographical and Historical Remarks

Discrete Ricci Flow for Surface and 3-Manifold

Introduction

Theoretic Background

Surface Ricci Flow

3-Manifold Ricci Flow

Applications

Summary

Bibliographical and Historical Remarks

2D and 3D Objects Morphing Using Manifold Techniques

Introduction

Interpolation on Euclidean spaces

Generalization of Interpolation Algorithms on a Manifold M

Interpolation on SO(m)

Application: The Motion of a Rigid Object in Space

Interpolation on Shape Manifold

Examples of Fitting Curves on Shape Manifolds

Summary

Learning Image Manifolds from Local Features

Introduction

Joint Feature-Spatial Embedding

Solving the Out-Of-Sample Problem

From Feature Embedding to Image Embedding

Applications

Summary

Bibliographical and Historical remarks

Human Motion Analysis Applications of Manifold Learning

Introduction

Learning A Simple Motion Manifold

Factorized Generative Models

Generalized Style Factorization

Solving for Multiple Factors

Examples

Summary

Bibliographical and Historical remarks

About the Editors

About the Editors:

Yunqian Ma received his PhD in electrical engineering from the University of Minnesota at twin cities in 2003. He then joined Honeywell International Inc., where he is currently senior principal research scientist in the advanced technology lab at Honeywell Aerospace. He holds 12 U.S. patents and 38 patent applications. He has authored 50 publications, including 3 books. His research interest includes inertial navigation, integrated navigation, surveillance, signal and image processing, pattern recognition and computer vision, machine learning and neural networks. His research has been supported by internal funds and external contracts, such as AFRL, DARPA, HSARPA, and FAA. Dr. Ma received the International Neural Network Society (INNS) Young Investigator Award for outstanding contributions in the application of neural networks in 2006. He is currently associate editor of IEEE Transactions on Neural Networks, on the editorial board of the pattern recognition letters journal, and has served on the program committee of several international conferences. He also served on the panel of the National Science Foundation in the division of information and intelligent system and is a senior member of IEEE. Dr. Ma is included in Marquis Who is Who Engineering and Science.

Yun Fu received his B.Eng. in information engineering and M.Eng. in pattern recognition and intelligence systems, both from Xian Jiaotong University, China. His M.S. in statistics, and Ph.D. in electrical and computer engineering, were both earned at the University of Illinois at Urbana-Champaign. He joined BBN Technologies, Cambridge, MA, as a Scientist in 2008 and was a part-time lecturer with the Department of Computer Science, Tufts University, Medford, MA, in 2009. Since 2010, he has been an assistant professor with the Department of Computer Science and Engineering, SUNY at Buffalo. His current research interests include applied machine learning, human-centered computing, pattern recognition, intelligent vision system, and social media analysis. Dr. Fu is the recipient of the 2002 Rockwell Automation Master of Science Award, Edison Cups of the 2002 GE Fund Edison Cup Technology Innovation Competition, the 2003 Hewlett-Packard Silver Medal and Science Scholarship, the 2007 Chinese Government Award for Outstanding Self-Financed Students Abroad, the 2007 DoCoMo USA Labs Innovative Paper Award (IEEE International Conference on Image Processing 2007 Best Paper Award), the 2007-2008 Beckman Graduate Fellowship, the 2008 M. E. Van Valkenburg Graduate Research Award, the ITESOFT Best Paper Award of 2010 IAPR International Conferences on the Frontiers of Handwriting Recognition (ICFHR), and the 2010 Google Faculty Research Award. He is a lifetime member of Institute of Mathematical Statistics (IMS), senior member of IEEE, member of ACM and SPIE.

Subject Categories

BISAC Subject Codes/Headings:
BUS061000
BUSINESS & ECONOMICS / Statistics
COM021030
COMPUTERS / Database Management / Data Mining
COM037000
COMPUTERS / Machine Theory