1st Edition

The Neural Bases of Multisensory Processes

Edited By Micah M. Murray, Mark T. Wallace Copyright 2012
    810 Pages 20 Color & 157 B/W Illustrations
    by CRC Press

    It has become accepted in the neuroscience community that perception and performance are quintessentially multisensory by nature. Using the full palette of modern brain imaging and neuroscience methods, The Neural Bases of Multisensory Processes details current understanding in the neural bases for these phenomena as studied across species, stages of development, and clinical statuses.

    Organized thematically into nine sub-sections, the book is a collection of contributions by leading scientists in the field. Chapters build generally from basic to applied, allowing readers to ascertain how fundamental science informs the clinical and applied sciences.

    Topics discussed include:

    • Anatomy, essential for understanding the neural substrates of multisensory processing
    • Neurophysiological bases and how multisensory stimuli can dramatically change the encoding processes for sensory information
    • Combinatorial principles and modeling, focusing on efforts to gain a better mechanistic handle on multisensory operations and their network dynamics
    • Development and plasticity
    • Clinical manifestations and how perception and action are affected by altered sensory experience
    • Attention and spatial representations

    The last sections of the book focus on naturalistic multisensory processes in three separate contexts: motion signals, multisensory contributions to the perception and generation of communication signals, and how the perception of flavor is generated. The text provides a solid introduction for newcomers and a strong overview of the current state of the field for experts.


    Structural Basis of Multisensory Processing: Convergence; H. R. Clemo, L. P. Keniston, and M. A. Meredith
    Cortical and Thalamic Pathways for Multisensory and Sensorimotor Interplay; C. Cappe, E. M. Rouiller, and P. Barone
    What Can Multisensory Processing Tell Us about the Functional Organization of Auditory Cortex? J. K. Bizley and A. J. King

    Neurophysiological Bases
    Are Bimodal Neurons the Same throughout the Brain? M. A. Meredith, B. Allman, L. P. Keniston, and H. R. Clemo
    Audiovisual Integration in Nonhuman Primates: A Window into the Anatomy and Physiology of Cognition; Y. Kajikawa, A. Falchier, G.Musacchia, P. Lakatos, and C. E. Schroeder
    Multisensory Influences on Auditory Processing: Perspectives from fMRI and Electrophysiology; C. Kayser, C. I. Petkov, R. Remedios, and N. K. Logothetis
    Multisensory Integration through Neural Coherence; A. K. Engel, D. Senkowski, and T. R. Schneider
    The Use of fMRI to Assess Multisensory Integration; T. W. James and R. A. Stevenson
    Perception of Synchrony between the Senses; M. Keetels and J. Vroomen
    Representation of Object Form in Vision and Touch; S. Lacey and K. Sathian

    Combinatorial Principles and Modeling
    Spatial and Temporal Features of Multisensory Processes: Bridging between Animal and Human Studies; D. K. Sarko, A. R. Nidiffer, A. R. Powers III, D. Ghose, A. Hillock-Dunn, M. C. Fister, J. Krueger, and M. T. Wallace
    Early Integration and Bayesian Causal Inference in Multisensory Perception; L. Shams
    Characterization of Multisensory Integration with fMRI: Experimental Design, Statistical Analysis, and Interpretation; U. Noppeney
    Modeling Multisensory Processes in Saccadic Responses: Time- Window-of- Integration Model; A. Diederich and H. Colonius

    Development and Plasticity
    The Organization and Plasticity of Multisensory Integration in the Midbrain; T. Perrault Jr., B. A. Rowland, and B. E. Stein
    Effects of Prolonged Exposure to Audiovisual Stimuli with Fixed Stimulus Onset Asynchrony on Interaction Dynamics between Primary Auditory and Primary Visual Cortex; A. Fillbrandt and F. W. Ohl
    Development of Multisensory Temporal Perception; D. J. Lewkowicz
    Multisensory Integration Develops Late in Humans; D. Burr and M. Gori
    Phonetic Recalibration in Audiovisual Speech; J. Vroomen and M. Baart
    Multisensory Integration and Aging; J. L. Mozolic, C. E. Hugenschmidt, A. M. Peiffer, and P. J. Laurienti

    Clinical Manifestations
    Neurophysiological Mechanisms Underlying Plastic Changes and Rehabilitation following Sensory Loss in Blindness and Deafness; E. Striem-Amit, A. Bubic, and A. Amedi
    Visual Abilities in Individuals with Profound Deafness: A Critical Review; F. Pavani and D. Bottari
    Peripersonal Space: A Multisensory Interface for Body–Object Interactions; C. Brozzoli, T. R. Makin, L. Cardinali, N. P. Holmes, and A. Farnè
    Multisensory Perception and Bodily Self-Consciousness: From Out-of-Body to Inside-Body Experience; J. E. Aspell, B. Lenggenhager, and O. Blanke

    Attention and Spatial Representations
    Spatial Constraints in Multisensory Attention; E. Macaluso
    Cross-Modal Spatial Cueing of Attention Influences Visual Perception; J. J. McDonald, J. J. Green, V. S. Störmer, and S. A. Hillyard
    The Colavita Visual Dominance Effect; C. Spence, C. Parise, and Y.-C. Chen
    The Body in a Multisensory World; T. Heed and B. Röder

    Naturalistic Multisensory Processes: Motion Signals
    Multisensory Interactions during Motion Perception: From Basic Principles to Media Applications; S. Soto-Faraco and A. Väljamäe
    Multimodal Integration during Self-Motion in Virtual Reality; J. L. Campos and H. H. Bülthoff
    Visual–Vestibular Integration for Self-Motion Perception; G. C. DeAngelis and D. E. Angelaki

    Naturalistic Multisensory Processes: Communication Signals
    Unity of the Senses for Primate Vocal Communication; A. A. Ghazanfar
    Convergence of Auditory, Visual, and Somatosensory Information in Ventral Prefrontal Cortex; L. M. Romanski
    A Multisensory Perspective on Human Auditory Communication; K. von Kriegstein

    Naturalistic Multisensory Processes: Flavor
    Multimodal Chemosensory Interactions and Perception of Flavor; J. Prescott
    A Proposed Model of a Flavor Modality; D. M. Small and B. G. Green
    Role of Visual and Auditory Cues in Multisensory Perception of Flavor; M. Zampini and C. Spence



    Micah M. Murray has received awards for his research from the Leenaards Foundation (2005 Prize for the Promotion of Scientific Research), the faculty of Biology and Medicine at the University of Lausanne (2008 Young Investigator Prize), and from the Swiss National Science Foundation (bonus of excellence in research). His research has been widely covered by the national and international media and he has authored more than 80 articles and book chapters. His group’s research primarily focuses on multisensory interactions, object recognition, learning and plasticity, electroencephalogram-correlated functional MRI (EEG/fMRI) methodological developments, and systems/cognitive neuroscience in general. Research in his group combines psychophysics, EEG, fMRI, and transcranial magnetic simulation in healthy and clinical populations.

    Mark T. Wallace has received a number of awards for both research and teaching, including the Faculty Excellence Award of Wake Forest University and the Outstanding Young Investigator in the Basic Sciences. He has an established record of research funding from the National Institutes of Health and is the author of more than 125 research presentations and publications. He currently serves on the editorial board of several journals including Brain Topography, Cognitive Processes, and Frontiers in Integrative Neuroscience. His work has employed a multidisciplinary approach to examining multisensory processing, and focuses upon the neural architecture of multisensory integration, its development, and its role in guiding human perception and performance.