This book develops a new framework for describing the structure of multimodal documents: how language, image, layout and other modes of communication work together to convey meaning. Building on recent research in multimodal analysis, functional linguistics and information design, the book examines the textual, visual, and spatial aspects of page-based multimodal documents and employs an analytical model to describe and interpret their structure using the concepts of semiotic modes, medium and genre. To demonstrate and test this approach, the study performs a systematic, longitudinal analysis of a corpus of multimodal documents within a single genre: an extensively annotated corpus of tourist brochures produced between 1967-2008. The book provides multimodal discourse analysts with methodological tools to draw empirically-based conclusions about multimodal documents, and will be a valuable resource for researchers planning to develop and study multimodal corpora.
1. Introduction 2. Understanding page-based media 3. An empirical approach to multimodality 4. Genre: perspectives and patterns 5. Working with multimodal corpora 6. The medium and its characteristics 7. The content and its structure 8. The page and its interpretation 9. Multimodal artefacts in digital media 10. Conclusions and outlook
Edited by Kay O'Halloran, Routledge Studies in Multimodality aims to advance knowledge of multimodal resources such as language, visual images, gesture, action, music, sound, 3-D artefacts, architecture and space, as well as the ways these resources integrate to create meaning in multimodal objects and events.