This volume develops a new multimodal semiotic approach to the study of communication, examining how multimodal discourse is construed transmedially and interculturally and how new technologies and cultural stances inform communicative contexts across the world.
It contributes to current theoretical debates in the disciplines of semiotics, linguistics, multimodality, and pragmatics, as well as those aspects of pedagogy and film studies that engage with the notions of text and narrative by addressing questions such as: How do we study multimedia communication? How do we incorporate the impact of new media technologies into the study of Linguistics and Semiotics? How do we construe culture in modern communication? How useful are the current multidisciplinary approaches to multimodal communication?
Through the analysis of specific case studies that are developed within diverse academic disciplines and which draw on a range of theoretical frameworks, the goal of this book is to provide a basis for an overarching framework that can be applied by scholars and students with different academic and cultural backgrounds.
'This volume enriches the approaches and analytical methods in the study of multimodality and multimodal communication by presenting studies with both practical analysis and theoretical considerations…with theoretical and methodological innovations, this edited volume offers its reader a range of recent studies in multimodal discourses of diverse kinds. These studies renew our knowledge, or in the editors’ term, “epistemologies” in multimodality and the rules played by multimodality in contemporary communication.' - Kunkun Zhang, Macquarie University, The LINGUIST List
IntroductionChris Christie and Arianna Maiorani Part 1: Multimodality as a Semiotic Perspective 1. An eye-tracking report on reference points, cognitive affordance and multimodal metaphors Luna Bergh and Tanya Beelders 2. Demotivators as deprecating and phatic multimodal communicative acts Krzysztof Ozga 3. Legitimation in Multimodal Material Ensembles Giulio Pagani 4. A pragma-semiotic analysis of advertisements as multimodal texts: A Case Study Chiara Pollaroli and Sabrina Mazzali-Lurati 5. Analysing Pictures: A Systemic-Functional Semiotic Model for Drawing Howard Riley 6. Multimodal Advertisement As Genre Within a Historical Context Sonja Starc Part 2: Multimodality as a Tool for Cultural Research 7. A Multimodal Analysis of the Metonymic Indexing of Power Relations in Novel and Film Christine Christie 8. Re-Bombing in Memento. Traumata of Coventry, Belgrade and Dresden in Multimodal Collective Memory Jan Krasni 9. Argumentation, Persuasion and Manipulation on Revisionist Websites: A Multimodal Rhetorical Analysis Michael Rinn 10. A Corpus Approach to Semantic Transformations in Multisemiotic Texts Alexandar Trklya 11. Multimodality and Illustrations: A Comparative Study of the English and Italian illustrated first editions of The Jungle Books by Rudyard Kipling Monica Turci Part 3: Multimodality as a Way to Analyse Contemporary Narrative Processes 12. Pragmatic Markers in Audiovisual Translation Maria Freddi 13. Filmic Narrative Sequences as Multimodal Environments: A New Perspective on the Effects of Dubbing Arianna Maiorani 14. Multimodal Analysis of the Textual Function in Children's Face-to-Face Classroom Interaction Roberta Taylor 15. The Contribution of Language to Multimodal Storytelling in Commercials Sabine Wahl 16. Coherence in Film: Analysing the Logical Form of Multimodal Discourse Janina Wildfeuer Conclusion Arianna Maiorani and Chris Christie
Edited by Kay O'Halloran, Routledge Studies in Multimodality aims to advance knowledge of multimodal resources such as language, visual images, gesture, action, music, sound, 3-D artefacts, architecture and space, as well as the ways these resources integrate to create meaning in multimodal objects and events.