1st Edition

Dance Data, Cognition and Multimodal Communication



  • Available for pre-order. Item will ship after March 18, 2022
ISBN 9780367617455
March 18, 2022 Forthcoming by Routledge
456 Pages 82 B/W Illustrations

USD $180.00

Prices & shipping based on shipping country


Preview

Book Description

Dance Data, Cognition and Multimodal Communication is the result of a collaborative and transdisciplinary effort towards a first definition of "dance data", with its complexities and contradictions, in a time where cognitive science is growing in parallel to the need of a renewed awareness of the body’s agency in our manyfold interactions with the world.

It is reflection on observing bodily movements in artistic settings to view human social interactions, multimodal communication, and cognitive processes through a different lens, that of the close collaboration between performing artists, designers, and scholars.

This collection focuses simultaneously on methods and technologies for creating, documenting, or representing dance data. The editors highlight works focusing on the dancers’ embodied minds, including research using neural, cognitive, behavioural, and linguistic data in the context of dance composition processes. Each chapter deals with dance data from an interdisciplinary perspective, presenting theoretical and methodological discussions emerging from empirical studies, as well as more experimental ones.

The book will be of great interest to students and scholars in contemporary dance, neuro-cognitive science, intangible cultural heritage, performing arts, cognitive linguistics, embodiment, design, and creativity studies.

Table of Contents

List of Figures and Tables

List of Contributors

 

  1. Introduction  
  2. Carla Fernandes

                                                                                                                                 

    PART I - Performance-as-Research: Dance data from the artists’ perspective            

       

  3. Negotiating Deliberate Choice-Making: Insights from an interdisciplinary and multimodal encounter during the making of a New Contemporary Dance

                                                                           

Sylvia Rijmer       

                                                                                                     

2. Dance | Data | Storytelling  

                                                                                         

Stephan Jürgens  

                                                                                                             

3. Enabling multimodal interaction in mixed-abled dance: Insights into creating highly accessible teaching tools through mixed-abled dance

                                                                     

Susanne Quinten and Mia Sophia Bilitza        

                                                     

PART II - Dance documentation and dance scores        

                                                 

4. Recording "Effect": A case study in technical, practical and critical perspectives on dance data creation

                                                                                                                                                     

David Rittershaus, Anton Koch, Scott deLahunta, and Florian Jenett

   

5. Digital-born artworks and interactive experience: documentation and archiving

           

PaulaVaranda                                                                                                                   

6. Dance Scoring and en-action as a creative tool for dance documentation

                       

Bertha Bermudez   

                                                                                                           

7. Terpsicore - dance and performing arts archive   

                                                             

Daniel Tércio, Ana Luísa Valdeira, and Catarina Canelas       

                                           

PART III - Computational dance data: Between the real and the virtual            

             

8. Augmented Seeing and Sensing

                                                                                           

Angus Forbes 

                                                                                                                   

9. Motion Capture, Kinetic Synaesthesia and the Digital Aesthetic: A praxis of using the Rokoko inertial motion tracking system in devising and producing contemporary dance performance.  

Daniel Strutt

                                                                                                                       

10. Challenges of Capturing and Visualizing 3D Dance Data

                                             

Claudia Ribeiro and Rafael Kuffner

 

PART IV - The brain’s experience of dance       

                                                                 

11. The embodied neuroaesthetics of dance

                                                                             

Emily Cross and Rebecca Smith

                                                                                                               

12. Dancing neurons: Common brain activity fMRI analysis of the cerebral phenomena behind dance perception

                                                                                                                               

Sofia Amaral Martins and Frank Pollick

                                                                     

13. "I see something, and I like it": unveiling a choreographer’s decision-making process using quantitative and qualitative methods   

                                                                                                     

Ana Rita Fonseca, Rodrigo Abril-de-Abreu, and Carla Fernandes  

                                 

PART V - Dance expertise and cognition           

                                                                 

14. Dance Expertise, Embodied Cognition and the Body in the Brain     

                             

Bettina Bläsing

                                                                                                                   

15. What makes dancers extraordinary? Insights from a cognitive science perspective  

Carla Fernandes, Vito Evola, and Joanna Skubisz

                                                           

16. The Role of Dance Experience, Visual Processing Strategies, and Quantitative Movement Features in Recognition of Emotion from Whole- Body Movements.   

                                             

Rebecca Smith and Frank Pollick   

                                                                               

PART VI - Cognitive metaphor and gestures in dance and theatre                                  

17. Unpeeling meaning: an analogy and metaphor identification and analysis tool for Modern and Post-Modern dance, and beyond

Vicky Fisher               

18. Understanding Non-Verbal Metaphor: A Cognitive Approach to Metaphor in Dance   

Lacey Okonski, Julie Madden, and Kaitlin Tothpal   

                                                   

19. Study on hand movements accompanied during description of dance appreciation    

Zi-Hyun Kim and Hedda Lausberg    

                                                                                     

20. Reduction of gesticulation and information patterning strategies in acted speech       

Giorgina Cantalini and Massimo Moneglia

21. Lines of experience: Towards a research method

Michael O'Connor

 

Note about Funding

Index

 

List of Contributors

 

Sylvia Rijmer is Professor of Dance at the Escola Superior de Dança (IPL) and an independent dance maker and researcher based in Lisbon, Portugal. Formally trained (Nationale Balletacademie, Elmhurst, Juilliard), she has danced professionally in various repertoire and freelance dance companies (Ballet Gulbenkian, Bern Ballet, Drift, Stadttheater Giessen, among others). Her current choreographic research takes an experimental approach which seeks to bridge the gap between Arts and Sciences to encounter alternative possibilities for making and experiencing dance.

Stephan Jürgens is a Post-Doc researcher at ITI-LARSyS, University of Madeira, Portugal. He holds a PhD on Contemporary Choreography and New Media Technologies. His research interests concentrate on the design of creative strategies for live performance involving interactive systems. Recently, Stephan has been involved in several 3D media productions exploring dance in VR.

 

Susanne Quinten is substitute professor at the faculty of Rehabilitation Sciences, TU Dortmund University, Germany. Her research interests include arts and disability, arts education with particular regard to mixed-abled dance. She is the editor of several books and publishing journals.

Mia Sophia Bilitza is research assistant at the faculty of Rehabilitation Science in Music and Movement in Rehabilitation and Pedagogy in Disability, TU Dortmund University, Germany. She is currently obtaining her PhD about respect behaviour in dance contexts and its possibilities for change in heterogenous societies. Her research interests are respect, dance, integration and inclusion. She is also a choreographer, dance manager and works internationally in the field of community dance.

David Rittershaus is a dance and theatre scholar with Motion Bank, Hochschule Mainz – University of Applied Sciences, Germany. He is working on his dissertation on the digital documentation and study of choreographic processes, linked to a critical theory of digital knowledge formation, representation, and transmission in Contemporary Dance.

Anton Koch is a research assistant with Motion Bank, Hochschule Mainz – University of Applied Sciences, Germany. He is the lead engineer and technological strategist, focusing on data modelling, experimental application infrastructures and deployment strategies for research projects in the humanities.

 

Scott deLahunta is Professor of Dance, Centre for Dance Research, Coventry University (UK) and co-directing (with Florian Jenett) Motion Bank, Hochschule Mainz – University of Applied Sciences, Germany.He has worked as writer, researcher, and organiser on a range of international projects bringing performing arts with a focus on choreography into conjunction with other disciplines and practices. http://www.sdela.dds.nl

Florian Jenett is Professor of Computer Science, Department of Design, Hochschule Mainz – University of Applied Sciences, Germany. He has been running his own art studio since 2007, has shown works in various exhibitions and is a long-time contributor to Processing, an international Creative Coding open-source project. From 2010 onwards he has been researching for the Motion Bank that he co-directs alongside Scott deLahunta since 2014.

 

Paula Varanda obtained her PhD from Middlesex University in Media and Performing Arts in 2016, London, UK. She was dance critic for PÚBLICO newspaper for 12 years in Portugal and published books and articles about dance, performance, technology and community practices. Her research interests are on aesthetics, arts education and audience development, the body and new media in contemporary societies, and cultural policies that foster access and sustainability to the arts.

Bertha Bermudez z Pascual is an artists, independent researcher and an external PhD student at the Faculty of Humanities, Capaciteitsgroep Media & Cultuur, Amsterdam University, Amsterdam, The Netherlands. Her research interests focuses on dance transmission, documentation, archive and dissemination using digital media. She has coordinated transdisciplinary research projects (Capturing) Intention, Inside Movement Knowledge and Pre-choreographic Elements between 2005 and 2014. Currently she is finishing her PhD Performing Archives at the Amsterdam University while working as independent advisor and coordinator for dance projects and artistic processes.

Daniel Tércio is Associated Professor at the University of Lisbon, Faculty of Human Kinetics and researcher at INET-MD. He published more than 20 articles in specialized journals, such as Performance Research (UK) and Repertório (Brazil). He authored several book chapters, some of which in volumes published by prestigious publishing houses such as Peter Lang and SAGE. As a critic, his dance reviews appear regularly in the Portuguese press since 2004.

 

Catarina Canelas is a junior researcher at Instituto de Etnomusicologia - centro de estudos em música e dança at the Faculty of Human Kinetics of the University of Lisbon (FMH-UL). She is working on Terpsicore (dance and performing arts archive) since 2017. This is her first article to be published. She has both degrees in Dance from FMH-UL and in Social Policy from Instituto Superior de Ciências Sociais e Políticas (Lisbon University).

Ana Luísa Valdeira is researcher at Instituto de Etnomusicologia - centro de estudos em música e danca, and editor at Imprensa da Universidade de Lisboa (University of Lisbon Press). She obtained her PhD in Arts from University of Lisbon in 2020.

 

Angus G. Forbes is Associate Professor of Computational Media at the University of California, Santa Cruz, where he directs the Creative Coding Lab, an interdisciplinary research group that investigates topics in visualization, graphics, human-computer interaction, and machine learning. More information about the lab can be found at https://creativecoding.soe.ucsc.edu/.

Dan Strutt is a lecturer in the department of Media, Communications and Cultural Studies at Goldsmiths, University of London, teaching film theory and analysis alongside social, cultural and economic theory. His book The Digital Image and Reality: Affect, Metaphysics and Post-Cinema was published with Amsterdam University Press in 2019. With previous research work on CREATe and the AHRC Creative Economy Programme, he also does collaborative work with digital audiovisual artists. https://www.gold.ac.uk/media-communications/staff/strutt-dan/

Cláudia Ribeiro is a Postdoctoral Researcher at FCUL, in the research group LASIGE. She obtained her PhD in Information Systems and Computer Engineering at the University of Lisbon. Her research interests include Serious Games, Computer Graphics, Machine learning, and Interactive Systems.

Rafael Kuffner dos Anjos is a Postdoctoral Researcher at CMIC, Victoria University of Wellington, Wellington, New Zealand. He obtained his PhD in Information Systems and Computer Engineering at the University of Lisbon in 2018. His research interests include Computer Graphics, Image-based rendering, and XR.

Carla Fernandes is Principal Investigator at ICNOVA Research Group on Performance & Cognition and Professor at FCSH – NOVA University Lisbon, where she leads the ERC-funded international project "BlackBox". Her research focus is in the intersection of Arts&Cognition, Multimodal Communication, New Media and Intangible Cultural Heritage, fascinated by the complexity of the human mind and non-verbal behavior in creativity settings. She holds a PhD in Cognitive Linguistics, supervises PhD and MA theses, and is author in international journals and books.

Emily S. Cross is Professor of Social Robotics within the Institute of Neuroscience and Psychology at the University of Glasgow in Scotland and Professor of Human Neuroscience within the Department of Cognitive Science at Macquarie University in Australia. She obtained her PhD in Cognitive Neuroscience from Dartmouth College in 2008 and has danced and toured with several contemporary dance companies in the USA, UK and NZ. She currently directs the Social Brain in Action laboratory which explores how different kinds of experience shape brain and behaviour.

Rebecca Smith is a PhD student within the Institute of Neuroscience and Psychology at the University of Glasgow in Scotland. As a classically trained ballet dancer, she brings considerable dance expertise to bear on her PhD work, which sits at the intersection of social psychology, dance, and artificial intelligence/robotics.

 

Sofia Amaral Martins is a dance science teacher at Neuroscience of Dance, Portugal. Upon attending the University of Glasgow in 2017, she decided to join her two passions by doing her research thesis on the cerebral phenomena beyond dance. She went on to develop the Substancia Nigra dance project where she teaches Neuroscience of Dance workshops worldwide. The project aims to break the science art division between dancers and neuroscience and instigate the use of dance as medicine.

Frank Pollick is a Professor of Psychology at the University of Glasgow, UK. He is interested in how we perceive human movement and how this movement is interpreted within brain mechanisms of emotion and higher order cognition. He has previously worked with the Jang Seon-Hee Ballet Company and the Rosie Kay Dance Company on dance neuroscience projects. He was also a member of the AHRC funded Watching Dance Project.

 

Ana Rita Fonseca is Post-doctoral researcher at Blackbox, Faculdade de Ciências Sociais e Humanas, Universidade Nova de Lisboa. She obtained her PhD in Neuroscience from Universidade Nova de Lisboa in 2016. Her research interests include Dance-making, Movement Creation and Creativity.

 

Rodrigo Abril de Abreu is an Invited researcher at Blackbox, Faculdade de Ciências Sociais e Humanas, Universidade Nova de Lisboa. He holds a PhD in Neuroscience, with a specialization in Social Behaviour. His main research interests lie in the topics of cooperation, empathy and social learning in human and non-human animals.

 

Bettina Bläsing is lecturer in Rehabilitation Science at the Technical University Dortmund, Germany. After completing her PhD in Biology, she worked as a postdoctoral researcher at the Max-Planck-Institute for Evolutionary Anthropology at Leipzig and at the Center of Excellence Cognitive Interaction Technology at Bielefeld. In 2019, she received the venia legendi in Sport Science at Bielefeld University for completing her habilitation on memory, learning and expertise in dance.

Vito Evola is currently Researcher in cognitive linguistics and multimodal communication at the Universidade Nova de Lisboa, having previously lectured and conducted research at universities in Palermo, Berkeley, Cleveland, Aachen, and Geneva. His research, presented and published in various international venues and journals, lies at the intersection of language, culture, and cognition, and analyses data from both common and more specialized contexts, such as patient-doctor interactions, psychotherapy and forensic interviews, religious discourse, and the performing arts.

Joanna Skubisz is a PhD candidate in General Linguistics at the Universidade NOVA de Lisboa, Portugal, and a former young researcher in the BlackBox project (2014-2019). Research on head gestures marks the beginning of her early scientific work. Her research interest includes reporting quantitative methods in Gesture Studies. Currently, in her PhD dissertation, she investigates the impact of vocalizations and touch in dance practice.

Rebecca Smith is a PhD student within the Institute of Neuroscience and Psychology at the University of Glasgow in Scotland. As a classically trained ballet dancer, she brings considerable dance expertise to bear on her PhD work, which sits at the intersection of social psychology, dance, and artificial intelligence/robotics.

Frank Pollick is a Professor of Psychology at the University of Glasgow, UK. He is interested in how we perceive human movement and how this movement is interpreted within brain mechanisms of emotion and higher order cognition. He has previously worked with the Jang Seon-Hee Ballet Company and the Rosie Kay Dance Company on dance neuroscience projects. He was also a member of the AHRC funded Watching Dance Project. 

Vicky J. Fisher is an affiliated researcher with the Multimodal Language and Cognition Group, Radboud University/Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands. Originally from England, Vicky is a participatory dance practitioner, founder member of CandoCo Dance Company and taught dance theory and practice for over twenty years. Her research focus is on dance as a form of embodied analogy/metaphor, integrating approaches from dance practice, multimodal linguistics, and cognitive psychology.

Lacey Okonski holds a PhD in Psychology. Previously a Fulbright Fellow and Visiting Professor in Brazil, she is currently at Umeå University, Sweden. Her research interests include psycholinguistics, metaphor and dance. Her work has been featured in various publications such as the Journal of Pragmatics, Metaphor and the Social World, and The American Journal of Psychology. Dr. Okonski has ballet training and was a performing member of Mambo Romero Latin Dance Company in San Francisco.

Julie Madden is a lecturer at the University of Tennessee at Chattanooga. She completed her undergraduate training at the University of California, Santa Cruz, and received her PhD in Cognitive Psychology from Florida State University. Dr. Madden is currently, in collaboration with Dr. Mike Kaschak, putting the final touches on a book chapter on best practices for replication science specifically focusing on research in embodied cognition.

Kaitlin Tothpal received her Bachelor of Arts degree in Psychology and education from the University of California, Santa Cruz. She began her dance training (ballet, tap, jazz, etc. ) at the age of three in Los Angeles County. Kaitlin has experience teaching dance as well as dancing professionally. She also has experience in the field of behavior therapy for Autistic children - young adults.

 

Zi Hyun Kim obtained her PhD in Sports Science from German Sport University Cologne in 2016. At present, she is a research scholar at the World Ethnic Dance Institute of Korea National University of Arts in Seoul, Korea, and interested in cross-cultural comparison studies on hand movement in connection with dance appreciation.

Hedda Lausberg is a Full Professor in the Department of Neurology, Psychosomatic Medicine and Psychiatry at German Sport University Cologne, Germany. She is a Neurologist, Specialist in Psychosomatic Medicine and Psychotherapy, Psychiatrist.

Giorgina Cantalini is didactic manager at the Civica Scuola di Teatro Paolo Grassi in Milan, Italy. She obtained her PhD in Linguistics at Roma Tre University in 2018 with a dissertation on Gesture/Prosody Synchronization in Acting and Spontaneous Speech. She is an actress and a drama professor, and she has developed a technique for exploiting body movements for expressive reading.

Massimo Moneglia is Professor of Linguistics at the Department of Letters and Philosophy of the University of Florence, Italy, where he currently directs the LABLITA research unit devoted to the collection and annotation of multilingual and multimodal language resources. Among his main achievements are the C-ORAL-ROM Multilingual Corpus of Spontaneous Speech and the IMAGACT Cross-linguistic Ontology of Action.

Michael O’Connor is currently a Ph.D. candidate at the Vrije Universiteit in Amsterdam, NL. He is a choreographer and dancer, whose work is influenced by cognitive science, social and philosophical theories.

...
View More

Editor(s)

Biography

Carla Fernandes is Principal Investigator and Invited Professor at NOVA University Lisbon.  She currently works for NOVA’s Institute for Communication, working as Head of the "BlackBox LAB Arts&Cogntion" and as research partner of EU projects on Cultural Heritage (T-Factor, Weave, Europeana-Space, CultureMoves).  She was awarded an ERC Grant for her interdisciplinary project "BlackBox: a collaborative platform to document performance composition". Her research focus is on the documentation of Intangible Cultural Heritage, Multimodal Communication and Cognition, fascinated by non-verbal behaviour in creativity settings. She is supervisor of MA and PhD theses, and author of numerous book chapters and papers in peer-reviewed publications. 

Vito Evola is a cognitive linguistics researcher at FCSH – Universidade NOVA de Lisboa, working at the intersection of language, culture, and cognition, focusing on cognitive semiotics, gesture and bodily communication, and metaphors.

Cláudia Ribeiro is a Postdoctoral Researcher at FCUL – Universidade de Lisboa, in the research group LASIGE. Her research interests include Machine learning, Deep Learning (focusing on emotion recognition in multimedia content), and Interactive Systems.