1st Edition

Sound and Robotics Speech, Non-Verbal Audio and Robotic Musicianship

Edited By Richard Savery Copyright 2024
    357 Pages 76 B/W Illustrations
    by Chapman & Hall

    357 Pages 76 B/W Illustrations
    by Chapman & Hall

    357 Pages 76 B/W Illustrations
    by Chapman & Hall

    Sound in human–robot interaction currently encompasses a wide range of approaches and methodologies not easily classified, analyzed or compared among projects. This edited book covers the state of the art in sound and robotics, aiming to gather existing approaches in a combined volume.

    Collecting chapters from world-leading academic and industry authors, Sound and Robotics: Speech, Non-Verbal Audio and Robotic Musicianship explores how robots can communicate through speech, non-verbal audio and music. The first set of chapters explores how robots use verbal communication, considering the possibilities of speech for human–robot interaction. The second section shifts to roles of non-verbal communication in HRI, including consequential sound, sonification and audio cues. The third and final section describes current approaches to robotic musicianship and their evaluation.

    This book is primarily aimed at HRI researchers, ranging from those who have never used sound to those very experienced with sound. Alongside robotic researchers, this book will present avenues for a diverse range of musicians, composers and sound designers to become introduced to the world of HRI and learn of potential creative directions in robotics.

    1. The Landscape of Sound and Robotics Richard Savery and Trinity Melder  Part 1: Speech  2. Effects of Number of Voices and Voice Type on Storytelling Experience and Robot Perception Sophia C. Steinhaeusser and Birgit Lugrin  3. Learning from Humans: How Research on Vocalizations can Inform the Conceptualization of Robot Sound Hannah Pelikan and Leelo Keevallik  4. Talk To Me: Using speech for loss-of-trust mitigation in social robots Amandus Krantz, Christian Balkenius and Birger Johansson  5. Grounding Spoken Language Cynthia Matuszek  Part 2: Non-semantic Audio  6. Consequential Sounds and their Effect on Human Robot Interaction Aimee Allen, Richard Savery and Nicole Robinson  7. Robot Sound in Distributed Audio Environments Frederic Anthony Robinson, Mari Velonaki and Oliver Bown  8. Navigating Robot Sonification: Exploring Four Approaches to Sonification in Autonomous Vehicles Richard Savery, Anna Savery, Martim Galvao and Lisa Zahray  9. Towards Improving User Experience and Shared Task Performance with Mobile Robots through Parameterized Nonverbal State Sonification Liam Roy, Richard Attfield, Dana Kuli´c and Elizabeth Croft  10. How Happy Should I Be? Leveraging Neuroticism and Extraversion for Music-Driven Emotional Interaction in Robotics Richard Savery, Amit Rogel, Lisa Zahray and Gil Weinberg  11. Augmenting a Group of Task-Driven Robotic Arms with Emotional Musical Prosody Richard Savery, Amit Rogel, and Gil Weinberg  Part 3: Robotic Musicianship and Musical Robots  12. Musical Robots : Overview and Methods for Evaluation Emma Frid  13. Robotic Dancing, Emotional Gestures and Prosody: A Framework for Gestures of Three Robotic Platforms Richard Savery, Amit Rogel, and Gil Weinberg  14. Dead Stars and ‘Live’ Singers: Posthumous ‘Holographic’ Performances in the US and Japan Yuji Sone

    Biography

    Richard Savery is a Research Fellow at Macquarie University, Australia, working at the intersection of sound and robotics. He completed his doctorate in Music Technology at Georgia Tech, USA, focusing on the use of non-verbal audio for improved human-robot interaction.

    "This book is a timely introduction to the sonic world as it relates to robots and human-robot interaction.  Covering an eclectic range of topics including speech, music and emotion, it provides a valuable exploration of contemporary issues in an area of growing importance.”

     

    -Prof Roger K Moore, Chair of Spoken Language Processing, Vocal Interactivity Lab (VILab), Department of Computer Science, University of Sheffield


    "Sound transcends its role as a mere instrument for human communication; it has evolved into an essential aspect of our interaction with the machines surrounding us. This book offers a vital compilation of insights into how sound can be integrated as a central component in the future of robotics.”

     

    -Dr Martin Clancy, editor of Artificial Intelligence and Music Ecosystem