1st Edition
Advancements in Human–Agent Teaming Research Infrastructure Testbeds, Metrics, and Concepts
SECTION 1 Testbeds
Chapter 1 Testbed Requirements to Support Future Research Directions in Human-Agent Teaming
Amanda K. Newendorp, Isabelle Clement and Michael C. Dorneich et al
Chapter 2 Buy vs. Build: A Structured Assessment of Testbed Alternatives
Lillian K.E. Asiala, James E. McCarthy and Lixiao Huang
Chapter 3 The Team Coordination Testbed: An Open-Source Testbed for Assessing Highly Interdependent Teams
James E. McCarthy, Lillian K.E. Asiala and Michael A. Bailey
Chapter 4 Human Agent Teaming Testbeds: Crewed Autonomous Aircraft Flight Simulator
Richard Agbeyibor, Sanya Doda and Carmen Jimenez Cortes et al
Chapter 5 CHART: A Configurable Testbed for Human-AI Teaming Research in Cybersecurity Operations
Yinuo Du, Volodymyr Miloserdov and Maria José Ferreira et al
Chapter 6 Multiplayer Gaming as a Testbed for Advancing Human-Agent Teaming, Decision-Making, and Communication
Cassandra L. Crone, Patrick Nalepka and Gaurav Patil et al
SECTION 2 Metrics
Chapter 7 Multi-Agent Team Trust Emergence Research (MATTER) Testbed Development and Experimentation
Kendall Carmody, Meredith Carroll and Jessica Wildman et al
Chapter 8 How Well Do We Rely on Reliance? On the Under-Utilization of Reliance-Based Metrics in Studying Human Response to Automation Assistance
Ranjani Narayanan and Karen Feigh
Chapter 9 Beyond Static Metrics: Adaptive Performance as a Process-Oriented Framework for Human-Agent Teaming
Eva Gößwein and Magnus Liebherr
SECTION 3 Concepts
Chapter 10 Goal-based Control of Multiple Intelligent Autonomous Systems: A Paradigm Shift in Human-Autonomy Teaming
Cassandra Heffernan, Thomas Fahy and Kingsley Fletcher et al
Chapter 11 Human-AI Leadership for Search and Rescue
Anirudh More, Tianzi Wang and Nathan Lau
Chapter 12 Joint Activity Testing: A Foundation for Human-AI Evaluation Testbeds
Mohammadreza Jalaeia, Dane A. Morey and Michael F. Rayo
Chapter 13 The ABC–DEFs of HATs: A Cyber-Social Paradigm for Human-AI Teaming
Mukhunth Raghavan, Daniel Griffin and Stephanie Boettcher et al
Chapter 14 Developing Autonomous System Training Models through Hierarchical Reasoning Representations
Mary L. Cummings
Chapter 15 Ambient Intelligent Command Center Testbed for the Navy
Jeffrey Bennett, Brian Lu and Jaquelin Tsui
Biography
Dr. Erin K. Chiou is an Associate Professor of Human Systems Engineering at Arizona State University, USA, with a Ph.D. in Industrial and Systems Engineering from the University of Wisconsin Madison, USA. Her research leverages social and psychological science to improve human-automation work system design. Recent projects have focused on AI-enabled decision support systems with applications in complex and safety critical settings. She directs the Automation Design Advancing People and Technology Laboratory.
Dr. Jason H. Wong is a Senior Cognitive Scientist with a Ph.D. in Human Factors and Applied Cognitive Psychology from George Mason University, USA. His work leverages cognitive science to optimize how people use emerging technologies. Currently focused on human-AI teaming in defense, his expertise also includes human-centered design for augmented reality and aligning training systems with human performance and learning principles.
Dr. Douglas S. Lange is a Senior Scientist in Machine Learning and Artificial Intelligence with a Ph.D. in Computer Software Engineering from the Naval Postgraduate School, USA. He has extensive experience in research, development, and technology insertion for current and future command, control, communications, computers, intelligence, surveillance, and reconnaissance (C4ISR) systems.
Dr. Julie Marble directs research in Human-Autonomy Teaming at the Applied Research Laboratory for Intelligence & Security with a Ph.D. in Human Factors and Cognitive Psychology from Purdue University, USA. She has more than 25 years of experience in human-machine teaming, human-robot interaction, and human reliability analysis, and is a member of the Board on Human-System Integration at the National Academies of Science, Engineering, and Medicine.
