1st Edition

Artificial Intelligence Safety and Security

Edited By Roman V. Yampolskiy Copyright 2018
    474 Pages 35 B/W Illustrations
    by Chapman & Hall

    474 Pages 35 B/W Illustrations
    by Chapman & Hall

    474 Pages 35 B/W Illustrations
    by Chapman & Hall

    The history of robotics and artificial intelligence in many ways is also the history of humanity’s attempts to control such technologies. From the Golem of Prague to the military robots of modernity, the debate continues as to what degree of independence such entities should have and how to make sure that they do not turn on us, its inventors. Numerous recent advancements in all aspects of research, development and deployment of intelligent systems are well publicized but safety and security issues related to AI are rarely addressed. This book is proposed to mitigate this fundamental problem. It is comprised of chapters from leading AI Safety researchers addressing different aspects of the AI control problem as it relates to the development of safe and secure artificial intelligence. The book is the first edited volume dedicated to addressing challenges of constructing safe and secure advanced machine intelligence.

    The chapters vary in length and technical content from broad interest opinion essays to highly formalized algorithmic approaches to specific problems. All chapters are self-contained and could be read in any order or skipped without a loss of comprehension.

    Preface: Introduction to AI Safety and Security




    Part I Concerns of Luminaries

    Chapter 1 Why the Future Doesn’t Need Us

    Bill Joy

    Chapter 2 The Deeply Intertwined Promise and Peril of GNR

    Ray Kurzweil

    Chapter 3 The Basic AI Drives

    Stephen M. Omohundro

    Chapter 4 The Ethics of Artificial Intelligence

    Nick Bostrom and Eliezer Yudkowsky

    Chapter 5 Friendly Artificial Intelligence: The Physics Challenge

    Max Tegmark

    Chapter 6 MDL Intelligence Distillation: Exploring Strategies for Safe Access to Superintelligent Problem-Solving Capabilities

    K. Eric Drexler

    Chapter 7 The Value Learning Problem

    Nate Soares

    Chapter 8 Adversarial Examples in the Physical World

    Alexey Kurakin, Ian J. Goodfellow, and Samy Bengio

    Chapter 9 How Might AI Come About?: Different Approaches and Their Implications for Life in the Universe

    David Brin

    Chapter 10 The MADCOM Future: How Artificial Intelligence Will Enhance Computational Propaganda, Reprogram Human Culture, and Threaten Democracy … and What can be Done About It

    Matt Chessen

    Chapter 11 Strategic Implications of Openness in AI Development

    Nick Bostrom

    Part II Responses of Scholars

    Chapter 12 Using Human History, Psychology, and Biology to Make AI Safe for Humans

    Gus Bekdash

    Chapter 13 AI Safety: A First-Person Perspective

    Edward Frenkel

    Chapter 14 Strategies for an Unfriendly Oracle AI with Reset Button

    Olle Häggström

    Chapter 15 Goal Changes in Intelligent Agents

    Seth Herd, Stephen J. Read, Randall O’Reilly, and David J. Jilk

    Chapter 16 Limits to Verification and Validation of Agentic Behavior

    David J. Jilk

    Chapter 17 Adversarial Machine Learning

    Phillip Kuznetsov, Riley Edmunds, Ted Xiao, Humza Iqbal, Raul Puri, Noah Golmant, and Shannon Shih

    Chapter 18 Value Alignment via Tractable Preference Distance

    Andrea Loreggia, Nicholas Mattei, Francesca Rossi, and K. Brent Venable

    Chapter 19 A Rationally Addicted Artificial Superintelligence

    James D. Miller

    Chapter 20 On the Security of Robotic Applications Using ROS

    David Portugal, Miguel A. Santos, Samuel Pereira, and Micael S. Couceiro

    Chapter 21 Social Choice and the Value Alignment Problem

    Mahendra Prasad

    Chapter 22 Disjunctive Scenarios of Catastrophic AI Risk

    Kaj Sotala

    Chapter 23 Offensive Realism and the Insecure Structure of the International System: Artificial Intelligence and Global Hegemony

    Maurizio Tinnirello

    Chapter 24 Superintelligence and the Future of Governance: On Prioritizing the Control Problem at the End of History

    Phil Torres

    Chapter 25 Military AI as a Convergent Goal of Self-Improving AI

    Alexey Turchin and David Denkenberger

    Chapter 26 A Value-Sensitive Design Approach to Intelligent Agents

    Steven Umbrello and Angelo F. De Bellis

    Chapter 27 Consequentialism, Deontology, and Artificial Intelligence Safety

    Mark Walker

    Chapter 28 Smart Machines ARE a Threat to Humanity

    Kevin Warwick



    Dr. Roman V. Yampolskiy is a Tenured Associate Professor in the department of Computer Engineering and Computer Science at the Speed School of Engineering, University of Louisville. He is the founding and current director of the Cyber Security Lab and an author of many books including Artificial Superintelligence: a Futuristic Approach. During his tenure at UofL, Dr. Yampolskiy has been recognized as: Distinguished Teaching Professor, Professor of the Year, Faculty Favorite, Top 4 Faculty, Leader in Engineering Education, Top 10 of Online College Professor of the Year, and Outstanding Early Career in Education award winner among many other honors and distinctions. Yampolskiy is a Senior member of IEEE and AGI; Member of Kentucky Academy of Science, former Research Advisor for MIRI and Associate of GCRI.

    Dr. Yampolskiy’s main areas of interest are AI Safety, Artificial Intelligence, Behavioral Biometrics, Cybersecurity, Genetic Algorithms, and Pattern Recognition. Dr. Yampolskiy is an author of over 150 publications including multiple journal articles and books. His research has been cited by 1000+ scientists and profiled in popular magazines both American and foreign (New Scientist, Poker Magazine, Science World Magazine), dozens of websites (BBC, MSNBC, Yahoo! News), on radio (German National Radio, Swedish National Radio) and TV. Dr. Yampolskiy’s research has been featured 1000+ times in numerous media reports in 30 languages.

    "Artificial intelligence: Safety and Security is a timely and ambitious edited volume. It comprises 28 chapters organized under three distinct themes: security, artificial intelligence and safety. Edited by Roman V. Yampolskiy, the contributions are well integrated and challenge common conceptions. Yampolskiy has assembled a diverse team of leading scholars.

    In sum, the book provides valuable insight into the cyber ecosystem. It can be read in any order without missing the essence of the subject matter, yet the chapters speak to each other. The chapters provide insight into new research areas and experimental designs. The book is a must-read for computer scientists, security experts, mathematicians, students and individuals who are interested in learning more about the progress of the artificial intelligence field. It will also be of interest to hackers and the intelligence community."

    -International Affairs, Volume 95, Issue 3, May 2019, Pages 728–729, https://doi.org/10.1093/ia/iiz016

    "There are those of us who philosophize and debate the finer points surrounding the dangers of artificial intelligence. And then there are those who dare go in the trenches and get their hands dirty by doing the actual work that may just end up making the difference. So if AI turns out to be like the terminator then Prof. Roman Yampolskiy may turn out to be like John Connor – but better. Because instead of fighting by using guns and brawn he is utilizing computer science, human intelligence and code."

    -Nikola Danaylov (author of Conversations with the Future: 21 Visions for the 21st Century)

    "Artificial Intelligence Safety and Security is an interesting read to learn about risks associated with the rapid growth of autonomous AI systems around us. While benefits of such systems are going to be enormous, so will be the risks if their power is left unchecked. A skillfully edited volume by my Computer Science and Engineering University of Louisville colleague, Dr. Roman Yampolskiy."

    -Jacek ZURADA, Ph.D., Candidate for IEEE President, IEEE Life Fellow, Professor of Electrical and Computer Engineering Department, University of Louisville

    "This amazing and brand-new book with 47 contributors and more than 470 densely packed pages will immediately be recognized as indispensable in the AI safety and AI futurology literature. Among the 28 chapters, the first 11 more or less have the status of modern classics. The remaining 17 are new …"

    -Olle Häggström, Professor of mathematical statistics at Chalmers University

    "Yampolskiy (Univ. of Louisville) furnishes readers with a thoughtful discussion of the state of the art regarding the safety and security of artificial intelligence (AI). To fully appreciate this text, readers must read the editor's preface. In it, he lays out the history of AI with a focus on its failures and how these might have been prevented, previewing themes to be explored in depth in the coming 28 chapters, contributed by 46 researchers in the field of AI. [. . . .] This text offers a comprehensive look at an emerging field; it is best suited for specialists."

    -J. Beidler, emeritus, University of Scranton, Pennsylvania, United States of America