Designed for Death

Autonomous weapons systems, often referred to as ‘killer robots’, have been a hallmark of popular imagination for decades. However, with the inexorable advance of artificial intelligence systems (AI) and robotics, killer robots are quickly becoming a reality. These lethal technologies can learn, adapt, and potentially make life and death decisions on the battlefield with little-to-no human involvement. This naturally leads to not only legal but ethical concerns as to whether we can meaningful control such machines, and if so, then how. Such concerns are made even more poignant by the ever-present fear that something may go wrong, and the machine may carry out some action(s) violating the ethics or laws of war. Researchers, policymakers, and designers are caught in the quagmire of how to approach these highly controversial systems and to figure out what exactly it means to have meaningful human control over them, if at all. In Designed for Death, Dr Steven Umbrello aims to not only produce a realistic but also an optimistic guide for how, with human values in mind, we can begin to design killer robots. Drawing on the value sensitive design (VSD) approach to technology innovation, Umbrello argues that context is king and that a middle path for designing killer robots is possible if we consider both ethics and design as fundamentally linked. Umbrello moves beyond the binary debates of whether or not to prohibit killer robots and instead offers a more nuanced perspective of which types of killer robots may be both legally and ethically acceptable, when they would be acceptable, and how to design for them.

• By (author) Steven Umbrello

"Killer robots continue to raise ethical and political questions as they are used in wars all over the world - today even in Europe. Rather than simply rejecting such technologies or discussing Terminator scenarios, "Designed for Death" is a careful and pragmatic argument for meaningful human control over real-world autonomous weapon systems. Using the value sensitive design approach, accounting for military procedures and design histories, and taking an interesting holistic, systems thinking approach, Steven Umbrello shows how technologies embody and disembody values in often unforeseen or unforeseeable ways, and offers a thorough philosophical analysis of autonomy and meaningful human control that can guide regulation in this area." Mark Coeckelbergh, University of Vienna "Designed for Death" tackles the challenging ethical issues raised by autonomous weapons systems, such as what we mean by 'meaningful human control'. This book challenges the reader to see beyond simplistic 'black' or 'white' answers and engage with what we mean when speaking of 'autonomy'. This book draws us into a much broader systems view of the ethical issues and rightly places anthropology, sociology, and the philosophy of technology right back at the centre of the conversation. It will inspire policymakers to a more nuanced approach and provide the more general reader with an introduction to the issues and how we might think our way to a reasoned response to the employment of automated weapons systems." Beth Singler, University of Cambridge "Steven Umbrello offers a much-needed middle path to the debate surrounding increasingly autonomous weapons systems. In this accessible and well-written book, Umbrello makes a compelling case in support of embedding values into autonomous weapons systems as an effective method of ensuring meaningful human control is maintained into the future. Umbrello shows how Value-Sensitive Design and Systems Thinking offer a far more effective solution to these issues than the international civil-society led campaign for a ban, which has thus far been unsuccessful and would be of questionable value. I highly recommend this book to policymakers and scholars looking for an effective middle-ground along which we can progress meaningfully toward ethical controls over autonomous weapons systems." Austin Wyatt, University of New South Wales, and author of The Disruptive Impact of Lethal Autonomous Weapons Systems Diffusion: Modern Melians and the Dawn of Robotic Warriors
—