Nav: Home

Researchers question if banning of 'killer robots' actually will stop robots from killing

November 15, 2016

BUFFALO, N.Y. - A University at Buffalo research team has published a paper that implies that the rush to ban and demonize autonomous weapons or "killer robots" may be a temporary solution, but the actual problem is that society is entering into a situation where systems like these have and will become possible.

Killer robots are at the center of classic stories told in films such as "The Terminator" and the original Star Trek television series' "The Doomsday Machine," yet the idea of fully autonomous weapons acting independently of any human agency is not the exclusive license of science fiction writers.

Killer robots have a Pentagon budget line and a group of non-governmental organizations, including Human Rights Watch, is already working collectively to stop their development.

Governance and control of systems like killer robots needs to go beyond the end products.

"We have to deconstruct the term 'killer robot' into smaller cultural techniques," says Tero Karppi, assistant professor of media study, whose paper with Marc Böhlen, UB professor of media study, and Yvette Granta, a graduate student at the university, appears in the International Journal of Cultural Studies.

"We need to go back and look at the history of machine learning, pattern recognition and predictive modeling, and how these things are conceived," says Karppi, an expert in critical platform and software studies whose interests include automation, artificial intelligence and how these systems fail. "What are the principles and ideologies of building an automated system? What can it do?"

PHOTO: http://www.buffalo.edu/news/releases/2016/11/015.html.

By looking at killer robots we are forced to address questions that are set to define the coming age of automation, artificial intelligence and robotics, he says.

"Are humans better than robots to make decisions? If not, then what separates humans from robots? When we are defining what robots are and what they do we also define what it means to be a human in this culture and this society," Karppi says.

Cultural techniques are principles that lead into technical developments. Originally related to agriculture, cultural techniques were once about cultivation and the processes, labors and actions necessary to render land productive and habitable.

In media theory, however, the cultural-techniques approach is interested in various working parts and multiple evolutionary chains of thought, technology, imagination and knowledge production, and how these practices turn into actual systems, products and concepts. Cultural techniques provide insight into the process of becoming: How we got to now.

"Cultural techniques create distinctions in the world," says Karppi. "Previously humans have had the agency on the battlefield to pull the trigger, but what happens when this agency is given to a robot and because of its complexity we can't even trace why particular decisions are made in particular situations?"

Any talk of killer robots sounds at first to be an exercise in fantasy, but agencies are already both working to build and trying to prevent the building of their operative foundation.

The Pentagon allocated $18 billion of its latest budget to develop systems and technologies that could form the basis of fully autonomous weapons, instruments that independently seek, identify and attack enemy combatants or targets, according to The New York Times.

A diplomatic strike in this potential theater of machine warfare came in 2012 when a group of NGOs formed "The Campaign to Stop Killer Robots," charged with banning the development of such weapons.

But Karppi and his fellow authors argue in their paper "that there is a need to reconsider the composition of the actual threat."

"Consider how both software and ethical systems operate on certain rules," says Karppi. "Can we take the ethical rule-based system and code that into the software? Whose ethics do we choose? What does the software allow us to do?"

Self-driving cars operate based on the rules of the road: when to stop, turn, yield or proceed. But autonomous weapons need to distinguish between friend and foe and, perhaps most importantly, when one becomes the other, in the case of surrender, for instance.

"The distinctions between combatant and non-combatant, human and machine, life and death are not drawn by a robot," write the authors. "While it may be the robot that pulls the trigger, the actual operation of pulling is a consequence of a vast chain of operations, processes and calculations."

Karppi says it's necessary to unpack two different elements in the case of killer robots.

"We shouldn't focus on what is technologically possible," he says. "But rather the ideological, cultural and political motivations that drive these technological developments."
-end-


University at Buffalo

Related Robots Articles:

Tactile sensor gives robots new capabilities
Eight years ago, Ted Adelson's research group at MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) unveiled a new sensor technology, called GelSight, that uses physical contact with an object to provide a remarkably detailed 3-D map of its surface.
Researchers question if banning of 'killer robots' actually will stop robots from killing
A University at Buffalo research team has published a paper that implies that the rush to ban and demonize autonomous weapons or 'killer robots' may be a temporary solution, but the actual problem is that society is entering into a situation where systems like these have and will become possible.
Soft robots that mimic human muscles
An EPFL team is developing soft, flexible and reconfigurable robots.
Team of robots learns to work together, without colliding
When you have too many robots together, they get so focused on not colliding with each other that they eventually just stop moving.
Social robots -- programmable by everyone
The startup LuxAI was created following a research project at the Interdisciplinary Centre for Security, Reliability and Trust (SnT) of the University of Luxembourg.
On the path toward molecular robots
Scientists at Hokkaido University have developed light-powered molecular motors that repetitively bend and unbend, bringing us closer to molecular robots.
Gentle strength for robots
A soft actuator using electrically controllable membranes could pave the way for machines that are no danger to humans.
Robots get creative to cut through clutter
Clutter is a special challenge for robots, but new Carnegie Mellon University software is helping robots cope, whether they're beating a path across the moon or grabbing a milk jug from the back of the refrigerator.
Humans can empathize with robots
Toyohashi Tech researchers in cooperation with researchers at Kyoto University have presented the first neurophysiological evidence of humans' ability to empathize with a robot in perceived pain.
Giving robots a more nimble grasp
Engineers at MIT have now hit upon a way to impart more dexterity to simple robotic grippers: using the environment as a helping hand.

Related Robots Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Digital Manipulation
Technology has reshaped our lives in amazing ways. But at what cost? This hour, TED speakers reveal how what we see, read, believe — even how we vote — can be manipulated by the technology we use. Guests include journalist Carole Cadwalladr, consumer advocate Finn Myrstad, writer and marketing professor Scott Galloway, behavioral designer Nir Eyal, and computer graphics researcher Doug Roble.
Now Playing: Science for the People

#530 Why Aren't We Dead Yet?
We only notice our immune systems when they aren't working properly, or when they're under attack. How does our immune system understand what bits of us are us, and what bits are invading germs and viruses? How different are human immune systems from the immune systems of other creatures? And is the immune system so often the target of sketchy medical advice? Those questions and more, this week in our conversation with author Idan Ben-Barak about his book "Why Aren't We Dead Yet?: The Survivor’s Guide to the Immune System".