When robots commit wrongdoing, people may incorrectly assign the blame

April 05, 2019

Last year, a self-driven car struck and killed a pedestrian in Tempe, Arizona. The woman's family is now suing Arizona and the city of Tempe for negligence. But, in an article published on April 5 in the journal Trends in Cognitive Sciences, cognitive and computer scientists ask at what point people will begin to hold self-driven vehicles or other robots responsible for their own actions--and whether blaming them for wrongdoing will be justified.

"We're on the verge of a technological and social revolution in which autonomous machines will replace humans in the workplace, on the roads, and in our homes," says Yochanan Bigman of the University of North Carolina, Chapel Hill. "When these robots inevitably do something to harm humans, how will people react? We need to figure this out now, while regulations and laws are still being formed."

The article explores how the human moral mind is likely to make sense of robot responsibility. The authors argue that the presence--or perceived presence--of certain key capacities could make people more likely to hold a machine morally responsible.

Those capacities include autonomy, the ability to act without human input. The appearance of a robot also matters, as the more humanlike a robot looks, the more likely people are to ascribe a human mind to it. Other factors that can lead people to perceive robots as having "minds of their own" include an awareness of the situations they find themselves in as well as the ability to act freely and with intention.

Such issues have important implications for people in their interactions with robots. They're also critical considerations for the people and companies who create and operate autonomous machines--and the authors argue that there could be cases where robots that take the blame for harm caused to humans could shield the people and companies who are ultimately responsible for programming and directing them.

As the technology continues to advance, there will be other intriguing questions to consider, including whether robots should have rights. Already, the authors note, the American Society for the Prevention of Cruelty to Robots and a 2017 European Union report have argued for extending certain moral protections to machines. They explain that such debates often revolve around the impact machine rights would have on people, as expanding the moral circle to include machines might in some cases serve to protect people.

While robot morality might still sound like the stuff of science fiction, the authors say that's exactly why it's critical to ask such questions now.

"We suggest that now--while machines and our intuitions about them are still in flux--is the best time to systematically explore questions of robot morality," they write. "By understanding how human minds make sense of morality, and how we perceive the mind of machines, we can help society think more clearly about the impending rise of robots and help roboticists understand how their creations are likely to be received."

As the early experience in Tempe highlights, people are already sharing roads, skies, and hospitals with autonomous machines. Inevitably, more people will get hurt. How robots' capacity for moral responsibility is understood will have important implications for real-world public policy decisions. And those decisions will help to shape a future in which people may increasingly coexist with ever more sophisticated, decision-making machines.
This work is supported by the National Science Foundation and a grant from the Charles Koch Foundation.

Trends in Cognitive Sciences, Bigman et al.: "Holding Robots Responsible: The Elements of Machine Morality" https://www.cell.com/trends/cognitive-sciences/fulltext/S1364-6613(19)30063-4

Trends in Cognitive Sciences (@TrendsCognSci), published by Cell Press, is a monthly review journal that brings together research in psychology, artificial intelligence, linguistics, philosophy, computer science, and neuroscience. It provides a platform for the interaction of these disciplines and the evolution of cognitive science as an independent field of study. Visit: http://www.cell.com/trends/cognitive-sciences. To receive Cell Press media alerts, please contact press@cell.com.

Cell Press

Related Robots Articles from Brightsurf:

On the way to lifelike robots
In order for robots to be able to achieve more than simple automated machines in the future, they must not only have their own ''brain''.

Children think robots can help the elderly -- but not their own grandparents
A study that asked children to assess three different robots showed that they responded most positively to simple robots shaped like flower pots, and were most sceptical of Pepper the robot, which looks more human.

Nanomaterial gives robots chameleon skin
A new film made of gold nanoparticles changes color in response to any type of movement.

How many jobs do robots really replace?
MIT economist Daron Acemoglu's new research puts a number on the job costs of automation.

Robots popular with older adults
A new study by psychologists from the University of Jena (Germany) does not confirm that robot skepticism among elder people is often suspected in science.

Showing robots how to do your chores
By observing humans, robots learn to perform complex tasks, such as setting a table.

Designing better nursing care with robots
Robots are becoming an increasingly important part of human care, according to researchers based in Japan.

Darn you, R2! When can we blame robots?
A recent study finds that people are likely to blame robots for workplace accidents, but only if they believe the robots are autonomous.

Robots need a new philosophy to get a grip
Robots need to know the reason why they are doing a job if they are to effectively and safely work alongside people in the near future.

How can robots land like birds?
Birds can perch on a wide variety of surfaces, thick or thin, rough or slick.

Read More: Robots News and Robots Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.