Model driverless car regulations after drug approval process, AI ethics experts argue

January 26, 2017

Autonomous systems -- like driverless cars -- perform tasks that previously could only be performed by humans. In a new IEEE Intelligent Systems Expert Opinion piece, Carnegie Mellon University artificial intelligence ethics experts David Danks and Alex John London argue that current safety regulations do not plan for these systems and are therefore ill-equipped to ensure that autonomous systems will perform safely and reliably.

"Currently, we ensure safety on the roads by regulating the performance of the various mechanical systems of vehicles and by licensing drivers" said London, professor of philosophy and director of the Center for Ethics and Policy in the Dietrich College of Humanities and Social Sciences. "When cars drive themselves we have no comparable system for evaluating the safety and reliability of their autonomous driving systems."

Danks and London point to the Department of Transportation's recent attempt to develop safety regulations for driverless cars as an example of traditional guidelines that do not adequately test and monitor the novel capabilities of autonomous systems. Instead, they suggest creating a staged, dynamic system that resembles the regulatory and approval process for drugs and medical devices, including a robust system for post-approval monitoring.

"Self-driving cars and autonomous systems are rapidly spreading through every part of society, but their successful use depends on whether we can trust and understand them," said Danks, the L.L. Thurstone Professor of Philosophy and Psychology and head of the Department of Philosophy. "We, as a society, need to find new ways to monitor and guide the development and implementation of these autonomous systems."

The phased process Danks and London propose would begin with "pre-clinical trials," or testing in simulated environments, such as self-driving cars navigating varied landscapes and climates. This would provide information about how the autonomous system makes decisions in a wide range of contexts, so that we can understand how they might act in future, new situations.

Acceptable performance would permit the system to move on to "in-human" studies through a limited introduction into real-world environments with trained human "co-pilots." Successful trials in these targeted environments would then lead to monitored, permit-based testing, and further easing of restrictions as performance goals were met.

Danks and London propose that this regulatory system should be modeled and managed similarly to how the Food and Drug Administration regulates the drug approval process.

"Autonomous vehicles have the potential to save lives and increase economic productivity. But these benefits won't be realized unless the public has credible assurance that such systems are safe and reliable," said London.
-end-


Carnegie Mellon University

Related Ethics Articles from Brightsurf:

An embedded ethics approach for AI development
The increasing use of AI (artificial intelligence) in the development of new medical technologies demands greater attention to ethical aspects.

New in Ethics and Human Research
Covid-19: Why Challenge Trials of Vaccines Could be Ethical, Despite Severe Risks, Equitably Sharing the Benefits and Burdens of Research.

Ethics and Human Research, January-February 2020
Exploitation in 'crowdsourced' research, oversight of right-to-try access to experimental drugs, and more.

Report builds framework for 'digital political ethics' in 2020
With the 2020 elections looming and amid continuing concerns over social media's role in US politics, four top universities have published a comprehensive new report recommending how candidates, tech platforms and regulators can ensure that digital political campaigns promote and protect fair elections.

New in Ethics & Human Research, September-October 2019
Ethical questions about efforts to 'do research differently' in response to past injustices, and more in the September - October issue.

New in Ethics & Human Research, May-June 2019
Parent experiences when approached for research in a pediatric intensive care unit, the role of inclusion benefits in ethics committee assessment of research, and more in the current issue.

New in Ethics & Human Research, March-April 2019
Anticipatory waivers of consent for pediatric biobanking, a case study of unethical US experiments in Guatemala, and more in the current issue of Ethics & Human Research.

American College of Physicians releases new edition of Ethics Manual
The American College of Physicians (ACP) today released the seventh edition of its Ethics Manual.

Code of ethics doesn't influence decisions of software developers
The world's largest computing society, ACM, updated its code of ethics in July 2018 -- but new research shows that the code of ethics does not appear to affect the decisions made by software developers.

Why are data ethics so challenging in a changing world?
We now live largely in a data-driven world, and ethical oversight and constraints are needed to be sure that data ethics can reach an appropriate balance between the risks and benefits of data technology.

Read More: Ethics News and Ethics Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.