On the road to autonomy, remember the operator

December 19, 2016

Automakers and their tech partners may be looking toward a future when they can offer fully autonomous cars, but Mica Endsley, the author of the recently released Human Factors paper, "From Here to Autonomy," contends that without considering the cognitive constraints of the driver, safety can't be assured. People will still be needed to oversee, direct, and intervene in the actions of autonomous systems for the foreseeable future. Automobiles are only one among many areas of implementation to which this applies; the same can be said for cybersecurity, unmanned aircraft, space exploration, cargo delivery, health monitoring, and more.

Endsley, who conceptualized and has worked extensively on human situation awareness, examines four decades of human factors research on human-automation interaction (aka autonomy) and has developed the Human-Autonomy System Oversight model (HASO). The model identifies critical cognitive processes and user interface features that must be considered when designing and testing any autonomous system.

The challenge for humans in monitoring autonomous systems is remaining aware of and attentive to the system state and the environment so they can respond when the system alone can't do so safely and be able to act in partnership with the automation to achieve optimum results. Behind this challenge are a number of cognitive factors, including becoming complacent when nothing is going wrong, overly trusting the automation to take the correct action when needed, and the sheer boredom that can arise when not actively engaged in automated tasks, all of which get worse the better the automation is. This creates what Endsley posits is an automation conundrum:

"The more automation is added to a system, and the more reliable and robust that automation is, the less likely it is that human operators overseeing the automation will be aware of critical information and able to take over manual control when needed."

According to Endsley, autonomous systems should be, among other things,

Endsley notes, "the article includes specific guidelines that designers can implement in building the operator interfaces for autonomous systems to better keep people in the loop and able to interact with the system autonomy effectively. This will help engineers and organizations that are trying to figure out what to do about the problem."

Endsley concludes, "As long as human oversight of autonomous systems and intervention is required to achieve successful performance, the automation conundrum will undermine performance and safety in many applications."
-end-
To obtain a copy of "From Here to Autonomy: Lessons Learned from Human-Automation Research" for media-reporting purposes, contact HFES Communications Director Lois Smith , 310/394-1811.

The Human Factors and Ergonomics Society is the world's largest scientific association for human factors/ergonomics professionals, with more than 4,500 members globally. HFES members include psychologists and other scientists, designers, and engineers, all of whom have a common interest in designing systems and equipment to be safe and effective for the people who operate and maintain them. "Human Factors and Ergonomics: People-Friendly Design Through Science and Engineering."

Human Factors and Ergonomics Society

Related Autonomy Articles from Brightsurf:

Improving health care autonomy for young adults with autism
Independence has always been a driving force in Nancy Cheak-Zamora's life.

Muscle aging: Stronger for longer
With life expectancy increasing, age-related diseases are also on the rise, including sarcopenia, the loss of muscle mass due to aging.

AI management can benefit the growing online workforce
USC research shows that gig workers and others in the new crowdwork economy need more autonomy and clear purpose in online tasks to perform at a high level -- advantages that AI assistance offers.

Is your job killing you? Stress, lack of autonomy, ability can lead to depression, death
A new study from the Indiana University Kelley School of Business finds that our mental health and mortality have a strong correlation with the amount of autonomy we have at our job, our workload and job demands, and our cognitive ability to deal with those demands.

New Chicago Booth research suggests patients prefer expert guidance for medical decisions
New research from University of Chicago Booth School of Business suggests that in times of uncertainty, people want expert guidance when making choices about their medical care.

'Terrible twos' not inevitable: With engaged parenting, happy babies can become happy toddlers
Parents should not feel pressured to make their young children undertake structured learning or achieve specific tasks, particularly during lockdown.

More autonomy at work reduces the risk of low back pain
A team of psychologists from Technische Universit├Ąt Dresden, in cooperation with experts from health sciences and the Federal Institute for Occupational Safety and Health, has carried out a meta-analysis to identify psychosocial work factors that pose a risk for the development of chronic low back pain (CLBP).

Hastings Center Report, November-December 2019
GoFundMe urged to halt campaigns for unproven medical treatments; the case for new laws to stem the doctor burnout crisis; why sugar taxes don't undermine liberty, and more.

Scientists help soldiers figure out what robots know
An Army-led research team developed new algorithms and filled in knowledge gaps about how robots contribute to teams and what robots know about their environment and teammates.

Tension around autonomy increases family conflict at end of life
Conflict within families can be stressful and confusing, and it can lead to feelings of sadness.

Read More: Autonomy News and Autonomy Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.