Queen's researchers invent computers that 'pay attention' to users

April 01, 2003

(Kingston, ON) - With increasing numbers of digital devices vying for our attention and time today, researchers from the Human Media Lab (HML) at Queen's University have developed a new concept that allows computers to pay attention to their users' needs.

HML researchers are addressing the problem of the barrage of messages people receive from large numbers of digital appliances. Their Attentive User Interface (AUI) is a new paradigm for interacting with groups of computers that moves beyond the traditional desktop interface.

Current computers are generally designed to act in isolation, without considering what the user is doing before producing distracting interruptions. As a result, today's user has trouble keeping up with volumes of e-mail, instant messages, phone calls and appointment notifications.

"Today's digital lifestyle has the unfortunate side effect of bombarding people with messages from many devices all the time, regardless of whether they're willing, or able to respond," says HML director Dr. Roel Vertegaal. "Like spam [unsolicited e-mail], this problem needs to be addressed." The HML team is designing devices that determine the level of user attention and the importance of each message relative to what the user is doing. Then the computer decides whether to "take a turn" to deliver the message.

Next week in Fort Lauderdale, Florida, Dr. Vertegaal and his students, Jeffrey Shell, Alexander Skaburskis and Connor Dickie, will present their findings at the prestigious ACM CHI 2003 Conference on Human Factors in Computing Systems. HML works in collaboration with IBM Almaden Research Center in San Jose, and Microsoft Research in Redmond, Washington. This month the Association of Computing Machinery's (ACM) flagship publication, Communications of ACM, features a special issue on Attentive User Interfaces, edited by Dr. Vertegaal.

"The way that we use computers has fundamentally changed," says Dr. Vertegaal. "There has been a shift over the past four decades from many users sharing a single mainframe computer, to a single user with a single PC, to many people using many portable, networked devices.

"We now need computers that sense when we are busy, when we are available for interruption, and know when to wait their turn - just as we do in human-to-human interactions," the HML director continues. "We're moving computers from the realm of being merely tools, to being 'sociable' appliances that can recognize and respond to some of the non-verbal cues humans use in group conversation."

Many of the Queen's team's discoveries are rooted in their research into the function of eye contact in managing human group conversation. One of the main underlying technologies they developed is an eye contact sensor that allows each device to determine whether a user is present, and further, whether that user is looking at the device. This allows devices to establish what the user is attending to, and when, whether, and how they should contact the user, if at all.

Funding support for the Human Media Lab includes the Premier's Research Excellence Awards (PREA), the Natural Sciences and Engineering Research Council (NSERC), Institute for Robotics and Information Systems (IRIS), Communications and Information Technology Ontario (CITO) and Microsoft Research.

A number of AUI applications have been developed to date in the Human Media Lab:When they look at the mirror, this bubble pops. This process serves as a metaphor for attention and interruption.
For high resolution pictures of the above projects: http://www.hml.queensu.ca/press.html
To download HML papers: http://www.hml.queensu.ca/papers.html
For details of the CHI 2003 conference: http://www.chi2003.org.

Nancy Dorrance, Queen's News & Media Services, 613-533-2869
Lorinda Peterson, Queen's News & Media Services, 613-533-6000 ext. 77559

Queen's University

Related Eye Contact Articles from Brightsurf:

A smart eye mask that tracks muscle movements to tell what 'caught your eye'
Integrating first-of-its-kind washable hydrogel electrodes with a pulse sensor, researchers from the University of Massachusetts Amherst have developed smart eyewear to track eye movement and cardiac data for physiological and psychological studies.

Vision scientists discover why people literally don't see eye to eye
We humans may not always see eye to eye on politics, religion, sports and other matters of debate.

Eye contact activates the autonomic nervous system even during video calls
A new study from Tampere University in Finland found that eye contact during video calls can elicit similar psychophysiological responses than those in genuine, in-person eye contact.

Smart contact lens sensor developed for point-of-care eye health monitoring
A research group led by Prof. DU Xuemin from the Shenzhen Institutes of Advanced Technology (SIAT) of the Chinese Academy of Sciences has developed a ''smart'' contact lens that can show real-time changes in moisture and pressure by altering colors.

Cooperation after eye contact: Gender matters
Researchers from the UB published an article in the journal Scientific Reports which analyses, through the prisoner's dilemma game, the willingness of people to cooperate when in pairs.

Self-moisturising smart contact lenses
Researchers at Tohoku University have developed a new type of smart contact lenses that can prevent dry eyes.

Antibody-based eye drops show promise for treating dry eye disease
Researchers have identified the presence of a specific type of antibody, called anti-citrullinated protein autoantibodies, or ACPAs, in human tear fluid.

Left eye? Right eye? American robins have preference when looking at decoy eggs
Just as humans are usually left- or right-handed, other species sometimes prefer one appendage, or eye, over the other.

UNH researchers create a hydrogel contact lens to treat serious eye disease
Researchers at the University of New Hampshire have created a hydrogel that could one day be made into a contact lens to more effectively treat corneal melting, a condition that is a significant cause for blindness world-wide.

New research debunks importance of eye contact
Using eye tracking technology, ECU researchers have demonstrated that people don't need to mindfully look at the eyes of their audience to be perceived as making eye contact during face-to-face conversation.

Read More: Eye Contact News and Eye Contact Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.