Eye of a fly: Researchers reveal secrets of fly vision for rapid flight control

September 01, 2020

By examining how fruit flies use eye movements to enhance flight control with a staggeringly fast reaction speed -- about 30 times faster than the blink of an eye -- Penn State researchers have detailed a framework to mimic this ability in robotics.

The researchers described the motions of fruit flies tethered in a virtual reality flight simulator constructed with LED lights and recorded using high speed cameras, in a paper published today (Aug. 31) in the Proceedings of the National Academy of Sciences.

"If you are able to study flies doing what they do best -- flying -- you can find some incredible engineering solutions that already exist in biology," said Benjamin Cellini, a doctoral student studying mechanical engineering and the first author of the paper.

Cellini and his adviser, Jean-Michel Mongeau, assistant professor of mechanical engineering and the director of the Bio-Motion Systems Lab, were able to determine how fruit flies use eye movements to quickly coordinate their wings in response to what they were seeing. Since fly eyes are fixed to the head, the researchers tracked head movements to infer where the flies were looking.

Stabilizing gaze is an ordinary phenomenon that most living things can do. For instance, we seamlessly move our eyes, head and/or body to scan a room.

"But that is a challenging, complex problem to understand, how are we and other animals able to do that so well?" Mongeau said. "My lab is interested in active sensing, which is a branch of engineering and biology that studies how sensor movement, like eyes scanning a room, can enhance sensing itself."

While much of the previous research in this area has focused on wing movements, understanding how animals like flies use active eye movements to control flight could greatly enhance robotics. Currently, most robots have stationary sensors, keeping sensing and movement decoupled. However, by better emulating the eyes and brain through the coordination of visual sensors capable of moving on the body, the flight control of robots could be vastly improved.

In support of this theory, the researchers determined the eyes of the fruit fly were able to react four times faster than the body or wings of the animal. These reactions were also tightly coupled, demonstrating that flies rely heavily upon eye movements to coordinate their wing movements.

"We've shown that their eyes can control and stabilize their vision better than we originally thought, by reducing motion blur," Cellini said. "Like in sports, they teach baseball players to follow the ball with their eyes to reduce blur and increase batting performance."

In addition, they found that when the flies had glue carefully applied to their heads and then recorded in the virtual reality flight simulator, the restriction of their head movements had a dramatic impact on flight performance.

"An important principle we discovered here was that fly eyes slow down visual motion that go into the brain and this process enhances their flying behavior," Mongeau said.

Demonstrated in this work, the researchers believe unlocking the secrets of the biological world could have broad implications for technology.

"In engineering, you are taught to apply principles from mathematics and physics to solve problems," Cellini said. "If you want to build a robot to fly on Mars, you can use engineering concepts to provide potential solutions. But we don't always have to develop ideas from scratch; we can also seek inspiration from nature."
A grant from the Air Force Office of Scientific Research supported this research.

Penn State

Related Engineering Articles from Brightsurf:

Re-engineering antibodies for COVID-19
Catholic University of America researcher uses 'in silico' analysis to fast-track passive immunity

Next frontier in bacterial engineering
A new technique overcomes a serious hurdle in the field of bacterial design and engineering.

COVID-19 and the role of tissue engineering
Tissue engineering has a unique set of tools and technologies for developing preventive strategies, diagnostics, and treatments that can play an important role during the ongoing COVID-19 pandemic.

Engineering the meniscus
Damage to the meniscus is common, but there remains an unmet need for improved restorative therapies that can overcome poor healing in the avascular regions.

Artificially engineering the intestine
Short bowel syndrome is a debilitating condition with few treatment options, and these treatments have limited efficacy.

Reverse engineering the fireworks of life
An interdisciplinary team of Princeton researchers has successfully reverse engineered the components and sequence of events that lead to microtubule branching.

New method for engineering metabolic pathways
Two approaches provide a faster way to create enzymes and analyze their reactions, leading to the design of more complex molecules.

Engineering for high-speed devices
A research team from the University of Delaware has developed cutting-edge technology for photonics devices that could enable faster communications between phones and computers.

Breakthrough in blood vessel engineering
Growing functional blood vessel networks is no easy task. Previously, other groups have made networks that span millimeters in size.

Next-gen batteries possible with new engineering approach
Dramatically longer-lasting, faster-charging and safer lithium metal batteries may be possible, according to Penn State research, recently published in Nature Energy.

Read More: Engineering News and Engineering Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.