Nav: Home

New 'moonshot' effort to understand the brain brings AI closer to reality

January 21, 2016

Harvard's John A. Paulson School of Engineering and Applied Sciences (SEAS), Center for Brain Science (CBS), and the Department of Molecular and Cellular Biology have been awarded over $28 million to develop advanced machine learning algorithms by pushing the frontiers of neuroscience.

The Intelligence Advanced Research Projects Activity (IARPA) funds large-scale research programs that address the most difficult challenges facing the intelligence community. Today, intelligence agencies are inundated with data - more than they are able to analyze in a reasonable amount of time. Humans, naturally good at recognizing patterns, can't keep pace. The pattern-recognition and learning abilities of machines, meanwhile, still pale in comparison to even the simplest mammalian brains. IARPA's challenge: figure out why brains are so good at learning, and use that information to design computer systems that can interpret, analyze, and learn information as successfully as humans.

To tackle this challenge, Harvard researchers will record activity in the brain's visual cortex in unprecedented detail, map its connections at a scale never before attempted, and reverse engineer the data to inspire better computer algorithms for learning.

"This is a moonshot challenge, akin to the Human Genome Project in scope," said project leader David Cox, assistant professor of molecular and cellular biology and computer science. "The scientific value of recording the activity of so many neurons and mapping their connections alone is enormous, but that is only the first half of the project. As we figure out the fundamental principles governing how the brain learns, it's not hard to imagine that we'll eventually be able to design computer systems that can match, or even outperform, humans."

These systems could be designed to do everything from detecting network invasions, to reading MRI images, to driving cars.

The research team tackling this challenge includes Jeff Lichtman, the Jeremy R. Knowles Professor of Molecular and Cellular Biology; Hanspeter Pfister, the An Wang Professor of Computer Science; Haim Sompolinsky, the William N. Skirball Professor of Neuroscience; and Ryan Adams, assistant professor of computer science; as well as collaborators from MIT, Notre Dame, New York University, University of Chicago, and Rockefeller University.

The multi-stage effort begins in Cox's lab, where rats will be trained to recognize various visual objects on a computer screen. As the animals are learning, Cox's team will record the activity of visual neurons using next-generation laser microscopes built for this project with collaborators at Rockefeller University, to see how brain activity changes as the animals learn. Then, a substantial portion of the rat's brain - one-cubic millimeter in size - will be sent down the hall to Lichtman's lab, where it will be diced into ultra-thin slices and imaged under the world's first multi-beam scanning electron microscope, housed in the Center for Brain Science.

"This is an amazing opportunity to see all the intricate details of a full piece of cerebral cortex," says Lichtman. "We are very excited to get started but have no illusions that this will be easy."

This difficult process will generate over a petabyte of data -- equivalent to about 1.6 million CDs worth of information. This vast trove of data will then be sent to Pfister, whose algorithms will reconstruct cell boundaries, synapses, and connections, and visualize them in three dimensions.

"This project is not only pushing the boundaries of brain science, it is also pushing the boundaries of what is possible in computer science," said Pfister. "We will reconstruct neural circuits at an unprecedented scale from petabytes of structural and functional data. This requires us to make new advances in data management, high-performance computing, computer vision, and network analysis."

If the work stopped here, its scientific impact would already be enormous -- but it doesn't. Once researchers know how visual cortex neurons are connected to each other in three dimensions, the next question is to figure out how the brain uses those connections to quickly process information and infer patterns from new stimuli. Today, one of the biggest challenges in computer science is the amount of training data that deep learning systems require. For example, in order to learn to recognize a car, a computer system needs to see hundreds of thousands of cars. But humans and other mammals don't need to see an object thousands of times to recognize it -- they only need to see it a few times.

In subsequent phases of the project, researchers at Harvard and their collaborators will build computer algorithms for learning and pattern recognition that are inspired and constrained by the connectomics data. These biologically-inspired computer algorithms will outperform current computer systems in their ability to recognize patterns and make inferences from limited data inputs. For example, this research could improve the performance of computer vision systems that can help robots see and navigate through new environments.

"We have a huge task ahead of us in this project, but at the end of the day, this research will help us understand what is special about our brains," Cox said. "One of the most exciting things about this project is that we are working on one of the great remaining achievements for human knowledge -- understanding how the brain works at a fundamental level."

Harvard John A. Paulson School of Engineering and Applied Sciences

Related Brain Articles:

Study describes changes to structural brain networks after radiotherapy for brain tumors
Researchers compared the thickness of brain cortex in patients with brain tumors before and after radiation therapy was applied and found significant dose-dependent changes in the structural properties of cortical neural networks, at both the local and global level.
Blue Brain team discovers a multi-dimensional universe in brain networks
Using a sophisticated type of mathematics in a way that it has never been used before in neuroscience, a team from the Blue Brain Project has uncovered a universe of multi-dimensional geometrical structures and spaces within the networks of the brain.
New brain mapping tool produces higher resolution data during brain surgery
Researchers have developed a new device to map the brain during surgery and distinguish between healthy and diseased tissues.
Newborn baby brain scans will help scientists track brain development
Scientists have today published ground-breaking scans of newborn babies' brains which researchers from all over the world can download and use to study how the human brain develops.
New test may quickly identify mild traumatic brain injury with underlying brain damage
A new test using peripheral vision reaction time could lead to earlier diagnosis and more effective treatment of mild traumatic brain injury, often referred to as a concussion.
More Brain News and Brain Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Do animals grieve? Do they have language or consciousness? For a long time, scientists resisted the urge to look for human qualities in animals. This hour, TED speakers explore how that is changing. Guests include biological anthropologist Barbara King, dolphin researcher Denise Herzing, primatologist Frans de Waal, and ecologist Carl Safina.
Now Playing: Science for the People

#534 Bacteria are Coming for Your OJ
What makes breakfast, breakfast? Well, according to every movie and TV show we've ever seen, a big glass of orange juice is basically required. But our morning grapefruit might be in danger. Why? Citrus greening, a bacteria carried by a bug, has infected 90% of the citrus groves in Florida. It's coming for your OJ. We'll talk with University of Maryland plant virologist Anne Simon about ways to stop the citrus killer, and with science writer and journalist Maryn McKenna about why throwing antibiotics at the problem is probably not the solution. Related links: A Review of the Citrus Greening...