Artificial intelligence: Towards a better understanding of the underlying mechanisms

November 27, 2019

The automatic identification of complex features in images has already become a reality thanks to artificial neural networks. Some examples of software exploiting this technique are Facebook's automatic tagging system, Google's image search engine and the animal and plant recognition system used by iNaturalist. We know that these networks are inspired by the human brain, but their working mechanism is still mysterious. New research, conducted by SISSA in association with the Technical University of Munich and published for the 33rd Annual NeurIPS Conference, proposes a new approach for studying deep neural networks and sheds new light on the image elaboration processes that these networks are able to carry out.

Similar to what happens in the visual system, neural networks used for automatic image recognition analyse the content progressively, through a chain of processing stages. However, to date, it is not completely clear which mechanisms allow deep networks to reach their extraordinary levels of accuracy.

"We have developed an innovative method to systematically measure the level of complexity of the information encoded in the various layers of a deep network - the so-called intrinsic dimension of image representations" say Davide Zoccolan and Alessandro Laio, respectively neuroscientist and physicist at SISSA. "Thanks to a multidisciplinary work that has involved the collaboration of experts in physics, neurosciences and machine learning, we have succeeded in exploiting a tool originally developed in another area to study the functioning of deep neural networks".

SISSA scientists, in association with Jakob Macke, of the Technical University of Munich, have examined how the information acquired from neural networks used for image classification is processed: "We have found that image representations undergo a progressive transformation. In the early processing stages, image information is faithfully and exhaustively represented, giving rise to rich and complex representations. In the final processing stages, the information is radically simplified, producing image representations that are supported by a few dozen parameters" explain the two scientists. "Surprisingly we found that the classification accuracy of a neural network tightly depends on its ability to simplify: the more it simplifies the information, the more accurate it is."

This is an especially important result for SISSA that has recently launched a new research program in Data Science, with the goal of studying and developing innovative algorithms for the processing of complex and large data sets.
This study has been published in the proceedings of the 33rd Annual NeurIPS (Neural Information Processing Systems) Conference, the key appointment dedicated to artificial intelligence and to machine learning, in Vancouver from 8 to 14 December 2019. On that occasion, it will be presented by Alessio Ansuini, first author of the study and the scientist who was responsible for conducting the experiments during his post-doctoral research activity at SISSA.

Scuola Internazionale Superiore di Studi Avanzati

Related Human Brain Articles from Brightsurf:

Does the human brain resemble the Universe?
An astrophysicist of the University of Bologna and a neurosurgeon of the University of Verona compared the network of neuronal cells in the human brain with the cosmic network of galaxies... and surprising similarities emerged

New multiscale view of the human brain
Researchers from University of Barcelona study how multilayers that form the human brain interact at different resolutions

New model of human brain 'conversations' could inform research on brain disease, cognition
A team of Indiana University neuroscientists has built a new model of human brain networks that sheds light on how the brain functions.

Researchers explore how the human brain is so resilient
Future technology may be able to monitor and modify the brain to produce enhanced team performance, while increasing the efficiency and accuracy of decisions.

Nanoelectronics learn the same way as the human brain
Activities in the field of artificial intelligence, like teaching robots to walk, demand ever more powerful, yet at the same time more economical computer chips.

New genomic atlas of the developing human brain
Researchers at Gladstone Institutes and UC San Francisco (UCSF) Weill Institute for Neurosciences have created a comprehensive region-specific atlas of the regulatory regions of the genome linked to human embryonic brain development.

Human brain size gene triggers bigger brain in monkeys
Dresden and Japanese researchers show that a human-specific gene causes a larger neocortex in the common marmoset, a non-human primate.

Unique insight into development of the human brain: Model of the early embryonic brain
Stem cell researchers from the University of Copenhagen have designed a model of an early embryonic brain.

New method provides unique insight into the development of the human brain
Stem cell researchers at Lund University in Sweden have developed a new research model of the early embryonic brain.

One step closer to understanding the human brain
An international team of scientists led by researchers at Karolinska Institutet in Sweden has launched a comprehensive overview of all proteins expressed in the brain, published today in the journal Science.

Read More: Human Brain News and Human Brain Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to