Nav: Home

A new approach to the correction of artificial intelligence errors is proposed

August 05, 2019

The journal Physics of Life Reviews, which has one of the highest impact factors in the categories "Biology" and "Biophysics", has published an article entitled "Symphony of high-dimensional brain".

The authors of the article, world-famous scientists of Russian origin, including the chief researcher at the laboratory for advanced methods of multidimensional data analysis at Lobachevsky University, professor at the University of Leicester (UK) Alexander Gorban, the leading researcher at the laboratory for advanced methods of multidimensional data analysis at Lobachevsky University, professor at University of Leicester (UK) Ivan Tyukin, and the senior researcher at the laboratory of neural network technologies at Lobachevsky University, professor at the Complutense University (Madrid, Spain) Valery Makarov, sum up a broad discussion in the journal Physics of Life Reviews.

The discussion was focused on two problems:
    1) How to quickly and effectively correct the errors of artificial intelligence (AI)?

    2) What is the reason why small neural ensembles in the multidimensional brain are so effective?
A unified approach to these problems was proposed in the article by the same authors, "The unreasonable effectiveness of small neural ensembles in high-dimensional brain", which was published earlier in the same journal and triggered a wide discussion. According to the authors, the heart of the matter is in the geometry of multidimensional spaces. One of the discussion participants, the famous expert in neuroscience R. Quian Quiroga, proposed to call the new approach using the authors' initials: the GMT approach.

As Alexander Gorban notes, data clouds acquire unexpectedly simple properties in multdimensional systems. Even in large random data sets, each point can be separated with a high degree of probability from all other points by a plane, which is constructed using explicit formulas.

"This phenomenon of stochastic separation serves at the same time as the basis for the correction of artificial intelligence errors and for such neurophysiological phenomena as "grandmother or concept cells", individual neurons that selectively respond to the presentation of any image ("grandmother"). Artificial intelligence systems make mistakes and will continue to make mistakes. We must develop an effective technology for processing artificial intelligence errors or abandon the use of artificial intelligence in important projects," Professor Gorban emphasized.

According to the GMT approach, if an artificial intelligence error is detected, it can be corrected for the future by separating the situation with an error from other situations where there were no errors using a simple rule (a plane). It is easy to build cascades of such simple correction tools. They allow the errors of artificial intelligence to be corrected without retraining the original system, which would require incomparably more time and more resources of all types.

Also, "grandmothers or concept cells" can easily separate a specific multidimensional signal from all others signals without creating complex and essentially non-linear rules. New models of neural memory in the multidimensional brain were also proposed by professors Gorban, Makarov and Tyukin (GMT models).

The idea of the "curse of dimensionality", formulated by R.E. Bellman in 1957, is quite well known. In the framework of the GMT approach, the curse of dimensionality turns into a blessing of dimensionality. One should not be afraid of or avoid multiple dimensions: the trick is to use them properly.

The discussion of the new GMT approaches involved ten world-renowned experts. V. K?rková, President of the European Neural Network Society, focused on the need to revise the modern theory of machine learning, since data in the real world are not independent and are not equally distributed.

A. Tozzi and J.F. Peters propose their own approach to deal with the curse of dimensionality. It is based on a multidimensional topology, that is, on the most general geometric properties that are invariant with respect to any continuous transformations. R. Quian Quiroga compares the GMT approach with modern neuroscience concepts on sparse coding in the brain.

The problem of effective information exchange between modern neuroscience and artificial intelligence technology is discussed by several experts with varying degrees of optimism.

P. Varona notes that researchers may face similar problems in these areas, but artificial intelligence is still far from mastering the heterogeneous, robust and effective correction mechanisms that exist in the real brain.

On the other hand, C. van Leeuwen believes that the modern cybernetic approach to the brain is misleading, artificial intelligence models are ineffective in neuroscience, and a change of basic paradigms is required to achieve some success.

To describe the transition between low-dimensional models and the real brain, R. Barrio introduces two worlds, "brainland" and "flatland", and discusses the problem of the rational travel between them. The point of view of L. Fortuna, who studies the influence of non-linear processes of small dimension on the multidimensional brain, is close to the one of R. Barrio. G. Kreiman emphasizes that modern multidimensional geometry allows us to reduce multidimensionality to low-dimensional systems.

V. Kreinovich uses the famous lines from Boris Pasternak's poem to evaluate the GMT approach, which reveals the unexpected simplicity of very complex things:

Assured of kinship with all things
And with the future closely knit
We can't but fall - a heresy! -
To unbelievable simplicity.
But to be spared we can't expect
If we do not conceal it closely.
Men need it more than anything,
But complex things are easier for them...

The result of this discussion is as follows: the GMT approach has proven its value. Proposed models have already been confirmed by real applications. The new error correction technology really works: it corrects artificial intelligence errors on the fly and allows artificial intelligence systems to train each other. New GMT memory models allow for experimental verification and already give some unexpected predictions. In the experts' discussion, new issues arise and horizons for further work open up.
-end-
The research was supported by the Ministry of Science and Higher Education of the Russian Federation and was implemented within the framework of the megagrant won by Lobachevsky University (Project No. 14.Y26.31.0022). Work of ANG and IVT was also supported by InnovateUK (Knowledge Transfer Partnership grants KTP009890; KTP010522) and University of Leicester. VAM work was supported by the Spanish Ministry of Economy, Industry, and Competitiveness (grant FIS2017-82900-P)

Links to the articles:

Gorban A.N., Makarov V.A., Tyukin I.Y. Symphony of high-dimensional brain: Reply to comments on "The unreasonable effectiveness of small neural ensembles in high-dimensional brain". Phys Life Rev, 2019; https://doi.org/10.1016/j.plrev.2019.06.003, as well as the preprint version https://arxiv.org/pdf/1906.12222.pdf.

Gorban A.N., Makarov V.A., Tyukin I.Y. The unreasonable effectiveness of small neural ensembles in high-dimensional brain. Phys Life Rev, 2019; https://doi.org/10.1016/j.plrev.2018.09.005 (open access)

Lobachevsky University

Related Science Articles:

75 science societies urge the education department to base Title IX sexual harassment regulations on evidence and science
The American Educational Research Association (AERA) and the American Association for the Advancement of Science (AAAS) today led 75 scientific societies in submitting comments on the US Department of Education's proposed changes to Title IX regulations.
Science/Science Careers' survey ranks top biotech, biopharma, and pharma employers
The Science and Science Careers' 2018 annual Top Employers Survey polled employees in the biotechnology, biopharmaceutical, pharmaceutical, and related industries to determine the 20 best employers in these industries as well as their driving characteristics.
Science in the palm of your hand: How citizen science transforms passive learners
Citizen science projects can engage even children who previously were not interested in science.
Applied science may yield more translational research publications than basic science
While translational research can happen at any stage of the research process, a recent investigation of behavioral and social science research awards granted by the NIH between 2008 and 2014 revealed that applied science yielded a higher volume of translational research publications than basic science, according to a study published May 9, 2018 in the open-access journal PLOS ONE by Xueying Han from the Science and Technology Policy Institute, USA, and colleagues.
Prominent academics, including Salk's Thomas Albright, call for more science in forensic science
Six scientists who recently served on the National Commission on Forensic Science are calling on the scientific community at large to advocate for increased research and financial support of forensic science as well as the introduction of empirical testing requirements to ensure the validity of outcomes.
World Science Forum 2017 Jordan issues Science for Peace Declaration
On behalf of the coordinating organizations responsible for delivering the World Science Forum Jordan, the concluding Science for Peace Declaration issued at the Dead Sea represents a global call for action to science and society to build a future that promises greater equality, security and opportunity for all, and in which science plays an increasingly prominent role as an enabler of fair and sustainable development.
PETA science group promotes animal-free science at society of toxicology conference
The PETA International Science Consortium Ltd. is presenting two posters on animal-free methods for testing inhalation toxicity at the 56th annual Society of Toxicology (SOT) meeting March 12 to 16, 2017, in Baltimore, Maryland.
Citizen Science in the Digital Age: Rhetoric, Science and Public Engagement
James Wynn's timely investigation highlights scientific studies grounded in publicly gathered data and probes the rhetoric these studies employ.
Science/Science Careers' survey ranks top biotech, pharma, and biopharma employers
The Science and Science Careers' 2016 annual Top Employers Survey polled employees in the biotechnology, biopharmaceutical, pharmaceutical, and related industries to determine the 20 best employers in these industries as well as their driving characteristics.
Three natural science professors win TJ Park Science Fellowship
Professor Jung-Min Kee (Department of Chemistry, UNIST), Professor Kyudong Choi (Department of Mathematical Sciences, UNIST), and Professor Kwanpyo Kim (Department of Physics, UNIST) are the recipients of the Cheong-Am (TJ Park) Science Fellowship of the year 2016.
More Science News and Science Current Events

Top Science Podcasts

We have hand picked the top science podcasts of 2019.
Now Playing: TED Radio Hour

Risk
Why do we revere risk-takers, even when their actions terrify us? Why are some better at taking risks than others? This hour, TED speakers explore the alluring, dangerous, and calculated sides of risk. Guests include professional rock climber Alex Honnold, economist Mariana Mazzucato, psychology researcher Kashfia Rahman, structural engineer and bridge designer Ian Firth, and risk intelligence expert Dylan Evans.
Now Playing: Science for the People

#541 Wayfinding
These days when we want to know where we are or how to get where we want to go, most of us will pull out a smart phone with a built-in GPS and map app. Some of us old timers might still use an old school paper map from time to time. But we didn't always used to lean so heavily on maps and technology, and in some remote places of the world some people still navigate and wayfind their way without the aid of these tools... and in some cases do better without them. This week, host Rachelle Saunders...
Now Playing: Radiolab

Dolly Parton's America: Neon Moss
Today on Radiolab, we're bringing you the fourth episode of Jad's special series, Dolly Parton's America. In this episode, Jad goes back up the mountain to visit Dolly's actual Tennessee mountain home, where she tells stories about her first trips out of the holler. Back on the mountaintop, standing under the rain by the Little Pigeon River, the trip triggers memories of Jad's first visit to his father's childhood home, and opens the gateway to dizzying stories of music and migration. Support Radiolab today at Radiolab.org/donate.