Using artificial intelligence to understand collective behavior

April 08, 2019

Professor Thomas Müller and Professor Hans Briegel have been carrying out research on a machine learning model for several years. Their model differs significantly from alternative artificial intelligence (AI) learning models. The philosopher from Konstanz and the theoretical physicist from the University of Innsbruck integrate methods of philosophical action theory and quantum optics. Their "Projective Simulation" learning model has already been successfully applied in basic research. Together with the Innsbruck physicist Dr Katja Ried, the researchers have now adapted this AI model for realistic application to biological systems. The current issue of the scientific journal PLoS One discusses how the learning model can be used to model and reproduce locusts' specific swarming behaviour.

Demand for models that are "closer to biology"

To carry out their interdisciplinary collaborative research, the scientists utilized data on locust behaviour from the Cluster of Excellence "Centre for the Advanced Study of Collective Behaviour" in Konstanz, which carries out internationally leading research on collective behaviour and is being funded through the German Excellence Strategy since the beginning of 2019. Biologists in particular are demanding that models explaining collective behaviour be designed to be "closer to biology". Most current models were devised by physicists who assume that interacting individuals are influenced by a physical force. As a result, they don't necessarily perceive individuals within swarms to be agents, but instead, as points such as interacting magnetization units on a grid. "The models work well in physics and have a good empirical basis there. However, they do not model the interaction between living individuals," says Thomas Müller.

AI rules allow agents to learn

"Projective Simulation" is a learning model originally developed by Hans Briegel and is based on agents who do not react to events in a pre-programmed fashion. Instead, they are capable of learning. These "learning agents" are coded as individuals with different behavioural dispositions who interact with their environment by perceiving and reacting to sensory input. For this purpose, they follow AI rules that allow them to use their previous individual experiences to adjust their actions.

On the one hand, this learning process involves quantum physics-based random processes during which all potential courses of action are considered. On the other hand, the action theoretical principle of reinforcement learning comes into play, which is based on rewarding certain outcomes. "We give a reward if the agent moves with the others in a well-ordered manner. In time, an agent realizes: when perceiving certain things, it is better to react in a way that will lead to a reward. We do not preset the right course of action in a particular situation, but we do ensure that it is achieved through the interaction between the agents," explains Thomas Müller.

Learning model can reproduce collective behaviour

Thomas Müller, Katja Ried and Hans Briegel, who currently holds a three-year visiting professorship at the Department of Philosophy at the University of Konstanz, have applied this learning model to a locust's specific and well-researched swarming behaviour. In a confined space, the insect's movement behaviour corresponds to the size of the swarm. If there are only a few individuals, the locusts move in a disordered fashion. In larger numbers, they move together as a unit. In very large numbers, they move as a unit and in the same direction. Since the researchers were initially interested in simply testing their learning model, they utilized a qualitative description of the locusts' behaviour in place of raw data. In this way, they were, in fact, able to qualitatively reproduce the locusts' behaviour.

Looking ahead, Thomas Müller believes that future research in this area will benefit from large data sets on animals, such as schools of fish with their dynamic behavioural patterns. "Modelling fish would probably be a good but also very complicated next step in making our learning model even more realistic," concludes Müller.
Facts:Note to editors:

You can download a photo here:

Caption: Professor Thomas Müller

Copyright: Ulrike Sommer


University of Konstanz
Communications and Marketing
Phone: + 49 7531 88-3603


University of Konstanz

Related Learning Articles from Brightsurf:

Learning the language of sugars
We're told not to eat too much sugar, but in reality, all of our cells are covered in sugar molecules called glycans.

When learning on your own is not enough
We make decisions based on not only our own learning experience, but also learning from others.

Learning more about particle collisions with machine learning
A team of Argonne scientists has devised a machine learning algorithm that calculates, with low computational time, how the ATLAS detector in the Large Hadron Collider would respond to the ten times more data expected with a planned upgrade in 2027.

Getting kids moving, and learning
Children are set to move more, improve their skills, and come up with their own creative tennis games with the launch of HomeCourtTennis, a new initiative to assist teachers and coaches with keeping kids active while at home.

How expectations influence learning
During learning, the brain is a prediction engine that continually makes theories about our environment and accurately registers whether an assumption is true or not.

Technology in higher education: learning with it instead of from it
Technology has shifted the way that professors teach students in higher education.

Learning is optimized when we fail 15% of the time
If you're always scoring 100%, you're probably not learning anything new.

School spending cuts triggered by great recession linked to sizable learning losses for learning losses for students in hardest hit areas
Substantial school spending cuts triggered by the Great Recession were associated with sizable losses in academic achievement for students living in counties most affected by the economic downturn, according to a new study published today in AERA Open, a peer-reviewed journal of the American Educational Research Association.

Lessons in learning
A new Harvard study shows that, though students felt like they learned more from traditional lectures, they actually learned more when taking part in active learning classrooms.

Learning to look
A team led by JGI scientists has overhauled the perception of inovirus diversity.

Read More: Learning News and Learning Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to