When artificial intelligence evaluates chess champions

April 25, 2017

The ELO system, which most chess federations use today, ranks players by the results of their games. Although simple and efficient, it overlooks relevant criteria such as the quality of the moves players actually make. To overcome these limitations, Jean-Marc Alliot of the Institut de recherche en informatique de Toulouse (IRIT - CNRS/INP Toulouse/Université Toulouse Paul Sabatier/Université Toulouse Jean Jaurès/Université Toulouse Capitole) demonstrates a new system, published on 24 april 2017 in the ICGA Journal (International Computer Games Association) .

Since the 1970s, the system designed by the Hungarian, Arpad Elo, has been ranking chess players according to the result of their games. The best players have the highest ranking, and the difference in ELO points between two players predicts the probability of either player winning a given game. If players perform better or worse than predicted, they either gain or lose points accordingly. This method does not take into account the quality of the moves played during a game and is therefore unable to reliably rank players who have played at different periods. Jean-Marc Alliot suggests a direct ranking of players based on the quality of their actual moves.

His system computes the difference between the move actually played and the move that would have been selected by the best chess program to date, Stockfish. Running on the OSIRIM supercomputer1, this program executes almost perfect moves. Starting with those of Wilhelm Steinitz (1836-1900), all 26,000 games played since then by chess world champions have been processed in order to create a probabilistic model for each player. For each position, the model estimates the probability of making a mistake, and the magnitude of the mistake. These models can then be used to compute the win/draw/lose probability for any given match between two players. The predictions have proven not only to be extremely close to the actual results when players have played concrete games against one another, they also fare better than those based on ELO scores. The results demonstrate that the level of chess players has been steadily increasing. The current world champion, Magnus Carlsen, tops the list, while Bobby Fischer is third.

Under current conditions, this new ranking method cannot immediately replace the ELO system, which is easier to set up and implement. However, increases in computing power will make it possible to extend the new method to an ever-growing pool of players in the near future.

IOS Press

Related Probability Articles from Brightsurf:

Are climate scientists being too cautious when linking extreme weather to climate change?
Climate science has focused on avoiding false alarms when linking extreme events to climate change.

Research identifies sperm biomarker associated with couples' pregnancy probability
Researchers at the University of Massachusetts Amherst have identified a single-measure biomarker in sperm mitochondrial DNA that may predict male reproductive health and pregnancy success.

Why we distort probability
A team of scientists has concluded that our cognitive limitations lead to probability distortions and to subsequent errors in decision-making.

COVID-19 may have a longer incubation period, suggests probability analysis of Wuhan cases
By applying the renewal theory in probability to reduce recall bias in initial case reports, scientists have come up with a new estimate for the incubation period of COVID-19.

Risk of sepsis greatest for patients with frailty, older age or urinary tract infections
Patients with frailty, older age and urinary tract infections (UTIs) are at greatest risk of developing sepsis following infection consultations in primary care, research has found.

Discovery of accurate and far more efficient algorithm for point set registration problems
Point set registration problems, i.e. finding corresponding points between shapes represented as point sets, are important in a variety of fields, so algorithms have been developed.

How we learn is a quantum-like manner!
It brings people new perspectives on understanding how human brains run.

Probability of dying from road injury has dropped worldwide in all but 5 nations
Road injuries have become more frequent but less fatal over the past three decades, according to a new scientific study.

Extreme flooding from storm surge and heavy precipitation projected to increase higher probability of compound flooding from precipitation and storm surge in Europe under anthropogenic climate change
Risk of compound flooding, which can result when rapid sea level rises associated with storms occur along with heavy rains, is currently concentrated along Mediterranean countries but will greatly increase for Northern European in the future as the climate warms, according to a new modeling study.

Study: Action-oriented goals produce higher probability of purchases under tight deadlines
People on a tight deadline have stronger intentions to enact behaviors -- whether it's redeeming a coupon or following through on receiving a flu shot -- immediately after moving than after sitting, says research co-written by U. of.

Read More: Probability News and Probability Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.