The cost of computation

April 08, 2019

For decades, physicists have wrestled with understanding the thermodynamic cost of manipulating information, what we would now call computing. How much energy does it take, for example, to erase a single bit from a computer? What about more complicated operations? These are pressing, practical questions, as artificial computers are energy hogs, claiming an estimated four percent of total energy consumed in the United States.

These questions are not limited to the digital machines constructed by us. The human brain can be seen as a computer -- one that gobbles an estimated 10 to 20 percent of all the calories a person consumes. Living cells, too, can be viewed as computers, but computers that "are many orders of magnitude more efficient" than any laptop or smartphone humans have constructed, says David Wolpert of the Santa Fe Institute.

Wolpert, a mathematician, physicist, and computer scientist, has been on the frontlines of a rapid resurgence of interest in a deep understanding of the energy cost of computing. That research is now hitting its stride, thanks to advances in using some revolutionary tools recently developed in statistical physics, in order to understand the thermodynamic behavior of nonequilibrium systems. The reason these tools are so important is that computers are decidedly nonequilibrium systems. (Unplug your laptop and wait for it to reach equilibrium, and then see if it still works.) Although Wolpert primarily approaches these issues using tools from computer science and physics, there is also sharp interest from researchers in other areas, including those who study chemical reactions, cellular biology, and neurobiology.

However, research in nonequilibrium statistical physics largely happens in silos, says Wolpert. In a review published today in the Journal of Physics A, Wolpert collects recent advances in understanding the thermodynamics of computation that are grounded in computer science and physics. The review functions as a sort of state-of-the-science report for a burgeoning interdisciplinary investigation.

"It is basically a snapshot of the current state of the fields, where these ideas are starting to explode, in all directions," says Wolpert.

In the paper, Wolpert first summarizes the relevant theoretical ideas from physics and computer science. He then discusses what's known about the entropic cost of a range of computations, from erasing a single bit to running a Turing machine. He goes on to show how breakthroughs in nonequilibrium statistical physics have enabled researchers to more formally probe those cases -- moving far beyond simple bit erasure.

Wolpert also touches on the questions raised in this recent research which suggest real-world challenges, like how to design algorithms with energy conservation in mind. Can biological systems, for example, serve as inspiration for designing computers with minimal thermodynamic cost?

"We are being surprised and astonished in many ways," Wolpert says. In putting together the review, and coediting a book on the topic due out later this year, "we've uncovered phenomena that no one has analyzed before that were very natural to us, as we pursue this modern version of the thermodynamics of computation."
-end-


Santa Fe Institute

Related Physics Articles from Brightsurf:

Helium, a little atom for big physics
Helium is the simplest multi-body atom. Its energy levels can be calculated with extremely high precision only relying on a few fundamental physical constants and the quantum electrodynamics (QED) theory.

Hyperbolic metamaterials exhibit 2T physics
According to Igor Smolyaninov of the University of Maryland, ''One of the more unusual applications of metamaterials was a theoretical proposal to construct a physical system that would exhibit two-time physics behavior on small scales.''

Challenges and opportunities for women in physics
Women in the United States hold fewer than 25% of bachelor's degrees, 20% of doctoral degrees and 19% of faculty positions in physics.

Indeterminist physics for an open world
Classical physics is characterized by the equations describing the world.

Leptons help in tracking new physics
Electrons with 'colleagues' -- other leptons - are one of many products of collisions observed in the LHCb experiment at the Large Hadron Collider.

Has physics ever been deterministic?
Researchers from the Austrian Academy of Sciences, the University of Vienna and the University of Geneva, have proposed a new interpretation of classical physics without real numbers.

Twisted physics
A new study in the journal Nature shows that superconductivity in bilayer graphene can be turned on or off with a small voltage change, increasing its usefulness for electronic devices.

Physics vs. asthma
A research team from the MIPT Center for Molecular Mechanisms of Aging and Age-Related Diseases has collaborated with colleagues from the U.S., Canada, France, and Germany to determine the spatial structure of the CysLT1 receptor.

2D topological physics from shaking a 1D wire
Published in Physical Review X, this new study propose a realistic scheme to observe a 'cold-atomic quantum Hall effect.'

Helping physics teachers who don't know physics
A shortage of high school physics teachers has led to teachers with little-to-no training taking over physics classrooms, reports show.

Read More: Physics News and Physics Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.