Artificial agent designs quantum experiments

January 19, 2018

We carry smartphones in our pockets, the streets are dotted with semi-autonomous cars, but in the research laboratory experiments are still being designed by people. However, this could change soon. In the group of Innsbruck physicist Hans Briegel, researchers broach the question to what extent machines can carry out research autonomously. For this purpose, they use the projective simulation model for artificial intelligence, developed by the group, to enable a machine to learn and act creatively. The memory of this autonomous machine stores many individual fragments of experience, which are networked together. The machine builds up and adapts its memories while learning from both successful and unsuccessful experience. Now, the scientists from Innsbruck have teamed up Viennese colleagues in the group of Anton Zeilinger, who previously demonstrated the usefulness of automated procedures in the design of quantum experiments with a search algorithm called Melvin. Some of these computer-inspired experiments have already been performed in the lab of Zeilinger. Together, the physicists have now understood that quantum experiments are an ideal environment to test the applicability of AI to research. Therefore, they used the projective simulation model to investigate the potential of artificial learning agents in this test-bed. In a paper published in the Proceedings of the National Academy of Sciences, the researchers now present their first results.

Optimized experiments designed by an AI-agent

All starts with an empty laboratory table for photonic quantum experiments. The artificial agent then tries to develop new experiments by virtually placing mirrors, prisms or beam splitters on the table. If its actions lead to a meaningful result, the agent has a higher chance to do similar sequence of actions in the future. This is known as a reinforcement learning strategy. "Reinforcement learning is what distinguishes our model from the previously studied automated search, which is governed by unbiased random search," says Alexey Melnikov from the Department of Theoretical Physics at the University of Innsbruck. "The artificial agent performs tens of thousands of experiments on the virtual laboratory table. When we analyzed the memory of the machine, we discovered that certain structures have developed," explains his colleague Hendrik Poulsen Nautrup. Some of these structures are already known to physicists as useful tools from modern quantum optical laboratories. Others are completely new and could, in the future, be tested in the lab. "Reinforcement learning is what allows us to find, optimize and identify a huge amount of potentially interesting solutions," says Alexey Melnikov. "And sometimes it also provides answers to questions we didn't even ask."

Creative support in the laboratory

In the future, the scientists want to further improve their learning program. At this point, it is a tool that can autonomously learn to solve a given task. But can a machine be more than a tool? Can it provide more creative assistance to the scientists in basic research? This is what the scientists want to find out and only the future can tell what answers are in store for them.
-end-
The work was financially supported in part by the Austrian Science Fund FWF and the Templeton World Charity Foundation.

University of Innsbruck

Related Memory Articles from Brightsurf:

Memory of the Venus flytrap
In a study to be published in Nature Plants, a graduate student Mr.

Memory protein
When UC Santa Barbara materials scientist Omar Saleh and graduate student Ian Morgan sought to understand the mechanical behaviors of disordered proteins in the lab, they expected that after being stretched, one particular model protein would snap back instantaneously, like a rubber band.

Previously claimed memory boosting font 'Sans Forgetica' does not actually boost memory
It was previously claimed that the font Sans Forgetica could enhance people's memory for information, however researchers from the University of Warwick and the University of Waikato, New Zealand, have found after carrying out numerous experiments that the font does not enhance memory.

Memory boost with just one look
HRL Laboratories, LLC, researchers have published results showing that targeted transcranial electrical stimulation during slow-wave sleep can improve metamemories of specific episodes by 20% after only one viewing of the episode, compared to controls.

VR is not suited to visual memory?!
Toyohashi university of technology researcher and a research team at Tokyo Denki University have found that virtual reality (VR) may interfere with visual memory.

The genetic signature of memory
Despite their importance in memory, the human cortex and subcortex display a distinct collection of 'gene signatures.' The work recently published in eNeuro increases our understanding of how the brain creates memories and identifies potential genes for further investigation.

How long does memory last? For shape memory alloys, the longer the better
Scientists captured live action details of the phase transitions of shape memory alloys, giving them a better idea how to improve their properties for applications.

A NEAT discovery about memory
UAB researchers say over expression of NEAT1, an noncoding RNA, appears to diminish the ability of older brains to form memories.

Molecular memory can be used to increase the memory capacity of hard disks
Researchers at the University of Jyväskylä have taken part in an international British-Finnish-Chinese collaboration where the first molecule capable of remembering the direction of a magnetic above liquid nitrogen temperatures has been prepared and characterized.

Memory transferred between snails
Memories can be transferred between organisms by extracting ribonucleic acid (RNA) from a trained animal and injecting it into an untrained animal, as demonstrated in a study of sea snails published in eNeuro.

Read More: Memory News and Memory Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.