Nav: Home

Autonomous robot plays with NanoLEGO

September 03, 2020

Molecules are the building blocks of everyday life. Many materials are composed of them, a little like a LEGO model consists of a multitude of different bricks. But while individual LEGO bricks can be simply shifted or removed, this is not so easy in the nanoworld. Atoms and molecules behave in a completely different way to macroscopic objects and each brick requires its own "instruction manual". Scientists from Jülich and Berlin have now developed an artificial intelligence system that autonomously learns how to grip and move individual molecules using a scanning tunnelling microscope. The method, which has been published in Science Advances, is not only relevant for research but also for novel production technologies such as molecular 3D printing.

Rapid prototyping, the fast and cost-effective production of prototypes or models - better known as 3D printing - has long since established itself as an important tool for industry. "If this concept could be transferred to the nanoscale to allow individual molecules to be specifically put together or separated again just like LEGO bricks, the possibilities would be almost endless, given that there are around 1060 conceivable types of molecule," explains Dr. Christian Wagner, head of the ERC working group on molecular manipulation at Forschungszentrum Jülich.

There is one problem, however. Although the scanning tunnelling microscope is a useful tool for shifting individual molecules back and forth, a special custom "recipe" is always required in order to guide the tip of the microscope to arrange molecules spatially in a targeted manner. This recipe can neither be calculated, nor deduced by intuition - the mechanics on the nanoscale are simply too variable and complex. After all, the tip of the microscope is ultimately not a flexible gripper, but rather a rigid cone. The molecules merely adhere lightly to the microscope tip and can only be put in the right place through sophisticated movement patterns.

"To date, such targeted movement of molecules has only been possible by hand, through trial and error. But with the help of a self-learning, autonomous software control system, we have now succeeded for the first time in finding a solution for this diversity and variability on the nanoscale, and in automating this process," says a delighted Prof. Dr. Stefan Tautz, head of Jülich's Quantum Nanoscience institute.

The key to this development lies in so-called reinforcement learning, a special variant of machine learning. "We do not prescribe a solution pathway for the software agent, but rather reward success and penalize failure," explains Prof. Dr. Klaus-Robert Müller, head of the Machine Learning department at TU Berlin. The algorithm repeatedly tries to solve the task at hand and learns from its experiences. The general public first became aware of reinforcement learning a few years ago through AlphaGo Zero. This artificial intelligence system autonomously developed strategies for winning the highly complex game of Go without studying human players - and after just a few days, it was able to beat professional Go players.

"In our case, the agent was given the task of removing individual molecules from a layer in which they are held by a complex network of chemical bonds. To be precise, these were perylene molecules, such as those used in dyes and organic light-emitting diodes," explains Dr. Christian Wagner. The special challenge here is that the force required to move them must never exceed the strength of the bond with which the tip of the scanning tunnelling microscope attracts the molecule, since this bond would otherwise break. "The microscope tip therefore has to execute a special movement pattern, which we previously had to discover by hand, quite literally," Wagner adds. While the software agent initially performs completely random movement actions that break the bond between the tip of the microscope and the molecule, over time it develops rules as to which movement is the most promising for success in which situation and therefore gets better with each cycle.

However, the use of reinforcement learning in the nanoscopic range brings with it additional challenges. The metal atoms that make up the tip of the scanning tunnelling microscope can end up shifting slightly, which alters the bond strength to the molecule each time. "Every new attempt makes the risk of a change and thus the breakage of the bond between tip and molecule greater. The software agent is therefore forced to learn particularly quickly, since its experiences can become obsolete at any time," Prof. Dr. Stefan Tautz explains. "It's a little as if the road network, traffic laws, bodywork, and rules for operating the vehicle are constantly changing while driving autonomously." The researchers have overcome this challenge by making the software learn a simple model of the environment in which the manipulation takes place in parallel with the initial cycles. The agent then simultaneously trains both in reality and in its own model, which has the effect of significantly accelerating the learning process.

"This is the first time ever that we have succeeded in bringing together artificial intelligence and nanotechnology," emphasizes Klaus-Robert Müller. "Up until now, this has only been a 'proof of principle'," Tautz adds. "However, we are confident that our work will pave the way for the robot-assisted automated construction of functional supramolecular structures, such as molecular transistors, memory cells, or qubits - with a speed, precision, and reliability far in excess of what is currently possible."

Forschungszentrum Juelich

Related Learning Articles:

When learning on your own is not enough
We make decisions based on not only our own learning experience, but also learning from others.
Learning more about particle collisions with machine learning
A team of Argonne scientists has devised a machine learning algorithm that calculates, with low computational time, how the ATLAS detector in the Large Hadron Collider would respond to the ten times more data expected with a planned upgrade in 2027.
Getting kids moving, and learning
Children are set to move more, improve their skills, and come up with their own creative tennis games with the launch of HomeCourtTennis, a new initiative to assist teachers and coaches with keeping kids active while at home.
How expectations influence learning
During learning, the brain is a prediction engine that continually makes theories about our environment and accurately registers whether an assumption is true or not.
Technology in higher education: learning with it instead of from it
Technology has shifted the way that professors teach students in higher education.
Learning is optimized when we fail 15% of the time
If you're always scoring 100%, you're probably not learning anything new.
School spending cuts triggered by great recession linked to sizable learning losses for learning losses for students in hardest hit areas
Substantial school spending cuts triggered by the Great Recession were associated with sizable losses in academic achievement for students living in counties most affected by the economic downturn, according to a new study published today in AERA Open, a peer-reviewed journal of the American Educational Research Association.
Lessons in learning
A new Harvard study shows that, though students felt like they learned more from traditional lectures, they actually learned more when taking part in active learning classrooms.
Learning to look
A team led by JGI scientists has overhauled the perception of inovirus diversity.
Sleep readies synapses for learning
Synapses in the hippocampus are larger and stronger after sleep deprivation, according to new research in mice published in JNeurosci.
More Learning News and Learning Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: The Power Of Spaces
How do spaces shape the human experience? In what ways do our rooms, homes, and buildings give us meaning and purpose? This hour, TED speakers explore the power of the spaces we make and inhabit. Guests include architect Michael Murphy, musician David Byrne, artist Es Devlin, and architect Siamak Hariri.
Now Playing: Science for the People

#576 Science Communication in Creative Places
When you think of science communication, you might think of TED talks or museum talks or video talks, or... people giving lectures. It's a lot of people talking. But there's more to sci comm than that. This week host Bethany Brookshire talks to three people who have looked at science communication in places you might not expect it. We'll speak with Mauna Dasari, a graduate student at Notre Dame, about making mammals into a March Madness match. We'll talk with Sarah Garner, director of the Pathologists Assistant Program at Tulane University School of Medicine, who takes pathology instruction out of...
Now Playing: Radiolab

What If?
There's plenty of speculation about what Donald Trump might do in the wake of the election. Would he dispute the results if he loses? Would he simply refuse to leave office, or even try to use the military to maintain control? Last summer, Rosa Brooks got together a team of experts and political operatives from both sides of the aisle to ask a slightly different question. Rather than arguing about whether he'd do those things, they dug into what exactly would happen if he did. Part war game part choose your own adventure, Rosa's Transition Integrity Project doesn't give us any predictions, and it isn't a referendum on Trump. Instead, it's a deeply illuminating stress test on our laws, our institutions, and on the commitment to democracy written into the constitution. This episode was reported by Bethel Habte, with help from Tracie Hunte, and produced by Bethel Habte. Jeremy Bloom provided original music. Support Radiolab by becoming a member today at     You can read The Transition Integrity Project's report here.