Peking University, October 14, 2024: Fundamental to the development of artificial intelligence (AI), associative memory models of neural networks are designed to store and quickly retrieve information based on connections between elements. Recently, a research team led by Peking University professor Sun Zhong studied a resistive memory, or memristor, attractor network model that could overcome the limitations of the original Hopfield network model, which was recognized by the 2024 Nobel Prize in Physics.
The team proved for the first time that a circuit composed of a column of memristor devices is essentially an attractor network, which can be used in associative memory and combinatorial optimization. Their findings were published in Nature Communication on September 12, 2024.
Why it matters:
In the classic Hopfield network model, the storage capacity increases linearly with the number of neurons, so the network can only remember a small number of states at the same time. Increasing the storage capacity can be realized by using different nonlinear activation functions or providing different weight configurations, but hardware implementation has not yet been explored.
Memristors are bidirectional and nonvolatile neurons that can store more stable states in the circuit, greatly improving the storage capacity of associative memory. Thus, a resistive memory network allows for more stable states stored. This could be a highly compact and efficient solution for associative memory and is conducive to the development of new attractor network models or hardware solutions.
Methodology:
The research team fabricated resistive random-access memory (RRAM) devices and conducted experimental demonstrations of the recurrent neural network (RNN) model of a memristor circuit. An energy function for the probabilistic model of the memristor network was also constructed, and the team performed proof-of-concept demonstration for associative memory applications.
Key findings:
Source: Nature Communication
Edited by: Wu Jiayun
Nature Communications
An emergent attractor network in a passive resistive switching circuit
12-Sep-2024