Decoding short-term memory with fMRI

February 23, 2009

People voluntarily pick what information they store in short-term memory. Now, using functional magnetic resonance imaging (fMRI), researchers can see just what information people are holding in memory based only on patterns of activity in the brain.

Psychologists from the University of Oregon and the University of California, San Diego, reported their findings in the February issue of Psychological Science. By analyzing blood-flow activity, they were able to identify the specific color or orientation of an object that was intentionally stored by the observer.

The experiments, in which subjects viewed a stimulus for one second and held a specific aspect of the object in mind after the stimulus disappeared, were conducted in the UO's Robert and Beverly Lewis Center for Neuroimaging. In 10-second delays after each exposure, researchers recorded brain activity during memory selection and storage processing in the visual cortex, a brain region that they hypothesized would support the maintenance of visual details in short-term memory.

"Another interesting thing was that if subjects were remembering orientation, then that pattern of activity during the delay period had no information about color, even though they were staring at a colored-oriented stimulus," said Edward Awh, a UO professor of psychology. "Likewise, if they chose to remember color we were able to decode which color they remembered, but orientation information was completely missing."

Researchers used machine-learning algorithms to examine spatial patterns of activation in the early visual cortex that are associated with remembering different stimuli, said John T. Serences, professor of psychology at UC-San Diego. "This algorithm," he said, "can then be used to predict exactly what someone is remembering based on these activation patterns."

Increases in blood flow, as seen with fMRI, are measured in voxels -- small units displayed in a 3-D grid. Different vectors of the grid, corresponding to neurons, respond as subjects view and store their chosen memories. Based on patterns of activity in an individual's visual cortex, located at the rear of the brain, researchers can pinpoint what is being stored and where, Awh said.

The study is similar to one published this month in Nature and led by Vanderbilt University neuroscientist Frank Tong and colleagues, who were able to predict with 80-percent-plus accuracy which patterns individuals held in memory 11 seconds after seeing a stimulus.

"Their paper makes a very similar point to ours," Awh said, "though they did not vary which 'dimension' of the stimulus people chose to remember, and they did not compare the pattern of activity during sensory processing and during memory. They showed that they could look at brain activity to classify which orientation was being stored in memory."

What Awh and colleagues found was that the sensory area of the brain had a pattern of activity that represented only an individual's intentionally stored aspect of the stimulus. This voluntary control in memory selection, Awh said, falls in line with previous research, including that done by Awh and co-author Edward K. Vogel, also of the UO, that there is limited capacity for what can be stored at one time. People choose what is important and relevant to them, Awh said.

"Basically, our study shows that information about the precise feature a person is remembering is represented in the visual cortex," Serences said, "This is important because it demonstrates that people recruit the same neural machinery during memory as they do when they see a stimulus."

That demonstration, Awh said, supports the sensory recruitment hypothesis, which suggests the same parts of the brain are involved in perception of a stimulus and memory storage.

A fourth co-author with Awh, Serences and Vogel was Edward F. Ester, a UO doctoral student. Serences was with the University of California, Irvine, when the project began. The research was primarily funded by a grant from the National Institutes of Health to Awh, and by support from the UO's Robert and Beverly Lewis Center for Neuroimaging.

University of Oregon

---

---

	Statistical Analysis of fMRI Data by F. Gregory Ashby (Author) Functional magnetic resonance imaging (fMRI), which allows researchers to observe neural activity in the human brain noninvasively, has revolutionized the scientific study of the mind. An fMRI experiment produces massive amounts of highly complex data; researchers face significant challenges in analyzing the data they collect. This book offers an overview of the most widely used statistical methods of analyzing fMRI data. Every step is covered, from preprocessing to advanced methods for assessing functional connectivity. The goal is not to describe which buttons to push in the popular software packages but to help readers understand the basic underlying logic,...
	Handbook of Functional MRI Data Analysis by Russell A. Poldrack (Author), Jeanette A. Mumford (Author), Thomas E. Nichols (Author) Functional magnetic resonance imaging (fMRI) has become the most popular method for imaging brain function. Handbook for Functional MRI Data Analysis provides a comprehensive and practical introduction to the methods used for fMRI data analysis. Using minimal jargon, this book explains the concepts behind processing fMRI data, focusing on the techniques that are most commonly used in the field. This book provides background about the methods employed by common data analysis packages including FSL, SPM, and AFNI. Some of the newest cutting-edge techniques, including pattern classification analysis, connectivity modeling, and resting state network analysis, are also discussed. Readers of this book, whether newcomers to the field or experienced researchers, will obtain a deep and...
	Functional Magnetic Resonance Imaging, Second Edition by Scott A. Huettel (Author), Allen W. Song (Author), Gregory McCarthy (Author) Functional Magnetic Resonance Imaging was the first textbook to provide a true introduction to fMRI designed with undergraduate students, graduate students, and beginning researchers in mind. Among the changes to the Second Edition are: Revised MR physics chapters that include parallel conceptual and quantitative paths, allowing students from diverse backgrounds and interests to readily navigate these topics. Expanded discussion of fMRI data analysis, with separate chapters on standard hypothesis-driven analyses and advanced exploratory analyses. Expanded coverage of experimental design that includes new approaches to efficient creation of fMRI experiments. Revised discussion of the physiological basis of fMRI to include recent discoveries about the origins of the BOLD response. A new...
	BOLD fMRI: A Guide to Functional Imaging for Neuroscientists by Scott H. Faro (Editor), Feroze B. Mohamed (Editor) Functional magnetic resonance imaging (fMRI) measures quick, tiny metabolic changes that take place in the brain, providing the most sensitive method currently available for identifying, investigating, and monitoring brain tumors, stroke, and chronic disorders of the nervous system like multiple sclerosis, and brain abnormalities related to dementia or seizures. This overview explains the principles of fMRI, scanning methodlogies, experimental design and data analysis, and outlines challenges and limitations of fMRI. It also provides a detailed neuroanatomic atlas, and describes clinical applications of fMRI in cognitive, sensory, and motor cases, translating research into clinical application.
	fMRI Techniques and Protocols (Neuromethods) by Massimo Filippi (Editor) As fMRI technology has provided invaluable insights into the mechanisms through which the human brain works in healthy individuals and in patients with different neurological and psychiatric conditions, the study of brain function and even the monitoring of the effects of treatment have become more effective and efficient. In fMRI Techniques and Protocols, an international assemblage of renowned scientists and physicians provide the background needed to plan and design new studies in order to advance our knowledge of the physiology of the normal human brain and its change following tissue injury. With sections focusing on basic principles of fMRI, its application to measure brain function, clinical applications, and glimpses into the future of fMRI development, the volume condenses this...
	Networks of the Brain by Olaf Sporns (Author) Over the last decade, the study of complex networks has expanded across diverse scientific fields. Increasingly, science is concerned with the structure, behavior, and evolution of complex systems ranging from cells to ecosystems. Modern network approaches are beginning to reveal fundamental principles of brain architecture and function, and in Networks of the Brain, Olaf Sporns describes how the integrative nature of brain function can be illuminated from a complex network perspective. Highlighting the many emerging points of contact between neuroscience and network science, the book serves to introduce network theory to neuroscientists and neuroscience to those...
	Introduction to Functional Magnetic Resonance Imaging: Principles and Techniques by Richard B. Buxton (Author) Functional Magnetic Resonance Imaging (fMRI) has become a standard tool for mapping the working brain's activation patterns, both in health and in disease. It is an interdisciplinary field and crosses the borders of neuroscience, psychology, psychiatry, radiology, mathematics, physics and engineering. Developments in techniques, procedures and our understanding of this field are expanding rapidly. In this second edition of Introduction to Functional Magnetic Resonance Imaging, Richard Buxton - a leading authority on fMRI - provides an invaluable guide to how fMRI works, from introducing the basic ideas and principles to the underlying physics and physiology. He covers the relationship between fMRI and other imaging techniques and includes a guide to the statistical analysis of fMRI data....
	America's New Slavery? FMRI Technology! Functional Magnetic Resonance Imaging! Or America's Salvation? All Americans Should Be Concerned! by Jose Collazo (Author) America's New Slavery? FMRI Technology! Functional Magnetic Resonance Imaging! Or America's Salvation? All Americans Should Be Concerned! Jose Collazo
	fMRI: Basics and Clinical Applications by Stephan Ulmer (Editor), Olav Jansen (Editor) Functional MRI (fMRI) and the basic method of BOLD imaging were introduced in 1993 by Seiji Ogawa. From very basic experiments, fMRI has evolved into a clinical application for daily routine brain imaging. There have been various improvements in both the imaging technique as such as well as in the statistical analysis. In this volume, experts in the field share their knowledge and point out possible technical barriers and problems explaining how to solve them. Starting from the very basics on the origin of the BOLD signal, the book covers technical issues, anatomical landmarks, presurgical applications, and special issues in various clinical fields. Other modalities for brain mapping such as PET, TMS, and MEG are also compared with fMRI. This book is intended to give a state-of-the-art...
	MATLAB for Neuroscientists: An Introduction to Scientific Computing in MATLAB by Pascal Wallisch (Author), Michael Lusignan (Author), Marc Benayoun (Author), Tanya I. Baker (Author), Adam Seth Dickey (Author), Nicho Hatsopoulos (Author) Matlab is the accepted standard for scientific computing, used globally in virtually all Neuroscience and Cognitive Psychology laboratories. For instance, SPM, the most used software for the analysis and manipulation of fMRI images in research and clinical practice is fully programmed in matlab, and its use of the possibility to allow for sophisticated software modules to be freely added to the software has established it as the by far dominant software in the field. Many universities now offer, or are beginning to offer matlab introductory courses in their neuroscience and psychology programs. Nevertheless, so far there hasn't been a textbook specific to this market, and the use of the plethora of existing engineering focused Matlab textbooks is notoriously difficult for teaching the...