Accedi

Decoding Auditory Imagery with Multivoxel Pattern Analysis

Panoramica

Source: Laboratories of Jonas T. Kaplan and Sarah I. Gimbel—University of Southern California

Imagine the sound of a bell ringing. What is happening in the brain when we conjure up a sound like this in the "mind's ear?" There is growing evidence that the brain uses the same mechanisms for imagination that it uses for perception.1 For example, when imagining visual images, the visual cortex becomes activated, and when imagining sounds, the auditory cortex is engaged. However, to what extent are these activations of sensory cortices specific to the content of our imaginations?

One technique that can help to answer this question is multivoxel pattern analysis (MPVA), in which functional brain images are analyzed using machine-learning techniques.2-3 In an MPVA experiment, we train a machine-learning algorithm to distinguish among the various patterns of activity evoked by different stimuli. For example, we might ask if imagining the sound of a bell produces different patterns of activity in auditory cortex compared with imagining the sound of a chainsaw, or the sound of a violin. If our classifier learns to tell apart the brain activity patterns produced by these three stimuli, then we can conclude that the auditory cortex is activated in a distinct way by each stimulus. One way to think of this kind of experiment is that instead of asking a question simply about the activity of a brain region, we ask a question about the information content of that region.

In this experiment, based on Meyer et al., 2010,4 we will cue participants to imagine several sounds by presenting them with silent videos that are likely to evoke auditory imagery. Since we are interested in measuring the subtle patterns evoked by imagination in auditory cortex, it is preferable if the stimuli are presented in complete silence, without interference from the loud noises made by the fMRI scanner. To achieve this, we will use a special kind of functional MRI sequence known as sparse temporal sampling. In this approach, a single fMRI volume is acquired 4-5 s after each stimulus, timed to capture the peak of the hemodynamic response.

Procedura

1. Participant recruitment

  1. Recruit 20 participants.
    1. Participants should be right-handed and have no history of neurological or psychological disorders.
    2. Participants should have normal or corrected-to-normal vision to ensure that they will be able to see the visual cues properly.
    3. Participants should not have metal in their body. This is an important safety requirement due to the high magnetic field involved in fMRI.
    4. Participants should not suffer from claustrophobia

Log in or to access full content. Learn more about your institution’s access to JoVE content here

Risultati

The average classifier accuracy in the planum temporale across all 20 participants was 59%. According to the Wilcoxon Signed-Rank test, this is significantly different from chance level of 33%. The mean performance in the frontal pole mask was 32.5%, which is not greater than chance (Figure 2).

Figure 2
Figure 2. Classification perf

Log in or to access full content. Learn more about your institution’s access to JoVE content here

Riferimenti
  1. Kosslyn, S.M., Ganis, G. & Thompson, W.L. Neural foundations of imagery. Nat Rev Neurosci 2, 635-642 (2001).
  2. Haynes, J.D. & Rees, G. Decoding mental states from brain activity in humans. Nat Rev Neurosci 7, 523-534 (2006).
  3. Norman, K.A., Polyn, S.M., Detre, G.J. & Haxby, J.V. Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn Sci 10, 424-430 (2006).
  4. Meyer, K., et al. Predicting visual stimuli on the basis of activity in auditory cortices. Nat Neurosci 13, 667-668 (2010).
Tags
Auditory ImageryMultivoxel Pattern AnalysisPerceptionBrain ActivationFunctional Magnetic Resonance Imaging fMRISilent VideosAcoustic StimuliDistinguishing SoundsAuditory CortexImaginationMemoryDetailed ProcessingFMRI SessionsNeural Patterns

Vai a...

0:00

Overview

1:30

Experimental Design

4:40

Running the Experiment

6:37

Data Analysis

7:54

Representative Results

9:50

Applications

11:14

Summary

Video da questa raccolta:

article

Now Playing

Decoding Auditory Imagery with Multivoxel Pattern Analysis

Neuropsychology

6.4K Visualizzazioni

article

The Split Brain

Neuropsychology

68.2K Visualizzazioni

article

Motor Maps

Neuropsychology

27.4K Visualizzazioni

article

Perspectives on Neuropsychology

Neuropsychology

12.0K Visualizzazioni

article

Decision-making and the Iowa Gambling Task

Neuropsychology

32.2K Visualizzazioni

article

Executive Function in Autism Spectrum Disorder

Neuropsychology

17.6K Visualizzazioni

article

Anterograde Amnesia

Neuropsychology

30.3K Visualizzazioni

article

Physiological Correlates of Emotion Recognition

Neuropsychology

16.2K Visualizzazioni

article

Event-related Potentials and the Oddball Task

Neuropsychology

27.4K Visualizzazioni

article

Language: The N400 in Semantic Incongruity

Neuropsychology

19.5K Visualizzazioni

article

Learning and Memory: The Remember-Know Task

Neuropsychology

17.1K Visualizzazioni

article

Measuring Grey Matter Differences with Voxel-based Morphometry: The Musical Brain

Neuropsychology

17.3K Visualizzazioni

article

Visual Attention: fMRI Investigation of Object-based Attentional Control

Neuropsychology

41.4K Visualizzazioni

article

Using Diffusion Tensor Imaging in Traumatic Brain Injury

Neuropsychology

16.7K Visualizzazioni

article

Using TMS to Measure Motor Excitability During Action Observation

Neuropsychology

10.1K Visualizzazioni

JoVE Logo

Riservatezza

Condizioni di utilizzo

Politiche

Ricerca

Didattica

CHI SIAMO

Copyright © 2025 MyJoVE Corporation. Tutti i diritti riservati