Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2007 Jan 15;34(2):764-73.
doi: 10.1016/j.neuroimage.2006.07.044. Epub 2006 Nov 13.

Multisensory integration for timing engages different brain networks

Mukeshwar Dhamala  1 , Collins G Assisi, Viktor K Jirsa, Fred L Steinberg, J A Scott Kelso
Affiliations

Multisensory integration for timing engages different brain networks

Mukeshwar Dhamala et al. Neuroimage. .

Abstract

How does the brain integrate information from different senses into a unitary percept? What factors influence such multisensory integration? Using a rhythmic behavioral paradigm and functional magnetic resonance imaging, we identified networks of brain regions for perceptions of physically synchronous and asynchronous auditory-visual events. Measures of behavioral performance revealed the existence of three distinct perceptual states. Perception of asynchrony activated a network of the primary sensory, prefrontal, and inferior parietal cortices, perception of synchrony disengaged the inferior parietal cortex and further recruited the superior colliculus, and when no clear percept was established, only the residual areas comprised of prefrontal and sensory areas were active. These results indicate that distinct percepts arise within specific brain sub-networks, the components of which are differentially engaged and disengaged depending on the timing of environmental signals.

PubMed Disclaimer

Figures

Figure 1
Figure 1
The steady solutions of equation (1) are plotted as isoclines dependent on the parameters a and Δω for initial conditions close to in-phase (top) and anti-phase (bottom). Both anti-phase and in-phase solutions exist up to an upper bound of Δω, beyond which there is only a drift regime. Bistable solutions exist in the mutually overlapping regime of anti-phase and in-phase solutions (in the region bounded by the dashed line).
Figure 2
Figure 2
(a). Experimental design. A visual (V) stimulus is presented after an auditory stimulus (A) at a time interval of Δt (SOA) and repeated at a rate f (stimulation rate). Behavioral response in the space of Δt and f: the negative values of Δt imply that the visual stimulus (V) precedes the auditory stimulus (A) and the contour levels represent the normalized response (number of responses divided by the total possible responses). Depending on these timing parameters, the participants reported the perceptions of AV (sound before light), VA, S (synchronous) and D (drifting order), thereby partitioning the space into four distinct regions. Notice the asymmetry of S-region, extended more toward the region of AV (b). Mean normalized response versus stimulation rate for the perception of synchrony in the regions of VA and AV. The response in both regions first decreases and then increases with stimulation rate. The error bars are the standard error mean. There is a significant asymmetry, extended more toward the region of AV (p < 0.02).
Figure 3
Figure 3
Activations related to crossmodal processing (p<0.001). Areas: inferior frontal (I), superior temporal gyrus (II), middle occipital gyrus (III), inferior parietal lobule (IV), and posterior midbrain (V). The activation in the posterior midbrain (V) in the region of superior colliculus was obtained by a negative contrast of task versus rest. The color intensity represents t-statistics and the activations are overlaid on the Montreal Neurological Institute (MNI) structural template brain in the neurological orientation for display of the t-maps.
Figure 4
Figure 4
(a–c). Activations related with the perception of asynchrony (p<0.001) for the following conditions: (A) (Δ t, f) = (200 ms, 0.5 Hz), ( B) (−200 ms, 0.5 Hz) (C) (100 ms, 1.0 Hz). The inferior parietal lobule (IPL) showed significant activations for this percept. The overall signal change between task and rest is about 0.3 % (p < 0.01) (not shown here). The inferior parietal cortex was not active for (±100 ms, 3.0 Hz), where there was no fixed percept. (d). Activation associated with the perception of synchrony (p < 0.001). The negative contrast of the task versus rest activated the posterior midbrain (PM) in the region of superior colliculus for the condition (100ms, 1.0 Hz). The overall signal change between the rest and the task is about −0.3 % (p < 0.01) (not shown here). This indicates the involvement of the superior colliculus in the perception of synchrony.
Figure 5
Figure 5
Interregional correlation analysis: cross-correlations and the resulting networks during asynchrony, synchrony and drift. Significant positive (hot color) and negative (cold color) cross-correlation values of time-series with the on-off waveform during asynchrony, synchrony and drift are overlaid on the MNI brain (top panel). The second panel shows pairwise cross-correlation values between frontal (F), auditory (A), visual (V), parietal (P) and superior colliculus (S) areas. The third panel shows summary diagrams of connected brain networks that are functionally interdependent during asynchrony, synchrony and drift. (Here, the red and green circles on the cortical surface of the MNI brain indicate approximate locations and are used for illustrative purposes only).
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Ashburner J, Friston KJ. Nonlinear spatial normalization using basis functions. Hum Brain Mapp. 1999;7:254–266. - PMC - PubMed
    1. Van Atteveldt N, Formisano E, Goebel R, Blomert L. Integration of letters and speech sounds in the human brain. Neuron. 2004;43:271–82. - PubMed
    1. Assmus A, Marshall JC, Ritzl A, North J, Zilles K, Fink GR. Left inferior parietal cortex integrates time and space during collision judgments. NeuroImage. 2003;20:S82–S88. - PubMed
    1. Beauchamp MS, Argall BD, Bodurka J, Duyn JH, Martin A. Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nature Neuroscience. 2004;7:1190–1192. - PubMed
    1. Bushara KO, Grafman J, Hallett M. Neural correlates of auditory-visual stimulus onset asynchrony detection. J Neurosci. 2001;21:300–304. - PMC - PubMed

Publication types