Hostname: page-component-745bb68f8f-hvd4g Total loading time: 0 Render date: 2025-02-06T20:25:07.832Z Has data issue: false hasContentIssue false

Multisensory integration substantiates distributed and overlapping neural networks

Published online by Cambridge University Press:  30 June 2016

Achille Pasqualotto*
Affiliation:
Faculty of Arts and Social Sciences, Sabanci University, Tuzla 34956, Istanbul, Turkey. achille@sabanciuniv.edu

Abstract

The hypothesis that highly overlapping networks underlie brain functions (neural reuse) is decisively supported by three decades of multisensory research. Multisensory areas process information from more than one sensory modality and therefore represent the best examples of neural reuse. Recent evidence of multisensory processing in primary visual cortices further indicates that neural reuse is a basic feature of the brain.

Type
Open Peer Commentary
Copyright
Copyright © Cambridge University Press 2016 

Cognitive and perceptive functions are supported by highly overlapping neural networks distributed throughout the brain, and this phenomenon can be referred to as “neural reuse” (Anderson Reference Anderson2010; Reference Anderson2014; Pessoa Reference Pessoa2012). To use a metaphor, we might imagine the brain as a choir and neurons as the singers composing the choir; when the choir sings Song 1, some singers do not sing at all while others sing vigorously. “Active” singers represent the portion of the choir performing Song 1 (see Fig. 1a); in terms of the brain, those singers represent the neural network (parts of the brain) activated during a given cognitive or perceptive process (e.g., visual perception). When the choir sings Song 2, a slightly different, but highly overlapping portion of the singers might be active (see Fig. 1b). This exemplifies how different tasks (Song 1 and Song 2) recruit highly overlapping, but not identical, portions of the choir (see Fig. 1c); in the brain, a given cognitive or perceptive task (e.g., visual imagery) recruits a neural network highly overlapping, but not identical, to the one associated with visual perception (Ganis et al. Reference Ganis, Thompson and Kosslyn2004).

Figure 1. Singers of the choir singing (a) Song 1 (dark-grey); (b) Song 2 (dark-grey); (c) both Songs 1 and 2 (light-grey).

One of the hot topics for debate in experimental psychology and neuroscience is on the extent of specialisation or distribution of the brain functions (Anderson Reference Anderson2010; Driver & Noesselt Reference Driver and Noesselt2008; Liang et al. Reference Liang, Mouraux, Hu and Iannetti2013). Empirical evidence seems to favour the idea that the brain operates in a distributed, rather than specific, manner. For example, brain areas that were considered to be specialised for specific tasks (e.g., the fusiform face area for face recognition) have been found to be activated during performance of other tasks (e.g., recognition of cars; Gauthier et al. Reference Gauthier, Skudlarski, Gore and Anderson2000). Research has also shown that cognitive and perceptive processes usually involve networks of brain areas rather than one specific area; for example, a very specific process such as face recognition recruits a network of brain areas including the occipital, temporal, and frontal lobes rather than one specific portion of the brain (Goldstein Reference Goldstein2009). This distribution of brain functions is not only seen for the processing of faces, but also for other perceptual and cognitive functions (if not all; Van Dijk et al. Reference Van Dijk, Hedden, Venkataraman, Evans, Lazar and Buckner2010; Yeo et al. Reference Yeo, Krienen, Sepulcre, Sabuncu, Lashkari, Hollinshead, Roffman, Smoller, Zollei, Polimeni, Fischl, Liu and Buckner2011) such as perception (Takahashi et al. Reference Takahashi, Kansaku, Wada, Shibuya and Kitazawa2013; Uesaki & Ashida Reference Uesaki and Ashida2015), attention (Posner & Rothbart Reference Posner and Rothbart2007; Shulman et al. Reference Shulman, Ollinger, Akbudak, Conturo, Snyder, Petersen and Corbetta1999), memory (Alain et al. Reference Alain, Woods and Knight1998; Desgranges et al. Reference Desgranges, Baron and Eustache1998), language (Duffau Reference Duffau2008; Horwitz & Braun Reference Horwitz and Braun2004), spatial cognition (Burgess et al. Reference Burgess, Maguire, Spiers and O'Keefe2001; Vallar et al. Reference Vallar, Lobel, Galati, Berthoz, Pizzamiglio and Le Bihan1999), and body representation (Filippetti et al. Reference Filippetti, Lloyd-Fox, Longo, Farroni and Johnson2015; Longo et al. Reference Longo, Azañón and Haggard2010).

This phenomenon is not limited to the macroscopic level (i.e., brain areas), but has also been observed on the microscopic level. Some neurons have been found to respond to several types of stimuli, rather than to a specific type of stimulus, with different response patterns (e.g., firing frequencies). The difference in response patterns is the feature that distinguishes the stimuli represented by the neurons (Decharms & Zador Reference Decharms and Zador2000; Gerstner et al. Reference Gerstner, Kreiter, Markram and Herz1997). In a simplistic example, during the processing of Stimulus A, Neuron 1 fires at a high frequency, Neuron 2 at a low frequency, and Neuron 3 at a medium frequency. Whereas, during the processing of Stimulus B, Neuron 1 fires at a medium frequency, Neuron 2 at a high frequency, and Neuron 3 does not fire at all. To reuse the above-mentioned metaphor, the same singers might participate differently in performance of different songs.

The notion that brain functions are based on distributed and overlapping neural networks is convincingly supported by the findings that input from different sensory modalities activate distributed and overlapping networks of brain areas – namely, multisensory processing (Ricciardi et al. Reference Ricciardi, Bonino, Pellegrini and Pietrini2014; Stein & Stanford Reference Stein and Stanford2008; Stein et al. Reference Stein, Huneycutt and Meredith1988). Multisensory areas are portions of the brain processing input from different sensory modalities. In the last decades, an increasing number of multisensory areas have been identified (Amad et al. Reference Amad, Cachia, Gorwood, Pins, Delmaire, Rolland, Mondino, Thomas and Jardri2014; Gallese et al. Reference Gallese, Fadiga, Fogassi and Rizzolatti1996; Gobbelé et al. Reference Gobbelé, Schürmann, Forss, Juottonen, Buchner and Hari2003; Sereno & Huang Reference Sereno and Huang2006), suggesting that the brain is more engaged in multisensory processing than was initially believed. Classic multisensory (or associative) areas are activated by visual, auditory, and somatosensory input and consist of prefrontal (Fuster Reference Fuster1988; Öngür & Price Reference Öngür and Price2000), posterior parietal (Andersen et al. Reference Andersen, Essick and Siegel1985; Serino et al. Reference Serino, Canzoneri and Avenanti2011), and superior temporal (Beauchamp et al. Reference Beauchamp, Yasar, Frye and Ro2008; Bruce et al. Reference Bruce, Desimone and Gross1981) cortices. More recently, new multisensory areas have been identified, in the posterior frontal (Grafton et al. Reference Grafton, Fadiga, Arbib and Rizzolatti1997), temporoparietal (Matsuhashi et al. Reference Matsuhashi, Ikeda, Ohara, Matsumoto, Yamamoto, Takayama, Satowa, Begum, Usui, Nagamine, Mikuni, Takahashi, Miyamoto, Fukuyama and Shibasaki2004), and occipitotemporal (Beauchamp Reference Beauchamp2005) cortices. Additionally, some subcortical structures have been associated with multisensory processing, such as the superior colliculus (Jiang et al. Reference Jiang, Wallace, Jiang, Vaughan and Stein2001), hippocampus (Ravassard et al. Reference Ravassard, Kees, Willers, Ho, Aharoni, Cushman, Aghajan and Mehta2013), and amygdala (De Gelder & Bertelson Reference De Gelder and Bertelson2003). Widespread multisensory processing in the brain is responsible for the well-documented interaction of the senses during perceptual (Kawachi et al. Reference Kawachi, Grove and Sakurai2014; Vidal & Barrès Reference Vidal and Barrès2014) and cognitive tasks (Lawson et al. Reference Lawson, Boylan and Edwards2014; Pasqualotto et al. Reference Pasqualotto, Finucane and Newell2013a). Therefore, the hypothesis that largely overlapping brain networks underlie cognitive and perceptive functions is strongly supported by the findings that “overlapping” brain areas process input from different modalities.

Decisive evidence for the hypothesis that overlapping networks are the basis of brain functions comes from the surprising findings that multisensory processing also occurs in areas that were considered strictly unisensory, such as the primary visual (Borra & Rockland Reference Borra and Rockland2011; Zangaladze et al. Reference Zangaladze, Epstein, Grafton and Sathian1999) and primary auditory (Lakatos et al. Reference Lakatos, Chen, O'Connell, Mills and Schroeder2007; Murray et al. Reference Murray, Molholm, Michel, Heslenfeld, Ritter, Javitt, Schroeder and Foxe2005) cortices. Until recently, the notion that primary sensory cortices were concerned with processing input only from the corresponding sensory modalities was one of the core assumptions in neuroscience. However, this theory was challenged when studies with visually impaired participants surprisingly showed that the visual areas of these individuals were not “silent,” but they were active while visually impaired individuals performed a variety of tasks (Amedi et al. Reference Amedi, Raz, Pianka, Malach and Zohary2003; Poirier et al. Reference Poirier, Collignon, Scheiber, Renier, Vanlierde, Tranduy, Veraart and De Volder2006; Sadato et al. Reference Sadato, Pascual-Leone, Grafman, Ibañez, Deiber, Dold and Hallett1996). The activation of “visual” areas during nonvisual tasks performed by visually impaired individuals is a clear example of neural reuse, where a neural substrate deprived of its typical input is reused to process input from another modality (Guerreiro et al. Reference Guerreiro, Putzar and Röder2015; Iachini et al. Reference Iachini, Ruggiero and Ruotolo2014; Pasqualotto et al. Reference Pasqualotto, Lam and Proulx2013b; Saenz et al. Reference Saenz, Lewis, Huth, Fine and Koch2008). Additionally, sensory substitution, principally consisting of devices that convert visual information into its auditory or tactile equivalent (Bach-Y-Rita et al. Reference Bach-Y-Rita, Collins, Saunders, White and Scadden1969; Proulx et al. Reference Proulx, Ptito and Amedi2014), provides theoretical and practical insights into the ability of the brain (including the primary sensory cortices) to respond to environmental pressures (in this case sensory loss) by altering its functions.

Findings of studies with visually impaired participants demonstrate that even the primary visual cortex is involved in multisensory processing; but is this an effect of blindness? Studies wherein sighted adult participants underwent blindfolding showed that this is not the case. In fact, it is reported that participants who had been blindfolded for a few days subsequently exhibited activation of the primary visual cortex during performance of tactile tasks (Pascual-Leone & Hamilton Reference Pascual-Leone and Hamilton2001), and that this activation was necessary for successful completion of those tactile tasks (Kauffman et al. Reference Kauffman, Hamilton, Keenan, Warde and Pascual-Leone2000). Such a rapid effect of sensory deprivation on the brain function is incompatible with establishment of new brain connections and therefore suggests that multisensory processing “naturally” occurs in the primary sensory cortices (see also Hagen et al. Reference Hagen, Franzén, McGlone, Essick, Dancer and Pardo2002; Kayser et al. Reference Kayser, Petkov and Logothetis2008; Sathian & Zangaladze Reference Sathian and Zangaladze2002). Multisensory processing across distant parts of the brain is supported by preexisting brain connections that recent tracking techniques have started to uncover (Beer et al. Reference Beer, Plank and Greenlee2011; Reference Beer, Plank, Meyer and Greenlee2013; Kim et al. Reference Kim, Ducros, Carlson, Ronen, He, Ugurbil and Kim2006). In sum, mounting evidence indicates that distributed and overlapping neural networks encompassing both multisensory and “unisensory” (primary sensory) areas are underlying the brain functions, hence substantiating the idea that neural reuse is a ubiquitous phenomenon.

If highly overlapping parts of the brain are responsible for processing much of the information, how can we consciously undergo different experiences such as perceiving the smell of coffee or remembering the events of the past weekend? The answer is that highly overlapping parts of the brain are activated in a particular manner according to the content they process (Burgess et al. Reference Burgess, Maguire, Spiers and O'Keefe2001; Horwitz & Braun Reference Horwitz and Braun2004; Rolls & Tovee Reference Rolls and Tovee1995). Specific patterns of activation amongst overlapping neural population determine the types of neural processing and, ultimately, of the “mind content” (Shinkareva et al. Reference Shinkareva, Mason, Malave, Wang, Mitchell and Just2008). To recall the initial metaphor, different performance by each of the singers composing the same choir is responsible for the execution of a potentially unlimited number of songs; some up-beat, some down-beat, of different genres and styles.

References

Alain, C., Woods, D. L. & Knight, R. T. (1998) A distributed cortical network for auditory sensory memory in humans. Brain Research 812:2337.Google Scholar
Amad, A., Cachia, A., Gorwood, P., Pins, D., Delmaire, C., Rolland, B., Mondino, M., Thomas, P. & Jardri, R. (2014) The multimodal connectivity of the hippocampal complex in auditory and visual hallucinations. Molecular Psychiatry 19:184–91.Google Scholar
Amedi, A., Raz, N., Pianka, P., Malach, R. & Zohary, E. (2003) Early “visual” cortex activation correlates with superior verbal memory performance in the blind. Nature Neuroscience 6:758–66.Google Scholar
Andersen, R. A., Essick, G. K. & Siegel, R. M. (1985) Encoding of spatial location by posterior parietal neurons. Science 230:456–58.CrossRefGoogle ScholarPubMed
Anderson, M. L. (2010) Neural reuse: A fundamental organizational principle of the brain. Behavioral and Brain Sciences 33(4):245–66. doi: 10.1017/S0140525X10000853.CrossRefGoogle ScholarPubMed
Anderson, M. L. (2014) After phrenology: Neural reuse and the interactive brain. MIT Press.Google Scholar
Bach-Y-Rita, P., Collins, C. C., Saunders, F. A., White, B. & Scadden, L. (1969) Vision substitution by tactile image projection. Nature 221:963–64.Google Scholar
Beauchamp, M. S. (2005) See me, hear me, touch me: Multisensory integration in lateral occipital-temporal cortex. Current Opinion in Neurobiology 15:145–53.CrossRefGoogle Scholar
Beauchamp, M. S., Yasar, N. E., Frye, R. E. & Ro, T. (2008) Touch, sound and vision in human superior temporal sulcus. NeuroImage 41:1011–20.Google Scholar
Beer, A. L., Plank, T. & Greenlee, M. W. (2011) Diffusion tensor imaging shows white matter tracts between human auditory and visual cortex. Experimental Brain Research 213:299308.Google Scholar
Beer, A. L., Plank, T., Meyer, G. & Greenlee, M. W. (2013) Combined diffusion-weighted and functional magnetic resonance imaging reveals a temporal-occipital network involved in auditory-visual object processing. Frontiers in Integrative Neuroscience 7:5.Google Scholar
Borra, E. & Rockland, K. S. (2011) Projections to early visual areas V1 and V2 in the calcarine fissure from parietal association areas in the macaque. Frontiers in Neuroanatomy 5:35.Google Scholar
Bruce, C., Desimone, R. & Gross, C. G. (1981) Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. Journal of Neurophysiology 46:369–84.Google Scholar
Burgess, N., Maguire, E. A., Spiers, H. J. & O'Keefe, J. (2001) A temporoparietal and prefrontal network for retrieving the spatial context of lifelike events. NeuroImage 14:439–53.Google Scholar
De Gelder, B. & Bertelson, P. (2003) Multisensory integration, perception and ecological validity. Trends in Cognitive Sciences 7:460–67.Google Scholar
Decharms, R. C. & Zador, A. (2000) Neural representation and the cortical code. Annual Review of Neuroscience 23:613–47.Google Scholar
Desgranges, B., Baron, J. C. & Eustache, F. (1998) The functional neuroanatomy of episodic memory: The role of the frontal lobes, the hippocampal formation, and other areas. NeuroImage 8:198213.Google Scholar
Driver, J. & Noesselt, T. (2008) Multisensory interplay reveals crossmodal influences on “sensory-specific” brain regions, neural responses, and judgments. Neuron 57:1123.Google Scholar
Duffau, H. (2008) The anatomo-functional connectivity of language revisited: New insights provided by electrostimulation and tractography. Neuropsychologia 46:927–34.CrossRefGoogle ScholarPubMed
Filippetti, M. L., Lloyd-Fox, S., Longo, M. R., Farroni, T. & Johnson, M. H. (2015) Neural mechanisms of body awareness in infants. Cerebral Cortex 25:3779–87.Google Scholar
Fuster, J. M. (1988) Prefrontal cortex. Birkhäuser.Google Scholar
Gallese, V., Fadiga, L., Fogassi, L. & Rizzolatti, G. (1996) Action recognition in the premotor cortex. Brain 119:593609.Google Scholar
Ganis, G., Thompson, W. L. & Kosslyn, S. M. (2004) Brain areas underlying visual mental imagery and visual perception: An fMRI study. Cognitive Brain Research 20:226–41.Google Scholar
Gauthier, I., Skudlarski, P., Gore, J. C. & Anderson, A. W. (2000) Expertise for cars and birds recruits brain areas involved in face recognition. Nature Neuroscience 3:191–97.Google Scholar
Gerstner, W., Kreiter, A. K., Markram, H. & Herz, A. V. (1997) Neural codes: Firing rates and beyond. Proceedings of the National Academy of Sciences 94:12740–41.Google Scholar
Gobbelé, R., Schürmann, M., Forss, N., Juottonen, K., Buchner, H. & Hari, R. (2003) Activation of the human posterior parietal and temporoparietal cortices during audiotactile interaction. NeuroImage 20:503–11.Google Scholar
Goldstein, E. (2009) Sensation and perception. Cengage Learning.Google Scholar
Grafton, S. T., Fadiga, L., Arbib, M. A. & Rizzolatti, G. (1997) Premotor cortex activation during observation and naming of familiar tools. NeuroImage 6:231–36.Google Scholar
Guerreiro, M. J., Putzar, L. & Röder, B. (2015) The effect of early visual deprivation on the neural bases of multisensory processing. Brain 138:1499–504.Google Scholar
Hagen, M. C., Franzén, O., McGlone, F., Essick, G., Dancer, C. & Pardo, J. V. (2002) Tactile motion activates the human middle temporal/V5 (MT/V5) complex. European Journal of Neuroscience 16:957–64.Google Scholar
Horwitz, B. & Braun, A. R. (2004) Brain network interactions in auditory, visual and linguistic processing. Brain and Language 89:377–84.Google Scholar
Iachini, T., Ruggiero, G. & Ruotolo, F. (2014) Does blindness affect egocentric and allocentric frames of reference in small and large scale spaces? Behavioural Brain Research 273:7381.Google Scholar
Jiang, W., Wallace, M. T., Jiang, H., Vaughan, J. W. & Stein, B. E. (2001) Two cortical areas mediate multisensory integration in superior colliculus neurons. Journal of Neurophysiology 85:506–22.Google Scholar
Kauffman, T., Hamilton, R., Keenan, J. P., Warde, A. & Pascual-Leone, A. (2000) The role of visual cortex in tactile Braille reading: The early blind, the sighted, and the blindfolded. Annals of Neurology 48:418–19.Google Scholar
Kawachi, Y., Grove, P. M. & Sakurai, K. (2014) A single auditory tone alters the perception of multiple visual events. Journal of Vision 14:113.CrossRefGoogle ScholarPubMed
Kayser, C., Petkov, C. I. & Logothetis, N. K. (2008) Visual modulation of neurons in auditory cortex. Cerebral Cortex 18:1560–74.Google Scholar
Kim, M., Ducros, M., Carlson, T., Ronen, I., He, S., Ugurbil, K. & Kim, D.-S. (2006) Anatomical correlates of the functional organization in the human occipitotemporal cortex. Magnetic Resonance Imaging 24:583–90.Google Scholar
Lakatos, P., Chen, C. M., O'Connell, M. N., Mills, A. & Schroeder, C. E. (2007) Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53:279–92.Google Scholar
Lawson, R., Boylan, A. & Edwards, L. (2014) Where you look can influence haptic object recognition. Attention, Perception, and Psychophysics 76:559–74.Google Scholar
Liang, M., Mouraux, A., Hu, L. & Iannetti, G. D. (2013) Primary sensory cortices contain distinguishable spatial patterns of activity for each sense. Nature Communications 4:1979.Google Scholar
Longo, M. R., Azañón, E. & Haggard, P. (2010) More than skin deep: Body representation beyond primary somatosensory cortex. Neuropsychologia 48:655–68.Google Scholar
Matsuhashi, M., Ikeda, A., Ohara, S., Matsumoto, R., Yamamoto, J., Takayama, M., Satowa, T., Begum, T., Usui, K., Nagamine, T., Mikuni, N., Takahashi, J., Miyamoto, S., Fukuyama, H. & Shibasaki, H. (2004) Multisensory convergence at human temporo-parietal junction – epicortical recording of evoked responses. Clinical Neurophysiology 115:1145–60.Google Scholar
Murray, M. M., Molholm, S., Michel, C. M., Heslenfeld, D. J., Ritter, W., Javitt, D. C., Schroeder, C. E. & Foxe, J. J. (2005) Grabbing your ear: Rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cerebral Cortex 15:963–74.CrossRefGoogle Scholar
Öngür, D. & Price, J. L. (2000) The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cerebral Cortex 10:206–19.Google Scholar
Pascual-Leone, A. & Hamilton, R. (2001) The metamodal organization of the brain. Progress in Brain Research 134:427–45.Google Scholar
Pasqualotto, A., Finucane, C. M. & Newell, F. N. (2013a) Ambient visual information confers a context-specific, long-term benefit on memory for haptic scenes. Cognition 128:363–79.Google Scholar
Pasqualotto, A., Lam, J. S. Y. & Proulx, M. J. (2013b) Congenital blindness improves semantic and episodic memory. Behavioural Brain Research 244:162–65.Google Scholar
Pessoa, L. (2012) Beyond brain regions: Network perspective of cognition-emotion interactions. Behavioral and Brain Sciences 35:158–59.Google Scholar
Poirier, C., Collignon, O., Scheiber, C., Renier, L., Vanlierde, A., Tranduy, D., Veraart, C. & De Volder, A. G. (2006) Auditory motion perception activates visual motion areas in early blind subjects. NeuroImage 31:279–85.Google Scholar
Posner, M. I. & Rothbart, M. K. (2007) Research on attention networks as a model for the integration of psychological science. Annual Review of Psychology 58:123.Google Scholar
Proulx, M. J., Ptito, M. & Amedi, A. (2014) Multisensory integration, sensory substitution and visual rehabilitation. Neuroscience and Biobehavioral Reviews 41:12.CrossRefGoogle ScholarPubMed
Ravassard, P., Kees, A., Willers, B., Ho, D., Aharoni, D., Cushman, J., Aghajan, Z. M. & Mehta, M. R. (2013) Multisensory control of hippocampal spatiotemporal selectivity. Science 340:1342–46.Google Scholar
Ricciardi, E., Bonino, D., Pellegrini, S. & Pietrini, P. (2014) Mind the blind brain to understand the sighted one! Is there a supramodal cortical functional architecture? Neuroscience and Biobehavioral Reviews 41:6477.Google Scholar
Rolls, E. T. & Tovee, M. J. (1995) Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. Journal of Neurophysiology 73:713–26.CrossRefGoogle ScholarPubMed
Sadato, N., Pascual-Leone, A., Grafman, J., Ibañez, V., Deiber, M.P., Dold, G. & Hallett, M. (1996) Activation of the primary visual cortex by Braille reading in blind subjects. Nature 380:526–28.Google Scholar
Saenz, M., Lewis, L. B., Huth, A. G., Fine, I. & Koch, C. (2008) Visual motion area MT+/V5 responds to auditory motion in human sight-recovery subjects. Journal of Neuroscience 28:5141–48.Google Scholar
Sathian, K. & Zangaladze, A. (2002) Feeling with the mind's eye: Contribution of visual cortex to tactile perception. Behavioural Brain Research 135:127–32.Google Scholar
Sereno, M. I. & Huang, R. S. (2006) A human parietal face area contains aligned head-centered visual and tactile maps. Nature Neuroscience 9:1337–43.CrossRefGoogle ScholarPubMed
Serino, A., Canzoneri, E. & Avenanti, A. (2011) Fronto-parietal areas necessary for a multisensory representation of peripersonal space in humans: An rTMS study. Journal of Cognitive Neuroscience 23:2956–67.CrossRefGoogle ScholarPubMed
Shinkareva, S. V., Mason, R. A., Malave, V. L., Wang, W., Mitchell, T. M. & Just, M. A. (2008) Using fMRI brain activation to identify cognitive states associated with perception of tools and dwellings. PLoS One 3:e1394.Google Scholar
Shulman, G. L., Ollinger, J. M., Akbudak, E., Conturo, T. E., Snyder, A. Z., Petersen, S. E. & Corbetta, M. (1999) Areas involved in encoding and applying directional expectations to moving objects. Journal of Neuroscience 19:9480–96.Google Scholar
Stein, B. E., Huneycutt, W. S. & Meredith, M. A. (1988) Neurons and behavior: The same rules of multisensory integration apply. Brain Research 448: 355–58.Google Scholar
Stein, B. E. & Stanford, T. R. (2008) Multisensory integration: Current issues from the perspective of the single neuron. Nature Reviews Neuroscience 9:255–66.Google Scholar
Takahashi, T., Kansaku, K., Wada, M., Shibuya, S. & Kitazawa, S. (2013) Neural correlates of tactile temporal-order judgment in humans: An fMRI study. Cerebral Cortex 23:1952–64.Google Scholar
Uesaki, M. & Ashida, H. (2015) Optic-flow selective cortical sensory regions associated with self-reported states of vection. Frontiers in Psychology 6:775.Google Scholar
Vallar, G., Lobel, E., Galati, G., Berthoz, A., Pizzamiglio, L. & Le Bihan, D. (1999) A fronto-parietal system for computing the egocentric spatial frame of reference in humans. Experimental Brain Research 124:281–86.Google Scholar
Van Dijk, K. R. A., Hedden, T., Venkataraman, A., Evans, K. C., Lazar, S. W. & Buckner, R. L. (2010) Intrinsic functional connectivity as a tool for human connectomics: Theory, properties, and optimization. Journal of Neurophysiology 103:297321.Google Scholar
Vidal, M. & Barrès, V. (2014) Hearing (rivalling) lips and seeing voices: How audiovisual interactions modulate perceptual stabilization in binocular rivalry. Frontiers in Human Neuroscience 8:677.Google Scholar
Yeo, B. T., Krienen, F. M., Sepulcre, J., Sabuncu, M. R., Lashkari, D., Hollinshead, M., Roffman, J. L., Smoller, J. W., Zollei, L., Polimeni, J. R., Fischl, B., Liu, H. & Buckner, R. L. (2011) The organization of the human cerebral cortex estimated by intrinsic functional connectivity. Journal of Neurophysiology 106:1125–65.Google Scholar
Zangaladze, A., Epstein, C. M., Grafton, S. T. & Sathian, K. (1999) Involvement of visual cortex in tactile discrimination of orientation. Nature 401:587–90.Google Scholar
Figure 0

Figure 1. Singers of the choir singing (a) Song 1 (dark-grey); (b) Song 2 (dark-grey); (c) both Songs 1 and 2 (light-grey).