Hostname: page-component-745bb68f8f-grxwn Total loading time: 0 Render date: 2025-02-06T13:55:58.241Z Has data issue: false hasContentIssue false

Grounding predictive coding models in empirical neuroscience research

Published online by Cambridge University Press:  10 May 2013

Tobias Egner
Affiliation:
Department of Psychology & Neuroscience, and Center for Cognitive Neuroscience, Duke University, Durham, NC 27708. tobias.egner@duke.eduhttp://sites.google.com/site/egnerlab/
Christopher Summerfield
Affiliation:
Department of Experimental Psychology, University of Oxford, Oxford OX1 3UD, United Kingdom. christopher.summerfield@psy.ox.ac.ukhttps://sites.google.com/site/summerfieldlab/home

Abstract

Clark makes a convincing case for the merits of conceptualizing brains as hierarchical prediction machines. This perspective has the potential to provide an elegant and powerful general theory of brain function, but it will ultimately stand or fall with evidence from basic neuroscience research. Here, we characterize the status quo of that evidence and highlight important avenues for future investigations.

Type
Open Peer Commentary
Copyright
Copyright © Cambridge University Press 2013 

The intuition that our brains harbor a predictive (forward) model linking visual percepts to their probable external causes (Helmholtz Reference Helmholtz1876) has been fleshed out over recent decades by sophisticated models (Friston Reference Friston2005; Mumford Reference Mumford1992; Rao & Ballard Reference Rao and Ballard1999), inspiring the view that Clark puts forward in the target article, that predictive coding is a cardinal principle of neural systems (cf. Friston Reference Friston2010; Hawkins & Blakeslee Reference Hawkins and Blakeslee2004). While this perspective offers elegant post-hoc explanations for a wide array of behavioral and neural phenomena, empirical studies directly testing the basic biological assumptions of predictive coding remain scarce. Specifically, the core empirical hypotheses derived from the predictive coding scheme are the presence of separable and hierarchically organized visual expectation and surprise computations (and associated neural units/signals) in the posterior brain (Friston Reference Friston2005). These predictions are provocative, because they differ drastically from traditional views of visual neurons as mere bottom-up feature detectors (Hubel & Wiesel Reference Hubel and Wiesel1965; Riesenhuber & Poggio Reference Riesenhuber and Poggio2000). But what is the empirical evidence directly supporting these claims? We first address results from macroscopic, human neuroimaging studies, followed by microscopic data from invasive animal experiments.

At the macroscopic level of inquiry provided by whole-brain functional neuroimaging, there are at present modest but promising lines of empirical support for predictive coding's core propositions. Most firmly established is the finding of robust occipital responses evoked by the surprising presence or absence of visual stimuli, presumably attributable to the computation of prediction error (e.g., Alink et al. Reference Alink, Schwiedrzik, Kohler, Singer and Muckli2010; den Ouden et al. Reference den Ouden, Friston, Daw, McIntosh and Stephan2009; Egner et al. Reference Egner, Monti and Summerfield2010). Similarly, “repetition suppression,” the attenuated neural response to a repeated stimulus that predictive coding attributes to a decrease in prediction error (Friston Reference Friston2005), has repeatedly been shown to be modulated by expectations, including in human functional magnetic resonance imaging (fMRI) (Summerfield et al. Reference Summerfield, Trittschuh, Monti, Mesulam and Egner2008), electroencephalographic (EEG) (Summerfield et al. Reference Summerfield, Wyart, Johnen and De Gardelle2011), and magnetoencephalographic (MEG) (Todorovic et al. Reference Todorovic, van Ede, Maris and de Lange2011) recordings. However, although evidence for visual surprise signals at the neural population level is fairly abundant, the attribution of these signals to local prediction error computations is not unequivocal, in that they could instead be argued to reflect attentional highlighting of unexpected stimuli (cf. Pearce & Hall Reference Pearce and Hall1980) driven by predictive processing elsewhere in the brain. In fact, the precise role that attention plays in the predictive coding machinery is currently under debate (Feldman & Friston Reference Feldman and Friston2010; Summerfield & Egner Reference Summerfield and Egner2009) and represents an important line of recent (Kok et al. Reference Kok, Rahnev, Jehee, Lau and de Lange2011; Wyart et al. Reference Wyart, Nobre and Summerfield2012) and future investigations into the predictive brain hypothesis.

In contrast to this support for the existence visual surprise signals, the proposition that there are simultaneous computations of prediction and prediction error signals carried out by distinct neural populations in visual cortex is presently only poorly substantiated. One recent fMRI study showed that neural population responses in the ventral visual stream can be successfully modeled as reflecting the summed activity of putative prediction and prediction error signals (Egner et al. Reference Egner, Monti and Summerfield2010; Jiang et al. Reference Jiang, Schmajuk and Egner2012). Similarly, a recent computational model can account for a wide array of auditory EEG responses by supposing co-existing prediction and prediction error neurons (Wacongne et al. Reference Wacongne, Changeux and Dehaene2012). However, neither of these studies demonstrates unambiguously the simultaneous operation of distinct neural sub-populations coding for expectations and surprise, a finding that would greatly bolster the biological feasibility of predictive coding models. Finally, the purported hierarchical nature of the interplay between expectation and surprise signals has garnered indirect support from a handful of fMRI studies. For instance, Murray and colleagues demonstrated the “explaining away” of activity in lower-level visual regions by activity in higher-level visual cortex when presenting a coherent visual object compared to its dissembled constituent parts (Murray et al. Reference Murray, Kersten, Olshausen, Schrater and Woods2002). Other investigators have employed effective connectivity analysis of fMRI data to probe how dynamic interactions between different brain regions may mediate prediction and surprise signals (den Ouden et al. Reference den Ouden, Friston, Daw, McIntosh and Stephan2009; Reference den Ouden, Daunizeau, Roiser, Friston and Stephan2010; Kok et al. Reference Kok, Rahnev, Jehee, Lau and de Lange2011; Summerfield & Koechlin Reference Summerfield and Koechlin2008; Summerfield et al. Reference Summerfield, Egner, Greene, Koechlin, Mangels and Hirsch2006). Nevertheless, a comprehensive demonstration of predictive coding “message passing” across several adjacent levels of the visual processing hierarchy remains lacking from the literature.

Perhaps most importantly, microscopic or cellular level data addressing the core tenets of the predictive coding hypothesis have been particularly scarce. In part, this may be for methodological reasons: For example, neurons with proposed “predictive fields” might be excluded from recording studies where cells are screened according to their bottom-up sensitivity. Moreover, the dynamics of the reciprocal interaction within the hierarchy might give rise to complex neural responses, making it hard to segregate prediction and error signals. Nevertheless, recent work has supplied some promising data. First, Meyer and Olson (Reference Meyer and Olson2011) have recently described single neurons in monkey inferotemporal cortex that exhibit surprise responses to unexpected stimulus transitions, thus possibly documenting visual prediction error neurons in the ventral visual stream. Two other recent studies, one in monkeys (Eliades & Wang Reference Eliades and Wang2008) and one in mice (Keller et al. Reference Keller, Bonhoeffer and Hubener2012), assessed neuronal activity in the context of sensorimotor feedback (e.g., the integration of movement with predicted changes in visual stimulation), observing putative prediction error signals in primary sensory cortices (for alternative interpretations, see Eliades & Wang Reference Eliades and Wang2008). Importantly, in Keller et al. (Reference Keller, Bonhoeffer and Hubener2012), these surprise signals co-occurred with both pure motor-related and sensory-driven signals, thus providing initial evidence for the possibility of co-habiting prediction and prediction error neurons in early visual cortex. Moreover, the putative prediction error neurons were found in supra-granular layers 2/3, which house precisely the superficial pyramidal cells that have been posited to support prediction error signaling by theoretical models of predictive coding (Friston Reference Friston2008; Mumford Reference Mumford1992).

In conclusion, we submit that the extant data from studies that directly aimed at testing core tenets of the predictive coding hypothesis are few but generally supportive. Looking to the future, additional demonstrations of simultaneous prediction and surprise computations within a single processing stage (in particular from single-neuron electrophysiology), as well as evidence for hierarchical interactions with adjacent stages, are required. We hope that over coming years, neuroscientists will be inspired to collect these data.

References

Alink, A., Schwiedrzik, C. M., Kohler, A., Singer, W. & Muckli, L. (2010) Stimulus predictability reduces responses in primary visual cortex. Journal of Neuroscience 30:2960–66.CrossRefGoogle ScholarPubMed
den Ouden, H. E. M., Daunizeau, J., Roiser, J., Friston, K. J. & Stephan, K. E. (2010) Striatal prediction error modulates cortical coupling. Journal of Neuroscience 30:3210–19.CrossRefGoogle ScholarPubMed
den Ouden, H. E. M, Friston, K. J., Daw, N. D., McIntosh, A. R. & Stephan, K. E. (2009) A dual role for prediction error in associative learning. Cerebral Cortex 19:1175–85.Google Scholar
Egner, T., Monti, J. M. & Summerfield, C. (2010) Expectation and surprise determine neural population responses in the ventral visual stream. Journal of Neuroscience 30(49):16601–608.Google Scholar
Eliades, S. J. & Wang, X. (2008) Neural substrates of vocalization feedback monitoring in primate auditory cortex. Nature 453:1102–106.CrossRefGoogle ScholarPubMed
Feldman, H. & Friston, K. J. (2010) Attention, uncertainty, and free-energy. Frontiers in Human Neuroscience 4:215. doi:10.3389/fnmuh.2010.00215.Google Scholar
Friston, K. (2005) A theory of cortical responses. Philosophical Transactions of the Royal Society of London B: Biological Sciences 360(1456):815–36.Google Scholar
Friston, K. (2008) Hierarchical models in the brain. PLoS Computational Biology 4:e1000211.Google Scholar
Friston, K. J. (2010) The free-energy principle: A unified brain theory? Nature Reviews Neuroscience 11(2):127–38.Google Scholar
Hawkins, J. & Blakeslee, S. (2004) On intelligence. Owl Books/Times Books.Google Scholar
Helmholtz, H. von (1876) Handbuch der physiologischen Optik. Leopold Voss.Google Scholar
Hubel, D. H. & Wiesel, T. N. (1965) Receptive fields and functional architecture in two nonstriate visual areas (18 and 19) of the cat. Journal of Neurophysiology 28:229–89.Google Scholar
Jiang, J., Schmajuk, N. & Egner, T. (2012) Explaining neural signals in human visual cortex with an associative learning model. Behavioral Neuroscience 126(4):575–81.Google Scholar
Keller, G. B., Bonhoeffer, T. & Hubener, M. (2012) Sensorimotor mismatch signals in primary visual cortex of the behaving mouse. Neuron 74:809–15.Google Scholar
Kok, P., Rahnev, D., Jehee, J. F., Lau, H. C. & de Lange, F. P. (2011) Attention reverses the effect of prediction in silencing sensory signals. Cerebral Cortex 22:2197–206.Google Scholar
Meyer, T. & Olson, C. R. (2011) Statistical learning of visual transitions in monkey inferotemporal cortex. Proceedings of the National Academy of Sciences USA 108:19401–406.CrossRefGoogle ScholarPubMed
Mumford, D. (1992) On the computational architecture of the neocortex. II. The role of cortico-cortical loops. Biological Cybernetics 66(3):241–51.CrossRefGoogle ScholarPubMed
Murray, S. O., Kersten, D., Olshausen, B. A., Schrater, P. & Woods, D. L. (2002) Shape perception reduces activity in human primary visual cortex. Proceedings of the National Academy of Sciences USA 99(23):15164–69.Google Scholar
Pearce, J. M. & Hall, G. (1980) A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review 87:532–52.Google Scholar
Rao, R. P. N. & Ballard, D. H. (1999) Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience 2(1):7987.CrossRefGoogle ScholarPubMed
Riesenhuber, M. & Poggio, T (2000) Models of object recognition. Nature Neuroscience 3(Suppl.):1199–204.Google Scholar
Summerfield, C. & Egner, T (2009) Expectation (and attention) in visual cognition. Trends in Cognition Science 13:403409.Google Scholar
Summerfield, C., Egner, T., Greene, M., Koechlin, E., Mangels, J. & Hirsch, J (2006) Predictive codes for forthcoming perception in the frontal cortex. Science 314:1311–14.Google Scholar
Summerfield, C. & Koechlin, E. (2008) A neural representation of prior information during perceptual inference. Neuron 59:336–47.Google Scholar
Summerfield, C., Trittschuh, E. H., Monti, J. M., Mesulam, M. M. & Egner, T. (2008) Neural repetition suppression reflects fulfilled perceptual expectations. Nature Neuroscience 11(9):10041006.CrossRefGoogle ScholarPubMed
Summerfield, C., Wyart, V., Johnen, V. M. & De Gardelle, V (2011) Human scalp electroencephalography reveals that repetition suppression varied with expectation. Frontiers in Human Neuroscience 5:67. (Online publication). doi:10.3389/fnhum.2011.00067.CrossRefGoogle ScholarPubMed
Todorovic, A., van Ede, F., Maris, E. & de Lange, F. P. (2011) Prior expectation mediates neural adaptation to repeated sounds in the auditory cortex: An MEG study. Journal of Neuroscience 31:9118–23.Google Scholar
Wacongne, C., Changeux, J. P. & Dehaene, S. (2012) A neuronal model of predictive coding accounting for the mismatch negativity. Journal of Neuroscience 32:3665–78.Google Scholar
Wyart, V., Nobre, A. C. & Summerfield, C. (2012) Dissociable prior influences of signal probability and relevance on visual contrast sensitivity. Proceedings of the National Academy of Sciences USA 109:3593–98.Google Scholar