Neural Architecture for Feature Binding in Visual Working Memory
Sebastian Schneegans, Paul M. Bays
The Journal of Neuroscience · 2017 · CC BY-NC-SA
doi:10.1523/jneurosci.3493-16.2017 (opens in a new tab)
We email you when a new notice or a question about this paper appears.
Abstract
Binding refers to the operation that groups different features together into objects. We propose a neural architecture for feature binding in visual working memory that employs populations of neurons with conjunction responses. We tested this model using cued recall tasks, in which subjects had to memorize object arrays composed of simple visual features (color, orientation, and location). After a brief delay, one feature of one item was given as a cue, and the observer had to report, on a continuous scale, one or two other features of the cued item. Binding failure in this task is associated with swap errors, in which observers report an item other than the one indicated by the cue. We observed that the probability of swapping two items strongly correlated with the items' similarity in the cue feature dimension, and found a strong correlation between swap errors occurring in spatial and nonspatial report. The neural model explains both swap errors and response variability as results of decoding noisy neural activity, and can account for the behavioral results in quantitative detail. We then used the model to compare alternative mechanisms for binding nonspatial features. We found the behavioral results fully consistent with a model in which nonspatial features are bound exclusively via their shared location, with no indication of direct binding between color and orientation. These results provide evidence for a special role of location in feature binding, and the model explains how this special role could be realized in the neural system. SIGNIFICANCE STATEMENT The problem of feature binding is of central importance in understanding the mechanisms of working memory. How do we remember not only that we saw a red and a round object, but that these features belong together to a single object rather than to different objects in our environment? Here we present evidence for a neural mechanism for feature binding in working memory, based on encoding of visual information by neurons that respond to the conjunction of features. We find clear evidence that nonspatial features are bound via space: we memorize directly where a color or an orientation appeared, but we memorize which color belonged with which orientation only indirectly by virtue of their shared location.
Abstract licence: CC BY-NC-SA
References39
- 1.
Bays PM (2014 ) Noise in neural populations accounts for errors in working memory. J Neurosci 34:3632–3645.
Not in our library10.1523/jneurosci.3204-13.2014 (opens in a new tab)
- 2.
Bays PM (2016 ) Evaluating and excluding swap errors in analogue tests of working memory. Sci rep 6:19203.
Not in our library10.1038/srep19203 (opens in a new tab)
- 3.
Bays PM, Catalao RF, Husain M (2009 ) The precision of visual working memory is set by allocation of a shared resource. J Vis 9(10):7.1–11.
Not in our library10.1167/9.10.7 (opens in a new tab)
- 4.
Bays PM, Wu EY, Husain M (2011a ) Storage and binding of object features in visual working memory. Neuropsychologia 49:1622–1631.
Not in our library10.1016/j.neuropsychologia.2010.12.023 (opens in a new tab)
- 5.
Bays PM, Gorgoraptis N, Wee N, Marshall L, Husain M (2011b ) Temporal dynamics of encoding, storage, and reallocation of visual working memory. J Vis 11(10):pii:6.
Not in our library10.1167/11.10.6 (opens in a new tab)
- 6.
Emrich SM, Ferber S (2012 ) Competition increases binding errors in visual working memory. J Vis 12(4):pii:12.
Not in our library10.1167/12.4.12 (opens in a new tab)
- 7.
Fisher NI (1995 ) Statistical analysis of circular data. Cambridge, UK: Cambridge UP.
Not in our library
- 8.
Fougnie D, Alvarez GA (2011 ) Object features fail independently in visual working memory: Evidence for a probabilistic feature-store model. J Vis 11(12): pii:3.
Not in our library10.1167/11.12.3 (opens in a new tab)
- 9.
Fougnie D, Cormiea SM, Alvarez GA (2013 ) Object-based benefits without object-based representations. J Exp Psychol Gen 142:621–626.
Not in our library10.1037/a0030300 (opens in a new tab)
- 10.
Gorgoraptis N, Catalao RF, Bays PM, Husain M (2011 ) Dynamic updating of working memory resources for visual objects. J Neurosci 31:8502–8511.
Not in our library10.1523/jneurosci.0208-11.2011 (opens in a new tab)
- 11.
Hamker FH (2005 ) The reentry hypothesis: the putative interaction of the frontal eye field, ventrolateral prefrontal cortex, and areas v4, it for attention and eye movement. Cereb Cortex 15:431–447.
Not in our library10.1093/cercor/bhh146 (opens in a new tab)
- 12.
Itti L, Koch C (2001 ) Computational modelling of visual attention. Nat Rev Neurosci 2:194–203.
Not in our library10.1038/35058500 (opens in a new tab)
- 13.
Johnson JS, Spencer JP, Schöner G (2008 ) Moving to higher ground: the dynamic field theory and the dynamics of visual cognition. New Ideas Psychol 26:227–251.
Not in our library10.1016/j.newideapsych.2007.07.007 (opens in a new tab)
- 14.
Johnson JS, Simmering VR, Buss AT (2014 ) Beyond slots and resources: grounding cognitive concepts in neural dynamics. Atten Percept Psychophys 76:1630–1654.
Not in our library10.3758/s13414-013-0596-9 (opens in a new tab)
- 15.
Kahneman D, Treisman A, Gibbs BJ (1992 ) The reviewing of object files: object-specific integration of information. Cogn Psychol 24:175–219.
Not in our library10.1016/0010-0285(92)90007-o (opens in a new tab)
- 16.
Luck SJ, Vogel EK (1997 ) The capacity of visual working memory for features and conjunctions. Nature 390:279–281.
Not in our library10.1038/36846 (opens in a new tab)
- 17.
A probabilistic palimpsest model of visual short-term memory. · 2015
Not checked - 18.
Nissen MJ (1985 ) Accessing features and objects: is location special? In: Attention and performance XI (Posner MI, Marin OSM, eds), pp. 205–219. Hillsdale, NJ: Erlbaum.
Not in our library
- 19.
Op De Beeck H, Vogels R (2000 ) Spatial sensitivity of macaque inferior temporal neurons. J Comp Neurol 426:505–518.
Not in our library10.1002/1096-9861(20001030)426:4<505::aid-cne1>3.0.co;2-m (opens in a new tab)
- 20.
Palanca BJ, DeAngelis GC (2005 ) Does neuronal synchrony underlie visual feature grouping? Neuron 46:333–346.
Not in our library10.1016/j.neuron.2005.03.002 (opens in a new tab)
- 21.
Pertzov Y, Husain M (2014 ) The privileged role of location in visual working memory. Atten Percept Psychophys 76:1914–1924.
Not in our library10.3758/s13414-013-0541-y (opens in a new tab)
- 22.
Pouget A, Dayan P, Zemel R (2000 ) Information processing with population codes. Nat Rev Neurosci 1:125–132.
Not in our library10.1038/35039062 (opens in a new tab)
- 23.
Raffone A, Wolters G (2001 ) A cortical mechanism for binding in visual working memory. J Cogn Neurosci 13:766–785.
Not in our library10.1162/08989290152541430 (opens in a new tab)
- 24.
Rao SC, Rainer G, Miller EK (1997 ) Integration of what and where in the primate prefrontal cortex. Science 276:821–824.
Not in our library10.1126/science.276.5313.821 (opens in a new tab)
- 25.
Rerko L, Oberauer K, Lin HY (2014 ) Spatial transposition gradients in visual working memory. Q J Exp Psychol (Hove) 67:3–15.
Not in our library10.1080/17470218.2013.789543 (opens in a new tab)
- 26.
Schneegans S, Spencer J, Schöner G (2016 ) Integrating “what” and “where”: visual working memory for objects in a scene. In: Dynamic thinking: a primer on dynamic field theory (Schöner G, Spencer J, eds). New York: Oxford UP.
Not in our library
- 27.
Shadlen MN, Movshon JA (1999 ) Synchrony unbound: a critical evaluation of the temporal binding hypothesis. Neuron 24:67–77, 111–125.
Not in our library10.1016/s0896-6273(00)80822-3 (opens in a new tab)
- 28.
Swan G, Wyble B (2014 ) The binding pool: a model of shared neural resources for distinct items in visual working memory. Atten Percept Psychophys 76:2136–2157.
Not in our library10.3758/s13414-014-0633-3 (opens in a new tab)
- 29.
Theeuwes J, Kramer AF, Irwin DE (2011 ) Attention on our mind: the role of spatial attention in visual working memory. Acta Psychologica 137:248–251.
Not in our library10.1016/j.actpsy.2010.06.011 (opens in a new tab)
- 30.
Treisman A (1988 ) Features and objects: the fourteenth Bartlett memorial lecture. Q J Exp Psychol A 40:201–237.
Not in our library10.1080/02724988843000104 (opens in a new tab)
- 31.
Treisman A (1996 ) The binding problem. Curr Opin Neurobiol 6:171–178.
Not in our library10.1016/s0959-4388(96)80070-5 (opens in a new tab)
- 32.
Treisman A, Zhang W (2006 ) Location and binding in visual working memory. Mem Cogn 34:1704–1719.
Not in our library10.3758/bf03195932 (opens in a new tab)
- 33.
von der Malsburg C (1999 ) The what and why of binding: the modeler's perspective. Neuron 24:95–104, 111–125.
Not in our library10.1016/s0896-6273(00)80825-9 (opens in a new tab)
- 34.
Wang B, Cao X, Theeuwes J, Olivers CN, Wang Z (2016 ) Location-based effects underlie feature conjunction benefits in visual working memory. J Vis 16(11):12.
Not in our library10.1167/16.11.12 (opens in a new tab)
- 35.
Wang B, Cao X, Theeuwes J, Olivers CN, Wang Z (2017 ) Separate capacities for storing different features in visual working memory. J Exp Psychol Learn Mem Cogn 43:226–236.
Not in our library10.1037/xlm0000295 (opens in a new tab)
- 36.
Wei Z, Wang XJ, Wang DH (2012 ) From distributed resources to limited slots in multiple-item working memory: a spiking network model with normalization. J Neurosci 32:11228–11240.
Not in our library10.1523/jneurosci.0735-12.2012 (opens in a new tab)
- 37.
Wheeler ME, Treisman AM (2002 ) Binding in short-term visual memory. J Exp Psychol Gen 131:48–64.
Not in our library10.1037/0096-3445.131.1.48 (opens in a new tab)
- 38.
Wilken P, Ma WJ (2004 ) A detection theory account of change detection. J Vis 4(12):1120–1135.
Not in our library10.1167/4.12.11 (opens in a new tab)
- 39.
Wolfe JM (2007 ) Guided search 4.0: current progress with a model of visual search. In: Integrated models of cognitive systems (Gray W, ed), pp 99–119. New York: Oxford UP.
Not in our library
Cited by papers we hold4
Visual working memory and sensory processing in autistic children · 2021
Not checked
Reads
Read by people on this page
None yet.
Checked or read by AI through naulon
None yet.
A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.
Are you an author?
Is this your paper?
Claim it to add your note and be paid when agents cite it. Free.