What do neurons really want? The role of semantics in cortical representations.

TitleWhat do neurons really want? The role of semantics in cortical representations.
Publication TypeBook Chapter
Year of Publication2019
AuthorsKreiman, G
Book TitlePsychology of Learning and Motivation
Volume70
Chapter7
Abstract

What visual inputs best trigger activity for a given neuron in cortex and what type of semantic information may guide those neuronal responses? We revisit the methodol- ogies used so far to design visual experiments, and what those methodologies have taught us about neural coding in visual cortex. Despite heroic and seminal work in ventral visual cortex, we still do not know what types of visual features are optimal for cortical neurons. We briefly review state-of-the-art standard models of visual recog- nition and argue that such models should constitute the null hypothesis for any measurement that purports to ascribe semantic meaning to neuronal responses. While it remains unclear when, where, and how abstract semantic information is incorporated in visual neurophysiology, there exists clear evidence of top-down modulation in the form of attention, task-modulation and expectations. Such top-down signals open the doors to some of the most exciting questions today toward elucidating how abstract knowledge can be incorporated into our models of visual processing.

DOI10.1016/bs.plm.2019.03.005

Associated Module: 

CBMM Relationship: 

  • CBMM Funded