A fast, invariant representation for human action in the visual system.

TitleA fast, invariant representation for human action in the visual system.
Publication TypeJournal Article
Year of Publication2017
AuthorsIsik, L, Tacchetti, A, Poggio, T
JournalJ Neurophysiol
Paginationjn.00642.2017
Date Published11/2017
ISSN1522-1598
Keywordsaction recognition, magnetoencephalography, neural decoding, vision
Abstract

Humans can effortlessly recognize others' actions in the presence of complex transformations, such as changes in viewpoint. Several studies have located the regions in the brain involved in invariant action recognition, however, the underlying neural computations remain poorly understood. We use magnetoencephalography (MEG) decoding and a dataset of well-controlled, naturalistic videos of five actions (run, walk, jump, eat, drink) performed by different actors at different viewpoints to study the computational steps used to recognize actions across complex transformations. In particular, we ask when the brain discriminates between different actions, and when it does so in a manner that is invariant to changes in 3D viewpoint. We measure the latency difference between invariant and non-invariant action decoding when subjects view full videos as well as form-depleted and motion-depleted stimuli. We were unable to detect a difference in decoding latency or temporal profile between invariant and non-invariant action recognition in full videos. However, when either form or motion information is removed from the stimulus set, we observe a decrease and delay in invariant action decoding. Our results suggest that the brain recognizes actions and builds invariance to complex transformations at the same time, and that both form and motion information are crucial for fast, invariant action recognition.

DOI10.1152/jn.00642.2017
Alternate JournalJ. Neurophysiol.
PubMed ID29118198
Download:  PDF icon Author's last draft

Research Area: 

CBMM Relationship: 

  • CBMM Funded