%0 Conference Paper %B Computational and Systems Neurosciences %D 2020 %T Using task-optimized neural networks to understand why brains have specialized processing for faces %A Dobs, Katharina %A Alexander J. E. Kell %A Julio Martinez-Trujillo %A Michael Cohen %A Nancy Kanwisher %B Computational and Systems Neurosciences %C Denver, CO, USA %8 02/2020 %G eng %0 Conference Paper %B Conference on Cognitive Computational Neuroscience %D 2020 %T Why Are Face and Object Processing Segregated in the Human Brain? Testing Computational Hypotheses with Deep Convolutional Neural Networks %A Dobs, Katharina %A Alexander J. E. Kell %A Julio Martinez-Trujillo %A Michael Cohen %A Nancy Kanwisher %B Conference on Cognitive Computational Neuroscience %C Berlin, Germany %8 09/2020 %G eng %0 Journal Article %J Current Opinion in Neurobiology %D 2019 %T Deep neural network models of sensory systems: windows onto the role of task constraints %A Alexander J. E. Kell %A Josh H. McDermott %X

Sensory neuroscience aims to build models that predict neural responses and perceptual behaviors, and that provide insight into the principles that give rise to them. For decades, artificial neural networks trained to perform perceptual tasks have attracted interest as potential models of neural computation. Only recently, however, have such systems begun to perform at human levels on some real-world tasks. The recent engineering successes of deep learning have led to renewed interest in artificial neural networks as models of the brain. Here we review applications of deep learning to sensory neuroscience, discussing potential limitations and future directions. We highlight the potential uses of deep neural networks to reveal how task performance may constrain neural systems and behavior. In particular, we consider how task-optimized networks can generate hypotheses about neural representations and functional organization in ways that are analogous to traditional ideal observer models.

%B Current Opinion in Neurobiology %V 55 %P 121 - 132 %8 01/2019 %G eng %U https://linkinghub.elsevier.com/retrieve/pii/S0959438818302034 %! Current Opinion in Neurobiology %R 10.1016/j.conb.2019.02.003 %0 Journal Article %J Nature Communications %D 2019 %T Invariance to background noise as a signature of non-primary auditory cortex %A Alexander J. E. Kell %A Josh H. McDermott %X

Despite well-established anatomical differences between primary and non-primary auditory cortex, the associated representational transformations have remained elusive. Here we show that primary and non-primary auditory cortex are differentiated by their invariance to real-world background noise. We measured fMRI responses to natural sounds presented in isolation and in real-world noise, quantifying invariance as the correlation between the two responses for individual voxels. Non-primary areas were substantially more noise-invariant than primary areas. This primary-nonprimary difference occurred both for speech and non-speech sounds and was unaffected by a concurrent demanding visual task, suggesting that the observed invariance is not specific to speech processing and is robust to inattention. The difference was most pronounced for real-world background noise – both primary and non-primary areas were relatively robust to simple types of synthetic noise. Our results suggest a general representational transformation between auditory cortical stages, illustrating a representational consequence of hierarchical organization in the auditory system.

%B Nature Communications %V 10 %8 09/2019 %G eng %U http://www.nature.com/articles/s41467-019-11710-y %N 1 %! Nat Commun %R 10.1038/s41467-019-11710-y %0 Journal Article %J NeuroImage %D 2019 %T Representational similarity precedes category selectivity in the developing ventral visual pathway %A Cohen, Michael A. %A Dilks, Daniel D. %A Kami Koldewyn %A Weigelt, Sarah %A Jenelle Feather %A Alexander J. E. Kell %A Keil, Boris %A Fischl, Bruce %A Zöllei, Lilla %A Lawrence Wald %A Rebecca Saxe %A Nancy Kanwisher %B NeuroImage %V 197 %P 565 - 574 %8 Jan-08-2019 %G eng %U https://www.ncbi.nlm.nih.gov/pubmed/31077844 %! NeuroImage %R 10.1016/j.neuroimage.2019.05.010 %0 Journal Article %J Neuron %D 2018 %T A task-optimized neural network replicates human auditory behavior, predicts brain responses, and reveals a cortical processing hierarchy %A Alexander J. E. Kell %A Daniel L K Yamins %A Erica N Shook %A Sam V Norman-Haignere %A Josh H. McDermott %K auditory cortex %K convolutional neural network %K deep learning %K deep neural network %K encoding models %K fMRI %K Hierarchy %K human auditory cortex %K natural sounds %K word recognition %X

A core goal of auditory neuroscience is to build quantitative models that predict cortical responses to natural sounds. Reasoning that a complete model of auditory cortex must solve ecologically relevant tasks, we optimized hierarchical neural networks for speech and music recognition. The best-performing network contained separate music and speech pathways following early shared processing, potentially replicating human cortical organization. The network performed both tasks as well as humans and exhibited human-like errors despite not being optimized to do so, suggesting common constraints on network and human performance. The network predicted fMRI voxel responses substantially better than traditional spectrotemporal filter models throughout auditory cortex. It also provided a quantitative signature of cortical representational hierarchy—primary and non-primary responses were best predicted by intermediate and late network layers, respectively. The results suggest that task optimization provides a powerful set of tools for modeling sensory systems.

%B Neuron %V 98 %8 04/2018 %G eng %U https://www.sciencedirect.com/science/article/pii/S0896627318302502 %) Available online 19 April 2018 %R 10.1016/j.neuron.2018.03.044