A video-driven model of response statistics in the primate middle temporal area
Loading...
Date
2018-12-01
Authors
Rezai, Omid
Boyraz Jentsch, Pinar
Tripp, Bryan
Journal Title
Journal ISSN
Volume Title
Publisher
Elsevier
Abstract
Neurons in the primate middle temporal area (MT) encode information about visual motion and binocular disparity. MT has been studied intensively for decades, so there is a great deal of information in the literature about MT neuron tuning. In this study, our goal is to consolidate some of this information into a statistical model of the MT population response. The model accepts arbitrary stereo video as input. It uses computer-vision methods to calculate known correlates of the responses (such as motion velocity), and then predicts activity using a combination of tuning functions that have previously been used to describe data in various experiments. To construct the population response, we also estimate the distributions of many model parameters from data in the electrophysiology literature. We show that the model accounts well for a separate dataset of MT speed tuning that was not used in developing the model. The model may be useful for studying relationships between MT activity and behavior in ethologically relevant tasks. As an example, we show that the model can provide regression targets for internal activity in a deep convolutional network that performs a visual odometry task, so that its representations become more physiologically realistic.
Description
The final publication is available at Elsevier via https://dx.doi.org/10.1016/j.neunet.2018.09.004 © 2018. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/
Keywords
Area MT, Deep convolutional networks, Dorsal visual stream, Statistical model, Visual odometry, Visual representations