Neuroscience and Neurobiology Commons^™

Active Encoding Of Space Through Time, Michele Rucci, Jonathan D. Victor

MODVIS Workshop

No abstract provided.

A Dynamical Model Of Binding In Visual Cortex During Incremental Grouping And Search, Daniel Schmid, Daniel A. Braun, Heiko Neumann

MODVIS Workshop

Binding of visual information is crucial for several perceptual tasks. To incrementally group an object, elements in a space-feature neighborhood need to be bound together starting from an attended location (Roelfsema, TICS, 2005). To perform visual search, candidate locations and cued features must be evaluated conjunctively to retrieve a target (Treisman&Gormican, Psychol Rev, 1988). Despite different requirements on binding, both tasks are solved by the same neural substrate. In a model of perceptual decision-making, we give a mechanistic explanation for how this can be achieved. The architecture consists of a visual cortex module and a higher-order thalamic module. While the …

Validity Of Neural Distance Measures In Representational Similarity Analysis, Fabian A. Soto, Emily R. Martin, Hyeonjeong Lee, Nafiz Ahmed, Juan Estepa, Kianoosh Hosseini, Olivia A. Stibolt, Valentina Roldan, Alycia Winters, Mohammadreza Bayat

MODVIS Workshop

No abstract provided.

Visual Expertise In An Anatomically-Inspired Model Of The Visual System, Garrison W. Cottrell, Martha Gahl, Shubham Kulkarni

MODVIS Workshop

We report on preliminary results of an anatomically-inspired deep learning model of the visual system and its role in explaining the face inversion effect. Contrary to the generally accepted wisdom, our hypothesis is that the face inversion effect can be accounted for by the representation in V1 combined with the reliance on the configuration of features due to face expertise. We take two features of the primate visual system into account: 1) The foveated retina; and 2) The log-polar mapping from retina to V1. We simulate acquisition of faces, etc., by gradually increasing the number of identities the network learns. …

A Bayesian Account Of Depth From Shadow, James Elder, Patrick Cavanagh, Roberto Casati

MODVIS Workshop

When an object casts a shadow on a background surface, the offset of the shadow can be a compelling cue to the relative depth between the object and the background (e.g., Kersten et al 1996, Fig. 1). Cavanagh et al (2021) found that, at least for small shadow offsets, perceived depth scales almost linearly with shadow offset. Here we ask whether this finding can be understood quantitatively in terms of Bayesian decision theory.

Estimating relative depth from shadow offset is complicated by the fact that the shadow offset is co-determined by the slant of the light source relative to the …

Identifying And Localizing Multiple Objects Using Artificial Ventral And Dorsal Visual Cortical Pathways, Zhixian Han, Anne Sereno

MODVIS Workshop

We concluded in our previous study that model cortical visual pathways actively retained information differently according to the different goals of the training tasks. One limitation of our study was that there was only one object in each input image whereas in reality there may be multiple objects in a scene. In our current study, we try to find a brain-like algorithm that can recognize and localize multiple objects.

Variance Partitioning Reveals Consistent Representation Of Object Boundary Contours In Lo Across Different Datasets, Mark D. Lescroart, Utkarsh Singhal

MODVIS Workshop

No abstract provided.

Linking Signal Detection Theory And Encoding Models To Reveal Independent Neural Representations From Neuroimaging Data, Fabian A. Soto

MODVIS Workshop

No abstract provided.

A Feature-Based Model Of Visually Perceiving Deformable Objects, Vivian C. Paulun, Filipp Schmidt, Roland W. Fleming

MODVIS Workshop

No abstract provided.

Global Estimation Of Signed 3d Surface Tilt From Natural Images, Seha Kim, Johannes Burge

MODVIS Workshop

The ability of human visual systems to estimate 3D surface orientation from 2D retinal images is critical. But the computation to calculate 3D orientation in real-world scenes is not fully understood. A Bayes optimal model grounded in natural statistics has explained 3D surface tilt estimation of human observers in natural scenes (Kim and Burge, 2018). However, the model is limited because it estimates only unsigned tilt (tilt modulo 180deg). We extend the model to predict signed tilt estimates and compared with human signed estimates. The model takes image pixels as input and produces optimal estimates of tilt as output, using …

Inferring The Neural Representation Of Faces From Adaptation Aftereffects, Kara J. Emery, Michael A. Webster Ph.D.

MODVIS Workshop

The aftereffects of adaptation to faces have been studied widely, in part to characterize the coding schemes for representing different facial attributes. Often these aftereffects have been interpreted in terms of two alternative models of face processing: 1) a norm-based or opponent code, in which the facial dimension is represented by relative activity in a pair of broadly-tuned mechanisms with opposing sensitivities; or 2) an exemplar code, in which the dimension is sampled by multiple channels narrowly-tuned to different levels of the stimulus. Evidence for or against these alternatives is based on the different patterns of aftereffects they predict (e.g. …

Effect Of Noise On Mutually Inhibiting Pyramidal Cells In Visual Cortex: Foundation Of Stochasticity In Bi-Stable Perception, Naoki Kogo, Felix Kern, Thomas Nowotny, Raymond Van Ee, Richard Van Wezel, Takeshi Aihara

MODVIS Workshop

Bi-stable perception has been an important tool to investigate how visual input is interpreted and how it reaches consciousness. To explain the mechanisms of this phenomenon, it has been assumed that a mutual inhibition circuit plays a key role. It is possible that this circuit functions to resolve ambiguity of input image by quickly shifting the balance of competing signals in response to conflicting features. Recently we established an in vitro neural recording system combined with computerized connections mediated by model neurons and synapses (“dynamic clamp” system). With this system, mutual inhibition circuit between two pyramidal cells from primary visual …

Why Latent Representations In Convolutional Neural Networks Fall Outside Visual Space, Katerina Malakhova

MODVIS Workshop

It is common to compare properties of visual information processing by artificial neural networks and the primate visual system.

Some remarkable similarities were observed in the responses of neurons in IT cortex and units in higher layers of CNNs. Here I show that latent representations formed by weights in convolutional layers do not necessarily reflect visual domain. Instead they are strongly dependent on a choice of training set and cost function.

The most striking example is when an individual unit, which is highly selective to some members of a category is, nevertheless, inhibited by visually similar objects of the same …

Divisive Inhibition As A Solution To The Correspondence Problem In Perceptual Grouping, Chien-Chung Chen, Yi-Shiuan Lin, Li Lin

MODVIS Workshop

No abstract provided.

Discovery Of Activities Via Statistical Clustering Of Fixation Patterns, Jeffrey B. Mulligan

MODVIS Workshop

No abstract provided.

Central And Peripheral Difference In Perceptual Bias In Ambiguous Perception Using Dichoptic Stimuli --- Implications For The Analysis-By-Synthesis Process In Visual Recognition, Li Zhaoping Prof

MODVIS Workshop

No abstract provided.

Mapping The Spatio-Temporal Dynamics Of Vision In The Human Brain, Aude Oliva

MODVIS Workshop

Recognition of objects and scenes is a fundamental function of the human brain, necessitating a complex neural machinery that transforms low level visual information into semantic content. Despite significant advances in characterizing the locus and function of key visual areas, integrating the temporal and spatial dynamics of this processing stream has posed a decades-long challenge to human neuroscience. In this talk I will describe a brain mapping approach to combine magnetoencephalography (MEG), functional MRI (fMRI) measurements, and convolutional neural networks (CNN) by representational similarity analysis to yield a spatially and temporally integrated characterization of neuronal representations when observers perceive visual …

Similarity-Based Fusion Of Meg And Fmri Discerns Early Feedforward And Feedback Processing In The Ventral Stream, Yalda Mohsenzadeh Dr., Radoslaw Martin Cichy Dr., Aude Oliva Dr., Dimitrios Pantazis Dr.

MODVIS Workshop

Successful models of vision, such as DNNs and HMAX, are inspired by the human visual system, relying on a hierarchical cascade of feedforward transformations akin to the ventral stream. Despite these advances, the human visual cortex remains unique in complexity, with feedforward and feedback pathways characterized by rapid spatiotemporal dynamics as visual information is transformed into semantic content. Thus, a systematic characterization of the spatiotemporal and representational space of the ventral visual pathway can offer novel insights in the duration and sequencing of cognitive processes, suggesting computational constraints and new architectures for computer vision models.

To discern the feedforward and …

Modeling The Mechanisms Of Reward Learning That Bias Visual Attention, Jason Hays, Fabian Soto Phd

MODVIS Workshop

No abstract provided.

Parametrically Constrained Lightness Model Incorporating Edge Classification And Increment-Decrement Neural Response Asymmetries, Michael E. Rudd

MODVIS Workshop

Lightness matching data from disk-annulus experiments has the form of a parabolic (2^nd-order polynomial) function when matches are plotted against annulus luminance on log-log axes. Rudd (2010) has proposed a computational cortical model to account for this fact and has subsequently (Rudd, 2013, 2014, 2015) extended the model to explain data from other lightness paradigms, including staircase-Gelb and luminance gradient illusions (Galmonte, Soranzo, Rudd, & Agostini, 2015). Here, I re-analyze parametric lightness matching data from disk-annulus experiments by Rudd and Zemach (2007) and Rudd (2010) for the purpose of further testing the model and to try to constrain …

Identifying Falsifiable Predictions Of The Divisive Normalization Model Of V1 Neurons, Tadamasa Sawada, Alexander A. Petrov

MODVIS Workshop

The divisive normalization model (DNM, Heeger, 1992) accounts successfully for a wide range of phenomena observed in single-cell physiological recordings from neurons in primary visual cortex (V1). The DNM has adjustable parameters to accommodate the diversity of V1 neurons, and is quite flexible. At the same time, in order to be falsifiable, the model must be rigid enough to rule out some possible data patterns. In this study, we discuss whether the DNM predicts any physiological result of the V1 neurons based on mathematical analysis and computational simulations. We identified some falsifiable predictions of the DNM. The main idea is …

How Deep Is The Feature Analysis Underlying Rapid Visual Categorization?, Sven Eberhardt, Jonah Cader, Thomas Serre

MODVIS Workshop

Rapid categorization paradigms have a long history in experimental psychology: Characterized by short presentation times and fast behavioral responses, these tasks highlight both the speed and ease with which our visual system processes natural object categories. Previous studies have shown that feed-forward hierarchical models of the visual cortex provide a good fit to human visual decisions. At the same time, recent work has demonstrated significant gains in object recognition accuracy with increasingly deep hierarchical architectures: From AlexNet to VGG to Microsoft CNTK – the field of computer vision has championed both depth and accuracy. But it is unclear how well …

The Bounded Log-Odds Model Of Frequency And Probability Distortion, Hang Zhang, Laurence T. Maloney

MODVIS Workshop

No abstract provided.

Putting Saliency In Its Place, John K. Tsotsos

MODVIS Workshop

The role of attention and the place within the visual processing stream where the concept of saliency has been situated is critically examined by considering the experimental evidence and performing tests that link experiment to computation.

A Conceptual Framework Of Computations In Mid-Level Vision, Jonas Kubilius, Johan Wagemans, Hans P. Op De Beeck

MODVIS Workshop

The goal of visual processing is to extract information necessary for a variety of tasks, such as grasping objects, navigating in scenes, and recognizing them. While ultimately these tasks might be carried out by separate processing pathways, they nonetheless share a common root in the early and intermediate visual areas. What representations should these areas develop in order to facilitate all of these higher-level tasks? Several distinct ideas have received empirical support in the literature so far: (i) boundary feature detection, such as edge, corner, and curved segment extraction; (ii) second-order feature detection, such as the difference in orientation or …