Building and Evaluating Computational Models of the Mammalian Visual System

Building and Evaluating Computational Models of the Mammalian Visual System PDF Author: Nathan Cheuck Lam Kong
Publisher:
ISBN:
Category :
Languages : en
Pages : 0

Get Book Here

Book Description
Animals continuously and dynamically process sensory information in service of both flexible and inflexible behaviours. To understand the brain's complex information-processing pipeline by which such behaviours arise, we must first understand how the brain transforms sensory information from its raw form. This will then allow us determine what information is accessible downstream in the process. In this dissertation, we try to understand how the brain processes visual information, which entails building and evaluating computational models that can predict how the animal will respond to novel visual inputs. We focus on a class of models known as convolutional neural networks (CNNs) and demonstrate ways in which they can be evaluated against and be built for primates and for rodents to better understand how the mammalian visual system supports behaviour. We first demonstrate a time-resolved correspondence between a feedforward CNN and whole-brain neural responses during human object processing and develop a data-driven optimization approach to improve upon correlations achieved between the model and the neural data. Motivated by extensive empirical work in rodents on navigational and on decision-making behaviours and by the desire to integrate models of cortical and of subcortical areas that support these behaviours, we build quantitatively accurate CNN models of the mouse visual system. Although CNNs are state-of-the-art models of primate and of rodent visual processing, they are extremely brittle. We therefore examine the nature of their brittleness and show the existence of representational differences between primary visual cortex of non-human primates and the models. Finally, we suggest that building less-brittle models will require us to incorporate the temporally-continuous nature of the visual inputs that animals receive. Looking forward, we hope that models of sensory cortex can be integrated with computational models of downstream cortical and subcortical areas, so that we can better understand how flexible and inflexible behaviours arise.

Building and Evaluating Computational Models of the Mammalian Visual System

Building and Evaluating Computational Models of the Mammalian Visual System PDF Author: Nathan Cheuck Lam Kong
Publisher:
ISBN:
Category :
Languages : en
Pages : 0

Get Book Here

Book Description
Animals continuously and dynamically process sensory information in service of both flexible and inflexible behaviours. To understand the brain's complex information-processing pipeline by which such behaviours arise, we must first understand how the brain transforms sensory information from its raw form. This will then allow us determine what information is accessible downstream in the process. In this dissertation, we try to understand how the brain processes visual information, which entails building and evaluating computational models that can predict how the animal will respond to novel visual inputs. We focus on a class of models known as convolutional neural networks (CNNs) and demonstrate ways in which they can be evaluated against and be built for primates and for rodents to better understand how the mammalian visual system supports behaviour. We first demonstrate a time-resolved correspondence between a feedforward CNN and whole-brain neural responses during human object processing and develop a data-driven optimization approach to improve upon correlations achieved between the model and the neural data. Motivated by extensive empirical work in rodents on navigational and on decision-making behaviours and by the desire to integrate models of cortical and of subcortical areas that support these behaviours, we build quantitatively accurate CNN models of the mouse visual system. Although CNNs are state-of-the-art models of primate and of rodent visual processing, they are extremely brittle. We therefore examine the nature of their brittleness and show the existence of representational differences between primary visual cortex of non-human primates and the models. Finally, we suggest that building less-brittle models will require us to incorporate the temporally-continuous nature of the visual inputs that animals receive. Looking forward, we hope that models of sensory cortex can be integrated with computational models of downstream cortical and subcortical areas, so that we can better understand how flexible and inflexible behaviours arise.

Computational Models of Visual Processing

Computational Models of Visual Processing PDF Author: Michael S. Landy
Publisher: MIT Press
ISBN: 9780262121552
Category : Computer simulation
Languages : en
Pages : 420

Get Book Here

Book Description
The more than twenty contributions in this book, all new and previously unpublished, provide an up-to-date survey of contemporary research on computational modeling of the visual system. The approaches represented range from neurophysiology to psychophysics, and from retinal function to the analysis of visual cues to motion, color, texture, and depth. The contributions are linked thematically by a consistent consideration of the links between empirical data and computational models in the study of visual function. An introductory chapter by Edward Adelson and James Bergen gives a new and elegant formalization of the elements of early vision. Subsequent sections treat receptors and sampling, models of neural function, detection and discrimination, color and shading, motion and texture, and 3D shape. Each section is introduced by a brief topical review and summary. ContributorsEdward H. Adelson, Albert J. Ahumada, Jr., James R. Bergen, David G. Birch, David H. Brainard, Heinrich H. Bülthoff, Charles Chubb, Nancy J. Coletta, Michael D'Zmura, John P. Frisby, Norma Graham, Norberto M. Grzywacz, P. William Haake, Michael J. Hawken, David J. Heeger, Donald C. Hood, Elizabeth B. Johnston, Daniel Kersten, Michael S. Landy, Peter Lennie, J. Stephen Mansfield, J. Anthony Movshon, Jacob Nachmias, Andrew J. Parker, Denis G. Pelli, Stephen B. Pollard, R. Clay Reid, Robert Shapley, Carlo L. M. Tiana, Brian A. Wandell, Andrew B. Watson, David R. Williams, Hugh R. Wilson, Yuede. Yang, Alan L. Yuille

Integrating Visual System Mechanisms, Computational Models and Algorithms/Technologies

Integrating Visual System Mechanisms, Computational Models and Algorithms/Technologies PDF Author: Hedva Spitzer
Publisher: Frontiers Media SA
ISBN: 2889635104
Category :
Languages : en
Pages : 233

Get Book Here

Book Description


Computational Models of Early Visual Processing Layers

Computational Models of Early Visual Processing Layers PDF Author: Honghao Shan
Publisher:
ISBN: 9781124274973
Category :
Languages : en
Pages : 160

Get Book Here

Book Description
Visual information passes through layers of processing along the visual pathway, such as retina, lateral geniculate nucleus (LGN), primary visual cortex (V1), prestriate cortex (V2), and beyond. Understanding the functional roles of these visual processing layers will not only help to understand psychophysical and neuroanatomical observations of these layers, but also would help to build intelligent computer vision systems that exhibit human-like behaviors and performance. One of the popular theories about the functional role of visual perception, the efficient coding theory, hypothesizes that the early visual processing layers serve to capture the statistical structure of the visual inputs by removing the redundancy in the visual outputs. Linear implementations of the efficient coding theory, such as independent component analysis (ICA) and sparse coding, learn visual features exhibiting the receptive field properties of V1 simple cells when they are applied to grayscale image patches. In this dissertation, we explore different aspects of the early visual processing layers by building computational models following the efficient coding theory. 1) We develop a hierarchical model, Recursive ICA, that captures nonlinear statistical structures of the visual inputs that cannot be captured by a single layer of ICA. The model is motivated by the idea that higher layers of the visual pathway, such as V2, might work under similar computational principles as the primary visual cortex. Hence we apply a second layer of ICA on top of the first layer ICA outputs. To allow the second layer of ICA to better capture nonlinear statistical structures, we derive a coordinate-wise nonlinear activation function that transforms the first layer ICA's outputs to the second layer ICA's inputs. When applied to grayscale image patches, the model's second layer learns nonlinear visual features, such as texture boundaries and shape contours. We apply the above model to natural scene images, such as forest and grassland, to learn some generic visual features, and then use these features for face and handwritten digit recognition. We get higher recognition rates than those systems built with features designed for face and digit recognition. (2) We show that retinal coding, the pre-cortical stage of visual processing, can also be explained by the efficient coding theory. The retinal coding model turns out to be another variation of Sparse PCA, a technique widely applied in signal processing, financial analysis, bioinformatics, etc. Compared with ICA, which removes the redundancy among the input dimensions, Sparse PCA removes redundancy among the input samples. We apply Sparse PCA to grayscale images, chromatic images, grayscale videos, environmental sound, and human speech, and learn visual and auditory features that exhibit the filtering properties of retinal ganglion cells and auditory nerve fibers. This work suggests that the pre-cortical stages of visual and auditory pathway might work under similar computational principles.

Biological and Computer Vision

Biological and Computer Vision PDF Author: Gabriel Kreiman
Publisher: Cambridge University Press
ISBN: 1108759262
Category : Psychology
Languages : en
Pages : 275

Get Book Here

Book Description
Imagine a world where machines can see and understand the world the way humans do. Rapid progress in artificial intelligence has led to smartphones that recognize faces, cars that detect pedestrians, and algorithms that suggest diagnoses from clinical images, among many other applications. The success of computer vision is founded on a deep understanding of the neural circuits in the brain responsible for visual processing. This book introduces the neuroscientific study of neuronal computations in visual cortex alongside of the psychological understanding of visual cognition and the burgeoning field of biologically-inspired artificial intelligence. Topics include the neurophysiological investigation of visual cortex, visual illusions, visual disorders, deep convolutional neural networks, machine learning, and generative adversarial networks among others. It is an ideal resource for students and researchers looking to build bridges across different approaches to studying and developing visual systems.

Models of the Visual System

Models of the Visual System PDF Author: George K. Hung
Publisher: Springer Science & Business Media
ISBN: 1475758650
Category : Science
Languages : en
Pages : 777

Get Book Here

Book Description
Some of the best vision scientists in the world in their respective fields have contributed to chapters in this book. They have expertise in a wide variety of fields, including bioengineering, basic and clinical visual science, medicine, neurophysiology, optometry, and psychology. Their combined efforts have resulted in a high quality book that covers modeling and quantitative analysis of optical, neurosensory, oculomotor, perceptual and clinical systems. It includes only those techniques and models that have such fundamentally strong physiological, control system, and perceptual bases that they will serve as foundations for models and analysis techniques in the future. The book is aimed first towards seniors and beginning graduate students in biomedical engineering, neurophysiology, optometry, and psychology, who will gain a broad understanding of quantitative analysis of the visual system. In addition, it has sufficient depth in each area to be useful as an updated reference and tutorial for graduate and post-doctoral students, as well as general vision scientists.

Computational Visual Attention Models

Computational Visual Attention Models PDF Author: Milind S. Gide
Publisher:
ISBN: 9781680832808
Category : Technology & Engineering
Languages : en
Pages : 98

Get Book Here

Book Description
The human visual system has evolved to have the ability to selectively focus on the most relevant parts of a visual scene. This mechanism, referred to as visual attention, has been the focus of several neurological and psychological studies in the past few decades. These studies have inspired several computational visual attention models which have been successfully applied to problems in computer vision and robotics. Computational Visual Attention Models provides a comprehensive survey of the state-of-the-art in computational visual attention modeling with a special focus on the latest trends. By reviewing several models published since 2012, the theoretical advantages and disadvantages of each approach are discussed. In addition, existing methodologies to evaluate computational models through the use of eye-tracking data along with the visual attention performance metrics used are described. The shortcomings in existing approaches and approaches to overcome them are also covered. Finally, a subjective evaluation for benchmarking existing visual attention metrics is presented and open problems in visual attention are highlighted. This monograph provides the reader with an in-depth survey of the research conducted to date in computational visual attention models and provides the basis for further research in this exciting area.

Computational Modeling of Vision

Computational Modeling of Vision PDF Author: William Uttal
Publisher: CRC Press
ISBN: 9780824702427
Category : Science
Languages : en
Pages : 276

Get Book Here

Book Description
Defines a unified theory of vision in which nearly independent components of visual stimuli are recombined and synthesized at high levels of neural processing to produce the richness of visual experience. The text illustrates how visual systems gather, process and reconstruct information about objects in two and three dimensions.

Visual Population Codes

Visual Population Codes PDF Author: Nikolaus Kriegeskorte
Publisher: MIT Press
ISBN: 0262016249
Category : Mathematics
Languages : en
Pages : 659

Get Book Here

Book Description
How visual content is represented in neuronal population codes and how to analyze such codes with multivariate techniques. Vision is a massively parallel computational process, in which the retinal image is transformed over a sequence of stages so as to emphasize behaviorally relevant information (such as object category and identity) and deemphasize other information (such as viewpoint and lighting). The processes behind vision operate by concurrent computation and message passing among neurons within a visual area and between different areas. The theoretical concept of "population code" encapsulates the idea that visual content is represented at each stage by the pattern of activity across the local population of neurons. Understanding visual population codes ultimately requires multichannel measurement and multivariate analysis of activity patterns. Over the past decade, the multivariate approach has gained significant momentum in vision research. Functional imaging and cell recording measure brain activity in fundamentally different ways, but they now use similar theoretical concepts and mathematical tools in their modeling and analyses. With a focus on the ventral processing stream thought to underlie object recognition, this book presents recent advances in our understanding of visual population codes, novel multivariate pattern-information analysis techniques, and the beginnings of a unified perspective for cell recording and functional imaging. It serves as an introduction, overview, and reference for scientists and students across disciplines who are interested in human and primate vision and, more generally, in understanding how the brain represents and processes information.

Neuromorphic Olfaction

Neuromorphic Olfaction PDF Author: Krishna C. Persaud
Publisher: CRC Press
ISBN: 1439871728
Category : Medical
Languages : en
Pages : 237

Get Book Here

Book Description
Many advances have been made in the last decade in the understanding of the computational principles underlying olfactory system functioning. Neuromorphic Olfaction is a collaboration among European researchers who, through NEUROCHEM (Fp7-Grant Agreement Number 216916)-a challenging and innovative European-funded project-introduce novel computing p