Sparse representation of visual data for compression and compressed sensing

Sparse representation of visual data for compression and compressed sensing PDF Author: Ehsan Miandji
Publisher: Linköping University Electronic Press
ISBN: 9176851869
Category :
Languages : en
Pages : 180

Get Book Here

Book Description
The ongoing advances in computational photography have introduced a range of new imaging techniques for capturing multidimensional visual data such as light fields, BRDFs, BTFs, and more. A key challenge inherent to such imaging techniques is the large amount of high dimensional visual data that is produced, often requiring GBs, or even TBs, of storage. Moreover, the utilization of these datasets in real time applications poses many difficulties due to the large memory footprint. Furthermore, the acquisition of large-scale visual data is very challenging and expensive in most cases. This thesis makes several contributions with regards to acquisition, compression, and real time rendering of high dimensional visual data in computer graphics and imaging applications. Contributions of this thesis reside on the strong foundation of sparse representations. Numerous applications are presented that utilize sparse representations for compression and compressed sensing of visual data. Specifically, we present a single sensor light field camera design, a compressive rendering method, a real time precomputed photorealistic rendering technique, light field (video) compression and real time rendering, compressive BRDF capture, and more. Another key contribution of this thesis is a general framework for compression and compressed sensing of visual data, regardless of the dimensionality. As a result, any type of discrete visual data with arbitrary dimensionality can be captured, compressed, and rendered in real time. This thesis makes two theoretical contributions. In particular, uniqueness conditions for recovering a sparse signal under an ensemble of multidimensional dictionaries is presented. The theoretical results discussed here are useful for designing efficient capturing devices for multidimensional visual data. Moreover, we derive the probability of successful recovery of a noisy sparse signal using OMP, one of the most widely used algorithms for solving compressed sensing problems.

Sparse representation of visual data for compression and compressed sensing

Sparse representation of visual data for compression and compressed sensing PDF Author: Ehsan Miandji
Publisher: Linköping University Electronic Press
ISBN: 9176851869
Category :
Languages : en
Pages : 180

Get Book Here

Book Description
The ongoing advances in computational photography have introduced a range of new imaging techniques for capturing multidimensional visual data such as light fields, BRDFs, BTFs, and more. A key challenge inherent to such imaging techniques is the large amount of high dimensional visual data that is produced, often requiring GBs, or even TBs, of storage. Moreover, the utilization of these datasets in real time applications poses many difficulties due to the large memory footprint. Furthermore, the acquisition of large-scale visual data is very challenging and expensive in most cases. This thesis makes several contributions with regards to acquisition, compression, and real time rendering of high dimensional visual data in computer graphics and imaging applications. Contributions of this thesis reside on the strong foundation of sparse representations. Numerous applications are presented that utilize sparse representations for compression and compressed sensing of visual data. Specifically, we present a single sensor light field camera design, a compressive rendering method, a real time precomputed photorealistic rendering technique, light field (video) compression and real time rendering, compressive BRDF capture, and more. Another key contribution of this thesis is a general framework for compression and compressed sensing of visual data, regardless of the dimensionality. As a result, any type of discrete visual data with arbitrary dimensionality can be captured, compressed, and rendered in real time. This thesis makes two theoretical contributions. In particular, uniqueness conditions for recovering a sparse signal under an ensemble of multidimensional dictionaries is presented. The theoretical results discussed here are useful for designing efficient capturing devices for multidimensional visual data. Moreover, we derive the probability of successful recovery of a noisy sparse signal using OMP, one of the most widely used algorithms for solving compressed sensing problems.

Computational Photography

Computational Photography PDF Author: Saghi Hajisharif
Publisher: Linköping University Electronic Press
ISBN: 9179299059
Category :
Languages : en
Pages : 122

Get Book Here

Book Description
The introduction and recent advancements of computational photography have revolutionized the imaging industry. Computational photography is a combination of imaging techniques at the intersection of various fields such as optics, computer vision, and computer graphics. These methods enhance the capabilities of traditional digital photography by applying computational techniques both during and after the capturing process. This thesis targets two major subjects in this field: High Dynamic Range (HDR) image reconstruction and Light Field (LF) compressive capturing, compression, and real-time rendering. The first part of the thesis focuses on the HDR images that concurrently contain detailed information from the very dark shadows to the brightest areas in the scenes. One of the main contributions presented in this thesis is the development of a unified reconstruction algorithm for spatially variant exposures in a single image. This method is based on a camera noise model, and it simultaneously resamples, reconstructs, denoises, and demosaics the image while extending its dynamic range. Furthermore, the HDR reconstruction algorithm is extended to adapt to the local features of the image, as well as the noise statistics, to preserve the high-frequency edges during reconstruction. In the second part of this thesis, the research focus shifts to the acquisition, encoding, reconstruction, and rendering of light field images and videos in a real-time setting. Unlike traditional integral photography, a light field captures the information of the dynamic environment from all angles, all points in space, and all spectral wavelength and time. This thesis employs sparse representation to provide an end-to-end solution to the problem of encoding, real-time reconstruction, and rendering of high dimensional light field video data sets. These solutions are applied on various types of data sets, such as light fields captured with multi-camera systems or hand-held cameras equipped with micro-lens arrays, and spherical light fields. Finally, sparse representation of light fields was utilized for developing a single sensor light field video camera equipped with a color-coded mask. A new compressive sensing model is presented that is suitable for dynamic scenes with temporal coherency and is capable of reconstructing high-resolution light field videos.

A Mathematical Introduction to Compressive Sensing

A Mathematical Introduction to Compressive Sensing PDF Author: Simon Foucart
Publisher: Springer Science & Business Media
ISBN: 0817649484
Category : Computers
Languages : en
Pages : 634

Get Book Here

Book Description
At the intersection of mathematics, engineering, and computer science sits the thriving field of compressive sensing. Based on the premise that data acquisition and compression can be performed simultaneously, compressive sensing finds applications in imaging, signal processing, and many other domains. In the areas of applied mathematics, electrical engineering, and theoretical computer science, an explosion of research activity has already followed the theoretical results that highlighted the efficiency of the basic principles. The elegant ideas behind these principles are also of independent interest to pure mathematicians. A Mathematical Introduction to Compressive Sensing gives a detailed account of the core theory upon which the field is build. With only moderate prerequisites, it is an excellent textbook for graduate courses in mathematics, engineering, and computer science. It also serves as a reliable resource for practitioners and researchers in these disciplines who want to acquire a careful understanding of the subject. A Mathematical Introduction to Compressive Sensing uses a mathematical perspective to present the core of the theory underlying compressive sensing.

Data-Driven Science and Engineering

Data-Driven Science and Engineering PDF Author: Steven L. Brunton
Publisher: Cambridge University Press
ISBN: 1009098489
Category : Computers
Languages : en
Pages : 615

Get Book Here

Book Description
A textbook covering data-science and machine learning methods for modelling and control in engineering and science, with Python and MATLAB®.

Coded Optical Imaging

Coded Optical Imaging PDF Author: Jinyang Liang
Publisher: Springer Nature
ISBN: 3031390628
Category :
Languages : en
Pages : 697

Get Book Here

Book Description


Neural Networks and Statistical Learning

Neural Networks and Statistical Learning PDF Author: Ke-Lin Du
Publisher: Springer Nature
ISBN: 1447174526
Category : Mathematics
Languages : en
Pages : 988

Get Book Here

Book Description
This book provides a broad yet detailed introduction to neural networks and machine learning in a statistical framework. A single, comprehensive resource for study and further research, it explores the major popular neural network models and statistical learning approaches with examples and exercises and allows readers to gain a practical working understanding of the content. This updated new edition presents recently published results and includes six new chapters that correspond to the recent advances in computational learning theory, sparse coding, deep learning, big data and cloud computing. Each chapter features state-of-the-art descriptions and significant research findings. The topics covered include: • multilayer perceptron; • the Hopfield network; • associative memory models;• clustering models and algorithms; • t he radial basis function network; • recurrent neural networks; • nonnegative matrix factorization; • independent component analysis; •probabilistic and Bayesian networks; and • fuzzy sets and logic. Focusing on the prominent accomplishments and their practical aspects, this book provides academic and technical staff, as well as graduate students and researchers with a solid foundation and comprehensive reference on the fields of neural networks, pattern recognition, signal processing, and machine learning.

Machine Learning and Visual Perception

Machine Learning and Visual Perception PDF Author: Baochang Zhang
Publisher: Walter de Gruyter GmbH & Co KG
ISBN: 311059322X
Category : Computers
Languages : en
Pages : 176

Get Book Here

Book Description
The book provides an up-to-date on machine learning and visual perception, including decision tree, Bayesian learning, support vector machine, AdaBoost, object detection, compressive sensing, deep learning, and reinforcement learning. Both classic and novel algorithms are introduced. With abundant practical examples, it is an essential reference to students, lecturers, professionals, and any interested lay readers.

Selective Visual Attention

Selective Visual Attention PDF Author: Liming Zhang
Publisher: John Wiley & Sons
ISBN: 1118060059
Category : Technology & Engineering
Languages : en
Pages : 344

Get Book Here

Book Description
Visual attention is a relatively new area of study combining a number of disciplines: artificial neural networks, artificial intelligence, vision science and psychology. The aim is to build computational models similar to human vision in order to solve tough problems for many potential applications including object recognition, unmanned vehicle navigation, and image and video coding and processing. In this book, the authors provide an up to date and highly applied introduction to the topic of visual attention, aiding researchers in creating powerful computer vision systems. Areas covered include the significance of vision research, psychology and computer vision, existing computational visual attention models, and the authors' contributions on visual attention models, and applications in various image and video processing tasks. This book is geared for graduates students and researchers in neural networks, image processing, machine learning, computer vision, and other areas of biologically inspired model building and applications. The book can also be used by practicing engineers looking for techniques involving the application of image coding, video processing, machine vision and brain-like robots to real-world systems. Other students and researchers with interdisciplinary interests will also find this book appealing. Provides a key knowledge boost to developers of image processing applications Is unique in emphasizing the practical utility of attention mechanisms Includes a number of real-world examples that readers can implement in their own work: robot navigation and object selection image and video quality assessment image and video coding Provides codes for users to apply in practical attentional models and mechanisms

Sparse Representation, Modeling and Learning in Visual Recognition

Sparse Representation, Modeling and Learning in Visual Recognition PDF Author: Hong Cheng
Publisher: Springer
ISBN: 1447167147
Category : Computers
Languages : en
Pages : 259

Get Book Here

Book Description
This unique text/reference presents a comprehensive review of the state of the art in sparse representations, modeling and learning. The book examines both the theoretical foundations and details of algorithm implementation, highlighting the practical application of compressed sensing research in visual recognition and computer vision. Topics and features: describes sparse recovery approaches, robust and efficient sparse representation, and large-scale visual recognition; covers feature representation and learning, sparsity induced similarity, and sparse representation and learning-based classifiers; discusses low-rank matrix approximation, graphical models in compressed sensing, collaborative representation-based classification, and high-dimensional nonlinear learning; includes appendices outlining additional computer programming resources, and explaining the essential mathematics required to understand the book.

Sparse Modeling for Image and Vision Processing

Sparse Modeling for Image and Vision Processing PDF Author: Julien Mairal
Publisher: Now Publishers
ISBN: 9781680830088
Category : Computers
Languages : en
Pages : 216

Get Book Here

Book Description
Sparse Modeling for Image and Vision Processing offers a self-contained view of sparse modeling for visual recognition and image processing. More specifically, it focuses on applications where the dictionary is learned and adapted to data, yielding a compact representation that has been successful in various contexts.