Author: Yuichiro Kakihara
Publisher: World Scientific
ISBN: 9814759252
Category : Computers
Languages : en
Pages : 413
Get Book Here
Book Description
Information Theory is studied from the following points of view: (1) the theory of entropy as amount of information; (2) the mathematical structure of information sources (probability measures); and (3) the theory of information channels. Shannon entropy and Kolmogorov-Sinai entropy are defined and their basic properties are examined, where the latter entropy is extended to be a linear functional on a certain set of measures. Ergodic and mixing properties of stationary sources are studied as well as AMS (asymptotically mean stationary) sources.The main purpose of this book is to present information channels in the environment of functional analysis and operator theory as well as probability theory. Ergodic, mixing, and AMS channels are also considered in detail with some illustrations. In this second edition, channel operators are studied in many aspects, which generalize ordinary channels. Also Gaussian channels are considered in detail together with Gaussian measures on a Hilbert space. The Special Topics chapter deals with features such as generalized capacity, channels with an intermediate noncommutative system, and von Neumann algebra method for channels. Finally, quantum (noncommutative) information channels are examined in an independent chapter, which may be regarded as an introduction to quantum information theory. Von Neumann entropy is introduced and its generalization to a C*-algebra setting is given. Basic results on quantum channels and entropy transmission are also considered.
Author: Yichir Kakihara
Publisher: World Scientific
ISBN: 9789810237110
Category : Mathematics
Languages : en
Pages : 272
Get Book Here
Book Description
Information Theory is studied from the following view points: (1) the theory of entropy as amount of information; (2) the mathematical structure of information sources (probability measures); and (3) the theory of information channels. Shannon entropy and Kolmogorov-Sinai entropy are defined and their basic properties are examined, where the latter entropy is extended to be a linear functional on a certain set of measures. Ergodic and mixing properties of stationary sources are studied as well as AMS (asymptotically mean stationary) sources. The main purpose of this book is to present information channels in the environment of real and functional analysis as well as probability theory. Ergodic channels are characterized in various manners. Mixing and AMS channels are also considered in detail with some illustrations. A few other aspects of information channels including measurability, approximation and noncommutative extensions, are also discussed.
Author: Malempati Madhusudana Rao
Publisher: World Scientific
ISBN: 9811213674
Category : Mathematics
Languages : en
Pages : 341
Get Book Here
Book Description
The book presents, for the first time, a detailed analysis of harmonizable processes and fields (in the weak sense) that contain the corresponding stationary theory as a subclass. It also gives the structural and some key applications in detail. These include Levy's Brownian motion, a probabilistic proof of the longstanding Riemann's hypothesis, random fields indexed by LCA and hypergroups, extensions to bistochastic operators, Cramér-Karhunen classes, as well as bistochastic operators with some statistical applications.The material is accessible to graduate students in probability and statistics as well as to engineers in theoretical applications. There are numerous extensions and applications pointed out in the book that will inspire readers to delve deeper.
Author: Yuichiro Kakihara
Publisher: World Scientific
ISBN: 9811211760
Category : Mathematics
Languages : en
Pages : 539
Get Book Here
Book Description
This is a development of the book entitled Multidimensional Second Order Stochastic Processes. It provides a research expository treatment of infinite-dimensional stationary and nonstationary stochastic processes or time series, based on Hilbert and Banach space-valued second order random variables. Stochastic measures and scalar or operator bimeasures are fully discussed to develop integral representations of various classes of nonstationary processes such as harmonizable, V-bounded, Cramér and Karhunen classes as well as the stationary class. A new type of the Radon-Nikodým derivative of a Banach space-valued measure is introduced, together with Schauder basic measures, to study uniformly bounded linearly stationary processes.Emphasis is on the use of functional analysis and harmonic analysis as well as probability theory. Applications are made from the probabilistic and statistical points of view to prediction problems, Kalman filter, sampling theorems and strong laws of large numbers. Generalizations are made to consider Banach space-valued stochastic processes to include processes of pth order for p ≥ 1. Readers may find that the covariance kernel is always emphasized and reveals another aspect of stochastic processes.This book is intended not only for probabilists and statisticians, but also for functional analysts and communication engineers.
Author: Rupert Lasser
Publisher: World Scientific
ISBN: 9811266212
Category : Mathematics
Languages : en
Pages : 621
Get Book Here
Book Description
The book aims at giving a monographic presentation of the abstract harmonic analysis of hypergroups, while combining it with applied topics of spectral analysis, approximation by orthogonal expansions and stochastic sequences. Hypergroups are locally compact Hausdorff spaces equipped with a convolution, an involution and a unit element. Related algebraic structures had already been studied by Frobenius around 1900. Their axiomatic characterisation in harmonic analysis was later developed in the 1970s. Hypergoups naturally emerge in seemingly different application areas as time series analysis, probability theory and theoretical physics.The book presents harmonic analysis on commutative and polynomial hypergroups as well as weakly stationary random fields and sequences thereon. For polynomial hypergroups also difference equations and stationary sequences are considered. At greater extent than in the existing literature, the book compiles a rather comprehensive list of hypergroups, in particular of polynomial hypergroups. With an eye on readers at advanced undergraduate and graduate level, the proofs are generally worked out in careful detail. The bibliography is extensive.
Author: Debasis Sengupta
Publisher: World Scientific
ISBN: 9811200424
Category : Mathematics
Languages : en
Pages : 773
Get Book Here
Book Description
Starting with the basic linear model where the design and covariance matrices are of full rank, this book demonstrates how the same statistical ideas can be used to explore the more general linear model with rank-deficient design and/or covariance matrices. The unified treatment presented here provides a clearer understanding of the general linear model from a statistical perspective, thus avoiding the complex matrix-algebraic arguments that are often used in the rank-deficient case. Elegant geometric arguments are used as needed.The book has a very broad coverage, from illustrative practical examples in Regression and Analysis of Variance alongside their implementation using R, to providing comprehensive theory of the general linear model with 181 worked-out examples, 227 exercises with solutions, 152 exercises without solutions (so that they may be used as assignments in a course), and 320 up-to-date references.This completely updated and new edition of Linear Models: An Integrated Approach includes the following features:
Author: D.C. Hankerson
Publisher: CRC Press
ISBN: 9781584883135
Category : Mathematics
Languages : en
Pages : 394
Get Book Here
Book Description
An effective blend of carefully explained theory and practical applications, this text imparts the fundamentals of both information theory and data compression. Although the two topics are related, this unique text allows either topic to be presented independently, and it was specifically designed so that the data compression section requires no prior knowledge of information theory. The treatment of information theory, while theoretical and abstract, is quite elementary, making this text less daunting than many others. After presenting the fundamental definitions and results of the theory, the authors then apply the theory to memoryless, discrete channels with zeroth-order, one-state sources. The chapters on data compression acquaint students with a myriad of lossless compression methods and then introduce two lossy compression methods. Students emerge from this study competent in a wide range of techniques. The authors' presentation is highly practical but includes some important proofs, either in the text or in the exercises, so instructors can, if they choose, place more emphasis on the mathematics. Introduction to Information Theory and Data Compression, Second Edition is ideally suited for an upper-level or graduate course for students in mathematics, engineering, and computer science. Features: Expanded discussion of the historical and theoretical basis of information theory that builds a firm, intuitive grasp of the subject Reorganization of theoretical results along with new exercises, ranging from the routine to the more difficult, that reinforce students' ability to apply the definitions and results in specific situations. Simplified treatment of the algorithm(s) of Gallager and Knuth Discussion of the information rate of a code and the trade-off between error correction and information rate Treatment of probabilistic finite state source automata, including basic results, examples, references, and exercises Octave and MATLAB image compression codes included in an appendix for use with the exercises and projects involving transform methods Supplementary materials, including software, available for download from the authors' Web site at www.dms.auburn.edu/compression
Author: Thomas M. Cover
Publisher: John Wiley & Sons
ISBN: 1118585771
Category : Computers
Languages : en
Pages : 788
Get Book Here
Book Description
The latest edition of this classic is updated with new problem sets and material The Second Edition of this fundamental textbook maintains the book's tradition of clear, thought-provoking instruction. Readers are provided once again with an instructive mix of mathematics, physics, statistics, and information theory. All the essential topics in information theory are covered in detail, including entropy, data compression, channel capacity, rate distortion, network information theory, and hypothesis testing. The authors provide readers with a solid understanding of the underlying theory and applications. Problem sets and a telegraphic summary at the end of each chapter further assist readers. The historical notes that follow each chapter recap the main points. The Second Edition features: * Chapters reorganized to improve teaching * 200 new problems * New material on source coding, portfolio theory, and feedback capacity * Updated references Now current and enhanced, the Second Edition of Elements of Information Theory remains the ideal textbook for upper-level undergraduate and graduate courses in electrical engineering, statistics, and telecommunications.
Author: Aiden A. Bruen
Publisher: John Wiley & Sons
ISBN: 1119582407
Category : Computers
Languages : en
Pages : 688
Get Book Here
Book Description
CRYPTOGRAPHY, INFORMATION THEORY, AND ERROR-CORRECTION A rich examination of the technologies supporting secure digital information transfers from respected leaders in the field As technology continues to evolve Cryptography, Information Theory, and Error-Correction: A Handbook for the 21ST Century is an indispensable resource for anyone interested in the secure exchange of financial information. Identity theft, cybercrime, and other security issues have taken center stage as information becomes easier to access. Three disciplines offer solutions to these digital challenges: cryptography, information theory, and error-correction, all of which are addressed in this book. This book is geared toward a broad audience. It is an excellent reference for both graduate and undergraduate students of mathematics, computer science, cybersecurity, and engineering. It is also an authoritative overview for professionals working at financial institutions, law firms, and governments who need up-to-date information to make critical decisions. The book’s discussions will be of interest to those involved in blockchains as well as those working in companies developing and applying security for new products, like self-driving cars. With its reader-friendly style and interdisciplinary emphasis this book serves as both an ideal teaching text and a tool for self-learning for IT professionals, statisticians, mathematicians, computer scientists, electrical engineers, and entrepreneurs. Six new chapters cover current topics like Internet of Things security, new identities in information theory, blockchains, cryptocurrency, compression, cloud computing and storage. Increased security and applicable research in elliptic curve cryptography are also featured. The book also: Shares vital, new research in the field of information theory Provides quantum cryptography updates Includes over 350 worked examples and problems for greater understanding of ideas. Cryptography, Information Theory, and Error-Correction guides readers in their understanding of reliable tools that can be used to store or transmit digital information safely.
Author: David J. C. MacKay
Publisher: Cambridge University Press
ISBN: 9780521642989
Category : Computers
Languages : en
Pages : 694
Get Book Here
Book Description
Information theory and inference, taught together in this exciting textbook, lie at the heart of many important areas of modern technology - communication, signal processing, data mining, machine learning, pattern recognition, computational neuroscience, bioinformatics and cryptography. The book introduces theory in tandem with applications. Information theory is taught alongside practical communication systems such as arithmetic coding for data compression and sparse-graph codes for error-correction. Inference techniques, including message-passing algorithms, Monte Carlo methods and variational approximations, are developed alongside applications to clustering, convolutional codes, independent component analysis, and neural networks. Uniquely, the book covers state-of-the-art error-correcting codes, including low-density-parity-check codes, turbo codes, and digital fountain codes - the twenty-first-century standards for satellite communications, disk drives, and data broadcast. Richly illustrated, filled with worked examples and over 400 exercises, some with detailed solutions, the book is ideal for self-learning, and for undergraduate or graduate courses. It also provides an unparalleled entry point for professionals in areas as diverse as computational biology, financial engineering and machine learning.
