Author: I. M. Kogan
Publisher: CRC Press
ISBN: 9782881240645
Category : Computers
Languages : en
Pages : 482
Book Description
Since the main principles of applied information theory were formulated in the 1940s, the science has been greatly developed and today its areas of application range from traditional communication engineering problems to humanities and the arts. Interdisciplinary in scope, this book is a single-source reference for all applications areas, including engineering, radar, computing technology, television, the life sciences (including biology, physiology and psychology) and arts criticism. A review of the current state of information theory is provided; the author also presents several generalized and original results, and gives a treatment of various problems. This is a reference for both specialists and non-professionals in information theory and general cybernetics.
Applied Information Theory
Author: I. M. Kogan
Publisher: CRC Press
ISBN: 9782881240645
Category : Computers
Languages : en
Pages : 482
Book Description
Since the main principles of applied information theory were formulated in the 1940s, the science has been greatly developed and today its areas of application range from traditional communication engineering problems to humanities and the arts. Interdisciplinary in scope, this book is a single-source reference for all applications areas, including engineering, radar, computing technology, television, the life sciences (including biology, physiology and psychology) and arts criticism. A review of the current state of information theory is provided; the author also presents several generalized and original results, and gives a treatment of various problems. This is a reference for both specialists and non-professionals in information theory and general cybernetics.
Publisher: CRC Press
ISBN: 9782881240645
Category : Computers
Languages : en
Pages : 482
Book Description
Since the main principles of applied information theory were formulated in the 1940s, the science has been greatly developed and today its areas of application range from traditional communication engineering problems to humanities and the arts. Interdisciplinary in scope, this book is a single-source reference for all applications areas, including engineering, radar, computing technology, television, the life sciences (including biology, physiology and psychology) and arts criticism. A review of the current state of information theory is provided; the author also presents several generalized and original results, and gives a treatment of various problems. This is a reference for both specialists and non-professionals in information theory and general cybernetics.
Applied Coding and Information Theory for Engineers
Author: Wells
Publisher: Pearson Education India
ISBN: 9788131724163
Category :
Languages : en
Pages : 324
Book Description
Publisher: Pearson Education India
ISBN: 9788131724163
Category :
Languages : en
Pages : 324
Book Description
Introduction to Information Theory and Data Compression, Second Edition
Author: D.C. Hankerson
Publisher: CRC Press
ISBN: 9781584883135
Category : Mathematics
Languages : en
Pages : 394
Book Description
An effective blend of carefully explained theory and practical applications, this text imparts the fundamentals of both information theory and data compression. Although the two topics are related, this unique text allows either topic to be presented independently, and it was specifically designed so that the data compression section requires no prior knowledge of information theory. The treatment of information theory, while theoretical and abstract, is quite elementary, making this text less daunting than many others. After presenting the fundamental definitions and results of the theory, the authors then apply the theory to memoryless, discrete channels with zeroth-order, one-state sources. The chapters on data compression acquaint students with a myriad of lossless compression methods and then introduce two lossy compression methods. Students emerge from this study competent in a wide range of techniques. The authors' presentation is highly practical but includes some important proofs, either in the text or in the exercises, so instructors can, if they choose, place more emphasis on the mathematics. Introduction to Information Theory and Data Compression, Second Edition is ideally suited for an upper-level or graduate course for students in mathematics, engineering, and computer science. Features: Expanded discussion of the historical and theoretical basis of information theory that builds a firm, intuitive grasp of the subject Reorganization of theoretical results along with new exercises, ranging from the routine to the more difficult, that reinforce students' ability to apply the definitions and results in specific situations. Simplified treatment of the algorithm(s) of Gallager and Knuth Discussion of the information rate of a code and the trade-off between error correction and information rate Treatment of probabilistic finite state source automata, including basic results, examples, references, and exercises Octave and MATLAB image compression codes included in an appendix for use with the exercises and projects involving transform methods Supplementary materials, including software, available for download from the authors' Web site at www.dms.auburn.edu/compression
Publisher: CRC Press
ISBN: 9781584883135
Category : Mathematics
Languages : en
Pages : 394
Book Description
An effective blend of carefully explained theory and practical applications, this text imparts the fundamentals of both information theory and data compression. Although the two topics are related, this unique text allows either topic to be presented independently, and it was specifically designed so that the data compression section requires no prior knowledge of information theory. The treatment of information theory, while theoretical and abstract, is quite elementary, making this text less daunting than many others. After presenting the fundamental definitions and results of the theory, the authors then apply the theory to memoryless, discrete channels with zeroth-order, one-state sources. The chapters on data compression acquaint students with a myriad of lossless compression methods and then introduce two lossy compression methods. Students emerge from this study competent in a wide range of techniques. The authors' presentation is highly practical but includes some important proofs, either in the text or in the exercises, so instructors can, if they choose, place more emphasis on the mathematics. Introduction to Information Theory and Data Compression, Second Edition is ideally suited for an upper-level or graduate course for students in mathematics, engineering, and computer science. Features: Expanded discussion of the historical and theoretical basis of information theory that builds a firm, intuitive grasp of the subject Reorganization of theoretical results along with new exercises, ranging from the routine to the more difficult, that reinforce students' ability to apply the definitions and results in specific situations. Simplified treatment of the algorithm(s) of Gallager and Knuth Discussion of the information rate of a code and the trade-off between error correction and information rate Treatment of probabilistic finite state source automata, including basic results, examples, references, and exercises Octave and MATLAB image compression codes included in an appendix for use with the exercises and projects involving transform methods Supplementary materials, including software, available for download from the authors' Web site at www.dms.auburn.edu/compression
Information Theory Applied To Space-time Physics
Author: Henning F Harmuth
Publisher: World Scientific
ISBN: 9814504572
Category : Science
Languages : en
Pages : 320
Book Description
The success of Newton's mechanic, Maxwell's electrodynamic, Einstein's theories of relativity, and quantum mechanics is a strong argument for the space-time continuum. Nevertheless, doubts have been expressed about the use of a continuum in a science squarely based on observation and measurement. An exact science requires that qualitative arguments must be reduced to quantitative statements. The observability of a continuum can be reduced from qualitative arguments to quantitative statements by means of information theory.Information theory was developed during the last decades within electrical communications, but it is almost unknown in physics. The closest approach to information theory in physics is the calculus of propositions, which has been used in books on the frontier of quantum mechanics and the general theory of relativity. Principles of information theory are discussed in this book. The ability to think readily in terms of a finite number of discrete samples is developed over many years of using information theory and digital computers, just as the ability to think readily in terms of a continuum is developed by long use of differential calculus.
Publisher: World Scientific
ISBN: 9814504572
Category : Science
Languages : en
Pages : 320
Book Description
The success of Newton's mechanic, Maxwell's electrodynamic, Einstein's theories of relativity, and quantum mechanics is a strong argument for the space-time continuum. Nevertheless, doubts have been expressed about the use of a continuum in a science squarely based on observation and measurement. An exact science requires that qualitative arguments must be reduced to quantitative statements. The observability of a continuum can be reduced from qualitative arguments to quantitative statements by means of information theory.Information theory was developed during the last decades within electrical communications, but it is almost unknown in physics. The closest approach to information theory in physics is the calculus of propositions, which has been used in books on the frontier of quantum mechanics and the general theory of relativity. Principles of information theory are discussed in this book. The ability to think readily in terms of a finite number of discrete samples is developed over many years of using information theory and digital computers, just as the ability to think readily in terms of a continuum is developed by long use of differential calculus.
Information Theory and Statistical Learning
Author: Frank Emmert-Streib
Publisher: Springer Science & Business Media
ISBN: 0387848150
Category : Computers
Languages : en
Pages : 443
Book Description
This interdisciplinary text offers theoretical and practical results of information theoretic methods used in statistical learning. It presents a comprehensive overview of the many different methods that have been developed in numerous contexts.
Publisher: Springer Science & Business Media
ISBN: 0387848150
Category : Computers
Languages : en
Pages : 443
Book Description
This interdisciplinary text offers theoretical and practical results of information theoretic methods used in statistical learning. It presents a comprehensive overview of the many different methods that have been developed in numerous contexts.
Information Theory, Inference and Learning Algorithms
Author: David J. C. MacKay
Publisher: Cambridge University Press
ISBN: 9780521642989
Category : Computers
Languages : en
Pages : 694
Book Description
Table of contents
Publisher: Cambridge University Press
ISBN: 9780521642989
Category : Computers
Languages : en
Pages : 694
Book Description
Table of contents
Information Theory
Author: Robert B. Ash
Publisher: Halsted Press
ISBN:
Category : Computers
Languages : en
Pages : 360
Book Description
Publisher: Halsted Press
ISBN:
Category : Computers
Languages : en
Pages : 360
Book Description
Mathematical Foundations of Information Theory
Author: Aleksandr I?Akovlevich Khinchin
Publisher: Courier Corporation
ISBN: 0486604349
Category : Mathematics
Languages : en
Pages : 130
Book Description
First comprehensive introduction to information theory explores the work of Shannon, McMillan, Feinstein, and Khinchin. Topics include the entropy concept in probability theory, fundamental theorems, and other subjects. 1957 edition.
Publisher: Courier Corporation
ISBN: 0486604349
Category : Mathematics
Languages : en
Pages : 130
Book Description
First comprehensive introduction to information theory explores the work of Shannon, McMillan, Feinstein, and Khinchin. Topics include the entropy concept in probability theory, fundamental theorems, and other subjects. 1957 edition.
Information Theory
Author: Imre Csiszár
Publisher: Elsevier
ISBN: 1483281574
Category : Mathematics
Languages : en
Pages : 460
Book Description
Information Theory: Coding Theorems for Discrete Memoryless Systems presents mathematical models that involve independent random variables with finite range. This three-chapter text specifically describes the characteristic phenomena of information theory. Chapter 1 deals with information measures in simple coding problems, with emphasis on some formal properties of Shannon’s information and the non-block source coding. Chapter 2 describes the properties and practical aspects of the two-terminal systems. This chapter also examines the noisy channel coding problem, the computation of channel capacity, and the arbitrarily varying channels. Chapter 3 looks into the theory and practicality of multi-terminal systems. This book is intended primarily for graduate students and research workers in mathematics, electrical engineering, and computer science.
Publisher: Elsevier
ISBN: 1483281574
Category : Mathematics
Languages : en
Pages : 460
Book Description
Information Theory: Coding Theorems for Discrete Memoryless Systems presents mathematical models that involve independent random variables with finite range. This three-chapter text specifically describes the characteristic phenomena of information theory. Chapter 1 deals with information measures in simple coding problems, with emphasis on some formal properties of Shannon’s information and the non-block source coding. Chapter 2 describes the properties and practical aspects of the two-terminal systems. This chapter also examines the noisy channel coding problem, the computation of channel capacity, and the arbitrarily varying channels. Chapter 3 looks into the theory and practicality of multi-terminal systems. This book is intended primarily for graduate students and research workers in mathematics, electrical engineering, and computer science.
Information-Spectrum Methods in Information Theory
Author: Te Sun Han
Publisher: Springer Science & Business Media
ISBN: 3662120666
Category : Mathematics
Languages : en
Pages : 538
Book Description
From the reviews: "This book nicely complements the existing literature on information and coding theory by concentrating on arbitrary nonstationary and/or nonergodic sources and channels with arbitrarily large alphabets. Even with such generality the authors have managed to successfully reach a highly unconventional but very fertile exposition rendering new insights into many problems." -- MATHEMATICAL REVIEWS
Publisher: Springer Science & Business Media
ISBN: 3662120666
Category : Mathematics
Languages : en
Pages : 538
Book Description
From the reviews: "This book nicely complements the existing literature on information and coding theory by concentrating on arbitrary nonstationary and/or nonergodic sources and channels with arbitrarily large alphabets. Even with such generality the authors have managed to successfully reach a highly unconventional but very fertile exposition rendering new insights into many problems." -- MATHEMATICAL REVIEWS