Author: Tobias Lentz
Publisher: Logos Verlag Berlin GmbH
ISBN: 3832519351
Category : Computers
Languages : en
Pages : 166
Book Description
The use of non-intrusive virtual environments is gaining more and more importance but was focused mainly on addressing the visual sense. However, the human perception consists not only of visual input and thus it would be worthwhile to create multi-modal and interactive virtual environments. This thesis describes the techniques required to include the acoustic component into a virtual environment and furthermore the implementation of a software system, which takes advantage of these techniques to create complex acoustical scenes in real time. The system is based on the binaural technology. It features spatially distributed sound sources which are utilized to create an environment that is as authentic as possible. This comprises a description of the source, including its relevant angle-, distance- and time- dependent radiation, the sound distribution in the virtual scene (room acoustics), the perception-related consideration of all sound field components, as well as the exact reproduction of the artificial sound at the ears of the user. The focus of this thesis is put on the reproduction technology. In this context, an approach for dynamic crosstalk cancellation is presented, which enables a loudspeaker-based reproduction. The required filters are processed in real time on the basis of the position data and measured transfer functions of the outer ear. Furthermore the integration of this spatial audio system into a five-sided Virtual Reality display system is described and evaluated.
Binaural Technology for Virtual Reality
Author: Tobias Lentz
Publisher: Logos Verlag Berlin GmbH
ISBN: 3832519351
Category : Computers
Languages : en
Pages : 166
Book Description
The use of non-intrusive virtual environments is gaining more and more importance but was focused mainly on addressing the visual sense. However, the human perception consists not only of visual input and thus it would be worthwhile to create multi-modal and interactive virtual environments. This thesis describes the techniques required to include the acoustic component into a virtual environment and furthermore the implementation of a software system, which takes advantage of these techniques to create complex acoustical scenes in real time. The system is based on the binaural technology. It features spatially distributed sound sources which are utilized to create an environment that is as authentic as possible. This comprises a description of the source, including its relevant angle-, distance- and time- dependent radiation, the sound distribution in the virtual scene (room acoustics), the perception-related consideration of all sound field components, as well as the exact reproduction of the artificial sound at the ears of the user. The focus of this thesis is put on the reproduction technology. In this context, an approach for dynamic crosstalk cancellation is presented, which enables a loudspeaker-based reproduction. The required filters are processed in real time on the basis of the position data and measured transfer functions of the outer ear. Furthermore the integration of this spatial audio system into a five-sided Virtual Reality display system is described and evaluated.
Publisher: Logos Verlag Berlin GmbH
ISBN: 3832519351
Category : Computers
Languages : en
Pages : 166
Book Description
The use of non-intrusive virtual environments is gaining more and more importance but was focused mainly on addressing the visual sense. However, the human perception consists not only of visual input and thus it would be worthwhile to create multi-modal and interactive virtual environments. This thesis describes the techniques required to include the acoustic component into a virtual environment and furthermore the implementation of a software system, which takes advantage of these techniques to create complex acoustical scenes in real time. The system is based on the binaural technology. It features spatially distributed sound sources which are utilized to create an environment that is as authentic as possible. This comprises a description of the source, including its relevant angle-, distance- and time- dependent radiation, the sound distribution in the virtual scene (room acoustics), the perception-related consideration of all sound field components, as well as the exact reproduction of the artificial sound at the ears of the user. The focus of this thesis is put on the reproduction technology. In this context, an approach for dynamic crosstalk cancellation is presented, which enables a loudspeaker-based reproduction. The required filters are processed in real time on the basis of the position data and measured transfer functions of the outer ear. Furthermore the integration of this spatial audio system into a five-sided Virtual Reality display system is described and evaluated.
Binaural Technology for Virtual Reality
Author: Tobias Lentz
Publisher:
ISBN: 9783832598105
Category :
Languages : en
Pages : 168
Book Description
Publisher:
ISBN: 9783832598105
Category :
Languages : en
Pages : 168
Book Description
Binaural and Spatial Hearing in Real and Virtual Environments
Author: Robert Gilkey
Publisher: Psychology Press
ISBN: 1317780256
Category : Language Arts & Disciplines
Languages : en
Pages : 1109
Book Description
The current popular and scientific interest in virtual environments has provided a new impetus for investigating binaural and spatial hearing. However, the many intriguing phenomena of spatial hearing have long made it an exciting area of scientific inquiry. Psychophysical and physiological investigations of spatial hearing seem to be converging on common explanations of underlying mechanisms. These understandings have in turn been incorporated into sophisticated yet mathematically tractable models of binaural interaction. Thus, binaural and spatial hearing is one of the few areas in which professionals are soon likely to find adequate physiological explanations of complex psychological phenomena that can be reasonably and usefully approximated by mathematical and physical models. This volume grew out of the Conference on Binaural and Spatial Hearing, a four-day event held at Wright-Patterson Air Force Base in response to rapid developments in binaural and spatial hearing research and technology. Meant to be more than just a proceedings, it presents chapters that are longer than typical proceedings papers and contain considerably more review material, including extensive bibliographies in many cases. Arranged into topical sections, the chapters represent major thrusts in the recent literature. The authors of the first chapter in each section have been encouraged to take a broad perspective and review the current state of literature. Subsequent chapters in each section tend to be somewhat more narrowly focused, and often emphasize the authors' own work. Thus, each section provides overview, background, and current research on a particular topic. This book is significant in that it reviews the important work during the past 10 to 15 years, and provides greater breadth and depth than most of the previous works.
Publisher: Psychology Press
ISBN: 1317780256
Category : Language Arts & Disciplines
Languages : en
Pages : 1109
Book Description
The current popular and scientific interest in virtual environments has provided a new impetus for investigating binaural and spatial hearing. However, the many intriguing phenomena of spatial hearing have long made it an exciting area of scientific inquiry. Psychophysical and physiological investigations of spatial hearing seem to be converging on common explanations of underlying mechanisms. These understandings have in turn been incorporated into sophisticated yet mathematically tractable models of binaural interaction. Thus, binaural and spatial hearing is one of the few areas in which professionals are soon likely to find adequate physiological explanations of complex psychological phenomena that can be reasonably and usefully approximated by mathematical and physical models. This volume grew out of the Conference on Binaural and Spatial Hearing, a four-day event held at Wright-Patterson Air Force Base in response to rapid developments in binaural and spatial hearing research and technology. Meant to be more than just a proceedings, it presents chapters that are longer than typical proceedings papers and contain considerably more review material, including extensive bibliographies in many cases. Arranged into topical sections, the chapters represent major thrusts in the recent literature. The authors of the first chapter in each section have been encouraged to take a broad perspective and review the current state of literature. Subsequent chapters in each section tend to be somewhat more narrowly focused, and often emphasize the authors' own work. Thus, each section provides overview, background, and current research on a particular topic. This book is significant in that it reviews the important work during the past 10 to 15 years, and provides greater breadth and depth than most of the previous works.
Immersive Sound
Author: Agnieszka Roginska
Publisher: Taylor & Francis
ISBN: 1317480112
Category : Technology & Engineering
Languages : en
Pages : 364
Book Description
Immersive Sound: The Art and Science of Binaural and Multi-Channel Audio provides a comprehensive guide to multi-channel sound. With contributions from leading recording engineers, researchers, and industry experts, Immersive Sound includes an in-depth description of the physics and psychoacoustics of spatial audio as well as practical applications. Chapters include the history of 3D sound, binaural reproduction over headphones and loudspeakers, stereo, surround sound, height channels, object-based audio, soundfield (ambisonics), wavefield synthesis, and multi-channel mixing techniques. Knowledge of the development, theory, and practice of spatial and multi-channel sound is essential to those advancing the research and applications in the rapidly evolving fields of 3D sound recording, augmented and virtual reality, gaming, film sound, music production, and post-production.
Publisher: Taylor & Francis
ISBN: 1317480112
Category : Technology & Engineering
Languages : en
Pages : 364
Book Description
Immersive Sound: The Art and Science of Binaural and Multi-Channel Audio provides a comprehensive guide to multi-channel sound. With contributions from leading recording engineers, researchers, and industry experts, Immersive Sound includes an in-depth description of the physics and psychoacoustics of spatial audio as well as practical applications. Chapters include the history of 3D sound, binaural reproduction over headphones and loudspeakers, stereo, surround sound, height channels, object-based audio, soundfield (ambisonics), wavefield synthesis, and multi-channel mixing techniques. Knowledge of the development, theory, and practice of spatial and multi-channel sound is essential to those advancing the research and applications in the rapidly evolving fields of 3D sound recording, augmented and virtual reality, gaming, film sound, music production, and post-production.
Spatial Hearing
Author: Jens Blauert
Publisher: MIT Press
ISBN: 9780262024136
Category : Medical
Languages : en
Pages : 512
Book Description
The field of spatial hearing has exploded in the decade or so since Jens Blauert's classic work on acoustics was first published in English. This revised edition adds a new chapter that describes developments in such areas as auditory virtual reality (an important field of application that is based mainly on the physics of spatial hearing), binaural technology (modeling speech enhancement by binaural hearing), and spatial sound-field mapping. The chapter also includes recent research on the precedence effect that provides clear experimental evidence that cognition plays a significant role in spatial hearing.The remaining four chapters in this comprehensive reference cover auditory research procedures and psychometric methods, spatial hearing with one sound source, spatial hearing with multiple sound sources and in enclosed spaces, and progress and trends from 1972 (the first German edition) to 1983 (the first English edition) -- work that includes research on the physics of the external ear, and the application of signal processing theory to modeling the spatial hearing process. There is an extensive bibliography of more than 900 items.
Publisher: MIT Press
ISBN: 9780262024136
Category : Medical
Languages : en
Pages : 512
Book Description
The field of spatial hearing has exploded in the decade or so since Jens Blauert's classic work on acoustics was first published in English. This revised edition adds a new chapter that describes developments in such areas as auditory virtual reality (an important field of application that is based mainly on the physics of spatial hearing), binaural technology (modeling speech enhancement by binaural hearing), and spatial sound-field mapping. The chapter also includes recent research on the precedence effect that provides clear experimental evidence that cognition plays a significant role in spatial hearing.The remaining four chapters in this comprehensive reference cover auditory research procedures and psychometric methods, spatial hearing with one sound source, spatial hearing with multiple sound sources and in enclosed spaces, and progress and trends from 1972 (the first German edition) to 1983 (the first English edition) -- work that includes research on the physics of the external ear, and the application of signal processing theory to modeling the spatial hearing process. There is an extensive bibliography of more than 900 items.
Multimedia and Virtual Reality Engineering
Author: Richard Brice
Publisher: Butterworth-Heinemann
ISBN: 9780750629874
Category : Computers
Languages : en
Pages : 328
Book Description
This is the complete practical introduction to virtual reality and multimedia for those wishing to build systems. It covers the foundations and engineering needed to design and construct projects incorporating video, audio and textural elements and including the use of the latest hardware, to create an artificial world for education, information or entertainment. Production and authoring platforms are described, computer animation and hypertext are covered, but those looking for pages of software listings and computerspeak will be disappointed. This book is about the nuts and bolts: sound and video cards, head mounted displays, CrystalEyes glasses, other 3D glasses for entertainment, audio and video production, and realistic auditory and visual stimulation including stereoscopy. The creation of Cyberspace, and strategies to achieve a complete Cyberatmosphere are presented. Three-dimensional sound generation and video techniques that have never previously been published are revealed. This is the handbook for anyone working in the industry, or hoping to enter it. It also provides a guide for those hoping to 'cross-fertilise' the industry, coming from audio, video, computing or engineering backgrounds. A complete technical guide to MM and VR Includes a Hypertext edition of the book with added audio and graphics on CD Hardware, software, video and never before published 3D audio techniques covered
Publisher: Butterworth-Heinemann
ISBN: 9780750629874
Category : Computers
Languages : en
Pages : 328
Book Description
This is the complete practical introduction to virtual reality and multimedia for those wishing to build systems. It covers the foundations and engineering needed to design and construct projects incorporating video, audio and textural elements and including the use of the latest hardware, to create an artificial world for education, information or entertainment. Production and authoring platforms are described, computer animation and hypertext are covered, but those looking for pages of software listings and computerspeak will be disappointed. This book is about the nuts and bolts: sound and video cards, head mounted displays, CrystalEyes glasses, other 3D glasses for entertainment, audio and video production, and realistic auditory and visual stimulation including stereoscopy. The creation of Cyberspace, and strategies to achieve a complete Cyberatmosphere are presented. Three-dimensional sound generation and video techniques that have never previously been published are revealed. This is the handbook for anyone working in the industry, or hoping to enter it. It also provides a guide for those hoping to 'cross-fertilise' the industry, coming from audio, video, computing or engineering backgrounds. A complete technical guide to MM and VR Includes a Hypertext edition of the book with added audio and graphics on CD Hardware, software, video and never before published 3D audio techniques covered
The Technology of Binaural Understanding
Author: Jens Blauert
Publisher: Springer Nature
ISBN: 3030003868
Category : Science
Languages : en
Pages : 808
Book Description
Sound, devoid of meaning, would not matter to us. It is the information sound conveys that helps the brain to understand its environment. Sound and its underlying meaning are always associated with time and space. There is no sound without spatial properties, and the brain always organizes this information within a temporal–spatial framework. This book is devoted to understanding the importance of meaning for spatial and related further aspects of hearing, including cross-modal inference. People, when exposed to acoustic stimuli, do not react directly to what they hear but rather to what they hear means to them. This semiotic maxim may not always apply, for instance, when the reactions are reflexive. But, where it does apply, it poses a major challenge to the builders of models of the auditory system. Take, for example, an auditory model that is meant to be implemented on a robotic agent for autonomous search-&-rescue actions. Or think of a system that can perform judgments on the sound quality of multimedia-reproduction systems. It becomes immediately clear that such a system needs • Cognitive capabilities, including substantial inherent knowledge • The ability to integrate information across different sensory modalities To realize these functions, the auditory system provides a pair of sensory organs, the two ears, and the means to perform adequate preprocessing of the signals provided by the ears. This is realized in the subcortical parts of the auditory system. In the title of a prior book, the term Binaural Listening is used to indicate a focus on sub-cortical functions. Psychoacoustics and auditory signal processing contribute substantially to this area. The preprocessed signals are then forwarded to the cortical parts of the auditory system where, among other things, recognition, classification, localization, scene analysis, assignment of meaning, quality assessment, and action planning take place. Also, information from different sensory modalities is integrated at this level. Between sub-cortical and cortical regions of the auditory system, numerous feedback loops exist that ultimately support the high complexity and plasticity of the auditory system. The current book concentrates on these cognitive functions. Instead of processing signals, processing symbols is now the predominant modeling task. Substantial contributions to the field draw upon the knowledge acquired by cognitive psychology. The keyword Binaural Understanding in the book title characterizes this shift. Both books, The Technology of Binaural Listening and the current one, have been stimulated and supported by AABBA, an open research group devoted to the development and application of models of binaural hearing. The current book is dedicated to technologies that help explain, facilitate, apply, and support various aspects of binaural understanding. It is organized into five parts, each containing three to six chapters in order to provide a comprehensive overview of this emerging area. Each chapter was thoroughly reviewed by at least two anonymous, external experts. The first part deals with the psychophysical and physiological effects of Forming and Interpreting Aural Objects as well as the underlying models. The fundamental concepts of reflexive and reflective auditory feedback are introduced. Mechanisms of binaural attention and attention switching are covered—as well as how auditory Gestalt rules facilitate binaural understanding. A general blackboard architecture is introduced as an example of how machines can learn to form and interpret aural objects to simulate human cognitive listening. The second part, Configuring and Understanding Aural Space, focuses on the human understanding of complex three-dimensional environments—covering the psychological and biological fundamentals of auditory space formation. This part further addresses the human mechanisms used to process information and interact in complex reverberant environments, such as concert halls and forests, and additionally examines how the auditory system can learn to understand and adapt to these environments. The third part is dedicated to Processing Cross-Modal Inference and highlights the fundamental human mechanisms used to integrate auditory cues with cues from other modalities to localize and form perceptual objects. This part also provides a general framework for understanding how complex multimodal scenes can be simulated and rendered. The fourth part, Evaluating Aural-scene Quality and Speech Understanding, focuses on the object-forming aspects of binaural listening and understanding. It addresses cognitive mechanisms involved in both the understanding of speech and the processing of nonverbal information such as Sound Quality and Quality-of- Experience. The aesthetic judgment of rooms is also discussed in this context. Models that simulate underlying human processes and performance are covered in addition to techniques for rendering virtual environments that can then be used to test these models. The fifth part deals with the Application of Cognitive Mechanisms to Audio Technology. It highlights how cognitive mechanisms can be utilized to create spatial auditory illusions using binaural and other 3D-audio technologies. Further, it covers how cognitive binaural technologies can be applied to improve human performance in auditory displays and to develop new auditory technologies for interactive robots. The book concludes with the application of cognitive binaural technologies to the next generation of hearing aids.
Publisher: Springer Nature
ISBN: 3030003868
Category : Science
Languages : en
Pages : 808
Book Description
Sound, devoid of meaning, would not matter to us. It is the information sound conveys that helps the brain to understand its environment. Sound and its underlying meaning are always associated with time and space. There is no sound without spatial properties, and the brain always organizes this information within a temporal–spatial framework. This book is devoted to understanding the importance of meaning for spatial and related further aspects of hearing, including cross-modal inference. People, when exposed to acoustic stimuli, do not react directly to what they hear but rather to what they hear means to them. This semiotic maxim may not always apply, for instance, when the reactions are reflexive. But, where it does apply, it poses a major challenge to the builders of models of the auditory system. Take, for example, an auditory model that is meant to be implemented on a robotic agent for autonomous search-&-rescue actions. Or think of a system that can perform judgments on the sound quality of multimedia-reproduction systems. It becomes immediately clear that such a system needs • Cognitive capabilities, including substantial inherent knowledge • The ability to integrate information across different sensory modalities To realize these functions, the auditory system provides a pair of sensory organs, the two ears, and the means to perform adequate preprocessing of the signals provided by the ears. This is realized in the subcortical parts of the auditory system. In the title of a prior book, the term Binaural Listening is used to indicate a focus on sub-cortical functions. Psychoacoustics and auditory signal processing contribute substantially to this area. The preprocessed signals are then forwarded to the cortical parts of the auditory system where, among other things, recognition, classification, localization, scene analysis, assignment of meaning, quality assessment, and action planning take place. Also, information from different sensory modalities is integrated at this level. Between sub-cortical and cortical regions of the auditory system, numerous feedback loops exist that ultimately support the high complexity and plasticity of the auditory system. The current book concentrates on these cognitive functions. Instead of processing signals, processing symbols is now the predominant modeling task. Substantial contributions to the field draw upon the knowledge acquired by cognitive psychology. The keyword Binaural Understanding in the book title characterizes this shift. Both books, The Technology of Binaural Listening and the current one, have been stimulated and supported by AABBA, an open research group devoted to the development and application of models of binaural hearing. The current book is dedicated to technologies that help explain, facilitate, apply, and support various aspects of binaural understanding. It is organized into five parts, each containing three to six chapters in order to provide a comprehensive overview of this emerging area. Each chapter was thoroughly reviewed by at least two anonymous, external experts. The first part deals with the psychophysical and physiological effects of Forming and Interpreting Aural Objects as well as the underlying models. The fundamental concepts of reflexive and reflective auditory feedback are introduced. Mechanisms of binaural attention and attention switching are covered—as well as how auditory Gestalt rules facilitate binaural understanding. A general blackboard architecture is introduced as an example of how machines can learn to form and interpret aural objects to simulate human cognitive listening. The second part, Configuring and Understanding Aural Space, focuses on the human understanding of complex three-dimensional environments—covering the psychological and biological fundamentals of auditory space formation. This part further addresses the human mechanisms used to process information and interact in complex reverberant environments, such as concert halls and forests, and additionally examines how the auditory system can learn to understand and adapt to these environments. The third part is dedicated to Processing Cross-Modal Inference and highlights the fundamental human mechanisms used to integrate auditory cues with cues from other modalities to localize and form perceptual objects. This part also provides a general framework for understanding how complex multimodal scenes can be simulated and rendered. The fourth part, Evaluating Aural-scene Quality and Speech Understanding, focuses on the object-forming aspects of binaural listening and understanding. It addresses cognitive mechanisms involved in both the understanding of speech and the processing of nonverbal information such as Sound Quality and Quality-of- Experience. The aesthetic judgment of rooms is also discussed in this context. Models that simulate underlying human processes and performance are covered in addition to techniques for rendering virtual environments that can then be used to test these models. The fifth part deals with the Application of Cognitive Mechanisms to Audio Technology. It highlights how cognitive mechanisms can be utilized to create spatial auditory illusions using binaural and other 3D-audio technologies. Further, it covers how cognitive binaural technologies can be applied to improve human performance in auditory displays and to develop new auditory technologies for interactive robots. The book concludes with the application of cognitive binaural technologies to the next generation of hearing aids.
3-D Sound for Virtual Reality and Multimedia
Author: Durand R. Begault
Publisher:
ISBN:
Category : Computer sound processing
Languages : en
Pages : 248
Book Description
Publisher:
ISBN:
Category : Computer sound processing
Languages : en
Pages : 248
Book Description
Advances in Fundamental and Applied Research on Spatial Audio
Author: Brian F.G. Katz
Publisher: BoD – Books on Demand
ISBN: 1839690054
Category : Technology & Engineering
Languages : en
Pages : 234
Book Description
Spatial audio is a dynamic and rapidly evolving field, as it is closely linked to advances in computer technology and digital signal processing. The democratization of virtual reality hardware available as consumer devices has moved the field further out of traditional laboratory research, and directly into applied research targeting a wide range of consumers. Advances in Fundamental and Applied Research on Spatial Audio presents a collection of eight peer-reviewed chapters on this exciting area of research. The contributions are organized into three sections: “Acoustic Methodology”, “Perception”, and “Applications”, and cover a range of topics, addressing both headphone- and loudspeaker-based reproductions, offering both methodological overviews and specific case studies.
Publisher: BoD – Books on Demand
ISBN: 1839690054
Category : Technology & Engineering
Languages : en
Pages : 234
Book Description
Spatial audio is a dynamic and rapidly evolving field, as it is closely linked to advances in computer technology and digital signal processing. The democratization of virtual reality hardware available as consumer devices has moved the field further out of traditional laboratory research, and directly into applied research targeting a wide range of consumers. Advances in Fundamental and Applied Research on Spatial Audio presents a collection of eight peer-reviewed chapters on this exciting area of research. The contributions are organized into three sections: “Acoustic Methodology”, “Perception”, and “Applications”, and cover a range of topics, addressing both headphone- and loudspeaker-based reproductions, offering both methodological overviews and specific case studies.
Spatial Audio
Author: Francis Rumsey
Publisher: Taylor & Francis
ISBN: 1136119892
Category : Technology & Engineering
Languages : en
Pages : 255
Book Description
Explores the principles and practical considerations of spatial sound recording and reproduction. Particular emphasis is given to the increasing importance of multichannel surround sound and 3D audio, including binaural approaches, without ignoring conventional stereo. The enhancement of spatial quality is arguably the only remaining hurdle to be overcome in pursuit of high quality sound reproduction. The rise of increasingly sophisticated spatial sound systems presents an enormous challenge to audio engineers, many of whom are confused by the possibilities and unfamiliar with standards, formats, track allocations, monitoring configurations and recording techniques. The author provides a comprehensive study of the current state of the art in spatial audio, concentrating on the most widely used approaches and configurations. Anyone wishing to expand their understanding of these cutting-edge technologies will want to own this book.
Publisher: Taylor & Francis
ISBN: 1136119892
Category : Technology & Engineering
Languages : en
Pages : 255
Book Description
Explores the principles and practical considerations of spatial sound recording and reproduction. Particular emphasis is given to the increasing importance of multichannel surround sound and 3D audio, including binaural approaches, without ignoring conventional stereo. The enhancement of spatial quality is arguably the only remaining hurdle to be overcome in pursuit of high quality sound reproduction. The rise of increasingly sophisticated spatial sound systems presents an enormous challenge to audio engineers, many of whom are confused by the possibilities and unfamiliar with standards, formats, track allocations, monitoring configurations and recording techniques. The author provides a comprehensive study of the current state of the art in spatial audio, concentrating on the most widely used approaches and configurations. Anyone wishing to expand their understanding of these cutting-edge technologies will want to own this book.