Author: Abdulhamit Subasi
Publisher: Elsevier
ISBN: 0443291519
Category : Science
Languages : en
Pages : 426
Book Description
Artificial Intelligence and Multimodal Signal Processing in Human-Machine Interaction presents an overview of an emerging field that is concerned with exploiting multiple modalities of communication in both Artificial Intelligence and Human-Machine Interaction. The book not only provides cross disciplinary research in the fields of multimodal signal acquisition and sensing, analysis, IoTs (Internet of Things), Artificial Intelligence, and system architectures, it also evaluates the role of Artificial Intelligence I in relation to the realization of contemporary Human Machine Interaction (HMI) systems.Readers are introduced to the multimodal signals and their role in the identification of the intended subjects, mental state and the realization of HMI systems are explored, and the applications of signal processing and machine/ensemble/deep learning for HMIs are assessed. A description of proposed methodologies is provided, and related works are also presented. This is a valuable resource for researchers, health professionals, postgraduate students, post doc researchers and faculty members in the fields of HMIs, Brain-Computer Interface (BCI), Prosthesis, Computer vision, and Mental state estimation, and all those who wish to broaden their knowledge in the allied field. - Covers advances in the multimodal signal processing and artificial intelligence assistive HMIs - Presents theories, algorithms, realizations, applications, approaches, and challenges that will have their impact and contribution in the design and development of modern and effective HMI (Human Machine Interaction) system - Presents different aspects of the multimodal signals, from the sensing to analysis using hardware/software, and making use of machine/ensemble/deep learning in the intended problem-solving
Artificial Intelligence and Multimodal Signal Processing in Human-Machine Interaction
Author: Abdulhamit Subasi
Publisher: Elsevier
ISBN: 0443291519
Category : Science
Languages : en
Pages : 426
Book Description
Artificial Intelligence and Multimodal Signal Processing in Human-Machine Interaction presents an overview of an emerging field that is concerned with exploiting multiple modalities of communication in both Artificial Intelligence and Human-Machine Interaction. The book not only provides cross disciplinary research in the fields of multimodal signal acquisition and sensing, analysis, IoTs (Internet of Things), Artificial Intelligence, and system architectures, it also evaluates the role of Artificial Intelligence I in relation to the realization of contemporary Human Machine Interaction (HMI) systems.Readers are introduced to the multimodal signals and their role in the identification of the intended subjects, mental state and the realization of HMI systems are explored, and the applications of signal processing and machine/ensemble/deep learning for HMIs are assessed. A description of proposed methodologies is provided, and related works are also presented. This is a valuable resource for researchers, health professionals, postgraduate students, post doc researchers and faculty members in the fields of HMIs, Brain-Computer Interface (BCI), Prosthesis, Computer vision, and Mental state estimation, and all those who wish to broaden their knowledge in the allied field. - Covers advances in the multimodal signal processing and artificial intelligence assistive HMIs - Presents theories, algorithms, realizations, applications, approaches, and challenges that will have their impact and contribution in the design and development of modern and effective HMI (Human Machine Interaction) system - Presents different aspects of the multimodal signals, from the sensing to analysis using hardware/software, and making use of machine/ensemble/deep learning in the intended problem-solving
Publisher: Elsevier
ISBN: 0443291519
Category : Science
Languages : en
Pages : 426
Book Description
Artificial Intelligence and Multimodal Signal Processing in Human-Machine Interaction presents an overview of an emerging field that is concerned with exploiting multiple modalities of communication in both Artificial Intelligence and Human-Machine Interaction. The book not only provides cross disciplinary research in the fields of multimodal signal acquisition and sensing, analysis, IoTs (Internet of Things), Artificial Intelligence, and system architectures, it also evaluates the role of Artificial Intelligence I in relation to the realization of contemporary Human Machine Interaction (HMI) systems.Readers are introduced to the multimodal signals and their role in the identification of the intended subjects, mental state and the realization of HMI systems are explored, and the applications of signal processing and machine/ensemble/deep learning for HMIs are assessed. A description of proposed methodologies is provided, and related works are also presented. This is a valuable resource for researchers, health professionals, postgraduate students, post doc researchers and faculty members in the fields of HMIs, Brain-Computer Interface (BCI), Prosthesis, Computer vision, and Mental state estimation, and all those who wish to broaden their knowledge in the allied field. - Covers advances in the multimodal signal processing and artificial intelligence assistive HMIs - Presents theories, algorithms, realizations, applications, approaches, and challenges that will have their impact and contribution in the design and development of modern and effective HMI (Human Machine Interaction) system - Presents different aspects of the multimodal signals, from the sensing to analysis using hardware/software, and making use of machine/ensemble/deep learning in the intended problem-solving
Multimodal Signal Processing
Author: Jean-Philippe Thiran
Publisher: Academic Press
ISBN: 0080888690
Category : Computers
Languages : en
Pages : 343
Book Description
Multimodal signal processing is an important research and development field that processes signals and combines information from a variety of modalities – speech, vision, language, text – which significantly enhance the understanding, modelling, and performance of human-computer interaction devices or systems enhancing human-human communication. The overarching theme of this book is the application of signal processing and statistical machine learning techniques to problems arising in this multi-disciplinary field. It describes the capabilities and limitations of current technologies, and discusses the technical challenges that must be overcome to develop efficient and user-friendly multimodal interactive systems. With contributions from the leading experts in the field, the present book should serve as a reference in multimodal signal processing for signal processing researchers, graduate students, R&D engineers, and computer engineers who are interested in this emerging field. - Presents state-of-art methods for multimodal signal processing, analysis, and modeling - Contains numerous examples of systems with different modalities combined - Describes advanced applications in multimodal Human-Computer Interaction (HCI) as well as in computer-based analysis and modelling of multimodal human-human communication scenes.
Publisher: Academic Press
ISBN: 0080888690
Category : Computers
Languages : en
Pages : 343
Book Description
Multimodal signal processing is an important research and development field that processes signals and combines information from a variety of modalities – speech, vision, language, text – which significantly enhance the understanding, modelling, and performance of human-computer interaction devices or systems enhancing human-human communication. The overarching theme of this book is the application of signal processing and statistical machine learning techniques to problems arising in this multi-disciplinary field. It describes the capabilities and limitations of current technologies, and discusses the technical challenges that must be overcome to develop efficient and user-friendly multimodal interactive systems. With contributions from the leading experts in the field, the present book should serve as a reference in multimodal signal processing for signal processing researchers, graduate students, R&D engineers, and computer engineers who are interested in this emerging field. - Presents state-of-art methods for multimodal signal processing, analysis, and modeling - Contains numerous examples of systems with different modalities combined - Describes advanced applications in multimodal Human-Computer Interaction (HCI) as well as in computer-based analysis and modelling of multimodal human-human communication scenes.
Multimodal Interface for Human-machine Communication
Author: P. C. Yuen
Publisher: World Scientific
ISBN: 9789810245948
Category : Computers
Languages : en
Pages : 288
Book Description
With the advance of speech, image and video technology, human-computer interaction (HCI) will reach a new phase.In recent years, HCI has been extended to human-machine communication (HMC) and the perceptual user interface (PUI). The final goal in HMC is that the communication between humans and machines is similar to human-to-human communication. Moreover, the machine can support human-to-human communication (e.g. an interface for the disabled). For this reason, various aspects of human communication are to be considered in HMC. The HMC interface, called a multimodal interface, includes different types of input methods, such as natural language, gestures, face and handwriting characters.The nine papers in this book have been selected from the 92 high-quality papers constituting the proceedings of the 2nd International Conference on Multimodal Interface (ICMI '99), which was held in Hong Kong in 1999. The papers cover a wide spectrum of the multimodal interface.
Publisher: World Scientific
ISBN: 9789810245948
Category : Computers
Languages : en
Pages : 288
Book Description
With the advance of speech, image and video technology, human-computer interaction (HCI) will reach a new phase.In recent years, HCI has been extended to human-machine communication (HMC) and the perceptual user interface (PUI). The final goal in HMC is that the communication between humans and machines is similar to human-to-human communication. Moreover, the machine can support human-to-human communication (e.g. an interface for the disabled). For this reason, various aspects of human communication are to be considered in HMC. The HMC interface, called a multimodal interface, includes different types of input methods, such as natural language, gestures, face and handwriting characters.The nine papers in this book have been selected from the 92 high-quality papers constituting the proceedings of the 2nd International Conference on Multimodal Interface (ICMI '99), which was held in Hong Kong in 1999. The papers cover a wide spectrum of the multimodal interface.
Multimodal Signal Processing
Author: Steve Renals
Publisher: Cambridge University Press
ISBN: 1107022290
Category : Computers
Languages : en
Pages : 287
Book Description
A comprehensive synthesis of recent advances in multimodal signal processing applications for human interaction analysis and meeting support technology. With directly applicable methods and metrics along with benchmark results, this guide is ideal for those interested in multimodal signal processing, its component disciplines and its application to human interaction analysis.
Publisher: Cambridge University Press
ISBN: 1107022290
Category : Computers
Languages : en
Pages : 287
Book Description
A comprehensive synthesis of recent advances in multimodal signal processing applications for human interaction analysis and meeting support technology. With directly applicable methods and metrics along with benchmark results, this guide is ideal for those interested in multimodal signal processing, its component disciplines and its application to human interaction analysis.
Emerging Artificial Intelligence Applications in Computer Engineering
Author: Ilias G. Maglogiannis
Publisher: IOS Press
ISBN: 1586037803
Category : Computers
Languages : en
Pages : 420
Book Description
Provides insights on how computer engineers can implement artificial intelligence (AI) in real world applications. This book presents practical applications of AI.
Publisher: IOS Press
ISBN: 1586037803
Category : Computers
Languages : en
Pages : 420
Book Description
Provides insights on how computer engineers can implement artificial intelligence (AI) in real world applications. This book presents practical applications of AI.
The Oxford Handbook of Affective Computing
Author: Rafael A. Calvo
Publisher: Oxford Library of Psychology
ISBN: 0199942234
Category : Computers
Languages : en
Pages : 625
Book Description
"The Oxford Handbook of Affective Computing is a definitive reference in the burgeoning field of affective computing (AC), a multidisciplinary field encompassing computer science, engineering, psychology, education, neuroscience, and other disciplines. AC research explores how affective factors influence interactions between humans and technology, how affect sensing and affect generation techniques can inform our understanding of human affect, and on the design, implementation, and evaluation of systems involving affect at their core. The volume features 41 chapters and is divided into five sections: history and theory, detection, generation, methodologies, and applications. Section 1 begins with the making of AC and a historical review of the science of emotion. The following chapters discuss the theoretical underpinnings of AC from an interdisciplinary viewpoint. Section 2 examines affect detection or recognition, a commonly investigated area. Section 3 focuses on aspects of affect generation, including the synthesis of emotion and its expression via facial features, speech, postures, and gestures. Cultural issues are also discussed. Section 4 focuses on methodological issues in AC research, including data collection techniques, multimodal affect databases, formats for the representation of emotion, crowdsourcing techniques, machine learning approaches, affect elicitation techniques, useful AC tools, and ethical issues. Finally, Section 5 highlights applications of AC in such domains as formal and informal learning, games, robotics, virtual reality, autism research, health care, cyberpsychology, music, deception, reflective writing, and cyberpsychology. This compendium will prove suitable for use as a textbook and serve as a valuable resource for everyone with an interest in AC."--
Publisher: Oxford Library of Psychology
ISBN: 0199942234
Category : Computers
Languages : en
Pages : 625
Book Description
"The Oxford Handbook of Affective Computing is a definitive reference in the burgeoning field of affective computing (AC), a multidisciplinary field encompassing computer science, engineering, psychology, education, neuroscience, and other disciplines. AC research explores how affective factors influence interactions between humans and technology, how affect sensing and affect generation techniques can inform our understanding of human affect, and on the design, implementation, and evaluation of systems involving affect at their core. The volume features 41 chapters and is divided into five sections: history and theory, detection, generation, methodologies, and applications. Section 1 begins with the making of AC and a historical review of the science of emotion. The following chapters discuss the theoretical underpinnings of AC from an interdisciplinary viewpoint. Section 2 examines affect detection or recognition, a commonly investigated area. Section 3 focuses on aspects of affect generation, including the synthesis of emotion and its expression via facial features, speech, postures, and gestures. Cultural issues are also discussed. Section 4 focuses on methodological issues in AC research, including data collection techniques, multimodal affect databases, formats for the representation of emotion, crowdsourcing techniques, machine learning approaches, affect elicitation techniques, useful AC tools, and ethical issues. Finally, Section 5 highlights applications of AC in such domains as formal and informal learning, games, robotics, virtual reality, autism research, health care, cyberpsychology, music, deception, reflective writing, and cyberpsychology. This compendium will prove suitable for use as a textbook and serve as a valuable resource for everyone with an interest in AC."--
Coverbal Synchrony in Human-Machine Interaction
Author: Matej Rojc
Publisher: CRC Press
ISBN: 1466598255
Category : Computers
Languages : en
Pages : 436
Book Description
Embodied conversational agents (ECA) and speech-based human–machine interfaces can together represent more advanced and more natural human–machine interaction. Fusion of both topics is a challenging agenda in research and production spheres. The important goal of human–machine interfaces is to provide content or functionality in the form of a dialog resembling face-to-face conversations. All natural interfaces strive to exploit and use different communication strategies that provide additional meaning to the content, whether they are human–machine interfaces for controlling an application or different ECA-based human–machine interfaces directly simulating face-to-face conversation. Coverbal Synchrony in Human-Machine Interaction presents state-of-the-art concepts of advanced environment-independent multimodal human–machine interfaces that can be used in different contexts, ranging from simple multimodal web-browsers (for example, multimodal content reader) to more complex multimodal human–machine interfaces for ambient intelligent environments (such as supportive environments for elderly and agent-guided household environments). They can also be used in different computing environments—from pervasive computing to desktop environments. Within these concepts, the contributors discuss several communication strategies, used to provide different aspects of human–machine interaction.
Publisher: CRC Press
ISBN: 1466598255
Category : Computers
Languages : en
Pages : 436
Book Description
Embodied conversational agents (ECA) and speech-based human–machine interfaces can together represent more advanced and more natural human–machine interaction. Fusion of both topics is a challenging agenda in research and production spheres. The important goal of human–machine interfaces is to provide content or functionality in the form of a dialog resembling face-to-face conversations. All natural interfaces strive to exploit and use different communication strategies that provide additional meaning to the content, whether they are human–machine interfaces for controlling an application or different ECA-based human–machine interfaces directly simulating face-to-face conversation. Coverbal Synchrony in Human-Machine Interaction presents state-of-the-art concepts of advanced environment-independent multimodal human–machine interfaces that can be used in different contexts, ranging from simple multimodal web-browsers (for example, multimodal content reader) to more complex multimodal human–machine interfaces for ambient intelligent environments (such as supportive environments for elderly and agent-guided household environments). They can also be used in different computing environments—from pervasive computing to desktop environments. Within these concepts, the contributors discuss several communication strategies, used to provide different aspects of human–machine interaction.
Talker Quality in Human and Machine Interaction
Author: Benjamin Weiss
Publisher: Springer
ISBN: 3030227693
Category : Technology & Engineering
Languages : en
Pages : 155
Book Description
The book discusses subjective ratings of quality and preference of unknown voices and dialog partners – their likability, for example. Human natural and artificial voices are studied in passive listening and interactive scenarios. In this book, the background, state of research, and contributions to the assessment and prediction of talker quality that is constituted in voice perception and in dialog are presented. Starting from theories and empirical findings from human interaction, major results and approaches are transferred to the domain of human-computer interaction (HCI). The main objective of this book is to contribute to the evaluation of spoken interaction in humans and between humans and computers, and in particular to the quality subsequently attributed to the speaking system or person based on the listening and interactive experience. Provides a comprehensive overview of research in evaluation of speakers and dialog partners; Presents recent results on the relevance of a first passive and interactive impression; Includes human and HCI evaluation results from a communicative perspective.
Publisher: Springer
ISBN: 3030227693
Category : Technology & Engineering
Languages : en
Pages : 155
Book Description
The book discusses subjective ratings of quality and preference of unknown voices and dialog partners – their likability, for example. Human natural and artificial voices are studied in passive listening and interactive scenarios. In this book, the background, state of research, and contributions to the assessment and prediction of talker quality that is constituted in voice perception and in dialog are presented. Starting from theories and empirical findings from human interaction, major results and approaches are transferred to the domain of human-computer interaction (HCI). The main objective of this book is to contribute to the evaluation of spoken interaction in humans and between humans and computers, and in particular to the quality subsequently attributed to the speaking system or person based on the listening and interactive experience. Provides a comprehensive overview of research in evaluation of speakers and dialog partners; Presents recent results on the relevance of a first passive and interactive impression; Includes human and HCI evaluation results from a communicative perspective.
The Handbook of Multimodal-Multisensor Interfaces, Volume 3
Author: Sharon Oviatt
Publisher: Morgan & Claypool
ISBN: 1970001739
Category : Computers
Languages : en
Pages : 815
Book Description
The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces-user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces. This three-volume handbook is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This third volume focuses on state-of-the-art multimodal language and dialogue processing, including semantic integration of modalities. The development of increasingly expressive embodied agents and robots has become an active test bed for coordinating multimodal dialogue input and output, including processing of language and nonverbal communication. In addition, major application areas are featured for commercializing multimodal-multisensor systems, including automotive, robotic, manufacturing, machine translation, banking, communications, and others. These systems rely heavily on software tools, data resources, and international standards to facilitate their development. For insights into the future, emerging multimodal-multisensor technology trends are highlighted in medicine, robotics, interaction with smart spaces, and similar areas. Finally, this volume discusses the societal impact of more widespread adoption of these systems, such as privacy risks and how to mitigate them. The handbook chapters provide a number of walk-through examples of system design and processing, information on practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces need to be equipped to most effectively advance human performance during the next decade.
Publisher: Morgan & Claypool
ISBN: 1970001739
Category : Computers
Languages : en
Pages : 815
Book Description
The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces-user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces. This three-volume handbook is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This third volume focuses on state-of-the-art multimodal language and dialogue processing, including semantic integration of modalities. The development of increasingly expressive embodied agents and robots has become an active test bed for coordinating multimodal dialogue input and output, including processing of language and nonverbal communication. In addition, major application areas are featured for commercializing multimodal-multisensor systems, including automotive, robotic, manufacturing, machine translation, banking, communications, and others. These systems rely heavily on software tools, data resources, and international standards to facilitate their development. For insights into the future, emerging multimodal-multisensor technology trends are highlighted in medicine, robotics, interaction with smart spaces, and similar areas. Finally, this volume discusses the societal impact of more widespread adoption of these systems, such as privacy risks and how to mitigate them. The handbook chapters provide a number of walk-through examples of system design and processing, information on practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces need to be equipped to most effectively advance human performance during the next decade.
The Handbook of Multimodal-Multisensor Interfaces, Volume 1
Author: Sharon Oviatt
Publisher: Morgan & Claypool
ISBN: 1970001666
Category : Computers
Languages : en
Pages : 598
Book Description
The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces— user input involving new media (speech, multi-touch, gestures, writing) embedded in multimodal-multisensor interfaces. These interfaces support smart phones, wearables, in-vehicle and robotic applications, and many other areas that are now highly competitive commercially. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This first volume of the handbook presents relevant theory and neuroscience foundations for guiding the development of high-performance systems. Additional chapters discuss approaches to user modeling and interface designs that support user choice, that synergistically combine modalities with sensors, and that blend multimodal input and output. This volume also highlights an in-depth look at the most common multimodal-multisensor combinations—for example, touch and pen input, haptic and non-speech audio output, and speech-centric systems that co-process either gestures, pen input, gaze, or visible lip movements. A common theme throughout these chapters is supporting mobility and individual differences among users. These handbook chapters provide walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces should be designed in the future to most effectively advance human performance.
Publisher: Morgan & Claypool
ISBN: 1970001666
Category : Computers
Languages : en
Pages : 598
Book Description
The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces— user input involving new media (speech, multi-touch, gestures, writing) embedded in multimodal-multisensor interfaces. These interfaces support smart phones, wearables, in-vehicle and robotic applications, and many other areas that are now highly competitive commercially. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This first volume of the handbook presents relevant theory and neuroscience foundations for guiding the development of high-performance systems. Additional chapters discuss approaches to user modeling and interface designs that support user choice, that synergistically combine modalities with sensors, and that blend multimodal input and output. This volume also highlights an in-depth look at the most common multimodal-multisensor combinations—for example, touch and pen input, haptic and non-speech audio output, and speech-centric systems that co-process either gestures, pen input, gaze, or visible lip movements. A common theme throughout these chapters is supporting mobility and individual differences among users. These handbook chapters provide walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces should be designed in the future to most effectively advance human performance.