Estimating Spoken Dialog System Quality with User Models PDF Download
Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download Estimating Spoken Dialog System Quality with User Models PDF full book. Access full book title Estimating Spoken Dialog System Quality with User Models by Klaus-Peter Engelbrecht. Download full books in PDF and EPUB format.
Author: Klaus-Peter Engelbrecht
Publisher: Springer Science & Business Media
ISBN: 3642315917
Category : Technology & Engineering
Languages : en
Pages : 136
Get Book Here
Book Description
Spoken dialog systems have the potential to offer highly intuitive user interfaces, as they allow systems to be controlled using natural language. However, the complexity inherent in natural language dialogs means that careful testing of the system must be carried out from the very beginning of the design process. This book examines how user models can be used to support such early evaluations in two ways: by running simulations of dialogs, and by estimating the quality judgments of users. First, a design environment supporting the creation of dialog flows, the simulation of dialogs, and the analysis of the simulated data is proposed. How the quality of user simulations may be quantified with respect to their suitability for both formative and summative evaluation is then discussed. The remainder of the book is dedicated to the problem of predicting quality judgments of users based on interaction data. New modeling approaches are presented, which process the dialogs as sequences, and which allow knowledge about the judgment behavior of users to be incorporated into predictions. All proposed methods are validated with example evaluation studies.
Author: Klaus-Peter Engelbrecht
Publisher: Springer Science & Business Media
ISBN: 3642315917
Category : Technology & Engineering
Languages : en
Pages : 136
Get Book Here
Book Description
Spoken dialog systems have the potential to offer highly intuitive user interfaces, as they allow systems to be controlled using natural language. However, the complexity inherent in natural language dialogs means that careful testing of the system must be carried out from the very beginning of the design process. This book examines how user models can be used to support such early evaluations in two ways: by running simulations of dialogs, and by estimating the quality judgments of users. First, a design environment supporting the creation of dialog flows, the simulation of dialogs, and the analysis of the simulated data is proposed. How the quality of user simulations may be quantified with respect to their suitability for both formative and summative evaluation is then discussed. The remainder of the book is dedicated to the problem of predicting quality judgments of users based on interaction data. New modeling approaches are presented, which process the dialogs as sequences, and which allow knowledge about the judgment behavior of users to be incorporated into predictions. All proposed methods are validated with example evaluation studies.
Author: Stefan Hillmann
Publisher: Springer
ISBN: 3319625187
Category : Technology & Engineering
Languages : en
Pages : 262
Get Book Here
Book Description
This book describes an extension of the user behaviour simulation (UBS) of an existing tool for automatic usability evaluation (AUE). This extension is based upon a user study with a smart home system. It uses technical-sociological methods for the execution of the study and the analysis of the collected data. A comparison of the resulting UBS with former UBSs, as well as the empirical data, shows that the new simulation approach outperforms the former simulation. The improvement affects the prediction of dialogue metrics that are related to dialogue efficiency and dialogue effectiveness. Furthermore, the book describes a parameter-based data model, as well as a related framework. Both are used to uniformly describe multimodal human-computer interactions and to provide such descriptions for usability evaluations. Finally, the book proposes a new two-stage method for the evaluation of UBSs. The method is based on the computation of a distance measures between two dialogue corpora and the pair-wise comparison of distances among several dialogue corpora.
Author: Sebastian Möller
Publisher: Springer Science & Business Media
ISBN: 0387231862
Category : Technology & Engineering
Languages : en
Pages : 480
Get Book Here
Book Description
Quality of Telephone-Based Spoken Dialogue Systems is a systematic overview of assessment, evaluation, and prediction methods for the quality of services such as travel and touristic information, phone-directory and messaging, or telephone-banking services. A new taxonomy of quality-of-service is presented which serves as a tool for classifying assessment and evaluation methods, for planning and interpreting evaluation experiments, and for estimating quality. A broad overview of parameters and evaluation methods is given, both on a system-component level and for a fully integrated system. Three experimental investigations illustrate the relationships between system characteristics and perceived quality. The resulting information is needed in all phases of system specification, design, implementation, and operation. Although Quality of Telephone-Based Spoken Dialogue Systems is written from the perspective of an engineer in telecommunications, it is an invaluable source of information for professionals in signal processing, communication acoustics, computational linguistics, speech and language sciences, human factor design and ergonomics
Author: Sebastian Möller
Publisher: Springer Nature
ISBN: 3662656159
Category : Technology & Engineering
Languages : en
Pages : 202
Get Book Here
Book Description
Der Begriff der Qualität und der Gebrauchstauglichkeit hat in der Informations- und Kommunikationstechnik sowie der Informatik eine herausragende Bedeutung. Der Autor führt in diese Thematik ein, indem er zunächst die Fachbegriffe und die Grundlagen der Psychophysik und Psychometrie erläutert. Darauf aufbauend wird der Kreislauf einer menschenorientierten Systementwicklung vorgestellt. Die Messung und Vorhersage von Qualität und Gebrauchstauglichkeit wird anhand von Beispielen veranschaulicht, u. a. für Sprach- und multimodale Dialogsysteme.
Author: Wolfgang Minker
Publisher: Springer Science & Business Media
ISBN: 1441979344
Category : Technology & Engineering
Languages : en
Pages : 295
Get Book Here
Book Description
Spoken Dialogue Systems Technology and Design covers key topics in the field of spoken language dialogue interaction from a variety of leading researchers. It brings together several perspectives in the areas of corpus annotation and analysis, dialogue system construction, as well as theoretical perspectives on communicative intention, context-based generation, and modelling of discourse structure. These topics are all part of the general research and development within the area of discourse and dialogue with an emphasis on dialogue systems; corpora and corpus tools and semantic and pragmatic modelling of discourse and dialogue.
Author: Alexander Schmitt
Publisher: Springer Science & Business Media
ISBN: 1461445922
Category : Technology & Engineering
Languages : en
Pages : 258
Get Book Here
Book Description
In Monitoring Adaptive Spoken Dialog Systems, authors Alexander Schmitt and Wolfgang Minker investigate statistical approaches that allow for recognition of negative dialog patterns in Spoken Dialog Systems (SDS). The presented stochastic methods allow a flexible, portable and accurate use. Beginning with the foundations of machine learning and pattern recognition, this monograph examines how frequently users show negative emotions in spoken dialog systems and develop novel approaches to speech-based emotion recognition using hybrid approach to model emotions. The authors make use of statistical methods based on acoustic, linguistic and contextual features to examine the relationship between the interaction flow and the occurrence of emotions using non-acted recordings several thousand real users from commercial and non-commercial SDS. Additionally, the authors present novel statistical methods that spot problems within a dialog based on interaction patterns. The approaches enable future SDS to offer more natural and robust interactions. This work provides insights, lessons and inspiration for future research and development, not only for spoken dialog systems, but for data-driven approaches to human-machine interaction in general.
Author: Oliver Lemon
Publisher: Springer Science & Business Media
ISBN: 1461448034
Category : Computers
Languages : en
Pages : 184
Get Book Here
Book Description
Data driven methods have long been used in Automatic Speech Recognition (ASR) and Text-To-Speech (TTS) synthesis and have more recently been introduced for dialogue management, spoken language understanding, and Natural Language Generation. Machine learning is now present “end-to-end” in Spoken Dialogue Systems (SDS). However, these techniques require data collection and annotation campaigns, which can be time-consuming and expensive, as well as dataset expansion by simulation. In this book, we provide an overview of the current state of the field and of recent advances, with a specific focus on adaptivity.
Author: Kristiina Jokinen
Publisher: Springer
ISBN: 9811025851
Category : Technology & Engineering
Languages : en
Pages : 477
Get Book Here
Book Description
This book explores novel aspects of social robotics, spoken dialogue systems, human-robot interaction, spoken language understanding, multimodal communication, and system evaluation. It offers a variety of perspectives on and solutions to the most important questions about advanced techniques for social robots and chat systems. Chapters by leading researchers address key research and development topics in the field of spoken dialogue systems, focusing in particular on three special themes: dialogue state tracking, evaluation of human-robot dialogue in social robotics, and socio-cognitive language processing. The book offers a valuable resource for researchers and practitioners in both academia and industry whose work involves advanced interaction technology and who are seeking an up-to-date overview of the key topics. It also provides supplementary educational material for courses on state-of-the-art dialogue system technologies, social robotics, and related research fields.
Author: Christine Kühnel
Publisher: Springer Science & Business Media
ISBN: 3642296025
Category : Technology & Engineering
Languages : en
Pages : 188
Get Book Here
Book Description
This book systematically addresses the quantification of quality aspects of multimodal interactive systems. The conceptual structure is based on a schematic view on human-computer interaction where the user interacts with the system and perceives it via input and output interfaces. Thus, aspects of multimodal interaction are analyzed first, followed by a discussion of the evaluation of output and input and concluding with a view on the evaluation of a complete system.
Author: Ina Wechsung
Publisher: Springer Science & Business Media
ISBN: 3319038109
Category : Technology & Engineering
Languages : en
Pages : 204
Get Book Here
Book Description
This book presents (1) an exhaustive and empirically validated taxonomy of quality aspects of multimodal interaction as well as respective measurement methods, (2) a validated questionnaire specifically tailored to the evaluation of multimodal systems and covering most of the taxonomy‘s quality aspects, (3) insights on how the quality perceptions of multimodal systems relate to the quality perceptions of its individual components, (4) a set of empirically tested factors which influence modality choice, and (5) models regarding the relationship of the perceived quality of a modality and the actual usage of a modality.
