Influencing Factors in Speech Quality Assessment using Crowdsourcing

Influencing Factors in Speech Quality Assessment using Crowdsourcing PDF Author: Rafael Zequeira Jiménez
Publisher: Springer Nature
ISBN: 3030933105
Category : Technology & Engineering
Languages : en
Pages : 129

Get Book

Book Description
This book evaluates the impact of relevant factors affecting the results of speech quality assessment studies carried out in crowdsourcing. The author describes how these factors relate to the test structure, the effect of environmental background noise, and the influence of language differences. He details multiple user-centered studies that have been conducted to derive guidelines for reliable collection of speech quality scores in crowdsourcing. Specifically, different questions are addressed such as the optimal number of speech samples to include in a listening task, the influence of the environmental background noise in the speech quality ratings, as well as methods for classifying background noise from web audio recordings, or the impact of language proficiency in the user perception of speech quality. Ultimately, the results of these studies contributed to the definition of the ITU-T Recommendation P.808 that defines the guidelines to conduct speech quality studies in crowdsourcing.

Influencing Factors in Speech Quality Assessment using Crowdsourcing

Influencing Factors in Speech Quality Assessment using Crowdsourcing PDF Author: Rafael Zequeira Jiménez
Publisher: Springer Nature
ISBN: 3030933105
Category : Technology & Engineering
Languages : en
Pages : 129

Get Book

Book Description
This book evaluates the impact of relevant factors affecting the results of speech quality assessment studies carried out in crowdsourcing. The author describes how these factors relate to the test structure, the effect of environmental background noise, and the influence of language differences. He details multiple user-centered studies that have been conducted to derive guidelines for reliable collection of speech quality scores in crowdsourcing. Specifically, different questions are addressed such as the optimal number of speech samples to include in a listening task, the influence of the environmental background noise in the speech quality ratings, as well as methods for classifying background noise from web audio recordings, or the impact of language proficiency in the user perception of speech quality. Ultimately, the results of these studies contributed to the definition of the ITU-T Recommendation P.808 that defines the guidelines to conduct speech quality studies in crowdsourcing.

Assessing the Quality of Experience of Cloud Gaming Services

Assessing the Quality of Experience of Cloud Gaming Services PDF Author: Steven Schmidt
Publisher: Springer Nature
ISBN: 3031060113
Category : Technology & Engineering
Languages : en
Pages : 230

Get Book

Book Description
This book provides an overview of concepts and challenges in intis investigated using structural equation modeling. The conveyed understanding of gaming QoE, empirical eraction quality in the domain of cloud gaming services. The author presents a unified evaluation approach by combining quantitative subjective assessment methods in a concise way. The author discusses a measurement tool, Gaming Input Quality Scale (GIPS), that assesses the interaction quality of such a service available. Furthermore, the author discusses a new framework to assess gaming Quality of Experience (QoE) using a crowdsourcing approach. Lastly, based on a large dataset including dominant network and encoding conditions, the evaluation method is investigated using structural equation modeling. The conveyed understanding of gaming QoE, empirical findings, and models presented in this book should be of particular interest to researchers working in the fields of quality and usability engineering, as well as service providers and network operators.

Crowdsourcing for Speech Processing

Crowdsourcing for Speech Processing PDF Author: Maxine Eskenazi
Publisher: John Wiley & Sons
ISBN: 1118541251
Category : Technology & Engineering
Languages : en
Pages : 343

Get Book

Book Description
Provides an insightful and practical introduction to crowdsourcing as a means of rapidly processing speech data Intended for those who want to get started in the domain and learn how to set up a task, what interfaces are available, how to assess the work, etc. as well as for those who already have used crowdsourcing and want to create better tasks and obtain better assessments of the work of the crowd. It will include screenshots to show examples of good and poor interfaces; examples of case studies in speech processing tasks, going through the task creation process, reviewing options in the interface, in the choice of medium (MTurk or other) and explaining choices, etc. Provides an insightful and practical introduction to crowdsourcing as a means of rapidly processing speech data. Addresses important aspects of this new technique that should be mastered before attempting a crowdsourcing application. Offers speech researchers the hope that they can spend much less time dealing with the data gathering/annotation bottleneck, leaving them to focus on the scientific issues. Readers will directly benefit from the book’s successful examples of how crowd- sourcing was implemented for speech processing, discussions of interface and processing choices that worked and choices that didn’t, and guidelines on how to play and record speech over the internet, how to design tasks, and how to assess workers. Essential reading for researchers and practitioners in speech research groups involved in speech processing

Human Information Processing in Speech Quality Assessment

Human Information Processing in Speech Quality Assessment PDF Author: Stefan Uhrig
Publisher:
ISBN: 9783030713904
Category :
Languages : en
Pages : 0

Get Book

Book Description
This book provides a new multi-method, process-oriented approach towards speech quality assessment, which allows readers to examine the influence of speech transmission quality on a variety of perceptual and cognitive processes in human listeners. Fundamental concepts and methodologies surrounding the topic of process-oriented quality assessment are introduced and discussed. The book further describes a functional process model of human quality perception, which theoretically integrates results obtained in three experimental studies. This book's conceptual ideas, empirical findings, and theoretical interpretations should be of particular interest to researchers working in the fields of Quality and Usability Engineering, Audio Engineering, Psychoacoustics, Audiology, and Psychophysiology. Presents a new process-oriented approach towards speech quality assessment to uncover influences of speech transmission quality on human information processing; Proposes a multi-method assessment approach including subjective, behavioral, and neurophysiological levels of analysis; Reports findings from three experimental studies, that demonstrate interactions between perceived speech quality, contextual, and content-related influencing factors.

The Influence of Delay on Cloud Gaming Quality of Experience

The Influence of Delay on Cloud Gaming Quality of Experience PDF Author: Saeed Shafiee Sabet
Publisher: Springer Nature
ISBN: 303099869X
Category : Technology & Engineering
Languages : en
Pages : 166

Get Book

Book Description
This book provides an understanding of the impact of delay on cloud gaming Quality of Experience (QoE) and proposes techniques to compensate for this impact, leading to a better gaming experience when there are network delays. The author studies why some games in the cloud are more delay sensitive than others by identifying game characteristics influencing a user's delay perception and predicting the gaming QoE degraded by the delay. The author also investigates the impact of jitter and serial-position effects on gaming QoE and delay. Using the insight gained, the author presents delay compensation techniques that can mitigate the negative influence of delay on gaming QoE that use the game characteristics to adapt the games.

Quality of Experience

Quality of Experience PDF Author: Sebastian Möller
Publisher: Springer
ISBN: 331902681X
Category : Technology & Engineering
Languages : en
Pages : 431

Get Book

Book Description
This pioneering book develops definitions and concepts related to Quality of Experience in the context of multimedia- and telecommunications-related applications, systems and services and applies these to various fields of communication and media technologies. The editors bring together numerous key-protagonists of the new discipline “Quality of Experience” and combine the state-of-the-art knowledge in one single volume.

Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments

Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments PDF Author: Daniel Archambault
Publisher: Springer
ISBN: 3319664352
Category : Computers
Languages : en
Pages : 191

Get Book

Book Description
As the outcome of the Dagstuhl Seminar 15481 on Crowdsourcing and Human-Centered Experiments, this book is a primer for computer science researchers who intend to use crowdsourcing technology for human centered experiments. The focus of this Dagstuhl seminar, held in Dagstuhl Castle in November 2015, was to discuss experiences and methodological considerations when using crowdsourcing platforms to run human-centered experiments to test the effectiveness of visual representations. The inspiring Dagstuhl atmosphere fostered discussions and brought together researchers from different research directions. The papers provide information on crowdsourcing technology and experimental methodologies, comparisons between crowdsourcing and lab experiments, the use of crowdsourcing for visualisation, psychology, QoE and HCI empirical studies, and finally the nature of crowdworkers and their work, their motivation and demographic background, as well as the relationships among people forming the crowdsourcing community.

Quality of Synthetic Speech

Quality of Synthetic Speech PDF Author: Florian Hinterleitner
Publisher: Springer
ISBN: 9811037345
Category : Technology & Engineering
Languages : en
Pages : 157

Get Book

Book Description
This book reviews research towards perceptual quality dimensions of synthetic speech, compares these findings with the state of the art, and derives a set of five universal perceptual quality dimensions for TTS signals. They are: (i) naturalness of voice, (ii) prosodic quality, (iii) fluency and intelligibility, (iv) absence of disturbances, and (v) calmness. Moreover, a test protocol for the efficient indentification of those dimensions in a listening test is introduced. Furthermore, several factors influencing these dimensions are examined. In addition, different techniques for the instrumental quality assessment of TTS signals are introduced, reviewed and tested. Finally, the requirements for the integration of an instrumental quality measure into a concatenative TTS system are examined.

Macrotask Crowdsourcing

Macrotask Crowdsourcing PDF Author: Vassillis-Javed Khan
Publisher: Springer
ISBN: 3030123340
Category : Computers
Languages : en
Pages : 279

Get Book

Book Description
Crowdsourcing is an emerging paradigm that promises to transform several domains: creative work, business work, cultural cooperation, etc. Crowdsourcing reflects the close-knit interplay between the latest computer technologies, the rapidly changing work model of the 21st century, and the very nature of people. The interplay makes for an exciting but at the same time challenging new field to investigate under the lens of a diverse set of disciplines, ranging from the technical to the social and from the theoretical to the applied. Early research has focused on an aspect of crowdsourcing known as micro-tasking. Micro-tasks are simple tasks (like image annotations) that anyone could perform. An emerging area is how to utilize crowdsourcing to solve problems that go beyond simple tasks towards more complex ones, that require collaboration and creativity. In juxtaposition to micro-task crowdsourcing, this book investigates macro-task crowdsourcing and its potential.

Motivation of Workers on Microtask Crowdsourcing Platforms

Motivation of Workers on Microtask Crowdsourcing Platforms PDF Author: Babak Naderi
Publisher: Springer
ISBN: 3319727001
Category : Technology & Engineering
Languages : en
Pages : 112

Get Book

Book Description
This book studies the motivation of crowdworkers to find out how to attract more people and reach a higher quality of outcomes. The book first proposes a taxonomy for studying the motivation of crowdworkers including the potential influencing factors, different types of motivation, and possible consequences and outcomes related to the motivation. Next, the CWMS questionnaire, an instrument for measuring the underlying motivation of crowdworkers is developed. It considers different dimensions of motivation suggested by the Self-Determination Theory of motivation which is a well-established and empirically validated psychological theory used in various domains. This instrument can be used to study the effect of platform and user characteristics on the general motivation of crowdworkers. Later, the task-specific motivation of crowdworkers is studied in detail: Influencing factors are investigated, subjective methods for measuring them are evaluated, a model for predicting worker’s decision on taking a task is proposed, the relative importance of different factors for two populations of crowdworkers is studied, and finally, a model for predicting the expected workload (as one of the major influencing factors) given the task design is proposed.