Evaluation of Text Summaries Based on Linear Optimization of Content Metrics

Evaluation of Text Summaries Based on Linear Optimization of Content Metrics PDF Author: Jonathan Rojas-Simon
Publisher: Springer Nature
ISBN: 3031072146
Category : Technology & Engineering
Languages : en
Pages : 222

Get Book Here

Book Description
This book provides a comprehensive discussion and new insights about linear optimization of content metrics to improve the automatic Evaluation of Text Summaries (ETS). The reader is first introduced to the background and fundamentals of the ETS. Afterward, state-of-the-art evaluation methods that require or do not require human references are described. Based on how linear optimization has improved other natural language processing tasks, we developed a new methodology based on genetic algorithms that optimize content metrics linearly. Under this optimization, we propose SECO-SEVA as an automatic evaluation metric available for research purposes. Finally, the text finishes with a consideration of directions in which automatic evaluation could be improved in the future. The information provided in this book is self-contained. Therefore, the reader does not require an exhaustive background in this area. Moreover, we consider this book the first one that deals with the ETS in depth.

Evaluation of Text Summaries Based on Linear Optimization of Content Metrics

Evaluation of Text Summaries Based on Linear Optimization of Content Metrics PDF Author: Jonathan Rojas-Simon
Publisher: Springer Nature
ISBN: 3031072146
Category : Technology & Engineering
Languages : en
Pages : 222

Get Book Here

Book Description
This book provides a comprehensive discussion and new insights about linear optimization of content metrics to improve the automatic Evaluation of Text Summaries (ETS). The reader is first introduced to the background and fundamentals of the ETS. Afterward, state-of-the-art evaluation methods that require or do not require human references are described. Based on how linear optimization has improved other natural language processing tasks, we developed a new methodology based on genetic algorithms that optimize content metrics linearly. Under this optimization, we propose SECO-SEVA as an automatic evaluation metric available for research purposes. Finally, the text finishes with a consideration of directions in which automatic evaluation could be improved in the future. The information provided in this book is self-contained. Therefore, the reader does not require an exhaustive background in this area. Moreover, we consider this book the first one that deals with the ETS in depth.

Explainable AI Within the Digital Transformation and Cyber Physical Systems

Explainable AI Within the Digital Transformation and Cyber Physical Systems PDF Author: Moamar Sayed-Mouchaweh
Publisher: Springer Nature
ISBN: 3030764095
Category : Technology & Engineering
Languages : en
Pages : 201

Get Book Here

Book Description
This book presents Explainable Artificial Intelligence (XAI), which aims at producing explainable models that enable human users to understand and appropriately trust the obtained results. The authors discuss the challenges involved in making machine learning-based AI explainable. Firstly, that the explanations must be adapted to different stakeholders (end-users, policy makers, industries, utilities etc.) with different levels of technical knowledge (managers, engineers, technicians, etc.) in different application domains. Secondly, that it is important to develop an evaluation framework and standards in order to measure the effectiveness of the provided explanations at the human and the technical levels. This book gathers research contributions aiming at the development and/or the use of XAI techniques in order to address the aforementioned challenges in different applications such as healthcare, finance, cybersecurity, and document summarization. It allows highlighting the benefits and requirements of using explainable models in different application domains in order to provide guidance to readers to select the most adapted models to their specified problem and conditions. Includes recent developments of the use of Explainable Artificial Intelligence (XAI) in order to address the challenges of digital transition and cyber-physical systems; Provides a textual scientific description of the use of XAI in order to address the challenges of digital transition and cyber-physical systems; Presents examples and case studies in order to increase transparency and understanding of the methodological concepts.

Pattern Recognition

Pattern Recognition PDF Author: Osslan Osiris Vergara-Villegas
Publisher: Springer Nature
ISBN: 3031077504
Category : Computers
Languages : en
Pages : 377

Get Book Here

Book Description
This book constitutes the proceedings of the 14th Mexican Conference on Pattern Recognition, MCPR 2022, which was held in planned to be held Ciudad Juárez, Mexico, in June 2022. The 33 papers presented in this volume were carefully reviewed and selected from 66 submissions. They are organized in the following topical sections: pattern recognition techniques; neural networks and deep learning; image and signal processing and analysis; natural language processing and recognition; robotics and remote sensing applications of pattern recognition; medical applications of pattern recognition.

Text Summarization Evaluation: Correlating Human Performance on an Extrinsic Task with Automatic Intrinsic Metrics

Text Summarization Evaluation: Correlating Human Performance on an Extrinsic Task with Automatic Intrinsic Metrics PDF Author:
Publisher:
ISBN:
Category :
Languages : en
Pages : 110

Get Book Here

Book Description
This research describes two types of summarization evaluation methods, intrinsic and extrinsic, and concentrates on determining the level of correlation between automatic intrinsic methods and human task-based extrinsic evaluation performance. Suggested experiments and preliminary findings related to exploring correlations and factors affecting correlation (method of summarization, quality of summary, type of intrinsic method used, and genre of source documents) are detailed. A new measurement technique for task-based evaluations, Relevance Prediction, is introduced and contrasted with the current gold-standard based measurements of the summarization evaluation community. Preliminary experimental findings suggest that the Relevance Prediction method yields better performance measurements with human summaries than that of the LDC-Agreement method and that small correlations are seen with one of the automatic intrinsic evaluation metrics and human task-based performance results.

Toxic & Figurative Language Detection and Evaluation Metric for Abstractive and Extractive Summarization in Social Media Content

Toxic & Figurative Language Detection and Evaluation Metric for Abstractive and Extractive Summarization in Social Media Content PDF Author: Ramya Nischala Akula
Publisher:
ISBN:
Category :
Languages : en
Pages : 0

Get Book Here

Book Description
With the online presence of more than half the world population, social networks and social media plays a very important role in the lives of individuals as well as businesses alike. While there are advantages to using these online platforms, there as also downsides that one should be wary about. We focus on analyzing the information or the content that spreads on online platforms. Text summarization is a crucial task that helps in condensing an enormous amount of social media content. While there are multiple approaches to text summarization, the development of an automatic metric to evaluate the generated summaries remains an open problem in text summarization. We propose a novel evaluation metric, Sentence Pair EmbEDdings (SPEED) Score, for text summarization which is based on semantic similarity between sentence pairs. Our proposed evaluation metric shows an impressive performance in evaluating both abstractive and extractive summarization models and is faster than the current state-of-the-art metrics. In this research, we also put forward a multi-source transfer learning approach using models pre-trained on large-scale datasets to detect inappropriate social media content in universal language (English) and code-mixed environments. Here, sentiment analysis is the process of identifying the emotion associated with these social media texts. The presence of sarcasm in texts is the main hindrance in the performance of sentiment analysis. Inherent ambiguity in sarcastic expressions, make sarcasm detection very difficult. In this work, we focus on detecting sarcasm in textual conversations from various social networking platforms and online media. To this end, we develop an interpretable deep learning model that uses attention to identify crucial sarcastic cue words from the input.

MultiMedia Modeling

MultiMedia Modeling PDF Author: Klaus Schoeffmann
Publisher: Springer
ISBN: 3319736035
Category : Computers
Languages : en
Pages : 669

Get Book Here

Book Description
The two-volume set LNCS 10704 and 10705 constitutes the thoroughly refereed proceedings of the 24th International Conference on Multimedia Modeling, MMM 2018, held in Bangkok, Thailand, in February 2018. Of the 185 full papers submitted, 46 were selected for oral presentation and 28 for poster presentation; in addition, 5 papers were accepted for Multimedia Analytics: Perspectives, Techniques, and Applications, 12 extended abstracts for demonstrations ,and 9 accepted papers for Video Browser Showdown 2018. All papers presented were carefully reviewed and selected from 185 submissions.

Research evaluation metrics

Research evaluation metrics PDF Author: Das, Anup Kumar
Publisher: UNESCO Publishing
ISBN: 9231000829
Category :
Languages : en
Pages : 122

Get Book Here

Book Description
Traducción parcial de la Introducción: "En la actualidad, la evaluación de la investigaciones es una cuestión que se está replanteando en todo el mundo. En algunos casos, los trabajos de investigación están generando resultados muy buenos, en la mayoría de los casos los resultados son mediocres, y en algunos casos negativos. Por todo esto, la evaluación de los resultados de la investigación se convierte en una condición sine qua non. Cuando el número de investigadores eran menos, eran los propios colegas de profesión quienes evaluaban la investigación. Con el paso del tiempo, el número de investigadores aumentó, las áreas de investigación proliferaron, los resultados de la investigación se multiplicaron. La tendencia continuó y después de la Segunda Guerra Mundial, la investigación comenzó a crecer exponencialmente. Hoy en día, incluso en una estimación moderada hay alrededor de más de un millón de investigadores y producen más de dos millón de trabajos de investigación y otros documentos por año. En este contexto, la evaluación de la investigación es una cuestión de primera importancia. Para cualquier promoción, acreditación, premio y beca puede haber decenas o cientos de nominados. De entre éstos, seleccionar el mejor candidato es una cuestión difícil de determinar. Las evaluaciones inter pares en muchos casos están demostrando ser subjetivas. En 1963 se crea Science Citation Index (SCI) que cubre la literatura científica desde 1961. Unos años después, Eugene Garfield, fundador del SCI, preparó una lista de los 50 autores científicos más citados basándose en las citas que recibía el trabajo de un autor por parte de los trabajos de otros colegas de investigación. El documento titulado "¿Pueden predecirse los ganadores del Premio Nobel? 'Fue publicado en 1968 (Garfield y Malin, 1968). En el siguiente año es decir, 1969, dos científicos que figuran en la lista, por ejemplo, Derek HR Barton y Murray Gell-Mann recibieron el codiciado premio. Esto reivindicó la utilidad del análisis de citas. Cada año, varios científicos pertenecientes al campo de la Física, Química, Fisiología y Medicina reciben el Premio Nobel. De esta manera el análisis de citas se convirtió en una herramienta útil. Sin embargo, el análisis de citas siempre tuvo críticas y múltiples fallas. Incluso Garfield comentó - "El Uso del análisis de citas de los trabajos de evaluación es una tarea difícil. Existen muchas posibilidades de error '(Garfiled, 1983). Para la evaluación de la investigación, se necesitaban algunos otros indicadores. El análisis de citas, junto con la revisión por pares garantiza el mejor juicio en innumerables casos. Pero se necesita algo que sea más exacto. La llegada de la World Wide Web (WWW) brindó la oportunidad; pues un buen número de indicadores se están generando a partir de los datos disponibles en la WWW". (Trad. Julio Alonso Arévalo. Univ. Salamanca).

Artificial Intelligence and Evolutionary Computations in Engineering Systems

Artificial Intelligence and Evolutionary Computations in Engineering Systems PDF Author: Subhransu Sekhar Dash
Publisher: Springer
ISBN: 9811031746
Category : Technology & Engineering
Languages : en
Pages : 842

Get Book Here

Book Description
The volume is a collection of high-quality peer-reviewed research papers presented in the International Conference on Artificial Intelligence and Evolutionary Computation in Engineering Systems (ICAIECES 2016) held at SRM University, Chennai, Tamilnadu, India. This conference is an international forum for industry professionals and researchers to deliberate and state their research findings, discuss the latest advancements and explore the future directions in the emerging areas of engineering and technology. The book presents original work and novel ideas, information, techniques and applications in the field of communication, computing and power technologies.

Natural Language Generation Systems

Natural Language Generation Systems PDF Author: David D. McDonald
Publisher: Springer Science & Business Media
ISBN: 1461238463
Category : Language Arts & Disciplines
Languages : en
Pages : 401

Get Book Here

Book Description
Natural language generation is a field within artificial intelligence which looks ahead to the future when machines will communicate complex thoughts to their human users in a natural way. Generation systems supply the sophisticated knowledge about natural languages that must come into play when one needs to use wordings that will overpower techniques based only on symbolic string manipulation techniques. Topics covered in this volume include discourse theory, mechanical translation, deliberate writing, and revision. Natural Language Generation Systems contains contributions by leading researchers in the field. Chapters contain details of grammatical treatments and processing seldom reported on outside of full length monographs.

Evaluating Natural Language Processing Systems

Evaluating Natural Language Processing Systems PDF Author: Karen Sparck Jones
Publisher: Springer Science & Business Media
ISBN: 9783540613091
Category : Computers
Languages : en
Pages : 256

Get Book Here

Book Description
This book is about the patterns of connections between brain structures. It reviews progress on the analysis of neuroanatomical connection data and presents six different approaches to data analysis. The results of their application to data from cat and monkey cortex are explored. This volume sheds light on the organization of the brain that is specified by its wiring.