Semantic Multimedia Analysis Using Knowledge and Context

Semantic Multimedia Analysis Using Knowledge and Context PDF Author: Spyridon Nikolopoulos
Publisher:
ISBN:
Category :
Languages : en
Pages :

Get Book Here

Book Description
The difficulty of semantic multimedia analysis can be attributed to the extended diversity in form and appearance exhibited by the majority of semantic concepts and the difficulty to express them using a finite number of patterns. In meeting this challenge there has been a scientific debate on whether the problem should be addressed from the perspective of using overwhelming amounts of training data to capture all possible instantiations of a concept, or from the perspective of using explicit knowledge about the concepts' relations to infer their presence. In this thesis we address three problems of pattern recognition and propose solutions that combine the knowledge extracted implicitly from training data with the knowledge provided explicitly in structured form. First, we propose a BNs modeling approach that defines a conceptual space where both domain related evi- dence and evidence derived from content analysis can be jointly considered to support or disprove a hypothesis. The use of this space leads to sig- nificant gains in performance compared to analysis methods that can not handle combined knowledge. Then, we present an unsupervised method that exploits the collective nature of social media to automatically obtain large amounts of annotated image regions. By proving that the quality of the obtained samples can be almost as good as manually annotated images when working with large datasets, we significantly contribute towards scal- able object detection. Finally, we introduce a method that treats images, visual features and tags as the three observable variables of an aspect model and extracts a set of latent topics that incorporates the semantics of both visual and tag information space. By showing that the cross-modal depen- dencies of tagged images can be exploited to increase the semantic capacity of the resulting space, we advocate the use of all existing information facets in the semantic analysis of social media.

Semantic Multimedia Analysis Using Knowledge and Context

Semantic Multimedia Analysis Using Knowledge and Context PDF Author: Spyridon Nikolopoulos
Publisher:
ISBN:
Category :
Languages : en
Pages :

Get Book Here

Book Description
The difficulty of semantic multimedia analysis can be attributed to the extended diversity in form and appearance exhibited by the majority of semantic concepts and the difficulty to express them using a finite number of patterns. In meeting this challenge there has been a scientific debate on whether the problem should be addressed from the perspective of using overwhelming amounts of training data to capture all possible instantiations of a concept, or from the perspective of using explicit knowledge about the concepts' relations to infer their presence. In this thesis we address three problems of pattern recognition and propose solutions that combine the knowledge extracted implicitly from training data with the knowledge provided explicitly in structured form. First, we propose a BNs modeling approach that defines a conceptual space where both domain related evi- dence and evidence derived from content analysis can be jointly considered to support or disprove a hypothesis. The use of this space leads to sig- nificant gains in performance compared to analysis methods that can not handle combined knowledge. Then, we present an unsupervised method that exploits the collective nature of social media to automatically obtain large amounts of annotated image regions. By proving that the quality of the obtained samples can be almost as good as manually annotated images when working with large datasets, we significantly contribute towards scal- able object detection. Finally, we introduce a method that treats images, visual features and tags as the three observable variables of an aspect model and extracts a set of latent topics that incorporates the semantics of both visual and tag information space. By showing that the cross-modal depen- dencies of tagged images can be exploited to increase the semantic capacity of the resulting space, we advocate the use of all existing information facets in the semantic analysis of social media.

Semantic Multimedia Analysis and Processing

Semantic Multimedia Analysis and Processing PDF Author: Evaggelos Spyrou
Publisher: CRC Press
ISBN: 1351831836
Category : Computers
Languages : en
Pages : 555

Get Book Here

Book Description
Broad in scope, Semantic Multimedia Analysis and Processing provides a complete reference of techniques, algorithms, and solutions for the design and the implementation of contemporary multimedia systems. Offering a balanced, global look at the latest advances in semantic indexing, retrieval, analysis, and processing of multimedia, the book features the contributions of renowned researchers from around the world. Its contents are based on four fundamental thematic pillars: 1) information and content retrieval, 2) semantic knowledge exploitation paradigms, 3) multimedia personalization, and 4) human-computer affective multimedia interaction. Its 15 chapters cover key topics such as content creation, annotation and modeling for the semantic web, multimedia content understanding, and efficiency and scalability. Fostering a deeper understanding of a popular area of research, the text: Describes state-of-the-art schemes and applications Supplies authoritative guidance on research and deployment issues Presents novel methods and applications in an informative and reproducible way Contains numerous examples, illustrations, and tables summarizing results from quantitative studies Considers ongoing trends and designates future challenges and research perspectives Includes bibliographic links for further exploration Uses both SI and US units Ideal for engineers and scientists specializing in the design of multimedia systems, software applications, and image/video analysis and processing technologies, Semantic Multimedia Analysis and Processing aids researchers, practitioners, and developers in finding innovative solutions to existing problems, opening up new avenues of research in uncharted waters.

Semantic Multimedia and Ontologies

Semantic Multimedia and Ontologies PDF Author: Yiannis Kompatsiaris
Publisher: Springer Science & Business Media
ISBN: 1848000766
Category : Computers
Languages : en
Pages : 297

Get Book Here

Book Description
This comprehensive book draws together experts to explore how knowledge technologies can be exploited to create new multimedia applications, and how multimedia technologies can provide new contexts for the use of knowledge technologies. Thorough coverage of all relevant topics is given. The step-by-step approach guides the reader from fundamental enabling technologies of ontologies, analysis and reasoning, through to applications which have hitherto had less attention.

Multimedia Semantics

Multimedia Semantics PDF Author: Raphael Troncy
Publisher: John Wiley & Sons
ISBN: 1119970628
Category : Technology & Engineering
Languages : en
Pages : 234

Get Book Here

Book Description
In this book, the authors present the latest research results in the multimedia and semantic web communities, bridging the "Semantic Gap" This book explains, collects and reports on the latest research results that aim at narrowing the so-called multimedia "Semantic Gap": the large disparity between descriptions of multimedia content that can be computed automatically, and the richness and subjectivity of semantics in user queries and human interpretations of audiovisual media. Addressing the grand challenge posed by the "Semantic Gap" requires a multi-disciplinary approach (computer science, computer vision and signal processing, cognitive science, web science, etc.) and this is reflected in recent research in this area. In addition, the book targets an interdisciplinary community, and in particular the Multimedia and the Semantic Web communities. Finally, the authors provide both the fundamental knowledge and the latest state-of-the-art results from both communities with the goal of making the knowledge of one community available to the other. Key Features: Presents state-of-the art research results in multimedia semantics: multimedia analysis, metadata standards and multimedia knowledge representation, semantic interaction with multimedia Contains real industrial problems exemplified by user case scenarios Offers an insight into various standardisation bodies including W3C, IPTC and ISO MPEG Contains contributions from academic and industrial communities from Europe, USA and Asia Includes an accompanying website containing user cases, datasets, and software mentioned in the book, as well as links to the K-Space NoE and the SMaRT society web sites (http://www.multimediasemantics.com/) This book will be a valuable reference for academic and industry researchers /practitioners in multimedia, computational intelligence and computer science fields. Graduate students, project leaders, and consultants will also find this book of interest.

Semantic Multimedia Analysis and Processing

Semantic Multimedia Analysis and Processing PDF Author: Evaggelos Spyrou
Publisher: CRC Press
ISBN: 1466575506
Category : Computers
Languages : en
Pages : 555

Get Book Here

Book Description
Broad in scope, Semantic Multimedia Analysis and Processing provides a complete reference of techniques, algorithms, and solutions for the design and the implementation of contemporary multimedia systems. Offering a balanced, global look at the latest advances in semantic indexing, retrieval, analysis, and processing of multimedia, the book features the contributions of renowned researchers from around the world. Its contents are based on four fundamental thematic pillars: 1) information and content retrieval, 2) semantic knowledge exploitation paradigms, 3) multimedia personalization, and 4) human-computer affective multimedia interaction. Its 15 chapters cover key topics such as content creation, annotation and modeling for the semantic web, multimedia content understanding, and efficiency and scalability. Fostering a deeper understanding of a popular area of research, the text: Describes state-of-the-art schemes and applications Supplies authoritative guidance on research and deployment issues Presents novel methods and applications in an informative and reproducible way Contains numerous examples, illustrations, and tables summarizing results from quantitative studies Considers ongoing trends and designates future challenges and research perspectives Includes bibliographic links for further exploration Uses both SI and US units Ideal for engineers and scientists specializing in the design of multimedia systems, software applications, and image/video analysis and processing technologies, Semantic Multimedia Analysis and Processing aids researchers, practitioners, and developers in finding innovative solutions to existing problems, opening up new avenues of research in uncharted waters.

Semantic Multimedia

Semantic Multimedia PDF Author: David Duke
Publisher: Springer
ISBN: 3540922350
Category : Computers
Languages : en
Pages : 189

Get Book Here

Book Description
WearepleasedtowelcomeyoutotheproceedingsoftheThirdInternationalC- ference onSemantic andDigital Media Technologiesheld inKoblenz,Germany. The SAMT agenda brings together researchers at extreme ends of the - mantic multimedia spectrum. At one end, the Semantic Web and its supporting technologies are becoming established in both the open data environment and within specialist domains, such as corporate intranet search, e-Science (parti- larly life sciences), and cultural heritage. To facilitate the world-wide sharing of media, W3C is developing standard ways of denoting fragments of audio/visual content and of specifying and associating semantics with these. At the other end of the spectrum, media analysis tools continue to grow in sophistication, identifying features that can then be associated with explicit semantics, be they expressed formally or informally, using proprietary formats or open standards. Recent progress at these two fronts of the SAMT spectrum means that research spanningthesemanticgapisnowofvitalimportancetofeedtherealapplications that are emerging. This conference also represents a step towards bridging the gap between the research cultures and their respective approaches at both ends of the spectrum. The papers selected show that SAMT is able to attract researchers from media analysis, who see the bene?ts that more explicit semantics can provide, as well as researchers from knowledge engineering who realize that, while a picture can be expressed as a thousand concepts, a million morearewaiting to be extracted.

Multimedia Content and the Semantic Web

Multimedia Content and the Semantic Web PDF Author: Giorgos Stamou
Publisher: John Wiley & Sons
ISBN: 0470857633
Category : Technology & Engineering
Languages : en
Pages : 414

Get Book Here

Book Description
The emerging idea of the semantic web is based on the maximum automation of the complete knowledge lifecycle processes: knowledge representation, acquisition, adaptation, reasoning, sharing and use. Text-based based browsers involve a costly information-retrieval process: descriptions are inherently subjective and usage is often confined to the specific application domain for which the descriptions were created. Automatic extracted audiovisual features are, in general, more objective, domain-independent and can be native to the audiovisual content. This book seeks to draw together in one concise volume the findings of leading researchers from around the globe. The focus, in particular, is on the MPEG-7 and MPEG-21 standards that seek to consolidate and render effective the infrastructure for the delivery and management of multimedia content. Provides thorough coverage of all relevant topics, including structure identification in audiovisual documents, object-based video indexing, multimedia indexing and retrieval using natural language, speech and image processing methods Contains detailed advice on ontology representation and querying for realizing semantics-driven applications Includes cutting-edge information on multimedia content description in MPEG-7 and MPEG-21 Illustrates all theory with real-world case studies gleaned from state-of-the-art worldwide research. The contributors are pioneers in the fields of multimedia analysis and knowledge technologies This unified, comprehensive up-to-date resource will appeal to integrators, systems suppliers, managers and consultants in the area of knowledge management and information retrieval; particularly those concerned with the automation of the semantic web. The detailed, theory-based practical advice is also essential reading for postgraduates and researchers in these fields.

Semantic Multimedia

Semantic Multimedia PDF Author: David Duke
Publisher: Springer Science & Business Media
ISBN: 3540922342
Category : Computers
Languages : en
Pages : 189

Get Book Here

Book Description
WearepleasedtowelcomeyoutotheproceedingsoftheThirdInternationalC- ference onSemantic andDigital Media Technologiesheld inKoblenz,Germany. The SAMT agenda brings together researchers at extreme ends of the - mantic multimedia spectrum. At one end, the Semantic Web and its supporting technologies are becoming established in both the open data environment and within specialist domains, such as corporate intranet search, e-Science (parti- larly life sciences), and cultural heritage. To facilitate the world-wide sharing of media, W3C is developing standard ways of denoting fragments of audio/visual content and of specifying and associating semantics with these. At the other end of the spectrum, media analysis tools continue to grow in sophistication, identifying features that can then be associated with explicit semantics, be they expressed formally or informally, using proprietary formats or open standards. Recent progress at these two fronts of the SAMT spectrum means that research spanningthesemanticgapisnowofvitalimportancetofeedtherealapplications that are emerging. This conference also represents a step towards bridging the gap between the research cultures and their respective approaches at both ends of the spectrum. The papers selected show that SAMT is able to attract researchers from media analysis, who see the bene?ts that more explicit semantics can provide, as well as researchers from knowledge engineering who realize that, while a picture can be expressed as a thousand concepts, a million morearewaiting to be extracted.

Semantic Multimedia

Semantic Multimedia PDF Author: Yannis Avrithis
Publisher: Springer
ISBN: 3540493379
Category : Computers
Languages : en
Pages : 252

Get Book Here

Book Description
This book constitutes the refereed proceedings of the First International Conference on Semantics and Digital Media Technologies, SAMT 2006, held in Athens, Greece in December 2006. The 17 revised full papers address a wide area of integrative research on new knowledge-based forms of digital media systems, semantics, and low-level multimedia processing.

Managing Multimedia Semantics

Managing Multimedia Semantics PDF Author: Uma Srinivasan
Publisher: IGI Global
ISBN: 1591405432
Category : Computers
Languages : en
Pages : 409

Get Book Here

Book Description
"This book is aimed at researchers and practitioners involved in designing and managing complex multimedia information systems"--Provided by publisher.