Multimedia Ontology: Representation and Applications, 1st Edition (Paperback) book cover

Multimedia Ontology

Representation and Applications, 1st Edition

By Santanu Chaudhury, Anupama Mallik, Hiranmay Ghosh

Chapman and Hall/CRC

304 pages | 108 B/W Illus.

Purchasing Options:$ = USD
Paperback: 9780367445829
pub: 2020-03-31
SAVE ~$14.99
Available for pre-order. Item will ship after 31st March 2020
Hardback: 9781482236347
pub: 2015-06-26
SAVE ~$19.59
eBook (VitalSource) : 9780429160899
pub: 2015-06-26
from $37.48

FREE Standard Shipping!


The result of more than 15 years of collective research, Multimedia Ontology: Representation and Applications provides a theoretical foundation for understanding the nature of media data and the principles involved in its interpretation. The book presents a unified approach to recent advances in multimedia and explains how a multimedia ontology can fill the semantic gap between concepts and the media world. It relays real-life examples of implementations in different domains to illustrate how this gap can be filled.

The book contains information that helps with building semantic, content-based search and retrieval engines and also with developing vertical application-specific search applications. It guides you in designing multimedia tools that aid in logical and conceptual organization of large amounts of multimedia data. As a practical demonstration, it showcases multimedia applications in cultural heritage preservation efforts and the creation of virtual museums.

The book describes the limitations of existing ontology techniques in semantic multimedia data processing, as well as some open problems in the representations and applications of multimedia ontology. As an antidote, it introduces new ontology representation and reasoning schemes that overcome these limitations. The long, compiled efforts reflected in Multimedia Ontology: Representation and Applications are a signpost for new achievements and developments in efficiency and accessibility in the field.

Table of Contents


The Multimedia Wave

Semantic Multimedia Web: Bridging the Semantic Gap

Multimedia Web Ontology Language

Organization of the Book

Ontology and the Semantic Web


Evolution of the Semantic Web

Semantic Web Technologies

What is an Ontology

Formal Ontology Definition

Ontology Representation


Characterizing Multimedia Semantics


A First Look at Multimedia Semantics

Percepts, Concepts, Knowledge and Expressions

Representing Multimedia Semantics

Semantic Web Technologies and Multimedia


Ontology Representations for Multimedia


An Overview of MPEG-7 and MPEG-21

MPEG-7 Ontologies

Using MPEG-7 Ontology for Applications

Multimedia Concept Modeling

Ontology Applications


Multimedia Web Ontology Language


Perceptual Modeling of Domains

An Overview of the Multimedia Web Ontology Language

MOWL: Concepts, Media Observables and Media Relations

MOWL: Spatio-temporal Constructs for Complex Events

MOWL Language Constructs

The Observation Model

MOWL Inferencing Framework

Reasoning Modes with Bayesian Network and MOWL


Modeling the Semantics of Multimedia Content


Data Driven Learning for Multimedia Semantics Extraction

Media Features for Semantic Modeling

Semantic Classification of Multimedia Content

Use of Ontology for Semantic Classification


Learning Multimedia Ontology


State of the Art in Ontology Learning

Learning an Ontology from Multimedia Data

Ontology-based Management of Multimedia Resources

Application of Multimedia Ontology Learning

Concluding Remarks

Applications Exploiting Multimedia Semantics


Multimedia Retrieval and Classification

Recommendation of Media-rich Commodities

Information Integration from Open Resources


Distributed Multimedia Applications


Challenges for Web-scale Multimedia Data Access

Architectures for Distributed Multimedia Data Processing

Peer-to-Peer Architecture

Multi-agent Architecture for Distributed Multimedia Systems

Ontology Alignment

Knowledge-based Access to Massively Distributed Multimedia


Application of Multimedia Ontology in Heritage Preservation


Preserving the Intangible Heritage of Indian Classical Dance

Intellectual Journey: Space-Time Traversal Using an Ontology

Cross-modal Query and Retrieval


Open Problems and Future Directions

Knowledge and Human Society

Knowledge Organization and Formal Representation

The Perceptual World and MOWL

The Big Debate: Data Driven vs. Knowledge Driven Approaches

Looking Forward: Convergence Between Knowledge-based and Data


A: MOWL Schema in Notation

B: MOWL Syntax Structural Specification

C: Examples of WSDL Specification for Media Pattern Detectors

About the Authors

Santanu Chaudhury did his BTech (1984) in Electronics and Electrical Communication Engineering and PhD (1989) in Computer Science and Engineering from Indian Institute of Technology (IIT), Kharagpur, India. Currently, he is a professor in the Department of Electrical Engineering at IIT Delhi. He was also Dean, Undergraduate Studies at IIT Delhi. He was awarded INSA medal for young scientists in 1993. He is a fellow of Indian National Academy of Engineering and National Academy of Sciences, India. He is also a fellow of the International Association of Pattern Recognition. His research interests are in the areas of Computer Vision, Artificial Intelligence and Multimedia Systems. He has published more than 150 papers in international journals and conference proceedings. He has been on the programme committee of a number of international conferences, including ICCV, ACCV, ICPR, ICVGIP, and PReMI.

Anupama Mallik did her BSc (1986) in Physics and Masters in Computer Applications (1989) from Delhi University, and PhD (2012) in Electrical Engineering from the Indian Institute of Technology (IIT), Delhi. Her PhD thesis dealt with ontology based exploration of multimedia contents. She is associated with Multimedia research group of the Electrical Engineering Department, IIT Delhi and has worked as a Research Scientist in projects sponsored by the Department of Science and Technology, Government of India. Her current research interests include Semantic web based applications, multimedia ontology, ontology applications in Internet of Things, and in cultural heritage preservation. She is a visiting faculty at the Indraprastha Institute of Information Technology, Delhi (IIIT-D). She is a member of the ACM.

Hiranmay Ghosh is a principal scientist with TCS Innovation Labs Delhi and leads its multimedia research track. He received his PhD from IIT, Delhi and his BTech and BSc degrees from the University of Calcutta. His current research interests include multimedia systems, knowledge representation and reasoning, semantic web, intelligent agents, cognitive models and robotics. He is an adjunct faculty member of the Electrical Engineering Department of IIT, Delhi and is associated with its multimedia research group. He is a member of the academic advisory committee of IIT, Ropar. He is a senior member of the Institute of Electrical and Electronics Engineers (IEEE), and a member of ACM and IUPRAI.

Subject Categories

BISAC Subject Codes/Headings:
COMPUTERS / Programming / Games
COMPUTERS / Database Management / Data Mining
COMPUTERS / Internet / General