Web-based semantic browsing of video collectionsusing multimedia ontologies

Marco Bertini, Gianpaolo D’Amico, Andrea Ferracani, Marco Meoni and Giuseppe Serra

Media Integration and Communication Center, University of Florence, Italy

Semantic browing tool

• Interactive and user friendly content-basedsemantic browsing of video collections

• Concept cloud view for the concepts withmore instances

•Graph representation of semantic structureof ontology that describe the video domain

• Support for multiple ontologies browsingand ontology reasoning

• Thumbnails view of the instances of eachconcept that is annotated

Interactive multimedia access

• Access to video metadata and videostreaming from the in a large video player.The video player shows the position of theconcept within the whole video.

• Multiple automatic layout algorithms forspatial positioning and manual drag & drop

• Efficient web-based interface, using theRich Internet Application paradigm (RIA)Second prize in the Adobe YouGC contest, RIAcategory

Related contents

• Access to the related contents of the concept from different sources, differing from each other by color

• Enrichment of information with associated material. Improve information completeness and increase user’sknowledge with a larger number of information sources

• The system uses the publicly available APIs of YouTube as source of video contents, Flickr for images andpictures and Twitter for social and real-time content.

TM

Acknowledgments: This work was partially supported by the EU IST Vidi- Video project (www.vidivideo.info - contract FP6-045547) and EU IST IM3I project(http://www.im3i.eu/ - contract FP7-222267). The authors thank Nicola Martorana for his help in software development.

ACM Multimedia 2010 - DEMO Program http://www.micc.unifi.it/ {bertini, damico, ferracani, meoni, serra}@dsi.unifi.it