Architecture & Data Management of Architecture & Data Management of XML-Based Digital Video Library XML-Based Digital Video Library

SystemSystem

Jacky C.K. Ma

Michael R. Lyu

Presentation Outline Introduction System Architecture

Video Server Indexing Server Query Server Client Application

Data Management Multimedia Content Description Multimedia Framework

i-View Java Client Synchronization Manager

Future Works

Introduction to XDVL

Search among a huge collection of digital video files

Include process from video creation to video delivery, plus other features

Adopt a multi-tier model to increase usability, extensibility, and reliability

Employ XML as an open standard framework in DVL data management

System Architecture

Four primary components: Video Server Indexing Server Query Server Client Applications

Single DVL-Workstation or distributed system over the Internet

Overview of a DVL System

Online Process

Offline ProcessVideo Server Indexing ServerIndexing the Video Contents

Query ServerClient Application

Raw

Vid

eo

User Query

Result SetFo

rmal

Que

ry

Res

ult S

et

Req

uest

Vid

eo

Del

iver

Vid

eo

Digital Video Library Network

Video Server

Video Server

Video Server

Indexing Server

Indexing Server

Indexing Server

QueryServer

QueryServer

QueryServer

Video Server

Storage subsystem Video capturing (video conversion) Video segmentation and storing Video streaming

Indexing Server

Meta-data subsystem Extract and store video features

Raw textual information Physical information Semantic information

Text-based or content-based query

Query Server

Information portal subsystem Accept queries from client application Send optimized queries to appropriate

Indexing Servers Collect and rank results Varies information retrieval model

Client Application

Presentation subsystem Query submission Query result presentation Video playback

Java Applet Client

Query Window

Thumbnail videos

for search results

Highlights of

video contents

Search by keywords Script Window with running highlights

Video Window

Data Management

Identifying and managing media content Enable “quality access” to content XML

Semi-structured leads to flexibility Maintains interoperability Transparent to most networks

Multimedia Content Description

MPEG-7 Proposed standard for describing the

multimedia content Support both human users and automatic

systems that process audiovisual information

Content Descriptors

Production Information Usage Information Physical Information Structural Feature Low Level Feature Conceptual Information Presentation Information References Interaction Information Form Conditions for accessing the material Classification Links to other relevant material The Context

Multimedia Framework

MEG-21 A common multimedia framework To facilitate co-operation between different

parties in the multimedia industry Includes models, rules, procedures, and

content formats

Elements in Multimedia Framework

Digital Item Declaration Digital Item Identification and Description Content Handling and Usage Intellectual Property Management and Protection Terminals and Networks Content Representation Event Reporting

i-View Java Client

Client Application of a DVL under the VIEW technology

Infrastructure components Communication manager Synchronization manager

Media Presentation components Result pane Text search query pane Key frame presentation pane Transcription presentation pane Map presentation pane

Synchronization Manager

Provide a single point of control/dependency for all component operations

Incoming XML stream will be digested and dispatched Notifies each component for the time and events Use Message Dispatcher and Component Registry to

get the status and attributes of each presentation components

Allow flexible plugging of presentation components

Future Research Work

Compare and investigate mechanisms on using XML in system synchronization

Investigate the feasibility of introducing MPEG-7 and MPEG-21 into the synchronization

Q&A