Presentation OutlinePresentation OutlineProject AimsIntroduction of Digital Video LibraryIntroduction of Our WorkConsiderations and ApproachDesign and ImplementationFuture Plans

Project AimsProject AimsLearn different issues about DVL

existing such as Informedia(TM) done by CMU

Implement a small-scale modelClient interface for playback of mediaProcess data source/user queries in ChineseWeb Integration

Introduction of Digital Video Introduction of Digital Video LibraryLibraryFunctions of a DVLWhy Digital Video Library?Issues about DVLTechniques Addressing DVL Issues

Functions of a DVLFunctions of a DVLStorage and play back of video

resourcesOnline access of video resourcesSearch of useful information through the

vast data collectionsRetrieval of the most relevant selections

Why Digital Video Library?Why Digital Video Library?Digital data

easy to process in an automated way takes advantage of the Internet

Multimedia contentmore attractive for education, training, sports and entertainment

Library managementAn organized way of retrieval media contents

Issues about DVLIssues about DVLBuilding Video DatabasesIndexing the Video ContentsBreaking the Video into SegmentsRetrieving Video

Building Video DatabaseBuilding Video DatabaseExtremely large space requirementChoosing a video formatOnline access of video resources

Indexing the Video ContentsIndexing the Video ContentsInaccessibility of information in videoLimitation of text-base descriptions

Tedious manual processCinematic information is complex to describe

Breaking the Video into Breaking the Video into SegmentsSegmentsVideo paragraphingAlternate representation of video

Text tileText abstractFull-text transcriptRepresentative single image“Skim” video

Retrieving VideoRetrieving VideoThree principle for searching

Let user to skim the video object quickly with their interest

Adjust the size of video Identify of desired video among multiple returned

results

Ways to achieveSmall size of video returned Information visualization

Overview of Digital Video Library System

Techniques Addressing DVL Techniques Addressing DVL IssuesIssuesSpeech Analysis

Speech recognition technology generates transcriptPauses and silence in audio help paragraphing

Image AnalysisDetect significant changes in weighted color

histogram Interpret camera motion

Natural Language ProcessingQuery processingRetrieval

Our WorkOur WorkFocus and TargetProgramming EnvironmentDesign and Implementation

System ConsiderationSystem DesignSystem Implementation

Future Plans

Focus and TargetFocus and TargetDivide the project into modules that can

be implemented in stagesdigital video preparationvideo playbackuser queryweb-integration

Programming EnvironmentProgramming EnvironmentPlatformJava as programming languageJMF API to present time-base media

Why use Java?Why use Java?Platform independenceNetwork readyInternational appealEasy to build GUIJMF API for video playbackDisadvantages?

Presenting Time-Base Media Presenting Time-Base Media with JMFwith JMFWhat is JMF?

Java Media Framework Application Programming Interface

Incorporating media data into Java

The high level architectureSimilar to traditional VCR

Data SourcePull data-source and Push data-source

Media PresentationProgrammed or Interactive controls

Design and ImplementationDesign and ImplementationSystem ConsiderationSystem DesignSystem Implementation

System ConsiderationSystem ConsiderationUser Perspective

User friendlyOther system component are transparent

Server ProgramRobust, reliable

Network IssueVideo Collections

System DesignSystem Design

Client Program

User

Query requestQuery request

Query Server

searching in database

Library Database

Server respond

Video Retrival

Watch the video

System ImplementationSystem ImplementationLibrary PreparationServer ProgramClient Program

Future PlansFuture PlansJava-applet Client ProgramSemi-auto Timestamp Editing ToolsSearching and Indexing CapabilityOther Possible Extensions

Automatically derived transcriptsLanguage processing of queries and transcriptsContent-based Image Manipulation