NGI Summer ProjectNGI Summer Project

Streaming Media Extensionsto Open Mash and Indiva

Allan Gu

NGI Summer Research (8/02) 2

Multicast BackboneMulticast Backbone(Mbone)(Mbone)

MulticastDistribution of IP packets to many hosts

Many-to-many communication

Mbone ToolsNSDR

VAT/RAT

VIC

NGI Summer Research (8/02) 3

NSDRNSDR SAP listener SAP announcer

NGI Summer Research (8/02) 4

VAT/RATVAT/RAT

Audio tool Participants talk

to each other

NGI Summer Research (8/02) 5

VICVIC Viewer Encoder

NGI Summer Research (8/02) 6

OpenMashOpenMash

Comprehensive toolkitCollection of Mbone toolsOpen source

NGI Summer Research (8/02) 7

ProblemsProblems

VIC displays useless streamSave screen real estateSave resources

Cache of multicast sessionsWeb interface

NGI Summer Research (8/02) 8

NGI Summer Research (8/02) 9

Blue StreamBlue StreamCamera OffEncoder encodes default blue

NGI Summer Research (8/02) 10

Algorithm to RemoveAlgorithm to RemoveBlue StreamBlue Stream

Check YUV frame

5 blocks of 4 pixels

Compare Y, U, V with known color

Blue is (Y,U,V) = (35, 212, 114)

NGI Summer Research (8/02) 11

Black StreamBlack Stream

Lights Off Can’t

compare Different

black Error not

black

NGI Summer Research (8/02) 12

Algorithm to RemoveAlgorithm to RemoveBlack StreamBlack Stream

Examine 20 blocks of 4 pixels eachNeed more samples to detect

Count number of values within ranges4 BINS (3 Black, 1 Other)

Also compute average value of pixelsBlack if satisfy certain condition

50% of pixels is true black (Y<16, 120<U&V <136)

AvgY<28, 120<avgU&avgV<136

NGI Summer Research (8/02) 13

Remove StreamRemove Stream

Drop packets from senderRemove thumbnail Callback to test stream later

Accept packet and check if still black or blue

If not black or blue, put back thumbnail

If still black or blue, register another callback

NGI Summer Research (8/02) 14

NGI Summer Research (8/02) 15

Indiva: Middleware for Streaming Indiva: Middleware for Streaming Media Equipment and ResourcesMedia Equipment and ResourcesNFS metaphor

Application mounts a server and issues commands

High level commandse.g., encode, move, copy, link, mkses, etc.

Bridge conventional audio/video environment and streaming media

Hide physical connections and control interfacesAllocate paths through conventional routing switchesAllocate encoding/decoding resources in a broadcast center

NGI Summer Research (8/02) 16

ISAPISAP

Cache of active Mbone sessionsClone of NSDR

Web interface

Run continuously

Well-known address for SAP 224.2.127.254/9875

A web-cast guide

NGI Summer Research (8/02) 17

ISAPISAP

Parse message according to IETF protocol

Execute indiva manager to create conference

Associate callbackAfter 30 minute, delete conference

Future – click link to participate in session

NGI Summer Research (8/02) 18

NGI Summer Research (8/02) 19

NGI Summer Research (8/02) 20

Future ResearchFuture Research

RTP a/v synchronizationA “time-based corrector” for RTP packet streams

Implement new Indiva services and applications

Ncast Telepresenter service

Webcast control apps

…

NGI Summer Research (8/02) 21

AcknowledgementAcknowledgement

NGILarry RoweWei Tsang OoiPeter PletcherJose Maria Gonzalez…and the entire OpenMash

community

NGI Summer Research (8/02) 22

For More InformationFor More Information

http://www.openmash.orghttp://www.bmrc.berkeley.edu/

frame/projects/indiva/