88
Course Matters

Course Matters. Recent Papers from journals Good Posters Bad Posters

Embed Size (px)

Citation preview

Page 1: Course Matters. Recent Papers from journals Good Posters Bad Posters

Course Matters

Page 2: Course Matters. Recent Papers from journals Good Posters Bad Posters

Recent Papers

from journals

Page 3: Course Matters. Recent Papers from journals Good Posters Bad Posters

Good PostersBad Posters

Page 4: Course Matters. Recent Papers from journals Good Posters Bad Posters

Improving I/O Performance of Intermediate

Multimedia Storage Node

Pal HalvorsenThomas Plagemann

Vera GoebelMultimedia Systems 03

Page 5: Course Matters. Recent Papers from journals Good Posters Bad Posters

Problem

• Improve the performance of I/O in integrated multimedia storage node

• 3 areas of improvement are identified• reduce memory copy• checksum computation• FEC computation

Page 6: Course Matters. Recent Papers from journals Good Posters Bad Posters

Reduce Memory Copy

• File system maintain pointer to an area in memory

• Communication system maintain pointer to same area in memory

• Memory copy avoided!

Page 7: Course Matters. Recent Papers from journals Good Posters Bad Posters

Network Level Framing

• Packet payloads are stored with checksum

• When packets are retrieved for sending, destination address in header is updated

• Checksum is updated with new destination

• No need to recompute checksum for payload

Page 8: Course Matters. Recent Papers from journals Good Posters Bad Posters

Integrated Error Management

• Data are stored on RAID-4 (single parity checks)

• Use the same error correcting code for RAID and packets

• Avoid multiple computation of error correcting code

Page 9: Course Matters. Recent Papers from journals Good Posters Bad Posters

Experiment: Memory Copy

• Read 28662512B file 38 times in a loop

• The time to transmit data through the storage node is reduced by 45-50% when there is no CPU load, and by 70-73% when CPU load is high

Page 10: Course Matters. Recent Papers from journals Good Posters Bad Posters

Experiment: Network Level Framing

• Transmit 255MB file• Time to calculate checksum is

reduced by 95-99%• Time spent in kernel is reduced

by 51-61%

Page 11: Course Matters. Recent Papers from journals Good Posters Bad Posters

Experiment: Integrated Error Management

• With encoding FEC, the maximum throughput is 22-24 Mbps.

• Without encoding FEC, the maximum throughput is 1Gbps

Page 12: Course Matters. Recent Papers from journals Good Posters Bad Posters

Let’s try again..

Page 13: Course Matters. Recent Papers from journals Good Posters Bad Posters

Improving I/O Performance of

Intermediate Media Storage Node

Pal HalvorsenThomas Plagemann

Vera Goebel

Page 14: Course Matters. Recent Papers from journals Good Posters Bad Posters

Contributions

• Improve performance by• reducing memory copy• reducing checksum computation• reducing ECC computation

Page 15: Course Matters. Recent Papers from journals Good Posters Bad Posters

Reduce Memory Copy

• One shared copy of data for different OS component

data

File System

NetworkSystem

Memory

Page 16: Course Matters. Recent Papers from journals Good Posters Bad Posters

Network Level Framing

1

2

3

store payloadwith payload’s checksum

read payloadwith checksum

update header andchecksum

• Reduce time to packetize data and compute checksum for data

Page 17: Course Matters. Recent Papers from journals Good Posters Bad Posters

Integrated Error Management

• Avoid multiple computation of error correcting code

data data data ECCRAID

ECC

reuse RAIDECC as ECCpacket

Page 18: Course Matters. Recent Papers from journals Good Posters Bad Posters

Average Time to Transmit 1GB file from memory system under high CPU Load

0

50

100

150

200

250

300

1KB 2KB 3KB 4KB

Packet Size

Tim

e (s

)

zero-copytraditional

Results: Zero Copy

Page 19: Course Matters. Recent Papers from journals Good Posters Bad Posters

Results: Network Level Framing

UDP With NLF

0

2

4

6

8

1 2 4 8

Packet Size (KB)

Tim

e (

x100 m

s)

The RestChecksum

Traditional UDP

0

2

4

6

8

1 2 4 8

Packet Size (KB)

Tim

e (

x100 m

s)

Accumulated UDP Protocol Execution Time for sending 225MB file

Page 20: Course Matters. Recent Papers from journals Good Posters Bad Posters

Results: Integrated Error Management

With ECC Encoding

Without ECC Encoding

22-24 Mbps 1 Gbps

Maximum Throughput with/without Encoding usingCauchy-based Reed Solomon Erasure Code

Page 21: Course Matters. Recent Papers from journals Good Posters Bad Posters

Ad Hoc Networks

Session 1

Page 22: Course Matters. Recent Papers from journals Good Posters Bad Posters

Mobile Ad Hoc Network

Radio

Router

Host

Page 23: Course Matters. Recent Papers from journals Good Posters Bad Posters

Animation

• http://www-i4.informatik.rwth-aachen.de/~mesut/manet/manet_en.html

Page 24: Course Matters. Recent Papers from journals Good Posters Bad Posters

Mobile Ad Hoc Network

Radio

Router

Host

Radio

Router

Host

Radio

Router

Host

Radio

Router

Host

Page 25: Course Matters. Recent Papers from journals Good Posters Bad Posters

Examples

• Battlefield• Highway• Disaster Zone

Page 26: Course Matters. Recent Papers from journals Good Posters Bad Posters

Challenges

• All the difficulties of wireless LAN• Plus• Nodes can move• Connections can go up/down• No fix route

Page 27: Course Matters. Recent Papers from journals Good Posters Bad Posters

Two Papers

• IEEE JSAC • Special Issues in Wireless

Multimedia

• Baochun Li from U. of Toronto• Shiwen Mao from Polytechnic U.

Page 28: Course Matters. Recent Papers from journals Good Posters Bad Posters

NonStop: Continuous Streaming Service on

MANET

Baochun Li IEEE JSAC 2004

Page 29: Course Matters. Recent Papers from journals Good Posters Bad Posters

Streaming over MANET

Page 30: Course Matters. Recent Papers from journals Good Posters Bad Posters

Network Partition Problem

Page 31: Course Matters. Recent Papers from journals Good Posters Bad Posters

Only Solution ..

• Predict Partition• Replicate Service

Page 32: Course Matters. Recent Papers from journals Good Posters Bad Posters

Partition Prediction

Page 33: Course Matters. Recent Papers from journals Good Posters Bad Posters

Network Partition Problem

Page 34: Course Matters. Recent Papers from journals Good Posters Bad Posters

How to Predict Partition?

• given velocity of each node• cluster nodes into “mobile

groups”• find mean group velocity

Page 35: Course Matters. Recent Papers from journals Good Posters Bad Posters

Clustering Algorithm

Page 36: Course Matters. Recent Papers from journals Good Posters Bad Posters

Clustering Algorithm

Page 37: Course Matters. Recent Papers from journals Good Posters Bad Posters

Clustering Algorithm

Page 38: Course Matters. Recent Papers from journals Good Posters Bad Posters

Clustering Algorithm

Page 39: Course Matters. Recent Papers from journals Good Posters Bad Posters

Choosing Server

?

Page 40: Course Matters. Recent Papers from journals Good Posters Bad Posters

How to Choose Server?

• find “stable group”• choose server within stable

group with the most similar velocity

Page 41: Course Matters. Recent Papers from journals Good Posters Bad Posters

Stable Group

A B

mean <= radio rangeand variance is not too large

probability

distance

Page 42: Course Matters. Recent Papers from journals Good Posters Bad Posters

Stable Group

A C

D

F

G

H

E

B

Page 43: Course Matters. Recent Papers from journals Good Posters Bad Posters

Stable Group

A C

D

F

G

H

E

B

BCD are in my group

AGH are in my group

Page 44: Course Matters. Recent Papers from journals Good Posters Bad Posters

Stable Group

A C

D

F

G

H

E

B

BCDGH are in my group

ABDGH are in my

group

Page 45: Course Matters. Recent Papers from journals Good Posters Bad Posters

How to Choose Server?

• find “stable group”• choose server within stable

group with the most similar velocity

Page 46: Course Matters. Recent Papers from journals Good Posters Bad Posters

Summary

• Server construct mobile group by clustering nodes using velocity

• Use mean mobile group velocity to predict network partition

•Replicate service before partition to ensure continuous service

Page 47: Course Matters. Recent Papers from journals Good Posters Bad Posters

Summary

• Node construct stable group by comparing distance over time

• Choose server within stable group with most similar velocity

Page 48: Course Matters. Recent Papers from journals Good Posters Bad Posters

Multipath Transport and Multistream

Coding for MANET

Shiwen Mao et. al.IEEE JSAC

Page 49: Course Matters. Recent Papers from journals Good Posters Bad Posters

Single Path Transport

Page 50: Course Matters. Recent Papers from journals Good Posters Bad Posters

Multipath Transport

Page 51: Course Matters. Recent Papers from journals Good Posters Bad Posters

Multipath Transport

Page 52: Course Matters. Recent Papers from journals Good Posters Bad Posters

Video Coding: 1 of 3

I P P P P P P P

Typical Frame Dependency

Page 53: Course Matters. Recent Papers from journals Good Posters Bad Posters

Video Coding: 1 of 3

II

PP

PP

PP

Multistream Coding

Page 54: Course Matters. Recent Papers from journals Good Posters Bad Posters

Dynamic Reference Frame

• Choose last received frame as reference

believed to be received

Page 55: Course Matters. Recent Papers from journals Good Posters Bad Posters

Predict Network States

GOOD :)

BAD :(

NACK ACK

Page 56: Course Matters. Recent Papers from journals Good Posters Bad Posters

Example

0

1

2

3

4

5

6

7

ACK0 ACK2 ACK4

NACK1 NACK3 NACK5 ACK7

8

9

ACK6

10

Page 57: Course Matters. Recent Papers from journals Good Posters Bad Posters

Video Coding: 2 of 3

I P P P

I P P P Base Layer

EnhancementLayer

Page 58: Course Matters. Recent Papers from journals Good Posters Bad Posters

Video Coding: 2 of 3

S D

EL

BL

Page 59: Course Matters. Recent Papers from journals Good Posters Bad Posters

Video Coding: 2 of 3

NACK

NACK

Page 60: Course Matters. Recent Papers from journals Good Posters Bad Posters

Video Coding: 2 of 3

S D

BL

Page 61: Course Matters. Recent Papers from journals Good Posters Bad Posters

Video Coding: 3 of 3

• Multiple Description Coding

Page 62: Course Matters. Recent Papers from journals Good Posters Bad Posters

MDMC

• MDMC

+

Page 63: Course Matters. Recent Papers from journals Good Posters Bad Posters

Example of MDMC

359 363 370

+7

Typical Reference Frame

Page 64: Course Matters. Recent Papers from journals Good Posters Bad Posters

Example of MDMC

359 363 370

MDMC Reference Frame

Page 65: Course Matters. Recent Papers from journals Good Posters Bad Posters

Example of MDMC

359 363 +9

Page 66: Course Matters. Recent Papers from journals Good Posters Bad Posters

Example of MDMC

359 ? +9

Page 67: Course Matters. Recent Papers from journals Good Posters Bad Posters

Example of MDMC

359 363 370

+9

361

Page 68: Course Matters. Recent Papers from journals Good Posters Bad Posters

Example of MDMC

359 ? +9,+2

Page 69: Course Matters. Recent Papers from journals Good Posters Bad Posters

Comparisons

Reference Frame

LayeredCoding

MDMC

Feedback

Buffer

Decoding Delay

Page 70: Course Matters. Recent Papers from journals Good Posters Bad Posters

Improving Multicast

Session 2

Page 71: Course Matters. Recent Papers from journals Good Posters Bad Posters

Organizing Multicast Receivers

Brian Neil Levine Sanjoy Paul

JJ Garcia-Luna-AcevesMultimedia Systems 03

Page 72: Course Matters. Recent Papers from journals Good Posters Bad Posters

Retransmission in Mcast

Page 73: Course Matters. Recent Papers from journals Good Posters Bad Posters

Idea

• Ask a neighbour for a missing packet

Page 74: Course Matters. Recent Papers from journals Good Posters Bad Posters

“Helper” Tree

Page 75: Course Matters. Recent Papers from journals Good Posters Bad Posters

Pick Helper By Hop

Page 76: Course Matters. Recent Papers from journals Good Posters Bad Posters

Pick Helper by Hop

• Not entirely accurate• Need to consider latency, link

condition etc.

Page 77: Course Matters. Recent Papers from journals Good Posters Bad Posters

Pick Neighbour By Latency

Page 78: Course Matters. Recent Papers from journals Good Posters Bad Posters

Pick Helper by Latency

• How to measure latency?• unicast?• multicast?• shared-tree? per-source tree?

Page 79: Course Matters. Recent Papers from journals Good Posters Bad Posters

Ideal “Location” of Helper

• share a common path, and is closer to source (“acceptable”)

Page 80: Course Matters. Recent Papers from journals Good Posters Bad Posters

Idea

• Suppose node A and B know their path back to the source, then they can deduce if A is acceptable to help B

Page 81: Course Matters. Recent Papers from journals Good Posters Bad Posters

MTrace

A B C

D

E

HG

F

I

Page 82: Course Matters. Recent Papers from journals Good Posters Bad Posters

ERS

A B C

D

E

HG

F

I

my path is ABCDF

Page 83: Course Matters. Recent Papers from journals Good Posters Bad Posters

ERS

A B C

D

E

HG

F

I

Page 84: Course Matters. Recent Papers from journals Good Posters Bad Posters

Respond if

• acceptable• not too many helpee

Page 85: Course Matters. Recent Papers from journals Good Posters Bad Posters

Picking Helper

• packet loss measurement

A B C

D

E

HG

F

I

30%

10%

Page 86: Course Matters. Recent Papers from journals Good Posters Bad Posters

Maintenance

• Periodic refresh states (soft-states)

• Periodic repeat procedure

Page 87: Course Matters. Recent Papers from journals Good Posters Bad Posters

Summary

• Organized receivers based on common path

• Enable peer-to-peer retransmission

Page 88: Course Matters. Recent Papers from journals Good Posters Bad Posters

THE END