PERSONAL TELEPRESENCE USING SCALABLE VIDEO CODING Alex Eleftheriadis, Chief Scientist alex@vidyo.com

Preview:

Citation preview

PERSONAL TELEPRESENCE USING SCALABLE VIDEO CODING

Alex Eleftheriadis, Chief Scientistalex@vidyo.com

2 TNC-2008 / May 21, 2008

Videoconferencing Industry – Quality vs. Scale

10 1000 1,000,000

Low Definition

Standard Definition

High Definition

10,000Number ofEnd Points

Resolution

Qu

ali

tyIn

tera

cti

vit

yCisco, HP, PolycomTandberg, LifeSize

$10K-$300KEndpoint

Price-Performance,Interactivity

Existing Technology

All Vendors

Cisco, Microsoft,Nortel, Avaya,Siemens

Skype, Yahoo, AOL,Adobe, Google

3 TNC-2008 / May 21, 2008

Key Videoconferencing System Characteristics

Rate Matching Support for heterogeneous endpoints and access networks

Personalized Layout Each user selects the resolution and users he/she wants to see

Delay Interactivity requires <200msec end-to-end

Error Resilience Tolerance to packet loss rates >10%

Error Localization An error in one user should not affect other users

Complexity Lower complexity = Lower cost Low complexity allows to integrate with existing network services (e.g., in cheap routers)

4 TNC-2008 / May 21, 2008

H.264 SVC

Scalable Video Coding (SVC) Developed by JVT (=Joint Video Team of ITU and ISO)

SVC is Amendment 3 to H.264 AVC Most of SVC is in Annex G of H.264 AVC CFP April 2004, Consented in Nov 2007 RTP payload format should go to last-call in July 2008 IETF (Dublin)

Vidyo™ is the first company to offer H.264/SVC standard-based solution to solve video conferencing challengesArchitecture centered on VidyoRouter™

5 TNC-2008 / May 21, 2008

Temporal Structure of Non-Scalable Codecs

6 TNC-2008 / May 21, 2008

Temporal Scalability

7 TNC-2008 / May 21, 2008

Spatial Scalability

Hierarchical MCP &Intra prediction

Base layercoding

texture

motion

MultiplexScalable

bit-stream

H.264/AVC MCP &Intra prediction

Base layercoding

texture

motion

H.264/AVC compatible encoder

H.264/AVC-compatiblebase layer bit-stream

Inter-layer prediction:•Intra•Motion•Residual

Hierarchical MCP &Intra prediction

Base layercoding

texture

motion

Inter-layer prediction:•Intra•Motion•Residual

Spatialdecimation

Spatialdecimation

8 TNC-2008 / May 21, 2008

Temporal + Spatial Scalability

9 TNC-2008 / May 21, 2008

Temporal + Spatial Scalability

QVGA30 fps

10 TNC-2008 / May 21, 2008

Temporal + Spatial Scalability

VGA15 fps

11 TNC-2008 / May 21, 2008

Multipoint with Native Rate Matching

High ResolutionHigh Frame Rate

Low ResolutionLow Frame Rate

1.5Mbps

512Kbps

128Kbps

Medium ResolutionMedium Frame Rate

256Kbps

Medium ResolutionHigh Frame Rate

High ResolutionHigh Frame Rate

Vid

yoR

ou

ter™

12 TNC-2008 / May 21, 2008

Traditional Transcoding MCU

ENCODE

DECODE

ENCODE

DECODE

Packet Loss Sensitivity, Requires

Dedicated Network

High CostHigh Delay

Quality Degradation

13 TNC-2008 / May 21, 2008

VidyoRouter™

VidyoRoom™ Endpoint

VidyoDesktop™ Endpoint

VidyoRoom™ Endpoint

ENCODE

DECODE

ENCODE

VidyoRouter™

14 TNC-2008 / May 21, 2008

VidyoRouter™ vs. MCU

VidyoRouter is simply an application layer router Nearly zero-delay (~10msec), allows cascading Eliminates video quality loss due to transcoding Extremely low cost of compute power

Limiting parameter is network I/O bandwidth and not number of video streams or resolution

Endpoint processing of the video from different participants makes the VidyoRouter highly scalable

Rate matching and personalized layout are routing decisions

Similar complexity to other network appliances

COMPOSE

DECODE

ENCODE

DECODE

ROUTE

MCUVidyoRouter

USER 1 USER 1 USER 2USER 2

USER 3

USER 3

15 TNC-2008 / May 21, 2008

HD at 60 fps on Every Port

9-site call (US and Europe) mixing HD Rooms and VGA desktops across the public Internet

16 TNC-2008 / May 21, 2008

Error Resilience

Low Reliability Channel

High Reliability Channel

Significant ImpactConventional Coding

Scalable Coding

Minor or No Impact

17 TNC-2008 / May 21, 2008

MCU vs. VidyoRouter™: Computation

Feature MCU VidyoRouter

Rate matching Transcoding FreePersonalized layout Transcoding FreeFrame Rate Increase

(30fps to 50fps)Faster Transcoding None

HD overhead for Server High MinimalMax resolution limited by Server ClientServer Complexity High LowServer Scalability Low Very HighObsolescence Risk High LowCompatibility with H.264 AVC √ √Server Integration with Routers √

Transcoding MCU is complex, adds delay and distortion, and scales poorly Move to HD 720p to HD 1080p to HD 1600p requires “forklift” upgrade for a

transcoding MCU

18

MCU vs. VidyoRouter™: Network

Feature MCU VidyoRouter

Rate matching Transcoding Free

Error Resilience (packet loss) 3% 20% +

End-to-End Delay

Switched Server~150-200ms ~150-200ms

End-to-End Delay

Multipoint Server~400+ms ~150-200ms

Max resolution limited by Server Client

Cascaded Servers √

VidyoRouter operates effectively over the InternetCascading VidyoRouters improves user experience, even in point-to-point calls

19 TNC-2008 / May 21, 2008

Videoconferencing Industry – The Future

10 1000 1,000,000

Low Definition

Standard Definition

High Definition

10,000Number ofEnd Points

Resolution

Qu

ali

tyIn

tera

cti

vit

yCisco, HP, PolycomTandberg, LifeSize

$10K-$300KEndpoint

Price-Performance,Interactivity

Existing Technology

All Vendors

Cisco, Microsoft,Nortel, Avaya,Siemens

Skype, Yahoo, AOL,Adobe, Google

20 April 21, 2023 Vidyo Proprietary Confidential & Patent Pending Information

VidyoConferencing™ Components

21 TNC-2008 / May 21, 2008

VidyoConferencing™ Summary

21

Based on a new standard H.264 SVC, the first effective video codec truly designed for converged IP Networks (Internet)

Much better user experience: better quality, easier to use, more naturalHD becomes deployable everywhere and can reach any desktop or laptop over shared IP networksA unified video solution from telepresence to desktop

An affordable and scalable architecture that matches the Internet model

22 TNC-2008 / May 21, 2008

Vidyo™ Demo

Demo to be held after the end of the session (transatlantic connection using laptop over WiFi connection)

Demo accounts can be set up upon request on the Vidyo system hosted by Surfnet (http://vidyo.showcase.surfnet.nl).

Contact: Eric Le Guiniec, eric@vidyo.com

22

Recommended