33
Fight back against the ISP Scorecards Thomas Vasen Subscriber Experience Evangelist

CommsDay Summit 2016: Procera's Thomas Vasen

Embed Size (px)

Citation preview

Page 1: CommsDay Summit 2016: Procera's Thomas Vasen

Fight back against the ISP Scorecards

Thomas VasenSubscriber Experience Evangelist

Page 2: CommsDay Summit 2016: Procera's Thomas Vasen

600 customers – 242 employees (35% R&D):

2010 2011 2012 2013 2014 2015

6 1118

3143

50

57

13

12

7

15Existing New

Customer GrowthTIER-1 SERVICE PROVIDERS

15+ YEARS OF SOFTWARE DEVELOPMENT IN

NETWORKS & APPLICATION AWARENESS

Corporate Snapshot:Private company with the backing of Francisco Partners – a $10B+ portfolio

HQ

R&D R&D

TAC

TAC

Confidential: Not for distribution without written consent of Procera Networks.

Page 3: CommsDay Summit 2016: Procera's Thomas Vasen

Customer Life-cycle: Interactions

FIND

GET

SETUP

USESUPPORT

PAY

MODIFY

Page 4: CommsDay Summit 2016: Procera's Thomas Vasen

Anyone seen this before?

Interesting, butnot actionable

Page 5: CommsDay Summit 2016: Procera's Thomas Vasen

What about this one?

Page 6: CommsDay Summit 2016: Procera's Thomas Vasen

Or this?

Page 7: CommsDay Summit 2016: Procera's Thomas Vasen

OTT Providers are winning the PR WAR on performance

Page 8: CommsDay Summit 2016: Procera's Thomas Vasen

8

Speed Quality

Page 9: CommsDay Summit 2016: Procera's Thomas Vasen

FCC Network Neutrality

“With respect to network performance, we adopt the following enhancements:

The existing transparency rule requires disclosure of actual network performance. In adopting that requirement, the Commission mentioned speed and latency as two key measures. Today we include packet loss as a necessary part of the network performance disclosure.

We expect that disclosures to consumers of actual network performance data should be reasonably related to the performance the consumer would likely experience in the geographic area in which the consumer is purchasing service.

We also expect that network performance will be measured in terms of average performance over a reasonable period of time and during times of peak usage.”

Source: page 73-74 of FCC-15-24A1, Emphasis Added

Page 10: CommsDay Summit 2016: Procera's Thomas Vasen

Consumer’s Choice on Quality

Airline Hospitality Restaurants

Page 11: CommsDay Summit 2016: Procera's Thomas Vasen

Not for Broadband

Download80.7 Mbps

Upload8.4 Mbps

Page 12: CommsDay Summit 2016: Procera's Thomas Vasen

Subscribers think Applications

Each with differentnetwork qualityrequirements

Page 13: CommsDay Summit 2016: Procera's Thomas Vasen

Show quality perApplication Type

Page 14: CommsDay Summit 2016: Procera's Thomas Vasen

Three ingredients to broadband quality

1. Throughput/Bandwidth/Speed2. Latency3. Packet Loss

Page 15: CommsDay Summit 2016: Procera's Thomas Vasen

Throughput/Bandwidth/Speed

Application Type Throughput Needs

Web Needs short bursts of download performance

Video Sustained throughput delivers good quality

Social Media Needs short bursts of download/upload performance

Gaming Most games do not require high bandwidth

Upload Sustained bursts of upload performance

Download Sustained bursts of download performance

Voice Low throughput requirements

Very dependent on the sampling frequency!

Page 16: CommsDay Summit 2016: Procera's Thomas Vasen

Latency

Application Type Throughput Needs

Web High latency leads to slow page load times

Video Not usually a concern except for initial loading of video

Social Media High latency can slow interactive sharing experience

Gaming High latency leads to lag in real-time games

Upload N/A

Download N/A

Voice High latency leads to poor voice experience

Page 17: CommsDay Summit 2016: Procera's Thomas Vasen

Packet Loss

Application Type Throughput Needs

Web Packet Loss can lead to slow page load times.

Video Less sensitive to loss unless it affects throughput

Social Media Packet Loss can slow interactive sharing experience

Gaming Packet Loss leads to lag in real-time games

Upload N/A

Download N/A

Voice Some loss can be tolerated, high loss leads to perceived latency

Page 18: CommsDay Summit 2016: Procera's Thomas Vasen

Different collection approaches…

Active Probes—Can affect the actual performance of network, especially during peak hours

Sampling—Does not provide consistent data for entire footprint

All subscriber traffic, all the time—Meets regulator guidance:

• Actual customer experience• In the actual geographic area • During Peak Usage

Page 19: CommsDay Summit 2016: Procera's Thomas Vasen

Measuring all traffic,all the time enables an operator to create their own ScoreCard

Page 20: CommsDay Summit 2016: Procera's Thomas Vasen

Putting it All Together

Application Type Throughput Latency Loss

Web Needs short bursts of download performance

High latency leads to slow page load times

Packet Loss can lead to slow page load times.

Video Sustained throughput delivers good quality

Not usually a concern except for initial loading of video

Less sensitive to loss unless it affects throughput

Social Media Needs short bursts of download/upload performance

High latency can slow interactive sharing experience

Packet Loss can slow interactive sharing experience

Gaming Most games do not require high bandwidth

High latency leads to lag in real-time games

Packet Loss leads to lag in real-time games

Upload Sustained bursts of upload performance N/A N/A

Download Sustained bursts of download performance N/A N/A

Voice Low throughput requirements High latency leads to poor voice experience

Some loss can be tolerated, high loss leads to perceived latency

Page 21: CommsDay Summit 2016: Procera's Thomas Vasen

“Graded” Quality Performance

Score Subjective Experience

A Awesome experience

B Almost perfect, but some slight impairments noticed

C Good experience but noticeable impairments

D Usable with frustrating impairments

E Really poor

F Unusable

Page 22: CommsDay Summit 2016: Procera's Thomas Vasen
Page 23: CommsDay Summit 2016: Procera's Thomas Vasen

Case Study

Page 24: CommsDay Summit 2016: Procera's Thomas Vasen

Captured in the Core

Page 25: CommsDay Summit 2016: Procera's Thomas Vasen

Break down by Perspectives

Device Location Subscriber Tier

Page 26: CommsDay Summit 2016: Procera's Thomas Vasen

Topology Perspective

Page 27: CommsDay Summit 2016: Procera's Thomas Vasen

Location Perspective

Page 28: CommsDay Summit 2016: Procera's Thomas Vasen

Subscriber Perspective

Page 29: CommsDay Summit 2016: Procera's Thomas Vasen

Subscriber Perspective

Page 30: CommsDay Summit 2016: Procera's Thomas Vasen

Impact

Page 31: CommsDay Summit 2016: Procera's Thomas Vasen

In summary – 3 use-cases

• Reporting to regulators on network performance with actual subscriber metrics

• Marketing to subscribers—Targeted service offerings “Good for Gaming!” —High Value SLA-based offerings—Scoring Service Plans by performance

• “An A for Video”—Promoting network capabilities

• Improving the network where deficiencies occur

or

vs

Page 32: CommsDay Summit 2016: Procera's Thomas Vasen
Page 33: CommsDay Summit 2016: Procera's Thomas Vasen

Thank [email protected]