The forces behind the changing Internet: IXPs, content delivery …steve/presentations/Internet-ecosystem-chin… · aware Traffic Engineering. ACM SIGCOMM Computer Communication

Steve Uhlig 1

The forces behind the changing Internet: IXPs, content delivery and virtualization

Prof. Steve Uhlig Professor of Networks

Head of Networks research group Queen Mary, University of London

[email protected] http://www.eecs.qmul.ac.uk/~steve/

Joint work with: B. Ager (ETH), N. Chatzis, A. Feldmann, B. Frank, I. Poese, N. Sarrar, G. Smaragdakis (T-labs), Bruce Maggs (Duke/Akamai), Laurent Mathy

(U. Liege), Walter Willinger (AT&T), Gaogang Xie (CAS)

Steve Uhlig 2

Internet Infrastructure

Internet: communication platform

Internet: content sharing and delivery platform

Steve Uhlig 3

Content-Processing-Network Infrastructure

Storage

Processing

Content-Processing-Network

+

+

Steve Uhlig 4

Agenda

•  Internet update •  Short history of content delivery •  Content delivery 101 •  Opportunities •  Summary

Steve Uhlig 5

Old mental model

Steve Uhlig 6

Accepted view of the Internet

•  35,000+ networks •  Hierarchical structure -  Tier-1 (10-20): ATT, L3, Sprint,… -  Regional ISPs (15%): BT, Telefonica,… -  Stubs (85%): eyeball ISPs, universities,

enterprise networks

•  Known AS connectivity -  Customer-provider: 90,000+ -  Peer-peer: 35-40,000

Steve Uhlig 7

Most recent mental model

C. Labovitz, S. Iekel-Johnson, D. McPherson, J. Oberheide, and F. Jahanian. Internet Interdomain Traffic. Proc. of ACM SIGCOMM, 2010.

Steve Uhlig 8

Internet Exchange Point •  An Internet exchange point (IXP)

is a layer 2 service to facilitate the interconnection between -  ISPs -  Hosting or service providers -  CDNs

•  An IXP facilitates peering between players, usually across a public and/or private peering fabric of some type

•  Offer public and/or private peerings

William B. Norton. The Internet Peering Playbook : Connecting to the Core of the Internet. DrPeering Press, 2012.

Steve Uhlig 9

IXP architecture: example

AS6AS7

AS8

AS9... ASN

AS1 AS2 AS3AS4

AS5

IXP switches

Members' routers

B. Ager, N. Chatzis, A. Feldmann, N. Sarrar, S. Uhlig, and W. Willinger. Anatomy of a Large European IXP. Proc. of ACM SIGCOMM, 2012.

Steve Uhlig 10

Interconnection and business

William B. Norton. The Internet Peering Playbook : Connecting to the Core of the Internet. DrPeering Press, 2012.

IXPs

Steve Uhlig 11

Updated view of the Internet

•  Mixed structure -  Tier-1 (10-20) + Large IXPs -  Regional ISPs + smaller regional IXP

•  Known AS connectivity -  Customer-provider: 90,000+ -  Peer-peer: data from a single IXP doubles it!

•  Traffic -  Increasingly exchanged directly between CDN

and regional ISPs B. Ager, N. Chatzis, A. Feldmann, N. Sarrar, S. Uhlig, and W. Willinger. Anatomy of a Large European IXP. Proc. of ACM SIGCOMM 2012.

Steve Uhlig 12

Content is power!

•  CAIDA: BGP-based degree or customer-cone •  Renesys: variant of CAIDA-cone •  Knodes: Fixedorbit.com centrality metric •  Arbor: Interdomain traffic •  Potential: hostname-based •  Normalized potential: weighted hostnames

B. Ager, W. Mühlbauer, G. Smaragdakis, and S. Uhlig. Web content cartography. Proc. of ACM SIGCOMM Internet Measurement Conference, 2011.

Steve Uhlig 13

Agenda


Steve Uhlig 14

The Early Web

Pathan Mukaddim. Ongoing Trends and Future Directions in Content Delivery Networks (CDNs). Available online from: http://amkpathan.wordpress.com/article/ongoing-trends-and-future-directions-in-3uxfz2buz8z1w-2/

A

Steve Uhlig 15

CDNs 1.0


A

Steve Uhlig 16

CDNs 2.0


A

Steve Uhlig 17

Autonomic CDNs


Steve Uhlig 18

Agenda


Steve Uhlig 19

Foundations

•  Server selection -  HTTP (DNS)

-  P2P

•  Deployment -  HTTP: data centers and CDNs

-  P2P: swarms

•  Network location diversity

Steve Uhlig 20

HTTP server selection

DNS

HTTP

Steve Uhlig 21

DNS deployment

•  ISP DNS deployment: -  Fixed: few bad ISPs -  Mobile: many bad ISPs

•  3rd party DNS: -  Raw performance: good compared to bad ISPs -  Confusing to content delivery networks!

B. Ager, W. Mühlbauer, G. Smaragdakis, and S. Uhlig. Comparing DNS resolvers in the wild. Proc. of ACM SIGCOMM Internet Measurement Conference, 2010.

Steve Uhlig 22

Foundations


-  P2P


-  P2P: swarms


Steve Uhlig 23

Server selection: P2P Tracker

Client

Swarm

Steve Uhlig 24

Server selection: P2P

•  Today: -  Random, e.g., Bittorrent unchokes 4 best peers

based on average download rate •  Alternatives: -  PADIS: provider-aided distance information

service -  P4P: provider-aided P2P selection -  Biased Unchoking: consider locality of peers in

their selection -  Ono: Vuze plugin, use CDN measurements to

guess peer proximity •  Plenty of potential research!

Steve Uhlig 25

Foundations


-  P2P


-  P2P: swarms


Steve Uhlig 26

World data centers

http://www.datacentermap.com/

Steve Uhlig 27

Google data centers

http://royal.pingdom.com/2008/04/11/map-of-all-google-data-center-locations/

Steve Uhlig 28

World clouds

http://www.datacentermap.com/

Steve Uhlig 29

Where is content?

•  California •  China already 2nd! •  USA: 9 among

top 20 •  Other developed

countries: limited own content

Steve Uhlig 30

CDNs in China

•  Selected top 100 Chinese websites (Alexa) •  Which CDNs serve content from these websites?

Steve Uhlig 31

ChinaCache

Steve Uhlig 32

Foundations


-  P2P


-  P2P: swarms


Steve Uhlig 33

Deployment of popular P2P swarms

Steve Uhlig 34

Foundations


-  P2P


-  P2P: swarms


Steve Uhlig 35

CDN diversity

0

0.2

0.4

0.6

0.8

1

1 10 100

CD

F of

tota

l HTT

P Tr

affic

Available SubnetsB. Frank, I. Poese, G. Smaragdakis, S. Uhlig, and A. Feldmann. Enabling Content-aware Traffic Engineering. ACM SIGCOMM Computer Communication Review, 42(5):21-28, October 2012.

Steve Uhlig 36

CDNs geographic coverage

B. Ager, W. Mühlbauer, G. Smaragdakis, and S. Uhlig. Web content cartography. Proc. of ACM SIGCOMM Internet Measurement Conference, 2011.

Steve Uhlig 37

P2P diversity

Steve Uhlig 38

Agenda


Steve Uhlig 39

Traffic engineering

•  Diversity in content location is an opportunity for traffic engineering

•  Content-aware traffic engineering

B. Frank, I. Poese, G. Smaragdakis, S. Uhlig, and A. Feldmann. Enabling Content-aware Traffic Engineering. ACM SIGCOMM Computer Communication Review, 42(5):21-28, October 2012.

ISPCP Server A CP Server B

CP Server C

ClientClientClientClient

Highly utilizedlink

shift

Steve Uhlig 40

Google and SDN

•  Google is using OpenFlow •  Purpose: traffic engineering

Steve Uhlig 41

Collaborative content delivery

B. Frank, I. Poese, G. Smaragdakis, S. Uhlig, and A. Feldmann. Pushing ISP-CDN Collaboration to the Limit. ACM SIGCOMM Computer Communication Review, 43(3):35-44, October 2013.

CDN ISP

CP User

•  Importance of stakeholders

•  Spectrum in the solution space

•  Enabling collaboration

Steve Uhlig 42

CDN 3.0

•  Hybrid infrastructures: Akamai, PPTV •  Meta-CDNs, e.g., Conviva •  Virtual CDNs through ISP micro-datacenters •  ICN

ISPS

S

S

S

S

S

S

S

= PoP with Microdatacenter (Service deployed)= PoP with Microdatacenter

PoPs

B. Frank, I. Poese, G. Smaragdakis, V. Aggarwal, A. Feldmann, S. Uhlig, B. Maggs, F. Schneider. Collaboration Opportunities for Content Providers and Network Infrastructures. SIGCOMM e-book chapter, to appear, 2013.

Steve Uhlig 43

Agenda


Steve Uhlig 44

Summary

•  Measurements to track the changing Internet ecosystem

•  Content as driver of Internet evolution •  Scalability of massive content infrastructure

through hybrid infrastructures •  Opportunities for collaborative traffic

engineering •  Virtualization for increased diversity and

agility

Steve Uhlig 45

References

•  C. Labovitz, S. Iekel-Johnson, D. McPherson, J. Oberheide, and F. Jahanian. Internet Interdomain Traffic. Proc. of ACM SIGCOMM, 2010.

•  I. Poese, B. Frank, B. Ager, G. Smaragdakis, and A. Feldmann. Improving content delivery using provider-aided distance information. Proc. of ACM SIGCOMM IMC 2010.

•  B. Ager, W. Mühlbauer, G. Smaragdakis, and S. Uhlig. Comparing DNS resolvers in the wild. Proc. of ACM SIGCOMM IMC 2010.

•  B. Ager, W. Mühlbauer, G. Smaragdakis, and S. Uhlig. Web content cartography. Proc. of ACM SIGCOMM IMC 2011.

•  William B. Norton. The Internet Peering Playbook : Connecting to the Core of the Internet. DrPeering Press, 2012.

•  P. Dhungel, K. Ross, M. Steiner, Y. Tian, X. Hei. Xunlei: Peer-Assisted Download Acceleration on a Massive Scale. Proc. of PAM 2012.

Steve Uhlig 46

References

•  I. Poese, B. Frank, B. Ager, G. Smaragdakis, S. Uhlig, A. Feldmann. Improving Content Delivery with PaDIS. IEEE Internet Computing, 16(3): 46-52, 2012.

•  B. Frank, I. Poese, G. Smaragdakis, S. Uhlig, and A. Feldmann. Enabling Content-aware Traffic Engineering. ACM CCR, 42(5):21-28, October 2012.

•  B. Ager, N. Chatzis, A. Feldmann, N. Sarrar, S. Uhlig, and W. Willinger. Anatomy of a Large European IXP. Proc. of ACM SIGCOMM, 2012.

•  B. Frank, I. Poese, G. Smaragdakis, S. Uhlig, and A. Feldmann. Pushing ISP-CDN Collaboration to the Limit. ACM CCR, 43(3):35-44, October 2013.

•  B. Frank, I. Poese, G. Smaragdakis, V. Aggarwal, A. Feldmann, S. Uhlig, B. Maggs, F. Schneider. Collaboration Opportunities for Content Providers and Network Infrastructures. SIGCOMM e-book, to appear, 2013.

Documents

The forces behind the changing Internet: IXPs, content delivery …steve/presentations/Internet-ecosystem-chin… · aware Traffic Engineering. ACM SIGCOMM Computer Communication