1

CHEETAH – a high speed optical network

Xiuduan Fang, Tao Li, Mark Eric McGinley, Xiangfei

Zhu, and Malathi Veeraraghavan

2

How does today's Internet work?

Abilene: Backbone network of Internet 2Internet2: Universities + Research LaboratoriesFrom http://abilene.internet2.edu/maps-lists/

• Regular mail: Letters are sent in envelopes and routed from post-office to post-office, with each post-office examining the address on the envelope to determine the next post-office to which the letter should be forwarded

• Internet: Your email messages, for example, are broken up into small packets. Each packet carries the destination address in a header. Each router extracts the address from the header, and determines the next-hop router to which to forward the packet.

3

What does a router look like?

Example: A Cisco GSR 12008 router

Header

Part of a user message

A typical packet

Header contains source and destination addresses

4

Internet's bandwidth sharing mechanism

Today's Internet operates in a reservationless mode A computer is not required to reserve bandwidth

before sending packets from an application, such as email

Consequence: congestion can result if many users' simultaneously send emails or access the web.

Packets can be delayed excessively, or even dropped by routers!

Analogy: The roadways network; convenient, efficient usage, but a driver could be held up in traffic jams

Second delay >> First delayPacket 3 was dropped becauseof other users' packets competingfor "road space"

4321

421

Sender

Receiver

t

t

First delay

Second delay

5

A new bandwidth-sharing mechanism

Reservation-oriented bandwidth sharing User application signals its required data rate to the

network The network reserves this rate, if available, on each link

of the end-to-end path Consequence: If a user request is admitted, service

quality is excellent; no unpredictable delays or losses Analogy: Airline travel; a user reserves a seat on each

flight of a multi-flight trip before starting the trip We are building high-speed optical networks

using this mode of bandwidth-sharing

6

Building block: reservation-capable switches

Example Cisco 15454

7

CHEETAH: Circuit-switched High-speed End-to-End Transport

Architecture CHEETAH

Sponsored by National Science Foundation (NSF) and the Department of Energy (DOE);

Built to support scientific research projects, such as the Terascale Supernova Initiative (TSI)

TSI Sponsored by the DOE Study the explosion mechanism of supernovae

rare in our galaxy need computer simulations to understand this mechanism

Enabling technology: TeraScale computing resources

8

Example: The Crab Nebula, remnant of SN 1054 supernova

The picture: one of the largest ever image taken by the Hubble Space Telescope, obtained from http://en.wikipedia.org/wiki/SN_1054

• Core collapse supernovae: the most energetic explosions in the Universe

• Scientists need to study explosion mechanism and understand observables

• Technology used: Large-scale, multi-dimensional computer simulations conducted by supercomputers

• Simulation generates huge amount of data at terabyte (1012) scale or even larger, which needs to be further processed by scientists’ computers

9

Problem: How to move simulation data

Picture obtained from http://www.science.doe.gov/National_Laboratories/index.htm

Cray XT3Supercomputer

Scientist

Move data through Internet?

10

Orbitty Cluster

1GOC192 OC192 GbE

1-8-331-8-34

1-8-35

1-8-36

1-6-1

1-6-171-8-37

MCNCCatalyst

6500

1G

1-7-1

1G

1G1G

1G

Wukong 152.48.249.102

1-8-381-7-17

cheetah-nc

3x1G VLAN

OC192

1-6-1

1-6-17

10GbE

1-7-1

GbE

1-7-33

1-7-34

1-7-35

1-7-36

1-7-37

1-7-38

1-7-39

1GZelda1 10.0.0.11

H

H

H1G

1GZelda2 10.0.0.12

Zelda3 10.0.0.13

1G

1G

Zelda4 10.0.0.14

H

H

Zelda5 10.0.0.15

1G1G

Cheetah-atl

OC-192 lamda

10GbEGbE

1-7-33

1-7-34

1-7-35

1-7-36

Cheetah-ornl

1-7-1 1-8-1

OC192

UCNS1GFC1G

1G

JuniperT320

JuniperT320

1G

1G

Force10E300

switch

Oak Ridge National Lab

Atlanta

NCSU

Direct fibers

VLANs

MPLS tunnels

Wuneng 152.48.249.1031-8-39

H

UVa Catalyst

4948WASHHOPI

Force10

WASHAbileneT640

NCSUM20

2x1G MPLS tunnels

CUNYFoundry

NYCHOPI

Force10

1G

1GMvstu6 152.48.249.106

H

H

1G

UVa

CUNY

Application of CHEETAH Network

OC-192 lamda

HCentuarFastIron

FESX448

H

Raleigh

cuny-h1 134.74.17.112

H

1G

cuny-h2 134.74.17.113

Prof. John Blondin

Internet

1. Reserve bandwidth

2. Move the terabyte sized files

11

Demo introduction Data being moved from Cray to Orbitty

are large files For visual effects, we use video instead

to illustrate the benefits of reservation-oriented networks

Two scenarios Small data rate with interfering traffic

Emulates popular webcam experience Higher data rates without interfering traffic

Much better video quality

12

Demo Setup

Interfering trafficEmulates congested Internet path

Router #2(Cisco GSR)

Router #1(Cisco GSR)

100Mbps Ethernet interface card

OC-3 interface card

Emulates dedicated CHEETAH circuit

SONY SNC-RZ30NNetwork camera

192.168.2.111

192.168.3.2

192.168.2.3100MbpsEthernetswitch

192.168.2.1192.168.3.1192.168.10.1192.168.10.2

Cisco 15454MSPP