Nlr.net © 2004 National LambdaRail, Inc GLIF: The Underlying Plumbing in the USA Tom West, CEO National LambdaRail [email protected]

nlr.net© 2004 National LambdaRail, Inc

GLIF: The Underlying Plumbing in the USA

Tom West, CEONational LambdaRail

[email protected]


2

Key Messages

• Ownership and Control• Leadership and Partnership• Network Research Laboratory • Big Science - Big Pipes• Teaching-Learning - Big Pipes• Collaboration and Cost Efficiencies• Nationwide and Worldwide Connectivity Essential


Institutional, Regional, National and International Network Infrastructures

Owned by the Research and Education Community: A Key Pillar


4

Optical Network Infrastructure Framework

Efforts to deploy optical networking are being led by groups that might be called Network Infrastructure Plumbing Persons for Education and Research

(The NIPPERS)


5

University of California San Diego

UCSD

CalREN to LA

UCSDMed Ctr

SDSU

To Riverside

Level 3 to Yuma

CalREN to LA

OtherUCSDSites

21

21

43

43

21

65

0 2.5 5

miles

805

5

15

8

15

8


6


7


8

Pacific Wave – SeattlePNWGP

Pacific Wave- Los Angeles

CENIC

NLR User / Node

10 Gbps Lambda

NLR Lambdas SupportingPacific Wave Peering

10 Gbps


9


10

Translight / Pacific Wave

David Richardson [email protected]


11

Five new circuits for iGrid…

Pacific Wave today

EthernetSeattle

EthernetSunnyvale

EthernetLA

UCSDCalIT2SDSC

Optiputer / Cavewave

SONET/GFPCanarie /

Pacific Wave

IEEAFCA*net4

… even more for SC’05


12

Pacific Wave tomorrow

Optical SwitchingPacific Wave

EthernetServices

SONET/GFPServices

Transport providers:NLR, CanarieCENIC, PNWGPRONs

Users,ResearchersOther networks…


13

Current Projects Served: OptIPuter


14

Univ of Illinois Chicago

Univ of Wash - Seattle

UCSD / SDSU

NLR User / Node

10 Gbps Lambda

NLR Lambdas Supporting Optiputer

10 Gbps

10 Gbps


15

Chicago Metro

~$1500/fiber mile

Wiltel POP


16

Global Lambda Integrated Facility

www.glif.isVisualization courtesy of Bob Patterson, NCSA.


17

iGrid Sample Traffic Stats (95th percentile)

27th 28th• Cave Wave 4620 3817

• KREONet 1852 934

• CENIC 937 958

• ABILENE 584 968


18

Question 1

• Why develop NLR?

• How does NLR fit into the evolution of R&E networking in the USA?

• How does the NLR effort compare to previous efforts?


19

Sea Change in R&E Impacting Networking Needs

• Growing urgency for new network technologies• Increased collaboration worldwide on“Big” Science

projects• Exponential growth in size of data sets being

accessed• Need for multiple dedicated/private research networks


20

R&E Networking in USA

• 1969-90--APRANET (Milnet split off in ‘83)

• 1981-96--BITNET/CREN (would not stop)

• 1981-91ish--CSNET (CSnet merged with BITNET into CREN)

• 1986-95ish--NSFnet• Mid-1990s--CoREN effort

• 1995-2001ish--vBNS

• 1998-??--Internet2/Abilene

• 2003-??--NLR


21

Characteristics of NLR

• Research Community Leadership• Partnerships

* Regional Aggregations of Research Universities

* Cisco Systems

• Launched with NLR Member Funds(no direct Federal Funds)

• Own the Nationwide Network Infrastructure• Provides for Multiple Networks• Committed to Support Network Research

and “Big” Science Applications and Projects • Owned and Driven by the NLR Members


22

Question 2

• What is the status of NLR development?


23


24

National LambdaRail Mission

To advance the research, clinical and educational goals of members and other institutions by establishing and maintaining a nationwide advanced network infrastructure.


25

National LambdaRail Goals

• Support experimental and production networks

• Foster networking research

• Promote next-generation applications

• Facilitate interconnectivity among high-performance research and education networks


26

Strategic Corporate Participants

• Cisco Systems

• Level 3 Communications

• WilTel Communications


27

Question 3

• Who is NLR targeting to serve?


28

Communities Served by NLR

• Network Researchers

• Science Researchers—Big Applications

• Educators---Teaching-Learning Applications

Supercomputing continues to be a key driver


29

Special Commitment to Network Research

• Devoting up to 50% of NLR capacity to support network research projects

• Advisory council of leading network researchers sets the agenda


30

Current Projects Served:Extensible Terascale Facility (ETF)


31

P A C I F I C W A V Ean International Connection & Exchange partnership of PNWGP & CENIC, done in collaborations with StarLight, and our international network partners, and partially funded by NSF


32

Current Projects Served: OptIPuter


33

UltraScience Net: Initial Configuration

PNNL

CalTech

Fermi

ORNL

Atlanta

Seattle

SLACSunnyvale

Chicago

Switching HubsStorage or Other Res.

Access Links

Dual 10Gbs BackboneMPLS (Via ESnet)


34

UltraScience Net Extensions: Coming or Under Discussion

PNNL

CalTech

Fermi

Switching Hubs

Seattle

SLAC

Sunnyvale

ChicagoNERSC

LBL

BNL

JLAB

To CERN

ANL

Switching HubsStorage or Other Res.

Access Links

Dual 10Gbs Backbone

MPLS (Via ESnet)

Proposed Links

ORNL

Atlanta (SOX)


35

ESNet: Plans for 2007


36

Current Projects Served: Internet2 Hybrid Optical Packet Infrastructure (HOPI)

• Exploring the evolution of the Internet’s core

• Examining a hybrid of packet switching and dynamically provisioned lambdas

• Engaging industry, regional, and international partners

• Deploying a testbed based on design team’s white paper


37

Potential Network Research Project:Virtualized Testbed for Network Research

• Provide multiple heterogeneous virtual networks on a common substrate

• Engage broad networking research community• Bridge gap between cutting-edge research and

production usage• Proposed by:

– Tom Anderson, University of Washington– Larry Peterson, Princeton University– Scott Shenker, UC Berkeley– Jon Turner, Washington University in St. Louis


38

Question 4

• What does NLR have to offer the Research Community?


39

POTENTIAL CAPACITY

• The Equivalent of 40 nationwide 10 G networks.


40

INITIALLY LIT CAPACITY

• LAYER 2 GE SWITCHED NETWORK

• LAYER 3 IP EXPERIMENTAL NETWORK• LAYER 3 IP STABLE NETWORK FOR PEERING• HOPI WAVE FOR INTERNET2• QUICK START & SPARE WAVE• 2 NETWORK RESEARCH PROGRAM WAVE


NLR FrameNet (Layer 2 Switched Ethernet Network)


42

HOU

TUL

ELP

KAN

NLR FrameNet – Initial Physical Topology

BAT

LAXALB

PIT

WDC

CLE

ATL

RAL

CHINYC

DENSVL

SEA

JAC

10GE wave10GE managed wave

Cisco 6509 switch


43

HOU

TUL

ELP

KAN

NLR FrameNet – Initial Logical Topology

BAT

LAXALB

PIT

WDC

CLE

ATL

RAL

CHINYC

DENSVL

SEA

JAC


Cisco 6509 switch


NLR PacketNet (Layer 3 Routed IP Network)


45

ALB

BAT

RAL

JAC

TUL

PIT

HOU

NLR PacketNet – Initial Physical Topology

LAX

WDC

ATL

CHINYC

DEN

SEA

CLE

Cisco CRS-1 8/S router



46

ALB

BAT

RAL

JAC

TUL

PIT

HOU

NLR PacketNet – Initial Logical Topology

LAX

WDC

ATL

CHINYC

DEN

SEA



CLE


47

ATL

NLR PacketNet Backhauls – dual homed: one 10G wave as primary connection and one 1G FrameNet link for backup

HOU

WDC

CHI

JAC

RAL

NCLR router

FLR router

NLR

BAT

10G wave, link or port1G wave, link or port


Cisco 6509 switch

Regional Network router

RAL and JAC are shown as examples; other MetaPoPsneeding backhaul are PIT, BAT, TUL, ALB and CLE.


NLR PoPConfigurations


49

Seattle (SEA) PoP

To POR

15808 ELHTerminal

SVL2

SVL4-5POR1

To BOI

15808 ELHTerminal

DEN1 DEN3-4

SVL1 DEN2

POR2-4

10GE wave, link or portOC192 wave, link or port10GE or OC192 wave (software selectable)10GE or OC192 managed wave1G wave, link or port

DWDM

… ……

6509

CRS-1 8/S

Out-of-band (OOB) managementdevices not shown


50

Chicago (CHI) PoP

To KAN

15808 ELHTerminal

KAN2DEN2-4, KAN3-4

To CLE

15808 ELHTerminal

PIT1

CLE3-4,PIT2-3

DEN1


DWDM

To STA

15454Terminal

CLE2

… …

KAN1CLE1

PIT4-6

STA1-3 fiberconnect

x3

x3

6509

CRS-1 8/S



51

Los Angeles (LAX) PoP

To SVL

15808 LHTerminal

SVL2

SVL3-4

To PHO

15454Terminal

PHO1,3-4

PHO5-6


DWDM

To SAN(Level3 route)

15808 LHTerminal

PHO2

…

SVL1

6509

15808 LHTerminal

SAN(L)1-2

To SAN(WilTel route)

…

SAN(W)1-2

SVL5-6

… …

…

CRS-1 8/S



52

Question 4

• What are NLR members and others doing to ensure researchers have or will have connectivity to the NLR backbone?


53

Optical Network Infrastructure Framework

Efforts to deploy optical networking are being led by groups that might be called Network Infrastructure Plumbing Persons for Education and Research

(The NIPPERS)


54

University of California Berkeley

inr-205

10001000

inr-204

inr-220

inr-230

inr-240

inr-260

inr-281

inr-280

inr-101

inr-120

inr-130

inr-140

inr-160

inr-170

100

inr-100

inr-102

inr-299

ResHall

EECS Network100

1000

10001000

Internet2

1000

10001000

1000

100

1000

CENIC-ISP(Level3, Qwest,

Cogent, Wiliams)

100

100

inr-666

100

100

inr-668

Cogent(SET I@home ISP)

PAIX

100

100

rate lim itingdevices

inr-270

100

Tier 1Backbone

(FDDI)

Tier 2Backbone

(G E)

Seti@ H om e

BorderRouters

1000

1000

1000 1000 1000

inr-001

inr-002

CalREN-HPR CalREN-DC

inr-000

1000

inr-203

inr-201

inr-202

10001000

Affiliates

inr-667


55Courtesy of Steve Corbato

Regional Optical Networks

• California (CALREN)• PNWGP • Colorado/Utah (FRGP) • Illinois (I-WIRE) • Michigan (MLR)• Indiana (I-LIGHT)• Ohio (TFN)• New York (NYSERnet)

•

• Maryland, D.C. & Virginia (MAX/MATP)

• North Carolina (NCREN) • Georgia (Southern Light Rail)• Florida (Florida LambdaRail)• Louisiana (LONI)• Texas (LEARN) • Oklahoma (OneNet)


56


57

MAX – MATP Combined Regional Infrastructure

McLean LVL3

UVA

VT

E-L

ight ODU

W&M

JeffLab

VCU

Ring completes via Pittsburgh

Ring completes via Durham

VRoanoke

VArlington

VRichmond

VNorfolk

VLynchburg

VCharlottesville

VAshburn

GMU

MAXDC metro

WDM

GWUGU UMD

VMATP OSR

NLR

CLPK

Baltimore

Abilene

ESnet

NREN NISN DREN

NASA

BoSSnet

JHU

NGIX

ATD

net

MAX T640

NetworkVirginia

MAX Members & Projects

MATP Members & Resources

V MATP VORTEX DWDM Node

OC-48 POS

10 GE

KEY:

Combined Participants (partial)

Primary Members (MAX and MATP)GMU GUGWU JeffLabs/SURAODU NASAUMD UVAVCU VTW&M

Selected ConnectorsLibrary of Congress NASA GSFCNat. Archives & Records Ad. NSFNat. Inst. Of Health ATDnetNat. Library of Medicine USGSNOAA USDANaval Research Lab US CensusHoward Hughes Med. Inst. JHUSmithsonian Institution ISI EastUCAID World BankUniv. System of Maryland (11 campuses)NetworkVirginia (651 campuses)

DR

AGO

N


58

Florida—Florida LambdaRail (FLR)


59

Texas—Lonestar Education and ResearchNetwork (LEARN)


60

Question 5

• How does NLR fit into the Global Lambda Integrated Facility (GLIF)?


61

Global Lambda Integrated Facility

www.glif.isVisualization courtesy of Bob Patterson, NCSA.


62


63

Summary

• Ownership and Control• Leadership and Partnership• Network Research Laboratory and • Big Science - Big Pipes• Teaching-Learning - Big Pipes• Collaboration and Cost Efficiencies• Nationwide and Worldwide Connectivity Essential


64

Think Globally – Act Locally


65

More Information

[email protected]

Documents

Nlr.net © 2004 National LambdaRail, Inc GLIF: The Underlying Plumbing in the USA Tom West, CEO National LambdaRail [email protected]