ITTC Communication Networks Laboratoryjpgs/courses/nets/lecture... · Communication Networks Laboratory The University of Kansas EECS 780 ... –2011 James P.G. Sterbenz Egemen K

© James P.G. SterbenzITTCCommunication Networks Laboratory

The University of Kansas EECS 780Programmable Networking with GpENI

© 2004–2011 James P.G. Sterbenz04 May 2011

Egemen K. Çetinkaya and James P.G. Sterbenz

Department of Electrical Engineering & Computer ScienceInformation Technology & Telecommunications Research Center

The University of Kansas

[email protected]@eecs.ku.edu

http://www.ittc.ku.edu/~jpgs/courses/nets

rev. 11.0

04 May 2011 KU EECS 780 – Comm Nets – GpENI NET-L5-2

© James P.G. SterbenzITTC

Network Experimentation with GpENIOutline

L5.1 Motivation and overviewL5.2 Participants and infrastructureL5.3 Node cluster and programmabilityL5.4 Network monitoring



Network Experimentation with GpENIMotivation and Overview




Large-Scale TestbedsMotivation

• Progression of research → deployment– analysis– simulation– emulation– lab prototyping– large-scale field prototyping– field deployment

• Testbeds needed to understand realistic behaviour– but realistic scale needed– essential for experiments in Future Internet architecture



Large-Scale TestbedsHistory

• CNRI Gigabit testbeds– Aurora, Blanca, Casa, Nectar, Vistanet, MAGIC– supported high-speed networking research– technology specific; not programmable

• e.g. ATM, HIPPI

• Active network testbeds– DARPA ABone, EU FP5 FAIN, EPSRC LARA++– dynamically programmable networks (signalling or capsules)– supported research in service and protocol deployment– logical predecessor to GENI



Large-Scale TestbedsCurrent Testbeds

• PlanetLab– international testbed to conduct Internet research– L4–7 programmable: applications and transport– VINI extends to control Internet topology– experiments use a slice of PlanetLab– basis for GENI cluster B

• Emulab: clusters of computing nodes– arbitrary system software– programmable interconnection– basis for GENI cluster C (ProtoGENI)



GENI and FIREOverview

• GENI: Global Environments for Network Innovation– funded by the US NSF and participant institutions– managed by the GPO (GENI Project Office – BBN)– goal: new experimental network infrastructure

• FIRE: Future Internet Research and Experimentation– funded by the EU under FP7– research component (similar to FIND)– experimental component (similar to GENI)



GpENIOverview

• GpENI [dʒɛ’pi ni] Great Plains Environment for Network Innovation– exploiting new fiber infrastructure in KS, MO, and NE– significant international footprint under deployment

Europe

Asia

Canada

KSUKU

UMKC

UNL

MOREnetKanREN

GPN



GpENIProject Goals

• Programmable research infrastructure– centered on optical infrastructure in Great Plains– undergoing international expansion

• Infrastructure to support future Internet research– NSF FIND PoMo– EU FIRE ResumeNet

• GpENI is part of GENI and affiliated with FIRE– GENI cluster B: PlanetLab control framework– testbed for EU FP7 FIRE ResumeNet project

• Open environment for network research community– GpENI clearinghouse for sharing experiments



Network Experimentation with GpENIParticipants and Infrastructure




GpENIPrincipal Participants: Universities1

• KU: The University of Kansas– James P.G. Sterbenz (lead PI),

Joseph B Evans (co-I), Rick McMullen (co-I),Ronqing Hui, Gary Minden

• KSU: Kansas State University– Caterina Scoglio (PI), Don Gruenbacher (co-PI),

Tricha Anjali

• UMKC: University of Missouri – Kansas City– Deep Medhi (PI), Baek-Young Choi (co-I)

Cory Beard, Khosrow Sohraby, Jim Schonemann

• UNL: University of Nebraska – Lincoln– Byrav Ramamurthy (PI)



GpENIPrincipal Participants: Universities2

• IIT: Illinois Institute of Technology– Tricha Anjali

• Lancaster University (UK)– David Hutchison, Andrew Scott (co-Is),

• ETH Zürich (Switzerland)– Bernhard Plattner (co-I)



GpENIParticipants: Research Networks

• GPN: Great Plains Network (consortium)– Greg Monaco (PI)

• KanREN: Kansas Research and Education Network– Cort Buffington (PI)

• MOREnet: Missouri Research and Education Network– Hank Niederhelm

• JANET• SWITCH• GÉANT2 / DANTE• NORDUnet



GpENIParticipants: Industry

• Ciena– Jeff Verrant (PI), Jim Archuleta (co-I)

• Qwest



GpENIParticipants: L2 Tunnel Fanout

• UK, Ireland, and Iberia– Lancaster

• Switzerland, Germany, Austria, Poland, Turkey– ETH Zürich– Bern (Torsten Braun)– Kaiserslautern / G-Lab (Paul Müller)

• Scandinavia and Russia– Simula Labs Oslo

• Asia– ?



Network Experimentation with GpENINode Cluster and Programmability




GpENINode Cluster Types

• Midwest optical backbone– KU, KSU, UNL, UMKC

• Optically connected islands– Lancaster, Cambridge– ETH Zürich, Bern, Uni Zürich

• L2TPv3 concentration/fanout nodes– Lancaster, Zürich, Bern, Kaiserslautern

• L2TPv3 terminal nodes– IU GMOC, ETH Zürich, Tampere, Simula, KIT, Passau, …

• IP tunneled nodes• Public Internet connected nodes?



GpENI Node ClusterArchitecture: Midwest Optical Node

• GpENI cluster• 5–10 PCs

– GpENI mgt.– L4: PlanetLab– L3: prog. routers

• GbE switch– arbitrary site interconnection– L2: GpENI/GENI VLAN– SNMP cluster monitoring

• Ciena optical switch– L1 GpENI interconnection

Ciena optical

GpENImanagement& control

GpENI optical backboneto Internet2 and KC SPPProtoGENI to MAX

GENIVLANs

PlanetLabGENIwrap

prog. nodes

� �site specificKUAR,

sensor, …

ctl. frwk. aggr. mgr. PLC VINI

DCN

GbEnet

prog. routersVINI,

Quagga,XORP, click,…



GpENI Node ClusterArchitecture: Island Optical Node




• L2 optical interconnection– among island tunneled to GpENI

GpENImanagement

& control

GENIVLANs

PlanetLabGENIwrap

prog. nodes

� �site

specificKUAR,

sensor, …

island specific

aggregate manager

GbEnet

prog. routers VINI,


L2TPv3



GpENI Node ClusterArchitecture: Tunneled Node Cluster




• Router terminating tunnels– L2TPv3 recommended

GpENImanagement

& control

GENIVLANs

L2TPv3 or IP tunnelsmultiple for fanout nodes

PlanetLabGENIwrap

prog. nodes

L2TPv3

� �site

specificKUAR,

sensor, …

ctl. frwk. aggr. mgr. PLC VINI

DCN

GbEnet

prog. routers VINI,




GpENI Node ClusterManagement and Control

• Management and control processor in each cluster– control‐1.⟨institution⟩.gpeni.net

• General purpose Linux box– runs any software needed by GpENI or local sites– e.g. PlanetLab control framework demo at KSU

• Security services– firewall and NAT for cluster private subnet

• Monitoring services– Cacti port monitoring of GbE switch– Nagios to monitor individual nodes



GpENI ProgrammabilityAll Layers

lightpath

VLAN

topology

router

end-to-end

application

experiment

RF, photonics

DCN

VINI

Quagga, XORP, Click, site

PlanetLab

Gush, Raven

site-specific

2

3

4

7

1

GpENI Layer Programmability



GpENI ProgrammabilityExperiment

• Software to assistresearcher runGpENI experiments

• Gush: GENI user shell[Albrecht]helps reserve resourcesusing GENI clearinghouse

• Raven provisioning service[Hartman]code and configuration deployment

• GpENI clearinghouse

lightpathVLAN

topologyrouter

end-to-endapplicationexperiment

RF,photonics

DCN

VINIQuagga, XORP, Click

PlanetLab

Gush, Raven

site-specific

2

3

47

1




GpENI ProgrammabilityApplication and End-to-End Transport

• PlanetLab sub-aggregate:upper layer programmability– application and E2E transport

• Shares resources usingslice paradigm

• GENIwrapper version of PlanetLab– SFA (slice facility architecture) exports GENI interfaces

• PLC located at KSU: geni‐myplc.ksu.gpeni.net• Programmable nodes at each institution

– geni‐planetlab‐n.⟨institution⟩.gpeni.net

lightpathVLAN

topologyrouter


photonics

DCN


PlanetLab

Gush, Raven

site-specific

2

3

47

1




GpENI ProgrammabilityNetwork Routers and Switches

• Programmable routersunder control ofVINI sub-aggregate

• GpENI standard software– Quagga– XORP currently being integrated– OpenFlow under investigation– Click possible

• Site-specific routers• Each cluster has at least 2 programmable routers

– geni‐router‐n.⟨institution⟩.gpeni.net

lightpathVLAN

topologyrouter


photonics

DCN


PlanetLab

Gush, Raven

site-specific

2

3

47

1




GpENI ProgrammabilityNetwork Topology

• VINI sub-aggregate:middle layer programmability– topology and router control

• PlanetLab with Trellis extensions– control of topology slices– eventual merge with PL

• Control located at UMKC: geni‐myvini.umkc.gpeni.net• Unification of PlanetLab and VINI underway

– by Princeton PlanetLab group– GpENI now has integrated portal

lightpathVLAN

topologyrouter


photonics

DCN


PlanetLab

Gush, Raven

site-specific

2

3

47

1




GpENI ProgrammabilityVLAN and Lightpath Connectivity

• DCN sub-aggregate:lower layer programmability

• DCN: dynamic circuit networkdeveloped by DRAGON– dynamic creation of

VLANs and lightpaths– GpENI port to Netgear GbE switch– MAX port to Ciena CoreDirector optical switch

• MAX + ISI working on DCN GENIwrapper– will enable unification of PlanetLab and DCN sub-aggregates

lightpathVLAN

topologyrouter


photonics

DCN


PlanetLab

Gush, Raven

site-specific

2

3

47

1




GpENI ProgrammabilityPhotonic and RF

• Site-specificlayer-1 programmability

• Edge– testbed attached to GbE switch

• Core– requires optical

GpENI interconnection– virtual connectivity hoped in future

lightpathVLAN

topologyrouter


photonics

DCN


PlanetLab

Gush, Raven

site-specific

2

3

47

1




GpENIPhysical Topology and Network Infrastructure

KSU – KS KU – KS

UMKC – MO

UNL – NE

GpENI CienaCoreDirector

GpENI CienaCN4200

CCD FlarsheimHall

AveryHall

C-bandn λs

KU/Qwestfiber

NicholsHall

RathboneHall

GpENI nodecluster

WTC fiber

KU/Qwestfiber

SFBB fiberEllsworth

HallPowerPlant

QwestPOP

KC MO

KU/Qwestfiber

Internet2POP

KC MO

MOREnetfiber Newcomb

Hall

Ethernet

ScottCenter

UNL (L3)fiber

splicepatch

CC

to Smith Ctr. KS (eventual link to CO)

dark fiber

2 λs

4 λs

C-bandn λs

C42

GpENI

CCD

GpENI

CCD

GpENI

CCD

GpENI

CCD

GpENI

• Midwest backbone (phase 3)– multiwavelength optical backbone

• current or imminent deployment

– 4 universities in 3 states• 1 switch/year with current funding

new nodes



GpENILayer 2 Connectivity (mid phase 1)

rapidlyevolving



• Regional GpENI partners: 11– Principal partners

• KU, KSU, UMKC, UNL, IIT

– South Dakota: 3 universities• DSU, SDSMT, USD

– Missouri: UMC– GMOC at Indiana University– Canada

• Waterloo

IIT

KSUKU UMKC

UNL

GpENIMidwest Expansion

DSU

USD

SDSMT

UMCIU

Europe

AsiaIU GMOC

Waterloo



Bucharest

Wien

Bilkent

Internet2DANTE

Passau

ETH

Lancaster

JANET

UC DublinHEAnet

UPCBarcelona

Tampere UT

UppsalaSICS

NORDUnet

Skt. PeterburgIIRAS

TKK Helsinki

Warszawa

GÉANT2

KTH Stockholm

U-ZürichKonstanz

München

GpENIEuropean Expansion

Moscow

SWITCH

Karlstads

ISCTELisboa

KSUKU UMKC

UNL

DSU

USD

SDSMT

UMC IUAsia IU GMOC

IIT

Karlsruhe

Cambridge

toBeijing

Bern

Simula

G-Lab

• European GpENI partners– 13 nations– 24 research institutions– ~120 nodes– more under discussion

Kaiserslautern



GpENIAsian Expansion

POSTECH

IIT Mumbai

IISc Bangalore

IIT Guwahati

Internet2

ERNET

APAN

CUC Beijing

Europe

KSUKU UMKC

UNL

DSU

USD

SDSMT

UMC IUAsia IU GMOC

IIT

• Asian GpENI partners– 3 nations– 5 research institutions– 25 nodes– more under discussion



GpENINode Cluster Status1

• Midwest backbone nodes– PlanetLab and VINI operational– UNL switch installed; KU switch this year

• GENI interconnection– physical connection to ProtoGENI in KC I2 POP– connection to MAX– L2TPv3 tunnel to GMOC: gmoc.gpeni.net




• British Iles and Iberia– L2TPv3 tunnel to Lancaster to…

• JANET wavelength to Cambridge (first European node up)• L2TPv3 tunnel to UPC Barcelona (up); ISCTE Lisboa (soon)

• Switzerland, Germany, and Austria– L2TPv3 tunnel to Bern to…

• ETH Zürich (may provide additional fan-out)

– L2TPv3 tunnel to Kaiserslautern / GLab to…• OpenVPN (experimental) to TUMünchen

– L2TPv3 tunnel to Karlsruhe (temporary)




• Nordic and Russia– L2TPv3 tunnel to Simula Norway to…

• Tampere (up)• Karlstad (up)

• European GpENI meeting this year– need UK – Germany/Switzerland/Austria – Nordic backbone

• Asia– IIT Guwahati (soon)



GpENIAggregate Status: PlanetLab

• PlanetLab sub-aggregate (KSU)– MyPLC 4.3– GENIwrapper 8.5 SFA– federated with Princeton PLC

• OpenFlow integration under investigation • Loop demo publicly available (but still fragile)• PlanetLab / VINI sub-aggregate integration

– integrated portal available– waiting for Princeton PL/VINI integration



GpENIAggregate Status: Programmable Router

• Programmable router sub-aggregate (UMKC)• VINI installed

– UMKC will be beta site for 5.0 to unify with PlanetLab

• Quagga running, tested with OSPF and Zebra– currently working on sliceability

• XORP integration underway• Integrating topology creation in map demo



GpENIAggregate Status: DCN Optical Control Plane

• Optical switch sub-aggregate (UNL)– UNL switch installed; KU next

• DCN running on Ciena CoreDirectorand Netgearswitch

• Connectionestablished toMAX through ProtoGENI– interdomain

DCN



GpENIStatus: Overall Management

• Overall management, monitoring, administration (KU)• L2TPv3 tunnels coming up

– complex planning given meager funding– working with European partners to provide fanout

• UK, Switzerland, Austria/Germany, Nordic/Russia, Asia

• International optical discussions soon• Nagios management interface begin developed• GMOC node cluster installed

– should provide integration with overall GENI monitoring

• TRIDENTCOM 2010 paper



GpENIStatus: Application and User Community

• Tools– experiment control: Gush running now– code deployment: Raven running now– suggestions for other tools welcome

• User access– Limited access to wider community; Web-based request form– Seattle running

• GpENI community will likely be the first real users– FIND PoMo, EU FIRE ResumeNet, project clearinghouse soon– …but others welcome (build it and they will come?)

• the road to hell is paved with unused testbeds



GpENIStatus: Experiments

• ResiliNets / ResumeNet experiments planned soon– NSF GEW Eager– Resilience and survivability at scale– GpENI WAN + ProtoGENI access networks

• European experiment planning soon



GpENI Node ClusterSystems Software Status

• PlanetLab sub-aggregate (KSU)– MyPLC 4.3 with GENIwrapper SFA federated with PlanetLab

• Programmable router sub-aggregate (UMKC)– VINI installed; will be beta for 5.0 to unify with PlanetLab– Quagga running, XORP integration in progress

• Optical switch sub-aggregate (UNL)– UNL switch installed; KU in summer 2010– DCN running on Ciena CoreDirector and Netgear Enet– coördinating with MAX for interdomain DCN

• Overall management, monitoring, administration (KU)



GpENIUser and Application Status

• Experiment control: Gush running now• Code deployment: Raven running now• User access: external access requests considered• Demo publicly available: control‐1.ksu.gpeni.net/demo



GpENIExperiment Plans

• PoMo: NSF FIND PostModern Internet Architecture– exploring resilient transport over heterogeneous realms

• ResumeNet: EU FIREResilinece and Survivability for Future Networking– GpENI is one of the testbeds– provide ability to experiment with

• new protocols• while investigating topologies and injecting failures

• Other activities– participating in NSF GENI experimenter’s workshop– GpENI clearinghouse for international collaborations



GpENIExperiment Example

• Resilience of network when challenged– cross-verification with KU-LoCGen/TacGen



Network Experimentation with GpENINetwork Monitoring




GpENIMonitoring via Nagios1

• Nagios provides instantaneous view of the GpENI net.



GpENIMonitoring via Nagios2

• http://control‐1.ku.gpeni.net/nagios



GpENINetwork Resource Monitoring via Cacti

• http://control‐1.ku.gpeni.net/cacti



Network Experimentation with GpENIReferences

• James P.G. Sterbenz et. al.“The Great Plains Environment for Network Innovation (GpENI): A Programmable Testbed for Future Internet Architecture Research,”Proc. of TridentCom, Berlin, May 2010, pp. 428 – 441

• R. Cherukuri, X. Liu, A. Bavier, J.P.G. Sterbenz, D. Medhi, “Network Virtualization in GpENI: Framework, Implementation & Integration Experience,” Proc. of IEEE ManFI, Dublin, May 2011

• http://www.gpeni.net



Network Experimentation with GpENIAcknowledgements

• Justin P. Rohrer @KU for Nagios, Cacti, and PlanetLab support• Xuan Liu @ UMKC for MyVINI support

Documents

ITTC Communication Networks Laboratoryjpgs/courses/nets/lecture... · Communication Networks Laboratory The University of Kansas EECS 780 ... –2011 James P.G. Sterbenz Egemen K