Sponsored by the National Science Foundation 1March 14, 2012

GENI Racks: Infrastructure Overview

Heidi DempseyMarch 14, 2012

www.geni.net

Sponsored by the National Science Foundation 2March 14, 2012

• GENI Racks • GENI Racks Status• ExoGENI Racks• InstaGENI Racks• OpenSource and International OF and Racks

• MesoScale• Regionals and GENI core evolution• Production Evolution• Using the Infrastructure

Agenda:

Sponsored by the National Science Foundation 3March 14, 2012

GENI Racks Status

• GENI Racks projects are taking place to build out the GENI Infrastructure in the US.

• Racks provide reservable sliceable compute and network resources using a single Aggregate Manager.

• AM API compliance• GENI v3 Rspec support• Federation with Slice

Authorities (GPO, PG, PLC)

Sponsored by the National Science Foundation 4March 14, 2012

GENI Racks Status

• GENI Racks design based on GPO requirements.• GPO Infrastructure team will run Acceptance

Tests to validate integration, experimenter and monitoring features.

• GENI Racks projects timeline:

Sponsored by the National Science Foundation 5March 14, 2012

GENI Racks Status

• GPO software team has developed GENI AM API Acceptance Tests, now available in GCF 1.6.1:– http://trac.gpolab.bbn.com/gcf/wiki/GettingGcf– http://trac.gpolab.bbn.com/gcf/wiki/AmApiAcceptanceTests

• Acceptance Tests are used by rack teams to verify GENI AM API compliance.

• Aggregates that passed AM API acceptance tests:–PG Utah (RSpecs pass rspeclint)–PLC (RSpecs pass rspeclint)–FOAM 0.6.3

Sponsored by the National Science Foundation 6March 14, 2012

GENI Racks Status

• GPO Infrastructure team has defined a System Acceptance Test Plan for GENI Racks:http://groups.geni.net/geni/wiki/GENIRacksHome/AcceptanceTests

• System Acceptance Tests will be run on each of the GENI Racks when rack development is completed.

• Focus is on :– Experimenter requirements – Integrated rack solution – Monitoring features reaching production level

• As part of each GENI Racks deployment, the GPO is an initial aggregate owner and will run a delivery evaluation.

Sponsored by the National Science Foundation 7March 14, 2012

GENI Racks Status

• GENI Racks Projects being deployed:– ExoGENI A high performance, flexible virtual networking

topologies solution including OpenFlow, that also delivers a powerful platform for multi-site cloud applications. These racks are typically deployed as an integrated part of a campus network.

– InstaGENI - A mid-range, expandable GENI Racks solution that can will be deployed at a large number of campuses, delivering Internet cloud applications support, along with Openflow and VLAN networking. These racks are normally deployed outside a site firewall.

– Starter Racks: Deployed by the GPO, a project to deliver an early low-end solution for GENI Racks.

Sponsored by the National Science Foundation 8March 14, 2012

GENI Racks - ExoGENI

• ExoGENI – High-performance GENI Racks – a partnership between

RENaissance Computing Institute (RENCI), Duke and IBM.

– ExoGENI racks deliver support for multi-domain cloud structure with flexible virtual networking topologies that allow combining ExoGENI, Meso-scale OpenFlow and WiMAX resources.

Sponsored by the National Science Foundation 9March 14, 2012

GENI Racks - ExoGENI

• ExoGENI deployment schedule 2012:

Sponsored by the National Science Foundation 10March 14, 2012

GENI Racks - InstaGENI

• InstaGENI– mid-range, expandable

GENI Racks at large number of campuses

– A small ProtoGENI cluster with OpenFlow networking and FOAM aggregate management

– Typically found outside the site firewall.

Sponsored by the National Science Foundation 11March 14, 2012

GENI Racks - InstaGENI

• InstaGENI deployment schedule 2012:

Sponsored by the National Science Foundation 12March 14, 2012

Open Source and International OF and Racks

• NEC– Proposing new racks – Using NEC switches, TREMA and OpenStack – Implemented with open source community– Based on commercial components already used in

GENI • OFELIA

– An European Union venture with 12 industry and academic partners

– Includes 5 OpenFlow campuses– Solution includes an aggregate manager that is similar

to the GENI AM.

Sponsored by the National Science Foundation 13March 14, 2012

Mesoscale: Building at-scale Infrastructure

• GENI VLAN data plane• Public IP control plane• GENI AM API programmable interface • GENI shared monitoring and reporting• GENI operations policies and support • Brave IT staff and researchers on campuses• Brave regionals and core networks• Tools

What do I need besides racks?

Sponsored by the National Science Foundation 14March 14, 2012

Mesocale Overview

Sponsored by the National Science Foundation 15March 14, 2012

MesoScale Spiral4 Deployments

Sponsored by the National Science Foundation 16March 14, 2012

MesoScale - Utah Education Network

UEN, ProtoGENI and InstaGENI:

Sponsored by the National Science Foundation 17March 14, 2012

Mesoscale – Southern Crossroads

SOX OF Regional

Sponsored by the National Science Foundation 18March 14, 2012

Regionals: CENIC (California)

CENIC proposed OpenFlow Topology

Sponsored by the National Science Foundation 19March 14, 2012

Regionals - Midwest OpenFlow Crossroads

MOXI Architecture – Aggregating Regionals

Sponsored by the National Science Foundation 20March 14, 2012

Regionals - Shared Fiber

MOXI I-Light Architecture

Sponsored by the National Science Foundation 21March 14, 2012

Expanding regional testbeds - GpENI + KanREN

Sponsored by the National Science Foundation 22March 14, 2012

StarLight/MREN

University of IllinoisUrbana

Champaign

I2 at StarLight

ESnet at StarLight

GENInet atStarLight/MREN Facility

MRENE1200lSwitch

OpticalSwitch

ICCN/I-WIRE

StarLightE1200Switch

NLRAt

StarLightOpticalSwitch

I2ION

ESnet

OpticalSwitch

Multiple EU, Asian, South

American Sites

NDDI

DYNES

InstaGENI RackWith OF SWiCAIR

GENI OF SWiCAIR

Multiple National Regional, State Net

Connections

StarLight/MREN

Sponsored by the National Science Foundation 23March 14, 2012

University of Utah, Princeton University, GPO, Northwestern University, Clemson University, Georgia Tech , University of Kansas , New York University

University of Victoria

GENI Core backbone NOX

GPNNYSERNET

CANARIEBCNET

SL/MREN

SOX

MAGPIUEN

InstaGENI Spiral 4

Sponsored by the National Science Foundation 24March 14, 2012

ExoGENI Spiral 4

FIU tbd

Sponsored by the National Science Foundation 25March 14, 2012

NLR OpenFlow Expansion

Sponsored by the National Science Foundation 26March 14, 2012

Internet2 OpenFlow Expansion and NDDI

Sponsored by the National Science Foundation 27March 14, 2012

OpenFlow integration and test

• Working closely with ONF and Stanford• FOAM AM now at all Spiral 4 OpenFlow sites• New firmware upgrades for some switches• Stanford campus expansion and CENIC migration• Any-to-any OpenFlow connections in Spiral 4

Sponsored by the National Science Foundation 28March 14, 2012

Evolving Production Support

• Help:– help@geni.net mailing list– GMOC helpdesk (Marianne Chitwood at Experimenter Tools and

Services GEC13 session) http://gmoc.grnoc.iu.edu/gmoc/index/support.html

– GEC "coding" sprints– IRC/chat (informal)

• Prototype monitoring and status for Meso-scale sites:– http://monitor.gpolab.bbn.com (at GPO)– http://gmoc-db.grnoc.iu.edu (at GMOC)– much more new coming with GENI Rack deployments

• GPO working with GMOC and GENI Rack Teams to get production level monitoring and statistics.

• Implement the GMOC Concept of Operations by refining the GMOC API format.

Sponsored by the National Science Foundation 29March 14, 2012

Evolving Production Support

Meso-scale site statistics from GEC12-GEC13• GPO PG Usage statistics:

– Overall slice creation attempts: 1992 (Successes: 1989 Failures: 3 )– Experimenter slices: 265 ( 29 distinct non-GPO PG users )

• Site Availability Statistics:Site %Internet2 99.8

NLR 96.1

Stanford 74.3

GPO 99.4

Clemson 97.7

Rutgers 93.0

GATech 94.7

Sponsored by the National Science Foundation 30March 14, 2012

Evolving Production Support

• Defining incidence response procedures Legal, Law Enforcement and Regulatory Plan– Emergency Stop Procedure

• Security and GENI Legal, Law Enforcement and Regulatory Contacts: – Adam Slagell (slagell@illinois.edu) primary– Steve Schwab (schwab@isi.edu)

Sponsored by the National Science Foundation 31March 14, 2012

Using the Infrastructure

• Experiments• Slice Around the World!

– A GENI international collaboration– To include various types of racks located in 4 continents

to provide resources into a common slice – Sites in Japan (CoreLab), Germany (G-Lab), and Brazil

(LARC)– Several US GENI Rack sites (TBD)– To take place July 2012 at GEC 14

• What do you want to do?