GEANTNetworkEvolution

RickHavernHeadofNetworkEngineering

TechExchangeSeptember2016

Miami

Agenda

Thethingscausingustothinkdifferently

Ourchallenge

Whatwehavedone

Whatwearedoing

Ourcollaborations

Whatwewanttoachieve

Onaveragehumanknowledgeisdoublingevery13monthsAccordingto IBMthebuildoutof the“internet ofthings”willleadtothedoublingofknowledgeevery12hours.

3

HumanBrainIndexingWillConsumeSeveralBillionPetabytesInalectureatHarvardUniversityneuroscientistJeffLichtman,whoisattemptingtomapthehumanbrain,hascalculatedthatseveralbillionpetabytesofdatastoragewouldbeneededtoindextheentirehumanbrain.

We are seeing traffic volumes doubling every 18 monthsThe amount of data forecast to be generated and stored isastounding. This will drive an exponential growth in networktraffic. IP backbone trunks will need to be 400Gbps by 2020 &a terabit by 2025

• Multidomaininteroperation• CommonlysupportedtechnologiessuchasMPLSarekey• CommonOSS/BSSsystemsarchitecture• Commonserviceofferings• InteroperatewithallkindsofServiceProviders&infrastructures

• Commercial• R&E

• Commonserviceofferings- Inalignmentwithglobalpartners;evaluatedagainstcommercialequivalents• Technology&vendoragnosticservices(hardware&software)• Servicesbuiltonstandardsbasedcommoncomponents- CreatedoutofasharedcommonOSS/BSSarchitecture

• Increasingcomplexity• Services&functionsmoveoutofhardwareintosoftware• Virtualised resourcesandfunctions• SoftwareOrchestration

• Sustainability• Morecapacity• Fasterinterfaces• Operationalcomplexity 4

Itisnotonlytrafficgrowththatisdrivingourthinkingforhowourplatforms(network+OSS)needtoevolve

Thisourchallenge

5

• Exponentialtrafficgrowth+

• Needformoreadvancedservices+

• Greateroperationalcomplexity

Forcesustoadopttechnologyearly

We adopt technology here Wepayapremium

• Convergenceofpacketandopticalnetworks• Commonpacket/opticalcontrolplane• Corenetworkmadesimpletoforwardpacketscosteffectively• Sophisticatedservicesdeliveredonoverlays- separationwithcorenetwork• Useofvirtualisednetworkfunctions• Greaterprogrammability• Intelligentmanagementplane(s)• Vendorindependence– separationofhardwareandsoftware• Seamlessinteroperationofinfrastructures

6

Newthinkingisrequiredtomeetlonger-termdemandscosteffectively

WhathavewedoneBuiltalabforevaluatingnewsoftware&technologies

• Labbuilttoemulateproductionenvironmentascloselyaspossiblewithinrealisticfinancialconstraints:• JuniperMXrouters andInfineraDTN-x,alongwithtrafficandroutegenerators,multicastsourcesandreceivers

• Configurationandcodeversionsidenticaltoproductionnetwork• BGPcommunitiesandnetworkseparation

• NetFlow v9• Infinera OTSV

• PXMevaluation&JuniperDWDM• Alienwavetesting

• SDNevaluationandtesting,Corsa DP6410;PICA-8P-3922;DellS4810-ON• DTNtesting• Pre-stagingandtestingequipmentbeforeshipment

7

• Equipment• 2xCORSADP64x0• 2xPICA8Switches• 2xDellS4810SwitchesrunningCumulusLinux

• 1xDellServerforVMs• InterconnectedtotheGÉANTJuniperMXlab

Whathavewedone:BuiltaSDNLabTestinganddevelopment- PoC evaluation

8

WhathavewedoneSuccessfulimplementationofnewIASAStoseparateREN-to-RENfromREN-to-Internettraffic

9

InternetAccessServicevirtualroutingandforwarding(VRF)created– newASestablished,REN-to-RENtrafficseparatedfromREN-to-Internettraffic

• CloudVRFadded

NRENshavetheabilitytotrafficengineertheirroutepropagationthroughtheuseofopt-inoropt-outBGPcommunities,withper-peer&per-PoP/IXgranularity

Ifrequired,createaphysicalseparationoftraffictypes:• RENtoRENon100Gbps• RENtoIonNx10Gbps

NRENB

NRENC

NRENA

Peer/upstream

Peersand upstreammovedtonew

VRF/ASN

GÉANTren-IASN21320 GÉANTren-ren

ASN20965

NewsFlash

NewsflashGÉANTCloudVRFperformancebeatscommercialISP

10

T-Systemsuncappedaccessto10Gforthedurationofthetest

NewsflashGÉANTCloudVRFperformancebeatscommercialISP

11

ThankstoCERNforsharingtheirtestresults

WhathavewedoneSharingspectrumwithNRENs

IdentifiedrouteswhereGÉANTandNRENscouldbenefitfrominfrastructuresharing• Amsterdam– Hamburg,alreadyinservice• Amsterdam– Paris,inserviceQ42016• Milan– Geneva• Madrid– Lisbon• Paris– Lisbon• Marseille– Milan• Marseille– Madrid• Budapest– Zagreb

12

WhathavewedonePacketopticalintegration

IP-over-OTNarchitectureisnowdeployedusingInfinera PXMcards

13

Juniper DWDM implementation is also beingconsidered, currently under lab testing andto be trialled in future

We can now disaggregate 100Gbps interfacewithout any of the nx10G performance issues andcreate multiple direct routes that do not follow thefibre

IPtrunksdidfollowthefibretoreducethenumberof100Gbpsinterfaces&cost

Whatarewedoing:Transportandmulti-layerSDNSoftwarecontrolofpacketandopticallayers

14

NREN

GÉANTWDM/OTN

100GbE 100GbE 100GbE 100GbE

100G

bE

NREN

GÉANTRouter

GÉANTRouter

GÉANTRouter

GÉANTRouter

LegacyODU4/2elinkstoroutersviaTIMports

IPtrunks.ODUflex usedtomanagebandwidthbetween

PXMcards.Thesearestatic(notOTScontrolled)

PXMcardssupportterminationofEVPLcircuitsonvlans

SDNcontroller

L2SDNswitch

L2SDNswitch

L2SDNswitch

Nx10G

bE

Nx10G

bE

OTSv

ODUflex andOTSvusedtodynamicallyinstatiate theselinks

• Solutionsforthecarrierbackbone• Software-DefinedInternetExchange(SDX)atLayer3(SDNIP)andLayer2

• TransportSDN• SDN-basedBandwidthonDemand(BoD)withadvancedpathcomputationcapabilities

Whatarewedoing:DevelopingSDNsolutionsfordifferentdomainsNewfeatures,futureservices

15

• Solutionforintra-campusnetworking• UsinganSDNcontrollertostitchflowspaces toVLANswithinthecampus

• Solutionforintra-DCnetworking• OverlaynetworkingandL2gatewaysolutions

• SDXLayer3:• EnablesanSDNnetworktobeoperatedastheIXPinfrastructure

• IPtransitserviceviaBGPtocustomers:• Dynamicpeeradministration• Same-subnetBGPpeers’configuration

• Directcommunicationbetweenpeers(viamodifiedProxyARPapp)

Whatarewedoing:Developing futureGEANTExchangepointsAhybridenvironmentforL2andL3services

16

BGPSpeaker1

BGPSpeaker2

SDN-IP1 SDN-IP2

ONOS1 ONOS2

ExternalNetwork1

ExternalNetwork2

ExternalNetwork3

ExternalNetwork4

ExternalBGP

Routers

ExternalBGP Router

ExternalBGP Router

ExternalBGP Router

ExternalBGP Router

SDNNetwork

• SDXLayer2:

• L2tunnelsbetweenMAC/VLANendpoints,taggedwithVLAN/MPLS

• AllowsautomatedprovisioningofL2tunnelsbetweenSDXcustomers:

• AbstractionofvirtualSDXs

Whatarewedoing:Developing futureGEANTExchangepointsAhybridenvironmentforL2andL3services

17

SDNNetwork

ExternalNetwork1

ExternalNetwork2

ExternalNetwork3

ExternalNetwork4

BGP peer1 BGP peer2

BGP peer3 BGP peer4

InternalBGPspeakerQuagga router1

InternalBGPspeakerQuagga router2

ONOS1controller

ONOS2controller

SDXL3app

SDXL3app

SDXL2app

SDXL2app

Whatarewedoing:DevelopingSDN-enabledBoDSDN-powered,guaranteed-capacitycircuitsondemand

18

GUITS

NSA IDM NSA

DynPaC DynPaC DynPaCONOS ONOS

TechnologyProxy

OpenFlow OpenFlow

RestAPI

RestAPI

NSI-CS NSI-CS

SW01Pica8

SW02Pica8

SW05CORSA

SW06CORSA

JuniperMX

JuniperMX

JuniperMX

JuniperMX

SW07OVS SW11

OVS

SW10OVSVM VM

SW08OVS

SW09OVS

Domain1

Domain2Domain3

CambridgeLabSDN GÉANT-BoD non-SDN AMRESSDN

JunosSpace

• Vendor-agnosticimplementation• Efficientuseofthenetworkcapacity

• Flowrelocation• Flowdisaggregation

• Resiliencyincaseofalinkfailurewithquickrecoverytimes• Pre-computedbackuppaths

Whatarewedoing:Evolvingournetworkmanagement,controlandserviceplaneDisaggregationandmodularisation ofsoftwarecomponents

19

• Software-ization ofthemanagementandcontrolplane*• Standard-ization ofinterfaces• Vendor-independence

• NotnecessarilyGEANT-builtsoftware

VendorEMS/NMS

OSS/Middleware

Serviceapp Serviceapp Serviceapp

TechnologyProxy

Legacynetworkelements

Embeddedmanagement/controlfeatures/vendorOS

Netconf/SNMP/…

Middleware

*NFVaspectsarestilltobeaddressedforGEANT

Services

SDN

Infrastructure

• DeliveringL2-L3SDNdataplanefunctionalitybyleveragingCORSAhardwarefeatures• Supportfor10/40/100GE,transceiveragnostic,enhancedQoS(Deepbuffers),OF1.3compliant,multi-tablepipeline

• GÉANT-tailoredmulti-tablepipeline• Metering• ONOSdriver

VendorcollaborationGÉANT-tailoredvendordevelopments

20

• Co-developingasolutionformanagingOTN(PXM)cardsusingONOS• LeveragingOTSv• UsingRESTtorequestanEthernetvirtualprivateline(EVPL)servicebetween100GBports

• PresentationofGÉANTservicedefinitions• Specialised presentationsonSDNcontrollerrequirements

• ComparisonofONOSroadmapwithGEANTroadmap• ManyGEANTcommitstotheONOScorecodebase:

• https://github.com/opennetworkinglab/onos/commits• https://github.com/opennetworkinglab/onos-app-samples/commits• Mostofthemreviewedandmerged

• Flow-objectiveframeworkcapabilitynotdeliveredaspromised:• GEANTdeveloperhostedbyON.Lab toimplementandintegratetherequiredfunctionality

• Three-waycollaborationwithCorsa ontheSDXL2/L3cases• Three-waycollaborationwithInfinera ontheTransportSDNcase

CollaborationwithON.LabGÉANTcontributingtoglobalcommunityopen-sourcecontroller

21

• Determinetherightwaytoseparatecontrol,dataandmanagementplanes• PowerfromvendorsintothehandsofUsersandOperators

• Integrationbetweenourpacketandopticalplatforms• Enablesinglecontrolacrosstheselayers– useexpensiveinfrastructuremoreefficiently

• Routerreplacement– separationofcontrolanddataplaneswithamanagementplane• Alternativetoexistingvendorsolutions

• Seamlessinteroperationofinfrastructures• Trulymultidomain

• Moveservicesintosoftware• Becomevendoragnostic

• CosteffectivelyruntheGEANTnetworkinthefuture

WhatwewanttoachievePutSDRIVENNintooperation– PRODUCTIONSDN

22

Thankyou andanyquestions?Thankyou andanyquestions?