PSNC's Optical Developments Artur Binczewski, Tomasz Szewczyk PSNC TERENA 3rd Network Architects Workshop

PIONIER in the pill

Source - http://www.glif.is/publications/maps

• Area 312k sq km

• Population 38M

• Main academic centers 21

• State universities 165+

• Students 2M+ • R&D institutions and Univ. interconnected via PIONIER network 700+

21 MANs and 5 HPC Centers in PIONIER Consortium with PSNC as Operator

6479 km of fiber infrastructure in Poland 2359 km of fiber in Europe (IRU) 8838 km of fiber in total

PIONIER global collaboration

GÉANT GLIF

PIONIER EU

PIONIER network infrastructure

Regional Networks

PIONIER National Infrastructure

NewMAN project

• National scale deployment of MPLS/IP platform for all MANs and PIONIER – MPLS „last mile” is provided for most of users – Full portfolio of offered services: IPV4, IPv6, MPLS based VPNs,

multicast, QoS,… • New generation DWDM with automatic restoration (GMPLS)

– 100G ready – Colorless, Directionless and Contentionless functions implemented – All nodes support p2p 10G transmission without regeneration

MPLS/IP platform

Core switches 191

Access switches 365

10 GE interfaces 4 416

1 GE interfaces 21 680

DWDM platform

nodes 79

ROADMs 143

10GE interfaces 396

ZIELONA GÓRA

KATOWICE

KRAKÓW

LUBLIN

WARSZAWA

BYDGOSZCZ

TORUŃ

CZĘSTOCHOWA

BIAŁYSTOK

OLSZTYN

RZESZÓW Bielsko-Biała

KOSZALIN

SZCZECIN

WROCŁAW

ŁÓDŹ

KIELCE

PUŁAWY

OPOLE

RADOM

CESNET; SANET 2x10 Gb/s

GÉANT 30 Gb/s

CBDF 10Gb/s

Zamość

UKRAINE 1x10 Gb/s

Gorzów

PIONIER network node

2 x 10 Gb/s (2 lambdas)

POZNAŃ

Elbląg Suwałki LITHUANIA 1 x 10 Gb/s

BIELARUS 1 x 10 Gb/s

GDAŃSK

RUSSIA (Kaliningrad) 1 x 10 Gb/s

Colorless, directionless and contentionless 80ch DWDM system

Sochaczew

Hamburg (GLIF, Surfnet, Nordunet) 4x10 Gb/s

National Research and Education Network – PIONIER (transmission)

New GLIF links

International Fiber Infrastructure

AMS-IX GLIF

CERN

DE-CIX

VIX

HAMBURG

100G migration

Gdańsk KDM

Poznań KDM

Wrocław KDM

MAN Szczecin

MAN Zielona

Góra

MAN Bydgoszcz

MAN Często chowa

MAN Opole

MAN Śląsk

MAN Łódź

100Gb/s

MAN Koszalin

MAN Olsztyn MAN

Toruń

MAN Białystok

MAN Puławy

MAN Radom

MAN Kielce

MAN Lublin

MAN Rzeszów

HPC Gdansk

HPC Poznan

HPC Wroclaw

HPC Warsaw

HPC Krakow N x 100Gb/s

100G migration

100Gb/s

N x 100Gb/s

AMS-IX GLIF

HAMBURG

VIX

CERN

DE-CIX

Wroc

Poz

Gda

Waw

Cra

planned

100G migration

HPC PSNC NODE

DWDM 100GE

Transponders 100GE

& 10x10GE

Muxponders

HPC 2

HPC 5

100NET DWDM Coherent ≥ 100G λ

HPC resource

Existing

Juniper MPLS Switch with new 100GE card

Existing

Juniper MPLS Switch with new 100GE card

MAN 1 MAN 21

LLE Switch SDN

IB/Eth Switch SDN

MPLS Switch 100GE/10GE

SDN

MPLS Switch 100GE/10GE

SDN

NewMAN DWDM 10G & 100G λ

Firewall

Firewall

Is it enough?

Research infrastructure must be equipped with advanced „living” labs

• Available always and remotely

• Provide possibility to make disruptive and repeatable tests

• Provide full workflow for users (managing lab infrastructure, users access and experiments)

Example of network technology laboratories in PIONIER network

• Hardware Design and Prototyping Laboratory

• Optical Technology Laboratory

• Open Network Hardware Laboratory

• Integrated Network Management and Simulation Laboratory

• Software Defined Network Laboratory

Hardware Design and Prototyping Laboratory

SMT PLACEMENT EQUIPMENT • Robotic SMT machine • High speed • High precision

STENCIL PRINTER

REFLOW OVEN • Multiple soldering zones • Conveyor belt PCB transmission • High quality thermal profiling

HETEROGENOUS INSPECTION SYSTEM • Voiding check capabilities • Cold solder joints discover • Electrical correctness inspection • Signal analysis in bandwidth of tens of GHz

PCB BOARD • Multilayered designs • Impedance controlled • Mostly FPGA powered • Gigabit transmission oriented

(10G / 3GSDI etc.)

Examples of own hardware design

VIDEO HEADER • 8 independent LVDS lines • Source synchronous mode • Up to 8Gbps throughput • Fitted for 8/10mpx sensors • 4K resolution @ 60fps

VIDEO RAM • Post acquisition buffer for digital signal

processing purposes • Video RAM for 4 independent video

controllers • DDR2 technology @ 400MHz

FPGA CHIP • Internal IP architecture based on

proprietary AXI4-like bus • Unique design of quad head

graphics controller • Real time demosaicing and color

space conversion

DIGITAL VIDEO INTERFACES • HD-SDI & 3GSDI compatible • Four independent video channels • Multiple video modes available

The miniaturized 4k camera

MULTIPLEXER FEATURES • integrated DDS for phase and freq

adjustment 10MHz clock • phase shifting for PPS & 10MHz • programmable delay line • silent switching capability • OCXO oscillator • backup clock for no input signal • ETH statistics and management

The high precision atomic clock signals MUX

Optical Technology Laboratory

Existing measurement tools

POLMUX WDM OSA

PSO-200

Power meter

Tunable attenuator

Router tester 10G

CD i PMD

EDFA/RAMAN

OTDR

Finisar WaveShaper

4000S

MEMs Optical Switch

IP tester 100G

Tunable Sources HR OSA

PMD ControllerFilters PolarizatorsFibers

Broadband light source

3 ROADM nodes supporting: – colourless, directionless,

contentionless and gridless

Interfaces: 10G, HD-SDI/3G, 100G and 400G link

Tunable lasers able to apply different modulation schemes (affecting the size of the signal spectral bandwidth)

Additional measurement tools and elements

Open Network Hardware Laboratory

ONH Laboratory: – ATCA standard (Advanced Telecommunications Computing

Architecture) – 6 chassis - equipped with several blades with different network

processors (NP) and digital signal processors (DSP) Each ATCA chassis (node) in the ONH Laboratory has:

– two Ethernet 14 SFP+ blades (switch), – two dual Intel Xeon E5-2600 blade with SAS disk, – dual Cavium Octeon II CN68xx blade together with Cavium Octeon

SDK, – dual Broadcom XLP832 module and dual EZchip NP4 blade.

Each ATCA chassis is also equipped with Texas Instrument DSP media resource module that provides high density of media processing Nodes have 20 x 1G/10G interfaces for interconnections and seven free slots for future expansion and reconfiguration

Open Network Hardware Laboratory

ATCA node decomposition

Integrated Network Management and Simulation Laboratory

FTTH Switch

CPE

MPLS Router

MPLS Router

MPLS Router

MPLS Router

MPLS Router

MPLS Router

CPE

STB STB

Domain A Domain B

Access Switch

MPLS Network MPLS Network

FTTH Network

Computer Center

FTTH Switch

CPE CPE

STB STB

Access Switch

TV TV

TV TV

Computing Resources

Server (OpenStack, OpenFlow, MGMT…)

Computer Center

FTTH Network

Integrated Network Management and Simulation Laboratory

Software • IBM Tivoli / HP OpenView

– Cloud and infrastructure management system – Network management – Virtualization management – Cloud management – Services management

• SteelCentral (OpNET) – Network planning – Network performance simulator – Multi-technology, multi-vendor design – Lifecycle support

Software Defined Network Laboratory

Current status • Mininet was used as first-choice for testing of SDN developments in

PSNC • A simple testbed using MX80, MX240 and EX9208 was used for

demonstrations (shared in time) • The number of SDN related projects increased, sharing the testbed is

not possible anymore, it was decided to build a shared, flowspace based testbed

• The testbed consists of: – Two Juniper MX80 supporting OpenFlow 1.0 – Flowvisor and servers to accommodate endpoints and controllers

flowvisor

controller1

controller1

Controller-3

Controller-n

VMA-1

VMA-2

VMA-3

VMA-n

VMB-1

VMB-2

VMB-3

VMB-n

Juniper MX 80Juniper MX 80

mgmt

OpenFlow OpenFlow

Endpoints Endpoints

Externalconnections

Externalconnections

Software Defined Network Laboratory

Current status • Floodlight and

OpenDaylight as a controller

• In addition to „traditional flowvisor” we looking also for other options for slicing/virtualization (flowspace firewall, OVX)

• This simple testbed is integrated with current national testbed (PL-LAB)

Software Defined Network Laboratory

• A new infrastructure project received structural funds funding: PL-LAB2020

• Joint collaboration of PSNC, NIT and 4 Polish Universities

• 10 Gb/s interconnectivity between SDN sites in the core

• Each site equipped with wireless and SDN testbeds

• Deployment: Q3/Q4 2015

PSNC

PG

PW

AGH

IITiS

PŚl PWr

PP

VPLS

IŁ

10 Gb/s 10 Gb/s

10 Gb/s

10 Gb/s

10 Gb/s

1 Gb/s

1 Gb/s

1 Gb/s

10 Gb/s

Summary • Infrastructure bridge between East Europe countries and GÉANT,

GLIF, CERN and Open/Internet Exchange Points based on 10/100 Gbps lambdas

• Achieve synergy in development network and research infrastructures – Openness for public and commercial research sectors – Support to national, Horizon 2020 and global collaboration

projects – Efficient use of Structural Funds

• PIONIER is part of Polish Roadmap of Research Infrastructures – Focused on innovation inspired by ICT – New list of 53 research initiatives – Integration with others research infrastructures