R O E NM A N I A N D U C A T I O N E T W O R K

N etE duR o

Monitoring backbone networks

Manuel Șubredu, Valeriu Vraciu – RoEduNet

Chișinău, September 9, 2014

Agenda

Why ? What ? How ? Tools ? Facts !

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Why ?

A picture is worth a thousand words ! – Frederick R. Barnard, 20th century

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

What to monitor ?

Backbone and critical equipment – routers, switches, firewalls, load-balancers, etc

Servers and services Values of traffic Error rates Transport network equipment, if available

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

How

Always use Industry standards for collecting data like:

SNMP NetFlow v5/v9 and IPFIX

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Tools

OSS Software largely available SNMP based:

NMIS Cacti Weathermap

NetFlow based: NFSEN/NFDUMP

Custom software Maps using free API from Google Maps (CEENGINE

VTR) Maps using different technologies: JS, ActionScript,

PHP, SVG, etc (RoEduNet WeatherMap) Proprietary software

For optical network

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Facts forRomanian Education Network !

NMIS: home: https://opmantek.com/network-

management-system-nmis/ 90 routers and 20 switches monitored Uses SNMP for collection of data Xen based VPS - 1 x Xeon 2.4Ghz, 1G of

memory, 64G of disk OpenSuSE (64 bits) Average load of the server – 2-3 3G of disk space for data since 2009 (5 years) Requires some knowledge of Linux system

and services for setup

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

NMIS (main page)

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Facts forRomanian Education Network !

Cacti home: http://www.cacti.net/ Uses SNMP for collecting data Can easily monitor any OID that returns an

integer (think about temperature, number of routes, etc)

Easy deployment and small requirements (web server with PHP)

Easy administration using a web interface Authenticated access, configurable per user

views

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Cacti (custom temperature graph)

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Facts forRomanian Education Network !

Weathermap home: http://www.network-weathermap.com/ Uses RRDs from NMIS Can be build using only OSS technologies like

SVG and JavaScript Is very flexible and can accommodate all kind

of data visualisation Major downside – requires some programming

skills

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

RoEduNet Weathermap

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Facts forRomanian Education Network !

Nfsen/nfdump home: http://nfsen.sourceforge.net/ Uses NetFlow (v5 or v9) Can have profiles of subset of data (think about

graphs by service type or by IP addresses) Supports plugins (Perl knowledge is required) Supports alerts based on threshold or deviation

from the mean Major downside – lots of hardware needed on

big networks: 1 server for data processing (8 x Xeon E7000 2.8Ghz with 64G of memory) and 22T of storage for 6 month of NetFlow’s exported by 13 core routers (8-12Gbps average traffic).

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Nfsen (main page)

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Facts forRomanian Education Network !

CEENGINE Visual Traceroute home: https://noc.ceengine.eu/vtr/ Based on Google Maps Heavy use of JS and custom web services Backend and data collector written in Perl

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

VTR

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Facts forRomanian Education Network !

Custom maps home: N.A. Frontend based on JS and HTML5 Backend uses multiple OSS services and

technologies: Lots of data input points: email, http, logs,

other databases. PostgreSQL as database server Perl for data processing REST API

Low hardware requirements: 1 Xen based VPS with 1 Processor and 4G or memory.

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Project Asgard

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

(Extra slide – RoEduNet Optical network management)

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Q ?

E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014