© 2006 Open Grid Forum Network Monitoring and Usage Introduction to OGF Standards

© 2006 Open Grid Forum

Network Monitoring and UsageIntroduction to OGF Standards

2 © 2006 Open Grid Forum OGF24 Singapore September 2008

But the Network just works !

Grids always used resource information about: CPUs, memory, disks, Job queues

But later Grids need information about the Network resource: Decisions by the Middleware Resource Broker Performance investigations Network Operators & Capacity planning

Many monitoring frameworks – all different but need to interoperate

Must be able to describe the topology: Monitoring Policy Dynamic control

Networks are becoming dynamic – multi-domain on demand operation from the middleware.

Need for standard mechanisms to describe and publish network descriptions, performance characteristics, & enable dynamic control.


Infrastructure Area: Networking

The relation between the working groups

Network MeasurementsNM-WG

Network Mark-up LanguageNML-WG

Grid High Performance NetworkingGHPN-RG Network Service Interface

NSI-WG

Network-NetworkDNMR-BOF

Grid-NetworkGNI-BOF

Network Measurement & ControlNMC-WG

Use CasesBest Practices

Standards

spawn

merge

Grid Virtualisation WG; Firewall Virtualisation WG

DICE


Network Measurements WG

Focuses on Network Characteristics of interest to grid applications.

Developed standard mechanisms to describe and publish these characteristics to the Grid middleware, network operators etc.

Created a document categorising the Network Performance Characteristics for Grid Applications.

Created XML Schemata to publish and exchange the values of the observations of these characteristics along with attributes describing the measurement conditions.


Characteristic Hierarchy Doc

“A Hierarchy of Network Performance Characteristics for Grid Applications and Services”

Document defines terms & relations: Network characteristics Measurement methodologies Observation

Nodes & Paths Defines the meanings Discusses the use & relations

For each Characteristic Defines the meaning Stated the attributes that SHOULD be included Discusses the issues to consider when making an observation

GGF Proposed Recommendation GFD-R.023 www.gridforum.org/documents/GWD-R/GFD-R.023.pdf


perfSONAR: Using NM-WG Schema

perfSONAR uses the NM-WG Recommendations and Schemata for the API Proposed the NMC-WG for protocols

perfSONAR is performance middleware Modular Web services-based Decentralized

Integrates: Network measurement tools Network measurement archives Discovery Authentication and authorization Data Manipulation Topology Visualization

Analysis & Visualization

Measurement Infrastructure

Performance Tools Performance

Tools

Analysis & Visualization

Measurement Infrastructure

API

API


perfSONAR Uptake & Deployment

perfSONAR is a joint effort: ESnet GÉANT2 JRA1 Internet2 RNP (Brazil)

ESnet includes: ESnet/LBL staff Fermilab

Internet2 includes: University of Delaware Georgia Tech SLAC Internet2 staff

GÉANT2 JRA1 includes: Arnes Belnet Carnet Cesnet CYNet DANTE DFN FCCN GRNet GARR ISTF PSNC Nordunet (Uninett) Renater RedIRIS Surfnet SWITCH

Other contributions & installations: CLARA (Latin American Cooperation

of Advanced Networks) LHC Network JANETAn OGF success story: 27 partners


Network Mark-up Language WG

Working to describe network topologies with a standardized network description ontology and schemata

The work will: facilitate interoperability between different projects. allow creation of inter-domain network graphs at various

abstraction levels provide an information model for service discovery facilitate on-demand multi-domain network provisioning

such as QoS, point-to-point lightpaths, Lambdas Feed into standards from other OGF working groups


An example of the descriptive task to be done

SONET switch with

Ethernet intf.End host End hostSONET switch

Ethernet &SONET switch

SONET switch with

Ethernet intf.Univer

sité du

Quebec

StarLight

Chicago

Universiteit

van

Amsterdam

CA★Net

Canada

MAN LANNew York

NetherLight

Amsterdam

IP layer

Ethernet layer

STS layer

UTPfiber

layerlayer

OC-192 layer


The Network Service Interface: Driver

AutoBAHNGÉANT & NRENs

DCNInternet2 & ESNET

DiracSURFNET

Dynamic domains are trying to inter-work NOW


Network Service Interface WG

First WG meeting in OGF24 Interest & support from industry – grid operators, network

equipment vendors industry partners include NTT, KDDI, Nortel and Alcatel-Lucent Bell

Labs

Build on research projects including: Phosphorus, AutoBahn, DICE, and G-Lambda

Involves currently deployed dynamic networks such as ESnet, Internet2, GÉANT, Surfnet

There is a real demand from users


Summary

There is a real demand from users for advanced network facilities

The need for inter-operation between domains & providers drives the need for standards

OGF facilitates co-operation & collaboration A document series for Standards


Any Questions?

Documents

© 2006 Open Grid Forum Network Monitoring and Usage Introduction to OGF Standards