MAGO Monitoring All Grid Objects

Anna Jannace, Carmine Spizuoco, Francesco Adinolfi, Giovanni Bracco

Consorzio Campano per l’Informatica e l’Automazione Industriale (C.R.I.A.I.),

[f.adinolfi, a.jannace, c.spizuoco]@criai.it

This poster describes the CRESCO subproject 1.2 “MAGO: Monitoring All Grid Objects of CRESCO”. This High Performance Computing system was installed to provide the required computing power to the CRESCO project applications and to integrate CRESCO HPC system into ENEA-GRID infrastructure.

This project is the result of the collaboration between ENEA and C.R.I.A.I.Consorzio Campano di Ricerca per l’informatica e l’automazione industriale.

The process of Monitoring & Discovery resources is needed in HPC system to find and solve the malfunctions arising in the infrastructure.

MAGO aims to realize an innovative tool to monitor ENEA-Grid resources.

The main ENEA-GRID software components are: • Multi-site resource manager LSF Multicluster, • OpenAFS distributed file system, • Kerberos 5 authentication,• GUI based on CITRIX technologies.

After a technological survey, the Information System model was chosen in according to the GLUE Schema standard (http://glueschema.forge.cnaf.infn.it/).

The study was based on the ENEA Grid infrastructure. Its characteristics imply the choice of Ganglia (http://ganglia.info/) as the core of the monitoring system.

The picture describe the monitoring system and its components: MAGO WEB, CORE and DB.

One of the peculiarities of the environments is the capability to be decentralized, allowing availability and robustness, also in case of crash involving specific computers.It was chosen in this work to create a centralized and hierarchical structure, because the system monitors Grid resources, but it does not manage them, and because such approach allows to minimize maintenance on single host.

MAGO SYSTEM

mago.sql

Core System MAGOmagoupdate.shMSiteLoaderMSiteProviderMMasterLoaderMetric

Web Application MAGOSignOnMSetupMMonitorMenquiry

MA

GO

Mon

itorin

g A

ll G

rid O

bjec

ts

INTEGRATION IN ENEA-GRID

The set of mature technologies, which belong to the infrastructure ENEA, allows to place MAGO as a tool for monitoring of activities carried out from Grid infrastructure.

HIGH LEVEL VIEW

Usage of different technologies made it possible to implement a flexible, modular, scalable, fault tolerance monitoring tool.

To understand this complexity is important to observe what and how many objects constitute the system, then in which way they interact with each other.

WEBConfigurationViewing AlarmsInclusion of new metricsQuery on database

AFSContainer of source code, application, scriptSaving configurations for each site and hostStoring Metrics

COREDecrease of collected metrics by the demons of Gmetad GangliaMAGO environment automatic installationon HostInformation Transfer on the server siteFetch and decoding input metrics

MAGO DBLarge database containing information about:

• Configuration• Metrics• Measurements• Subnets• Alarms

CORE

The core of MAGO is a distributed three level based architecture

Livello SERVER CENTRALE

Mago Core System

Livello Server di SITO

Livello HOST

Direzione Dell’informazione

The path shows the information flow from Server Site origin to Master Server destination

WEB VIEW

The MAGO Web Application has an user interface providing the following features:

Configuration of each subsystem

Access to the system through a secure connection on a CRESCO front-end host

Usage of capabilities provided by AFS and LSF systems already available in ENEA-Grid

Capability RobustnessReliability

Modularity

Scalability

Fault tolerance

MAGO project extends the functionalities offered by Ganglia package URL APPLICATION

http//www.afs.enea.it:8080/Mago/

DOCUMENTATION REFERENCEhttp://www.cresco.enea.it/LA1/cresco_sp12_criai/

CRIAIwww.CRIAI:IT

ENEAhttp://www.cresco.enea.it

Summary