1
Advanced Grid-Enabled System for Online Application Monitoring http://www.icsr.agh.edu.pl/ocmg Main Service M anager Main Service M anager Service M anager Service M anager Local M onitor Local Monitor Main Service Manager is a central component, one per each user. Location of MainSM is configurable. Service Managers are located on each site of the Grid, typically one Computing Element machines. Local Monitors are located on each Worker Node where there are monitored application process. In the process of development of Grid applications, various tools are helpful in order to find bugs in the application (debuggers) or to examine if the application is performing well (performance analyzers). Such tools require a facility that allows to obtain the information about the running application or even to manipulate its behavior. This functionality is provided by the OCM-G Monitoring System The OCM-G provides various services, for obtaining information or manipulating target application. The information obtained from the OCM-G can be presented by tools conntected to the OCM,, such as G-PM performance analyzer, in the form of various charts. Support for Grid applications running across multiple sites. Techniques for data rate reduction ensure extremely low overhead and high responsiveness. Flexible, services-driven rather than fixed-metrics- driven design Extendibility: the OCM-G can be extended with additional services, loaded dynamically at run-time. Compact and secure design: the OCM-G runs as a set of user processes, which use a fast socket-based communication mechanism. At the same time, state-of-the-art techniques are applied to ensure secure communication. No special access rights, open ports on firewalls, or other potential security holes) are required. Design as autonomous infrastructure exposing a standard interface OMIS, which minimizes the effort of porting OMIS-based tools across platforms and enables interoperability of multiple tools monitoring a single application. R U N NING A PPLIC ATIO N RUNNING APPLIC ATIO N OCM OCM- G G M ONITO RING M O NITO RING O F A PPLIC ATIO N O F AP PLIC ATIO N TO O L -VIS U ALIZA TIO N TO O L TO O L -VISU ALIZATIO N VISU ALIZATIO N G -PM G -PM Local Monitor Local Monitor Local Monitor Local M onitor A pplication Process1 A pplication Process1 A pplication Process2 A pplication Process2 U serInterface Com puting Elem ent W orker N ode W orker N ode Site A Site A Site C Site C Service M anager Service M anager Local M onitor L ocal Monitor A pplication Process3 A pplication Process3 Com puting Elem ent W orker N ode Service M anager Service M anager Main Service M anager Main Service M anager Site B Site B Purpose Bartosz Baliś 1,2 Marian Bubak 1,2 Tomasz Szepieniec 2 Marcin Radecki 2 Roland Wismüller 3 1 Institute of Computer Science, AGH, al. Mickiewicza 30, 30-059 Kraków, Poland 2 Academic Computer Centre CYFRONET AGH, Nawojki 11, 30-950 Kraków, Poland Electrical Engineering and Computer Science, University of Siegen, D-57068 Siegen, Germany {balis,bubak}@uci.agh.edu.pl, {t.szepieniec,m.radecki}@cyf-kr.edu.pl, [email protected] Architecture Unique features Usage References Bubak, M., Funika, W., Balis, B., and Wismüller, R. Concept for Grid Application Monitoring. In: Proceedings of the PPAM 2001 Conference, Vol. 2328 of Lecture Notes in Computer Science, pp 307-314, Naleczow, Poland, September 2001, Springer. Gerndt, M. et al.: Performance Tools for the Grid: State of the Art and Future. APART White Paper. Research Report Series. Balis, B., Bubak, M., Funika, W., Wismüller, R., Radecki, M., Szepieniec, T., Arodz, T., Kurdziel, M.: Grid Environment for On-line Application Monitoring and Performance Analysis. Scientific Programming, accepted. Related Work GRM / Mercury Monitor Part of GridLab project Based on fixed metrics Focus on traces R-GMA Generic framework from the DataGrid project Based on heavy Java-servlets-based communication

Advanced Grid-Enabled System for Online Application Monitoring

  • Upload
    ranger

  • View
    36

  • Download
    1

Embed Size (px)

DESCRIPTION

OCM-G. Advanced Grid-Enabled System for Online Application Monitoring. Bartosz Baliś 1,2 Marian Bubak 1,2 Tomasz Szepieniec 2 Marcin Radecki 2 Roland Wism ü ller 3 1 Institute of Computer Science, AGH, al. Mickiewicza 30, 30-059 Krak ó w, Poland - PowerPoint PPT Presentation

Citation preview

Page 1: Advanced Grid-Enabled System for Online Application Monitoring

Advanced Grid-Enabled System for Online Application Monitoring

http://www.icsr.agh.edu.pl/ocmg

Main Service

Manager

Main Service

Manager

Service Manager

Service Manager

Local Monitor

Local Monitor

Main Service Manager is a central component, one per each user. Location of MainSM is configurable.

Service Managers are located on each site of the Grid, typically one Computing Element machines.

Local Monitors are located on each Worker Node where there are monitored application process.

In the process of development of Grid applications, various tools are helpful in order to find bugs in the application (debuggers) or to examine if the application is performing well (performance analyzers). Such tools require a facility that allows to obtain the information about the running application or even to manipulate its behavior.

This functionality is provided by the

OCM-G Monitoring System

The OCM-G provides various services, for obtaining information or manipulating target application. The information obtained from the OCM-G can be presented by tools conntected to the OCM,, such as G-PM performance analyzer, in the form of various charts.

Support for Grid applications running across multiple sites.Techniques for data rate reduction ensure extremely low overhead and high responsiveness.Flexible, services-driven rather than fixed-metrics-driven design Extendibility: the OCM-G can be extended with additional services, loaded dynamically at run-time.Compact and secure design: the OCM-G runs as a set of user processes, which use a fast socket-based communication mechanism. At the same time, state-of-the-art techniques are applied to ensure secure communication. No special access rights, open ports on firewalls, or other potential security holes) are required.Design as autonomous infrastructure exposing a standard interface OMIS, which minimizes the effort of porting OMIS-based tools across platforms and enables interoperability of multiple tools monitoring a single application.

RUNNING APPLICATIONRUNNING APPLICATIONRUNNING APPLICATION

OCM-G – MONITORING OF APPLICATION

OCMOCM--G G –– MONITORING MONITORING OF APPLICATIONOF APPLICATION

TOOL - VISUALIZATIONTOOL TOOL -- VISUALIZATIONVISUALIZATION

G-PMG-PM

Local Monitor

Local Monitor

Local Monitor

Local Monitor

ApplicationProcess 1

ApplicationProcess 1

ApplicationProcess 2

ApplicationProcess 2

User Interface

Computing Element

Worker Node

Worker Node

Site ASite A

Site CSite C

Service Manager

Service Manager

Local Monitor

Local Monitor

ApplicationProcess 3

ApplicationProcess 3

ComputingElement

Worker Node

Service Manager

Service Manager

Main Service

Manager

Main Service

Manager

Site BSite B

Purpose

Bartosz Baliś1,2 Marian Bubak1,2 Tomasz Szepieniec2 Marcin Radecki2 Roland Wismüller3

1Institute of Computer Science, AGH, al. Mickiewicza 30, 30-059 Kraków, Poland2Academic Computer Centre CYFRONET AGH, Nawojki 11, 30-950 Kraków, Poland

Electrical Engineering and Computer Science, University of Siegen, D-57068 Siegen, Germany{balis,bubak}@uci.agh.edu.pl, {t.szepieniec,m.radecki}@cyf-kr.edu.pl, [email protected]

Architecture

Unique features Usage

References

• Bubak, M., Funika, W., Balis, B., and Wismüller, R. Concept for Grid Application Monitoring. In: Proceedings of the PPAM 2001 Conference, Vol. 2328 of Lecture Notes in Computer Science, pp 307-314, Naleczow, Poland, September 2001, Springer.

• Gerndt, M. et al.: Performance Tools for the Grid: State of the Art and Future. APART White Paper. Research Report Series.

• Balis, B., Bubak, M., Funika, W., Wismüller, R., Radecki, M., Szepieniec, T., Arodz, T., Kurdziel, M.: Grid Environment for On-line Application Monitoring and Performance Analysis. Scientific Programming, accepted.

Related Work

GRM / Mercury MonitorPart of GridLab projectBased on fixed metricsFocus on traces

R-GMAGeneric framework from the DataGrid projectBased on heavy Java-servlets-based

communication