22
Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

Embed Size (px)

Citation preview

Page 1: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

Experience of xrootd monitoring for ALICE at RDIG sites

G.S. Shabratova JINRA.K. Zarochentsev SPbSU

Page 2: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

Xrootd Monitoring

• Static monitoring - Bdii • Dynamic monitoring – Monalisa and “xRootd

federation monitoring”

Page 3: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

2 xrootd BDII versions(from Claudiu Schiaua ( [email protected]))

• Xrootd information service (xis) 2009• glite-info-provider-SE_xrootd (gip) 2010

Page 4: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

xis

• http://niham.nipne.ro/xis/xis.install.html• 2-d xrootd serivce on xis server :

root://xishost: 2194• Xrootd clients on xrootd servers.• Xrootd client on information provider (bdii

server)

Page 5: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

gip

• http://indico.cern.ch/getFile.py/access?contribId=0&resId=0&materialId=slides&confId=77435

• http://niham.nipne.ro/NIHAM-repo/instr.html Xrootd client on gip and bdii server Scheme:GlueSALocalID=xroot:SA

>ClueVOinfoLocalID=xroot:VOID:alice

Page 6: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

xrootd in ldap

Page 7: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

DPM and xrootd in BDII

http://gstat2.grid.sinica.edu.tw/gstat/site/RU-SPbSU/treeview/bdii_site/alice23.spbu.ru/

http://gstat2.grid.sinica.edu.tw/gstat/ldap

DPM

XROOTD

Page 8: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

RDIG monitoring

http://rocmon.jinr.ru:8080

Page 9: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

Requirements to dynamic monitoring

• Transfers details:– Host out (ip)– Host in (ip)– Size of file– Number of files

• Statistic details:– Size of packages for host out (in) by time– Errors

Page 10: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

Proposed Architecture to Monitoring & Control the Xrootd in ALICE

Long HistoryDB

MonALISA

Network Monitoring

ApMon

XROOTDSERVER

SystemMonitoring

MonaLisaXrootd Repository

Aggregated Data

Alerts

Actions

Xroootd Monitoring and Control, Harish Arora, Cern

ControlModule

Control / Update

MonALISA

Network Monitoring

ApMon

XROOTDSERVER

SystemMonitoring

ControlModule

MonALISA

Network Monitoring

ApMon

XROOTDSERVER

SystemMonitoring

ControlModule

Page 11: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

MonALISA on http://alimonitor.cern.ch/display

Page 12: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

MonALISA on http://alimonitor.cern.ch/display

Page 13: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

MonALISA on http://alimonitor.cern.ch/display

Page 14: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

MonALISA from gui client

• GUI client from alimonitor.cern.ch:

• Or form http://monalisa.caltech.edu/monalisa.htm :

Page 15: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

MonALISA from gui client

Page 16: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

MonALISA from console

• Need:– Monalisa Repository from

http://monalisa.caltech.edu/:

– And monalisaWSClients :

Page 17: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

MonALISA from console

• Result:

Page 18: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

xRootd federation monitoring

• 17 July 201215.45-16.00ATLAS Off-Grid Sites (Tier-3) Monitoring A.S. Petrosyan, D.A. Oleynik, S.D. Belov, J. Andreeva, I.S. Kadochnikov (on behalf of the ATLAS collaboration)

Page 19: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

Data flow for XRootD• Both summary and detailed events

gatherer implemented as Linux daemon• Summary data goes directly to Ganglia• File transfer data can be stored in local

PostgreSQL and then presented via Ganglia

• Detailed data can be delivered to ActiveMQ directly

• Data being sent to global level:• Domain from, host and ip address• Domain to, host and ip address• User• File, size• Bytes read, written• Time transfer started and finished

1917.07.2012 GRID'2012, JINR, Dubna

Page 20: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

Conclusions:• Bdii monitoring works, but not supported and

rarely used• Monalisa monitoring works, but can not

monitor separate transfer• “xRootd federation monitoring” – we wait it in

the near future.

Page 21: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

Many thanks:

• Sergey Belov• Daniil Oleynik• Artem Petrosyan• Andrey Kiryanov• And etc

Page 22: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

Questions?