19
28.11.2011 1 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH) RO-LCG WORKSHOP IFIN-HH, Magurele, 28.11.2011 M. Dulea Elementary Particles and Information Technology Dept. Applications of Grid Technology and High Performance Computing in Advanced Research

28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

Embed Size (px)

Citation preview

Page 1: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

28.11.2011 1

Current Status of the Grid Computing for Physics in Romania

Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

RO-LCG WORKSHOPIFIN-HH, Magurele, 28.11.2011

M. DuleaElementary Particles and Information Technology Dept.

Applications of Grid Technology and High Performance Computing in Advanced Research

Page 2: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

28.11.2011 2

OVERVIEW

NATIONAL GRID INFRASTRUCTURE

USER COMMUNITIES

MONITORING SERVICES AND TOOLS

ROMANIAN TIER-2 FEDERATION RO-LCG

RO-LCG RESOURCES, GRID PRODUCTION

2011 RESULTS

ORGANIZATION

PROSPECTS

FUNDING

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Page 3: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

06.04.2011 3

NATIONAL GRID INFRASTRUCTURE

Network infrastructure: NREN RoEduNet; backbone + connection to GEANT (10 Gbps)

Certified & active resource centers:

RO-LCG Federation:IFIN-HH, 5 Grid sites.ISS, Inst. for Space Sciences (2 sites)UPB, Univ. Politehnica Bucharest (susp.)ITIM, NIRD in Molecular & Isotopic Technologies - ClujUAIC, Univ. Alex. Ioan Cuza - Iasi

ROGRID_NGI: ICI, NIRD in Informatics, BucharestUTCN, Technical Univ. Cluj-NapocaUVT, West Univ. Timisoara; UPB

Other: certified and not active (2), or not certified and active (RO): GRIDIFIN, MEDGRID, UTCB

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

National Grid for Physics and Related Areas (GriNFiC) <=

Page 4: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

GRINFIC - NETWORK TOPOLOGY

28.11.2011 4

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Page 5: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

RESOURCES @ CTI/DPETImax.1100 cores, 270 TB

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Page 6: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

28.11.2011 6

USER COMMUNITIES (VOs)

GriNFiC

LHC user community: ALICE, ATLAS, LHCb (RO-LCG)

HEP: ILC, HONE

ITER user community: FUSION (in progress)

SPACE SCIENCES

National: GRIDIFIN - support the running of the physics applications of non-LCG users

ex.: computational modeling of materials

99% of the total grid production on national VOs

SAM: IFOPS - monitoring of the sites of GriNFiC, including those of RO-LCG

OTHERS (RO-09-UTCN)

envirogrids.vo.eu-egee. org - supports Black Sea region environment studies

gridmosi.ici.ro - High Performance Modelling, Simulation and Optimization

see, seegrid - regional SE Europe

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Page 7: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

28.11.2011 7

GRID PRODUCTION PER SITE and VO

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

LCG VOs: 97.55%HEP total: 98.03%National VOs: 0.91%Other VOs: 1.06%

Page 8: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

28.11.2011 8

MONITORING SERVICES

- NGI seems not be able, or not enough motivated to ensure reliable SAM services for RO-LCG

- RO-LCG site admins of are not notified about the problems

=> development of a parallel system for SAM and real-time notificationThe service is provided through IFOPS VO, which plays a similar role as OPS.The tests are modified to replace the part wich publishes the results to a STOMP server with the gsi-ftp transfer to GriNFiC's WMS. The results are collected and published using Nagios.

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Page 9: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

28.11.2011 9

MONITORING SERVICES

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Page 10: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

28.11.2011 10

MONITORING/ACCOUNTING TOOLS

job monitoring (queued/exec) on each VO

job accounting (megaSI2k) on each VO

data trensfer

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Tools for monitoring/accounting of jobs, network traffic for clusters & storage, developed in IFIN-HH

Page 11: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

07.12.09 11

ROMANIAN TIER-2 FEDERATION RO-LCGObjective: Coordination of the provision of the pledged hardware resources and the necessary manpower for computational simulation and analysis necessary in ALICE, ATLAS, LHCb, together with the realization of the minimal Tier-2 SLAs assumed in the MoU with CERN. Today, RO-LCG benefits of its own monitoring services.

MEMBERS: 5 institutions, 8 sites, > 3500 cores, > 1PetaByte• IFIN-HH

• NIHAM (ALICE / AliEn) - DFH • RO-02-NIPNE (ATLAS, HONE) - DPETI (ATLAS building) - Gabriel Stoicea• RO-07-NIPNE (ALICE, ATLAS, LHCb) - DPETI (CC) - Mihai Ciubancan• RO-11-NIPNE (LHCb) - DPETI (CC) - Teodor Ivanoaica

• Institute for Space Sciences (ISS)• ISS (ALICE / AliEn), RO-13-ISS - Sorin Zgura / Ionel Stan;

• "Alexandru Ioan Cuza" University - Iasi (UAIC)• RO-16-UAIC (ATLAS) - Octavian Rusu / Ciprian Pinzaru

• University “Politehnica” - Bucharest (UPB)• RO-03-UPB, (ALICE) - Nicolae Tapus - NCIT (currently suspended)

• Natl. Inst.for Isotopic and Molecular Technology - Cluj( ITIM-Cluj)• RO-14-ITIM (ATLAS) - Felix Farcas

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Page 12: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

28.11.2011 12

RO-LCG RESOURCES

Minimum network connectivity: 10 Gb/sec. (connection to RoEduNet backbone)Capacities now:

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

site cores TBRO-02-NIPNE 416 194RO-07-NIPNE 1100 270RO-11-NIPNE 120RO-13-ISS 64 156RO-14-ITIM 240 35RO-15-NIPNE 108 21RO-16-UAIC 248 82

total 2216 758

+ NIHAM (ALICE)(>1500 cores, > 1000 TB)

Page 13: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

06.04.2011 13

NATIONAL GRID PRODUCTION PER VO and PER SITE

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Page 14: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

28.11.2011 14

RO-LCG RESULTS - 1/2

NUMBER of LCG JOBS

During the last 12 months RO-LCG provided 1,72 % of

the total number of jobs processed by all the Tier-2

centres worldwide, ranking 11th of 33 countries in the

WLCG collaboration

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

GRID PRODUCTION on the 3 LCG VOs

RO-LCG had a higher annual rate of growth than Tier-2s

(Nov.2010-Oct.2011 / Nov.2009-Oct.2010)

RO-LCG rate of production growth: 2.25

Worldwide rate of growth of Tier-2s on the 3 VOs: 2.03

Source: EGI accounting portal http://www3.egee.cesga.es/

Page 15: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

28.11.2011 15

RO-LCG - RESULTS - 2/2

AVAILABILITY/RELIABILITY

Global improvement between Jan.2009 - Sep. 2011

Positive linear trend towards the ideal value of 95%

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Minima mainly due to network andhardware failures

Source: Lcg Office, monthly reliability & availability reports

Page 16: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

ORGANIZATION

Romanian Association for the Promotion of the Advanced Computational Methods in Scientific Research (ARCAŞ) - organization of scientists, IT professionals, and institutions engaged in the use of high performance computing technologies and methods for scientific research.

ARCAŞ is a Romanian private legal entity, apolitical, non-governmental, non-profit, which complies with the Romanian laws in force.

The purpose of ARCAŞ is to unify and coordinate at national level the efforts of the scientific community towards the promotion and development of advanced computational methods and the realization of a sustainable computing infrastructure for scientific research.

Founded in 2011 by a group of professionals from UAIC, IFIN-HH, ISS, UPB, UTCN, ROSA, UVT

Main objectives:

• Support of the development and application of advanced computational methods in scientific research, such as HPC, Grid computing, and cloud computing

• Strengthening the role of the scientific research and education community in the coordination at the national level of the HPSC activity

15.09.2011 16

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Page 17: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

PROSPECTS

RO-LCG

Participate to intense activity in 2012 in order to find evidence of new physics

Preparing for reprocessing and reanalysis of LHC data to be performed during the LHC

stop 2013-2014

GriNFiC

Enlarge the user community

Programing and/or implementation of new user tools

ARCAS

Increase number of members (persons and institutions)

Take part actively to the coordination of the advanced computing activities, projects, etc.

15.09.2011 17

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Page 18: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

FUNDING

RO-LCG Grid infrastructure was realized in the framework of various national projects within programmes of the National Plan for Research, Development and Innovation 1 & 2 (PNCDI1 & PNCDI2), financed by the National Authority for Scientific Research (ANCS)

GRIDIFIN infrastructure was realized with funding from the GRICEFCO project, special structural funds call SOP IEC 2.2.3 for Grid and RoEduNet

The collaboration with LIT-JINR / Dubna in the framework of the Hulubei-Meshcheriakov programme (2005-2013), theme Optimization Investigations of the GRID and Parallel Computing Facilities at LIT-JINR and Magurele Campus

The operational support of the HPC infrastructure that will be accessed through GriNFiC benefits of the FP7 HP-SEE project High-Performance Computing Infrastructure for South East Europe’s Research Communities, www.hp-see.eu

15.09.2011 18

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011

Page 19: 28.11.20111 Current Status of the Grid Computing for Physics in Romania Horia Hulubei National Institute of R&D in Physics and Nuclear Engineering (IFIN-HH)

28.11.2011 19

THANK YOU FOR YOUR ATTENTION !

RO-LCG WORKSHOP - IFIN-HH, MAGURELE, 28.11.2011