Romanian Physics Grid: recent progress and outlook
Florin D. Buzatu
Horia Hulubei National Institute for Physics and Nuclear Engineering
Bucharest - Romania
NEC’2007, September 11, Varna - Bulgaria
FOUR YEARS AGO: NEC’03
Topics
Progress regarding:
- national Grid strategy
- network infrastructure
- particle physics Grid (LCG)
- participation to SEE-GRID(2)
Plans for the future
NATIONAL GRID STRATEGY IN ROMANIA
The Task Force for the National Grid Infrastructure (NGI)
Created through the decision of the National Authority for Scientific Research (NASR), in July 2005
Members: the Ministry of Education and Research, the Ministry of External Affairs, 7 universities, 7 research institutions, the National Research and Education Network RoEduNet.
Goal: to promote a strategic plan to be implemented by the pilotproject “Implementation of the National Grid Infrastructure”.
Guiding lines: open infrastructure, compatible with those existing in EU;exploitation of the internal production of scientific software; balancedinvestments between: networking / Grid hard&soft infrastructure / application software development
Objectives of the strategic plan
Gradual and balanced development of the NGI based on centers of competence and reuse of the results provided by (inter)national cooperation
Integration of the information society into a virtual global environment which - increases scientific potential & capacities for applied software development - ensures new resources for the research field - extends the impact of research results in economics and society
Promotion of new specific Grid technologies in Romania - focusing the academic, research and business communities towards the new virtual global environment - training and specialization of the human resources - supporting the transition towards the new system
Development of the data communications segment for the Romanian Gridframework.
Recent developments
NASR, as Funding Agency, has signed the Memorandum of Understandingfor Collaboration in the Deployment and Exploitation of the Worldwide LHC Computing Grid (MoU), with CERN (2006)
The Romanian Space Agency (ROSA) has applied for Certification Authority(CA) to EuGRIDPMA, according to the decision of NASR (operational soon)
An agreement between the Romanian Government and the Government ofHungary concerning the cooperation in Grid infrastructure has been signed
RoEduNet applied the SEELIGHT project in the frame of the HiPERB program, and NASR will support the co-financing
Funding: project based financial support only, no institutional financingProgrammes: CEEX - Centres of Excellence
Structural Funds (2007-2013)National Plan for R&D and Innovation (PNCDI-2)
NETWORK INFRASTRUCTURE - RoEduNet
RoEduNet = organization and layered data communication system
Layer 0 backbone links (including international) and 7 RoEduNet NetworkOperation Centers (NOCs): headquarter (Bucharest) + 6 regional NOCs
Layer 1: 33 RoEduNet Points of Presence (PoPs) from county capitals +communication lines between NOCs and PoPs.
Layer 2: institutions connected to RoEduNet - research institutions,universities, (high) schools, hospitals, other education related non-profitinstitutions
ConnectivityInternational: to GEANT 2 x STM4 circuits (1.244 Gbps)
to RENAM (Republic of Moldova) 34 MbpsNational: inter NOCs - at least 1 Gbps
NOC to POPs - 10 Mbps up to 30 Mbps
Results and plans for 2007
Separation of international and national backbone connections in thenational NOC (new data center)
Expected results of DANTE’s tender for dark fiber (DF) or lambda connectivity to Bucharest
SEELight project (regional funds) started, with the main goal to provideDF connectivity to Hungary and Bulgaria (apart from GEANT connection)
Upgrade of the production link Bucharest - Budapest to 10 Gbps
Start a pilot link for the SEELight project by planned connection Sofia -- Bucharest
Start of the RoEduNet2 project:Stage 1: DF connections and DWDM equipments betweenBucharest and four main cities (Cluj, Iasi, Galati, Craiova)
Networking - Long term plans
Finalize RoEduNet2 project to provide:At least 2x10 Gbps connections between NOCsAt least 1 Gbps connections between NOCs and POPsRedundancy for all connections inter NOCs and NOCs - PoPs
Organize the national headquarter and only 4 main NOCs
Implement new services:Lambda on demand for national connectivityNational VoIP for education and researchFull support for multicast applications
Implement lambda based logical network for Grid activities
Provide lambda based of DF connectivity for Black Sea region to GEANTusing owned national communication infrastructure
PARTICLE PHYSICS GRID IN ROMANIA
Long term collaboration with CERN
Large Hadron Collider (LHC) experiments:
ALICE
ATLAS
LHCb
Participation to the LHC Computing Grid (LCG) project
Once upon a time … (2003)
WLCG COLLABORATION
WLCG = Worldwide LHC Computing Grid
Purpose: to provide the computing resources needed to process and analyze the data gathered by the Large Hadron Collider experiments.
Strategy: smaller Grid centers should form federations in order to jointly comply with the minimal levels-of service criteria for an LCG Tier centre.
The existing LCG sites in Romania united in anational federation to form together a Tier-2 centre
The Romanian Authority for Scientific Research has signed the MoU in March 2006, as Funding Agency of the Romanian Tier-2 Federation.
ROMANIAN TIER-2 FEDERATION
ICIInstitute of RD in Informatics
ITIM - ClujInstitute of RD for Isotopic& Molecular Technologies
UPBUniversity ‘Politehnica’ Bucharest
IFIN-HH
ISSInstitute for Space Sciences
Tier-2 Federation Map
Romanian and Tier-2 Federation Contributions to Grid Production
RO1.50%
position13 / 41
Tier-22.86%
position7 / 22
ROMANIAN TIER-2 FEDERATION: SITES AND VOs
• Horia Hulubei National Institute of RD for Physics and Nuclear Engineering (IFIN-HH)• NIHAM (ALICE / AliEn); NIHAM (ALICE / GLITE)• RO-02-NIPNE (ATLAS, HONE / GLITE )• RO-07-NIPNE (ALICE, ATLAS, LHCb, SEE, SEEGRID / GLITE)• RO-11-NIPNE (LHCb)
• Institute for Space Sciences (ISS) • ISS (ALICE / AliEn)
• National Institute of RD in Informatics (ICI)• RO-01-ICI (LHCb, BIOMED, SEE, SEEGRID, ... / GLITE)
•Institutul National pentru Tehnologii Izotopice si Moleculare (ITIM-Cluj)• Contributing to ATLAS / GLITE
• University “Politehnica” Bucharest (UPB)• RO-03-UPB, UPB (ALICE / AliEn)
Grid production:distribution over Vos
NIHAM
• “Nuclear Interactions and Hadronic Matter” Centre of Excellence• Lead by Prof. Mihai Petrovici• Members from many IFIN-HH departments and from other institutions• The group is doing research in many areas of nuclear physics• Core members of the group were involved in the past or are involved
now in many international physics collaborations, such as DRACULA (designed by the group), CHIMERA, FOPI, ALICE, and also in the preliminary phase of CBM
• Members of the group were involved in the development of ALICE-TRD detector and frontend electronics
• NIHAM produce now >20% of ALICE-TRD chambers• Members of the group are involved in EGEE project• NIHAM GRID site• Web page: http://niham.nipne.ro
NIHAM Datacenter
• 1 industrial-grade cooling unit, 110 KW cooling (a second one scheduled for end of 2008)
• 3 industrial-grade UPS-es (240 KVA total capacity)
• Cat. 6 cabling• connection to Institute's Diesel generator
NIHAM cluster
• 168 CPU cores (WNs+services)• 2GB RAM / core• ~50 TB RAW dedicated storage (excluding HDDs on nodes)• 1Gb/s internal network• 10Gb/s uplink
NIHAM GRID site
• Integrated EGEE & AliEn site• Contributes to ALICE VO• ~850 kHours CPU Time (>1 mil. EGEE-
normalized CPU hours)• ~3mil. files stored on NIHAM SE• 6-7% of ALICE• >70% of country contribution to EGEE
RO-02-NIPNE site
Particle Physics Department GRID Site
•100 logical CPU, 1 GB per logical CPU, 10 TB storage
• Supported VOs: ATLAS – CERN (main), H1 – DESY, BIOMED & other VOs in future
RO-02-NIPNE: Monthly reports
ALL Vos
job distribution
ALL Vos success rate
LHCb Grid at RO-11-NIPNE
• 3 servers dual Xeon 3 GHz, 2 GB RAM (Worker Nodes - WNs), 80 GB HDD
• 15 nodes dual Xeon 3 GHz LV, 2 GB RAM, 80 GB HDD + 5 nodes dual Xeon Core Duo, 2GB RAM, 80GB HDD
• 2 Pentium D 3 GHz, 2 Gb RAM (Computing Element - CE, Storage Element - SE)
• 2 TB storage for SE
22
THE IT&C CENTER AT IFIN-HH (CITC)
Activities • Administration and development of the IT infrastructure of IFIN-HH• Administration and development of the Grid site RO-07-NIPNE• Coordination of the Romanian Tier-2 Federation• Administration of the communication node at IFIN (10 Gbps)• Grid computing, databases, algorithms for parallel computing, etc.
• Participation in the EU projects EGEE and SEE-GRID (as third party)
Cooperation programme "Hulubei-Meshcheryakov" together with the Laboratory of Information Technologies at JINR - Dubna, that promotes activities in fields of the information technology and computational physics like: Grid technology, Grid software and Grid development; numerical algorithms, methods and tools for the description and modeling of complex physical systems; etc.
Basic mission: operate, maintain, and develop the computing and networking infrastructure of IFIN-HH, providing the technical support required by the international scientific collaborations.
Members of the group collaborate with the Dept. of Computer Science of UCF, Orlando, directly participate to the ATLAS and DIRAC experiments at CERN and to the research activities at IN2P3 - France.
CITC: RO-O7-NIPNE
• 190 CPU cores (WNs+services) (258 logical CPUs), 3.0 GHz• 2GB RAM / core• 7 TB RAID 6 dedicated storage (excluding HDDs on nodes)• 1Gbps internal network• 10Gbps uplink• middleware GLITE• VOs: ATLAS, LHCb, ALICE, SEE, SEEGRID
SEE-GRID2: EARTHQUAKE SIMULATIONS
Gridification: Numerical simulation of earthquake generation in Vrancea county (Romania)
Work in progress for the gridification of the algorithm proposed by O. Carbunar (IFIN-HH), M. Radulian (Inst. for Earth Physics - Romania)Geophysical Research Abstracts 9, 05522 (2007)
The simulation algorithm reproduces the rate of the background seismic activity and the range of repetition of the seismic cycle for major events.
Application in development at IFIN-HH , registered at SEE-GRID2 under the name EQUSIM - Earthquake simulation
1. Weakening areas before major earthquake
2. Weakening areas after major earthquake
CITC - IFIN-HH participation at SEE-GRID2:
Grid production: RO-07-NIPNE realised 4.33% of thetotal SEE+SEEGRID production in July+August, ranking5 / 21.
• M. Dulea – CTIC (WLCG, RO-07)
• S. Zgura – NASR, ISS (ALICE)
• C. Schiaua – DFH (ALICE, NIHAM)
• C. Alexa, T. Preda (ATLAS, RO-02)
• E. Pauna (LHCb, RO-11)
Thanks