Upload
maura
View
45
Download
4
Tags:
Embed Size (px)
DESCRIPTION
The French National Grid Initiative Guy Wormser Grids Institute Director Grid Workshop Krakow October 13, 2008. France and Grids. France has been involved in the Grid adventure since the very beginning on five different themes: Production grids Supercomputer grids - PowerPoint PPT Presentation
Citation preview
The French National Grid Initiative
Guy WormserGrids Institute DirectorGrid Workshop Krakow
October 13, 2008
Guy Wormser, Krakow Grid workshopl , October 13, 2008 2
France and Grids
• France has been involved in the Grid adventure since the very beginning on five different themes:– Production grids – Supercomputer grids– Research Grid (Grid5000)– Research on grids– Peer-to-peer grids
• Key partners in many european projects– DATAGRID, EGEE-I, EGEE-II, EGEE-III– EUROGRID, DEISA I, DEISA-II– EGI– PRACE– COREGRID– EDGES– EELA2
Guy Wormser, Krakow Grid workshopl , October 13, 2008 3
Grids Scientific added value
• Transparent access to distributed data– Exemples : Earth sciences, Life sciences
• Manipulation of very large data volumes– Particle physics, astrophysics, human sciences
• Very large flexibility for computing resources– Catastrophic events management– Avian flu challenge, malaria
Guy Wormser, Krakow Grid workshopl , October 13, 2008 4
The main grid actors in France
• CNRS (National Center for Scientific Research), the largest research organism in France and in Europe, covering all research fields from human sciences to subatomic physics including computing sciences. CNRS is focused on fundamental research
• INRIA (National Institute for computing research), working mostly on grid reserach and research grids
• CEA (Atomic Energy Commission), interested for the applications High energy physics, Fusion
• Universities • Other specialized institutes (INSERM, INRA,CNES,..)• RENATER : The French NREN
Guy Wormser, Krakow Grid workshopl , October 13, 2008 5
The main grid nodes in France
• The biggest French grid node is Lyon, the IN2P3/CNRS computing center in Lyon (LHC Grid Tier 1)
• Three Tier 2: GRIF (Paris area), Nantes, Clermont-Ferrand + analysis facility in Lyon
• Several Tier3: Strasbourg, Marseille, Annecy, Grenoble• 5 smaller nodes devoted mainly to other sciences:
Paris, Lyon, CGG, Ecole Centrale, Montpellier• France represents ~15% of the EGEE ressources• Supercomputer nodes in Deisa/Prace world
Guy Wormser, Krakow Grid workshopl , October 13, 2008 6
Tier-2: LPC Tier-2: LPC
AF: CC-IN2P3AF: CC-IN2P3
Tier-2: LAPPTier-2: LAPP
Tier-3: IPHCTier-3: IPHC
LyonLyon
Clermont-FerrandClermont-Ferrand
Ile de Ile de FranceFrance
MarseilleMarseille
NantesNantes
StrasbourgStrasbourg
AnnecyAnnecy
Tier-3: IPNLTier-3: IPNL
Tier-3: CPPMTier-3: CPPM
Tier-2: SubatechTier-2: Subatech
Tier-2: GRIF•CEA/DAPNIA•LAL•LLR•LPNHE•IPNO
Tier-2: GRIF•CEA/DAPNIA•LAL•LLR•LPNHE•IPNO
Tier-1: CC-IN2P3Tier-1: CC-IN2P3 GrenobleGrenobleTier-3: LPSCTier-3: LPSC
Sites LCG-France en 2007
Guy Wormser, Krakow Grid workshopl , October 13, 2008 7
RENATER
Guy Wormser, Krakow Grid workshopl , October 13, 2008 8
Contribution LHC (EGEE accounting)
Normalised CPU time to a reference value to 1 kSI2000Source: http://www3.egee.cesga.es/gridsite/accounting/CESGA/country_view.html
France ranked number 2 for LHC VOs in 2007
Guy Wormser, Krakow Grid workshopl , October 13, 2008 9
France supercomputer capacities
very large boost of France supercomputer capacities in 2008/2009very large boost of France supercomputer capacities in 2008/2009
0
50
100
150
200
250
300
350
400
450
500
MPPSMP
VectorielTotal
GPU
0 19
2 21
0
139
331
7
476
1922007 2008-9
Guy Wormser, Krakow Grid workshopl , October 13, 2008 10
CNRS role in EGEE
• CNRS is convinced that grid computing can lead to very significant breakthroughs in many sciences
• CNRS is therefore heavily involved in the production grid world (partner in DATAGRID, EGEE –I, II, III, EGI_DS)
• CNRS leading Applications workpackage in EGEE (NA4). Very happy and proud to see the very rich coverage (>250 VOs , 12 different scientific domains, 1/3 non LHC) and SA2 (relationship with computing networks)
• Strong role in Operations. Producing central operation tools • No direct involvment in gLite• CNRS has a very active computing science department working
on many aspects of grid computing
Guy Wormser, Krakow Grid workshopl , October 13, 2008 11
Why a Grid Institute
• Grid programs within CNRS reached in 2007 a considerable importance in volume and in impact
• Federate all activities concerning research Grids and production Grids – Better visibility– Better efficiency– Renforce interaction between these two domains
• point for national and international contacts • Act on belhalf of CNRS for all european projects/contracts and for
discussions with French Ministry– CNRS core of the French NGI– Parternship to construct with INRIA and other reserach organisms
involved on research grids and reserach on grids – Partner of all regional initiatives
• « Evangelisation » of new scientific users communities• Animation, training, outreach• Central core of the future French NGI
Guy Wormser, Krakow Grid workshopl , October 13, 2008 12
What is the Grid Institute?
• The Grid Insitute has a dual nature:– A virtual institute federating grid work within CNRS– A real formal CNRS unit « Unité Propre de Service UPS3107 »,
cretaed on Septembre 1st 2007
• As such, the unit has – One director (GW), two deputy directors – 300 k€ annual budget in 2008 (15 k€ operating funds +285 k€ project
related) Operational support for production Grid, some hardware for launching new
nodes Training, outreach, scientific animations
– Personnel : 1 temporary staff
• Formal sigantory to all grid related european contracts (EGEE-III, EGI, EDGES, EELA2)
• Membership : all CNRS personnel having some grid activity!
Guy Wormser, Krakow Grid workshopl , October 13, 2008 13
Participating laboratories
• 30 laboratories:APC, CC_IN2P3, CPPM, CREATIS, LIP, I3S, IBCP, IN2P3_adm,
IPGP, IPHC, IPNL, IPNO, IRISA, IRIT, LABRI, LAL, LAPP, LIFL, LIG, LIP6, LLR, LORIA, LPC Clermont, LPNHE, LRI, IPSL, LPSC, LSIT, Subatech, UREC
– 13 laboratories IN2P3 linked to EGEE/LCG– 11 computing science labs– 5 users labs linkied to earth science, life science – Administrative support
• GDR Architecture Systèmes et Réseaux (ASR)
Total membership of 350 people ! The full mailing list in itself is a new and important asset!
Guy Wormser, Krakow Grid workshopl , October 13, 2008 14
Grid Institute governance
• Steering committee (June 27, 2008)– Chaired by CNRS President (or Director Général)– Membership: directors of all departments scientific departments
and national institutes (IN2P3 and INSU)
• Scientific Council ( September 10, 2008)– Guidance to the steering committee and Grid Institute
management– Formé de hautes personnalités scientifiques étrangères
provenant pour moitié du monde de la recherche sur les grilles et pour moitié des infrastructures de production
• Collaboration board– Formed by the directors of all CNRS labs participating to Grid
Institutes– First plenary meeting Dec 4 in Orsay, next meeting to be
organized before the end of 2008
Guy Wormser, Krakow Grid workshopl , October 13, 2008 15
The Production Grid MoU
• Formally signed on October 7 , 2008• Establishing for two years a National Steering
Committee• The National Steering committee role:
– Defining the French strategy on all aspects of production Grids– Selecting one partner to represent all the others in every major
grid project (CNRS Grid Institute picked up for EGEE-III leading the French JRU, and for EGI_DS)
– Monitoring the national prospective exercice , entrusted to CNRS Grid Insitute, which will lead to a « White paper » end 2008 forling the basis for Grid Production National Action Plan (multiannual human and financial investment plan)
– Coordination with Supercomputer and Research initiatives– Transition to a formal French NGI
Guy Wormser, Krakow Grid workshopl , October 13, 2008 16
The Production Grid national MoU
•Eight signatories :
•Research Ministry
•CNRS
•CEA
•INRIA
•INRA
•INSERM
•CPU
•RENATER
Guy Wormser, Krakow Grid workshopl , October 13, 2008 17
The national exercice prospective under Grid Institute leadership
• Objective : Assess the production grid usefulness in all the various scientific domains. Produce a « White paper » for a mid term investment plan
• 14 Working groups formed in thematic and transverse groups
• Very good spirit: all research organisms involved• Information gathered through reports from EGEE, polls
sent in the scientific community, colloquium held on Oct 6-7
• Colloquium was a good success, very interesting debates and material gathered
Guy Wormser, Krakow Grid workshopl , October 13, 2008 18
National prospective working groups
• Disiciplinary working groups– Earth and Universe– Life sciences (avec d'éventuels sous groupes vu la taille du domaine:
bioinformatique, imagerie, physiologie,...)– Human sciences– Chemistry- Engineering sciences and computing sciences– Physics– Particle and nuclear physics
• Transversal– Data grids– Regional grids, relationship with GRID5000– Relationship with supercomputers -relationship with Large Research Infrastrucures (ESFRI list)– Grid access, users – Relationship with industry
Guy Wormser, Krakow Grid workshopl , October 13, 2008 19
Colloquium conclusions
• More than 1000 respones to the poll representing more than 3000 scientists
• Production grids are well established and heavily used in 4 groups (Life sciences, Earth and Universe, subatomic Physics and fusion)
• Short term uptake in Chemistry, Engineering and computing, Human sciences
• Nothing yet done in Agronomy-Ecology and Physics• In most cases, knowledge of grid technology is limited• But even when knowledge is limited, a huge majority sees large
potential benefits (at the 90% level!)• In all the communities, already very active users producing
science ( usually ~5% level)• 85% of the French subatomic physics community will use Grid as
their everyday tool in 2012• DATA grids are more important than CPU grids• Missing ressources are mostly human
Guy Wormser, Krakow Grid workshopl , October 13, 2008 20
Survey results (I/IV)
Connaissance personnelle des grilles
0,0%
10,0%
20,0%
30,0%
40,0%
50,0%
60,0%
70,0%
80,0%
Nulle Faible Satisfaisante Etendue
Tous
Biologie
Santé
Chimioinformatique
Imagerie médicale
Professionnels de santé
Personal knowledge on grids
None Limited Satisfactory Broad
Utilisation des grilles dans les laboratoires
0,0%
10,0%
20,0%
30,0%
40,0%
50,0%
60,0%
Inexistante Anecdotique Croissante Courante
Tous
Biologie
Santé
Chimioinformatique
Imagerie médicale
Professionnels de santé
Use of grids in the laboratories
None Limited Growing routinely
Guy Wormser, Krakow Grid workshopl , October 13, 2008 21
Hardware needs in life sciences
Besoins de la communauté
020406080
100120140160
Faible ou nul Peuimportant
Important Trèsimportant
no
mb
re d
e ré
po
nse
s
Connection réseau
Calculs sursupercalculateurs
Calculs sur clusters et grillesde PCs
Stockage
Guy Wormser, Krakow Grid workshopl , October 13, 2008 22
Short term Action Plan
• Signature of the MoU on production grids, alllowing the formal establishment of EGEE-III JRU and construction of the French NGI. Leading role in establishing EGI (launch of the EGI location call for proposal)
• Preparation of the French proposal for EGI siting (two sites under consideration (Paris and Lyon)
• Signature of the research GRID MoU. Building up strategic partnership with INRIA
• Gateways between Research/production– Grid Observatory (EGEE-III )– Scientific animations– Middleware diffusion
• Development of the French production grid– New nodes: Bordeaux, Montpellier, Grenoble, Lyon-bio– New grille régional grid : Rhône-Alpes
• Cooperation, Outreach, Training, « evangelisation »
Guy Wormser, Krakow Grid workshopl , October 13, 2008 23
Integration of the Mesocenters into the production Grid
• Definition : mesocenter : Mini supercomputer implanted in a University , usually rather in isolation
• Grid Institute goals:– Interconnect « mesocenters » in the national production grid– Interoperate local grids based on these mesocenters with the
national production grid– Build gateways betweens grids and supercomputers using
mesocenters experience– Promote regional grids around mesocenters
Guy Wormser, Krakow Grid workshopl , October 13, 2008 24
The first EGEE grid node in subsaharian Africa
Guy Wormser, Krakow Grid workshopl , October 13, 2008 25
Conclusion
• France sees Grids as a strategic tool for boosting its scientific potential
• Grid Institute creation in 2007 and MoU signature in 2008 correspond to a boost of these activities
• CNRS Grid Insitute is the key actor at the national level for production Grids
• Good start for NGI thru the MoU. Key particpation in EGI formation. Preparation of French response to EGI siting bid
• Very strong WLCG participation• Boost gateways between the research and production
communities • National prospective exercice bery useful: preparation
of the production grid white paper and investment plan