E-science grid facility for Europe and Latin America SA1 - Status Report Grid Infrastructure Activity Diego Carvalho (SA1 Activity Manager)

E-science grid facility for Europe and Latin America

www.eu-eela.eu

SA1 - Status ReportGrid Infrastructure Activity

Diego Carvalho (SA1 Activity Manager)CEFET-RJ (Brazil)

First Project ReviewBrussels, 28.04.2009

www.eu-eela.eu Brussels, First Project Review, 28.04.09


2

Outline

• Activity Objectives and Results

• Activity in numbers

• Future Plans and Conclusions


www.eu-eela.eu Brussels, First Project Review, 28.04.09 3

Activity Objectives and Results



4

Objectives and Results

• “Expanding the current e-Infrastructure to consist of 41 Resource Centres (13 in Europe and 28 in Latin America) mobilising about 3000 computing cores and more than 700 Terabytes of storage space, at start of the project and to further grow by 20 % in computing and 15 % in storage over the duration of the project.”

• “Providing the full set of Infrastructure and Application-oriented Grid Services needed by all types of applications in their scientific environment.”

The current infrastructure has 22 The current infrastructure has 22 Resource Centres (11 in Europe and 11 in Resource Centres (11 in Europe and 11 in Latin America) mobilising about 5800 Latin America) mobilising about 5800 computing cores and more than 192 computing cores and more than 192 Terabytes of storage.Terabytes of storage.

The current infrastructure has 22 The current infrastructure has 22 Resource Centres (11 in Europe and 11 in Resource Centres (11 in Europe and 11 in Latin America) mobilising about 5800 Latin America) mobilising about 5800 computing cores and more than 192 computing cores and more than 192 Terabytes of storage.Terabytes of storage.

Two Core Service Centres deployed (EU and LA), Two Core Service Centres deployed (EU and LA), providing a full set of Grid Services (information providing a full set of Grid Services (information systems, data and metadata catalogues, etc.) and systems, data and metadata catalogues, etc.) and the services developed by JRA1.the services developed by JRA1.

Two Core Service Centres deployed (EU and LA), Two Core Service Centres deployed (EU and LA), providing a full set of Grid Services (information providing a full set of Grid Services (information systems, data and metadata catalogues, etc.) and systems, data and metadata catalogues, etc.) and the services developed by JRA1.the services developed by JRA1.



5


• “Building the support of the e-Infrastructure to provide high reliability services to partnerships spanning the Atlantic Ocean by:”

• “Providing a complete set of Global Services from central EELA-2 Operation and Networking Support Centres (EOC/ENSC).”

• “Targeting the creation of Regional Operation Centres (ROC) in Latin America, covering one or more countries.”

• “Pursuing the aggressive EELA Training and Dissemination programme.”

• “Creating a comprehensive knowledge repository on Grid operation federated with the EGEE ones.”

A full set of ancillary tools was deployed on the EOC, which A full set of ancillary tools was deployed on the EOC, which acts as a central co-ordination point for the infrastructure.acts as a central co-ordination point for the infrastructure.

http://eoc.eu-eela.euhttp://eoc.eu-eela.eu

A full set of ancillary tools was deployed on the EOC, which A full set of ancillary tools was deployed on the EOC, which acts as a central co-ordination point for the infrastructure.acts as a central co-ordination point for the infrastructure.

http://eoc.eu-eela.euhttp://eoc.eu-eela.eu

Four OOD teams were engaged in Operations; they Four OOD teams were engaged in Operations; they prefigure the support teams of future Latin American ROCs.prefigure the support teams of future Latin American ROCs.Four OOD teams were engaged in Operations; they Four OOD teams were engaged in Operations; they prefigure the support teams of future Latin American ROCs.prefigure the support teams of future Latin American ROCs.

SA1 contributed trainers and infrastructure support to NA2 SA1 contributed trainers and infrastructure support to NA2 and NA3.and NA3.SA1 contributed trainers and infrastructure support to NA2 SA1 contributed trainers and infrastructure support to NA2 and NA3.and NA3.

As first step, SA1 and EGEE-SA1 agreed on common As first step, SA1 and EGEE-SA1 agreed on common protocols and procedures.protocols and procedures.As first step, SA1 and EGEE-SA1 agreed on common As first step, SA1 and EGEE-SA1 agreed on common protocols and procedures.protocols and procedures.

OOD Teams



6


• “Contributing to the implementation, operation and support of new Certification Authorities required in Latin America and to their coordination within the framework of TAGPMA.”

The mobility of all LA CA managers is supported by the The mobility of all LA CA managers is supported by the project.project.The Peruvian CA has been submitted for accreditation.The Peruvian CA has been submitted for accreditation.The Leader of TSA1.3 is chairing TAGPMA.The Leader of TSA1.3 is chairing TAGPMA.

The mobility of all LA CA managers is supported by the The mobility of all LA CA managers is supported by the project.project.The Peruvian CA has been submitted for accreditation.The Peruvian CA has been submitted for accreditation.The Leader of TSA1.3 is chairing TAGPMA.The Leader of TSA1.3 is chairing TAGPMA.



SA1 in numbers



LA Public Key Infrastructure Status

Certification Authority

Registration Authority

CA Applicant

Catch All Certification Authority

Every EELA-2 country has access to the LA


PKI PKI



PKI PKI



Resource Centre Map

Legacy Sitesprod.vo SitesOurGrid Sites



Computing Resources

0

5

10

15

20

25

M01 M02 M03 M04 M05 M06 M07 M08 M09 M10 M11 M12

Re

sou

rce

Ce

ntr

es

0

1000

2000

3000

4000

5000

6000

7000

Co

res

Legacy Cores prod.vo Cores Legacy RCs prod.vo RCs

22 sites on the Production Infrastructure


for a total of 5800 cores






crash programme



Infrastructure Usage - all VOs

About 1 million jobs executed




ResourceCentres



Infrastructure Usage - Only EELA-2 VO

More than 50k jobs executed




ResourceCentres



Proxy Creations

53 Registered “accounts”

One can clearly see an increase on the


infrastructure use

infrastructure use



infrastructure use

infrastructure use



Metrics on M12 - DoW Table

Metric Pledged Current

Percentage of Vacant positions < 10% 8%

Percentage of deployed tools specified in AEP > 80% 98%

Percentage of consolidated documents n.a (M14) 80%

Number of meetings per month >1 >2

Number of middleware releases >1 2

Number of CA candidates ≥1 2

Number of new accredited CAs n.a (M22) 0

Percentage of committed CPU slots integrated > 50% 190%

Percentage of committed TB of storage integ. > 40% > 27%



Future plans and conclusion



16

Future Plans

• From the DoW point of view: 2nd year is devoted to operations• Keep

• the momentum - integration of new sites (short-term)• the interoperation with EGEE (long-term)

• Increase• the OOD Teams know-how (short-term)• the usage of the support system (short-term)• the deployment of OurGrid on small/shared RCs (mid-term)

• Finish• the accounting system (short-term)• the Service Level Agreement (medium-term)

• Understand• technical issues like MPI heterogeneity (short-term)



17

Conclusions

• The infrastructure is composed by 22 Resource Centres and provides almost twice the amount of pledged job slots.

• About 1,000,000 user jobs were already executed on the infrastructure.

• Four OOD teams were trained and engaged into operations. ROC seeds.

• The use of the infrastructure increases every day.

• 2nd year is devoted to operations, fine-tuning.

Documents

E-science grid facility for Europe and Latin America SA1 - Status Report Grid Infrastructure Activity Diego Carvalho (SA1 Activity Manager)