GGF-16

Athens

Production Grid Computing in the UK

Neil Geddes

CCLRC Director, e-Science

Neil Geddes

CCLRC e-Science

Outline

• A little bit of History

• Where we are today– GridPP, EGEE and NGS

• Issues and Challenges

• The future

Neil Geddes

CCLRC e-Science

Grid Computing in the UK

• National initiatives began in 2001‘e-Science is about global collaboration in key areas of

science, and the next generation of infrastructure that will enable it.’

John Taylor

Director General of Research Councils

Office of Science and Technology

• UK e-Science programme – Application focused/led developments– Varying degree of “infrastructure” …

Ken Peach

e-Minerals

simulations performed on molecular length and time scales to address environmental issues:•adsorption of pollutants•crystal growth and dissolution•radiation damage•diffusion of pollutant atoms

climateprediction.net and GENIE

• Largest climate model ensemble

• >45,000 users, >1,000,000 model years

10K2K

Response of Atlantic circulation to freshwater forcing

UK Grid for Particle Physics

(2003)

GridPP www.gridpp.ac.uk

LHCb

ATLAS

CMS

CMS

CERN/LHC Community

Europe: 267 institutes, 4603 usersElsewhere: 208 institutes, 1632 users

Neil Geddes

CCLRC e-Science

UK e-Science Grid

Cambridge

Newcastle

Edinburgh

Oxford

Glasgow

Manchester

Cardiff

SouthamptonLondon

Belfast

DL

RAL Hinxton

Application independent

Neil Geddes

CCLRC e-Science

National Grid Service

Interfaces

OGSI::LiteOGSI::Lite

Neil Geddes

CCLRC e-Science

NGS Overview:User view

• Resources– 4 Core clusters – UK’s National HPC services– A range of partner contributions

• clusters, shared mem. portals, data …• Partners and affiliates

• Access– Support UK academic researchers– All partners support common user base + whoever they want– Free at the point of use– Light weight peer review for limited “free” resources

• Partners can provide larger commitments as required

• Central help desk – www.grid-support.ac.uk

Neil Geddes

CCLRC e-Science

NGS Overview:Oganisational view

• Management– GOSC Board

• Strategic direction– Technical Board

• Technical coordination and policy

• Grid Operations Support Centre– Manages the NGS– Operates the UK CA + over 30 RA’s– Operates central helpdesk– Minimum software stack

• Level-0, level-1 …– Policies and procedures– Manage and monitor partners

Number of Registered NGS Users

0

50

100

150

200

250

300

14 January2004

23 April2004

01 August2004

09November

2004

17February

2005

28 May2005

05September

2005

14December

2005

Date

Nu

mb

er o

f U

sers

NGS UserRegistrations

Linear (NGS UserRegistrations)

NGS UseUsage Statistics (Total Hours for all 4 Core Nodes)

0

50000

100000

150000

200000

250000

12 34 56 789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100

10110

210

310

410

510

610

710

810

911

011

111

211

311

411

511

611

711

811

912

012

112

212

312

412

512

612

712

812

913

013

113

213

313

413

513

613

7

Users (Anonymous)

Hours User DN

Total

0

5

10

15

20

25

30

35

40

45

50

O=

univ

ersi

teit-

utre

cht

OU

=B

BS

RC

OU

=B

irmin

gha

m

OU

=B

risto

l

OU

=C

ambr

idg

e

OU

=C

ardi

ff

OU

=C

LRC

OU

=C

PP

M

OU

=D

LS

OU

=D

MP

HB

OU

=E

dinb

urgh

OU

=G

lasg

ow

OU

=Im

peria

l

OU

=La

ncas

ter

OU

=Le

eds

OU

=Li

verp

ool

OU

=M

anch

est

er

OU

=N

ewca

stle

OU

=N

ottin

gha

m

OU

=O

AS

IS

OU

=O

xfor

d

OU

=P

orts

mo

uth

OU

=Q

UB

OU

=Q

uee

nMa

ryLo

ndo

n

OU

=R

eadi

ng

OU

=S

heff

ield

OU

=S

outh

amp

ton

OU

=U

CL

OU

=W

arw

ick

OU

=W

estm

inst

er

OU

=Y

ork

Count of OU=

OU=

Total

0

20

40

60

80

100

120

140

160

bbsrc cclrc epsrc nerc pparc AHRC mrc esrc

Count of "RC"

"RC"

Files stored

Users by institution

CPU time by user

Users by discipline

biol

ogy

Larg

e fa

cilit

ies

Eng

. +

Phy

s. S

ci

Env

. S

ci

PP

+ A

stro

nom

y

Med

icin

e

Hum

ani

ties

Soc

iolo

gy

Over 320 users

Applications: 1

Text mining

LatticeBoltzmann

Molecular Dynamics

substrate complex product complex

ADP

ATP

Applications: 2Systems Biology

H. Woo et al, Phys Rev B 72 064437 (2005)

Example: La2-xSrxNiO4

Neutron Scattering

Climate modelling

Econometric analysis

Applications: 3

• Many, but not all, applications cover traditional computational sciences– Both user and pre-installed

software

• Several data focused activites

• Common features are– Distributed data and/or

collaborators

• Not just pre-existing large collaborations– Explicitly encourage new

users– Common

infrastructure/interfaces

Other Applications:

•nano-particles•protein folding•ab-initio protein structure prediction•radiation transport (radiotherapy)•IXI (medical imaging)•Biological membranes•Micromagnetics•Archeology•Text mining•Lattice QCD (analysis)•Astronomy (VO services)

Neil Geddes

CCLRC e-Science

GridPP/LCG/EGEEContinues

0

2000

4000

6000

8000

10000

12000

14000

16000

18000

20000

06/2

4/04

07/0

9/20

04

07/2

4/04

08/0

8/20

04

08/2

3/04

09/0

7/20

04

09/2

2/04

10/0

7/20

04

10/2

2/04

11/0

6/20

04

11/2

1/04

12/0

6/20

04

12/2

1/04

01/0

5/20

05

01/2

0/05

02/0

4/20

05

02/1

9/05

03/0

6/20

05

03/2

1/05

04/0

5/20

05

04/2

0/05

05/0

5/20

05

05/2

0/05

06/0

4/20

05

06/1

9/05

07/0

4/20

05

07/1

9/05

08/0

3/20

05

08/1

8/05

09/0

2/20

05

09/1

7/05

10/0

2/20

05

10/1

7/05

11/0

1/20

05

11/1

6/05

12/0

1/20

05

EGEE total job slots UK total job slots

0.00%

5.00%

10.00%

15.00%

20.00%

25.00%

30.00%

35.00%

06/2

4/04

07/1

0/20

04

07/2

6/04

08/1

1/20

04

08/2

7/04

09/1

2/20

04

09/2

8/04

10/1

4/04

10/3

0/04

11/1

5/04

12/0

1/20

04

12/1

7/04

01/0

2/20

05

01/1

8/05

02/0

3/20

05

02/1

9/05

03/0

7/20

05

03/2

3/05

04/0

8/20

05

04/2

4/05

05/1

0/20

05

05/2

6/05

06/1

1/20

05

06/2

7/05

07/1

3/05

07/2

9/05

08/1

4/05

08/3

0/05

09/1

5/05

10/0

1/20

05

10/1

7/05

11/0

2/20

05

11/1

8/05

12/0

4/20

05

Date

Per

cen

tag

e co

ntr

ibu

tio

n

UK % total CPU

T0 to T1 streaming at 2GbT1 to T2 streaming at 200Mb

High performance services

Neil Geddes

CCLRC e-Science

Issues & Challenges

• What generic infrastructure/services exist ?– Moving tools form project -> infrastructure

• Difference community views of what is critical• Authorisation• User/VO management across shared infrastructures• Bringing infrastructures together

– Now• Common NGS/GridPP/EGEE helpdesk, security,

authentication• Overlapping local teams• Working on VO management and brokering

– Future• Depends on standardisation + commitment from projects• Shibboleth• ...

Neil Geddes

CCLRC e-Science

NGS Development

• Core Node refresh• Expand partnership

– HPC– Campus Grids– Data Centres– Digital Repositories – Experimental Facilities

• Baseline services– Aim to map user requirements onto standard

solutions– Support convergence/interoperability

• Move further towards project (VO) support– Support collaborative projects

• Mixed economy– Core resources– Shared resources– Project/project/contract specific resources

Baseline Services

Storage Element

Basic File Transfer

Reliable File Transfer

Catalogue Services

Data Management tools

Compute Element

Workload Management

VO specific services

VO Membership Services

DataBase Services

Posix-like I/O

Application Software Installation Tools

Job Monitoring

Reliable Messaging

Information System

UK e-Infrastructure

LHC

I SI S TS2

HPCx + HECtoR

Users get common access, tools, inf ormation, Nationally supported services, through NGS

I ntegratedinternationally

VRE, VLE, IE

Regional and Campus grids

Community Grids