27
1 HEP 2000, 10.02.2000 Roberto Barber Roberto Barbera Grid activities at the ALICE Experiment NC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico (CT), T. Anticic (IRB), R. Barbera (CT), I.J.Bloodworth (Birmingham), M. Botje (NIKHEF), P. Buncic (CERN), F. Carminati (CERN), P. Cerello (TO), G. Chabratova (DUBNA), J. Cleymans (South Africa), J. G. Contreras (MERIDA), D. Di Bari (BA), D. De Girolamo (BA), J. Gosset (SACLAY), A. Grigoryan (Yerevan), M.L. Luvisetto (BO), P. Malzacher (GSI), M. Masera (CERN/TO), A. Masoni (CA), K. Mkoyan (Yerevan), D. Mura (CA), L. Nellen (UNAM), B. Nilsen (OSU), S.K. Pal (Calcutta), F.

1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

Embed Size (px)

Citation preview

Page 1: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

1CHEP 2000, 10.02.2000 Roberto Barbera

Roberto Barbera

Grid activities at the ALICE Experiment

TNC2002, 03-06.06.2002

On behalf of the ALICE GRID Working Group:G. Andronico (CT), T. Anticic (IRB), R. Barbera (CT), I.J.Bloodworth (Birmingham), M. Botje (NIKHEF), P.

Buncic (CERN), F. Carminati (CERN), P. Cerello (TO), G. Chabratova (DUBNA), J. Cleymans (South Africa), J. G. Contreras (MERIDA), D. Di Bari (BA), D. De Girolamo

(BA), J. Gosset (SACLAY), A. Grigoryan (Yerevan), M.L. Luvisetto (BO), P. Malzacher (GSI), M. Masera

(CERN/TO), A. Masoni (CA), K. Mkoyan (Yerevan), D. Mura (CA), L. Nellen (UNAM), B. Nilsen (OSU), S.K. Pal (Calcutta), F. Pierella(BO), F. Rademakers (CERN), Y.

Schutz (SUBATECH), E. Scomparin (TO), M. Sitta (TO), R. Turrisi (PD), D. Vicinanza (SA)

Page 2: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

2Roberto Barbera

Outline

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

The ALICE Experiment

Grid activities at ALICE: the past: tests with Globus the present: AliEn, PROOF and DataGrid tests the future: grid interoperability with AliEn

Summary and conclusions

TNC2002, 03-06.06.2002

Page 3: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

3

http://www.cern.ch

~9 km

LHC

SPS

CERN

Roberto Barbera

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

The Large Hadron Collider

TNC2002, 03-06.06.2002

Page 4: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

4Roberto Barbera

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

The 4 LHC Experiments

Page 5: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

5Roberto Barbera

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

The ALICE Detector

Page 6: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

6TNC2002, 03-06.06.2002 Roberto Barbera

The Quark Gluon Plasma

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

Pb+Pb @ LHC (5.5 A TeV)

Th

e B

ig B

ang

Th

e L

ittl

e B

ang

Page 7: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

7Roberto Barbera

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

1/100 of a Pb+Pb @ LHC !

Simulation and reconstruction of a “full” (central) Pb+Pb collision at LHC (about 84000 primary tracks!) takes about 24 hours of a top-PC and produces an output bigger than 2 GB.

TNC2002, 03-06.06.2002

Page 8: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

8Roberto Barbera

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

2+ times the Eiffel Tower

600+ m

ALICE data per year 2-3 Petabytes ! ˜4.000.000 CD-ROM

TNC2002, 03-06.06.2002

Page 9: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

9Roberto Barbera

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

Yerevan

CERN

Saclay

Lyon

Dubna

Capetown, ZA

Birmingham

Cagliari

NIKHEF

GSI

Catania

BolognaTorino

Padova

IRB

Kolkata, India

OSU/OSCLBL/NERSC

Merida

Bari

Nantes

ALICE “computing” sites today

TNC2002, 03-06.06.2002

~O(108) events/year~O(103) batch and interactive users

in 2006

Page 10: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

10Roberto Barbera

100 - 1000 Mb/s

Tier 4Tier 4

Tier2 Center

2.5/10 Gb/s

Tier2 CenterTier2 Center Tier2 Center Tier2 Center Tier 2Tier 2

Computing model

Monarc Project

InstituteInstituteInstituteInstitute

Physics data cache

155/622 Mb/s

Tier 3Tier 3

UK Regional Center

France Regional Center

Italy Regional Center

Germany Regional Center

622/2500 Mb/s

Tier 1Tier 1

Tier 0Tier 0

~1.25 GB/s

Online System

Online Farm

CERN Computer Center

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

Page 11: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

11

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

I’m the impatient ALICE user checking the

availability of events

Anywhere

Tape Pool(CASTOR/

HPSS)I’m the localsite manager

DiskPool Run

DB

Linux farm +MRTG monitor

Production site

I’m the PPR production manager

Manager’s site

Roberto Barbera

Lay-out 2000/’01

MirrorDB

WWW/Carrot

Cron

WWW/Carrot

AliEnReposit.

Install/Update

Globus

EnginFrame

MySQLPHPBypass

bbFTP

TNC2002, 03-06.06.2002

Page 12: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

12TNC2002, 03-06.06.2002

Web interface to login on “The Grid”

Roberto Barbera

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE CollaborationUtilities

Web interface for

job submissi

on !

CPU LoadDisk spaceNetwork

availability

Boo

k k

eep

ing

syst

em

On

ly a

t L

yon

LDAP server for ALICE

(only in Italy)

Page 13: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

13Roberto Barbera

AliEn: the ALICE grid prototype

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

Page 14: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

14Roberto Barbera

AliEn architecture

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

Page 15: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

15Roberto Barbera

AliEn authentication

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

Page 16: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

16Roberto Barbera

First production with AliEn

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

PPR PB-PB + P-P PROD.

sito # Job CPU norm.CERN 2508 115280146LYON 726 71583048OSC 44 2511390LBL 807 26679717NIKHEF 30 2942802TORINO 1141 25337047CATANIA 623 15853058PADOVA 12 2858924BARI 2 398664

5893 263444796

PPR p-p AND Pb-Pb production (JOBS)

42%

12%1%14%

1%

19%

11%

0%

0%CERN

LYON

OSC

LBL

NIKHEF

TORINO

CATANIA

PADOVA

BARI

PPR p-p and Pb-Pb production (CPU)

44%

27%

1%

10%

1%

10%

6%

1%

0%

CERN

LYON

OSC

LBL

NIKHEF

TORINO

CATANIA

PADOVA

BARI

Page 17: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

17

Local

Remote

Selection

Parameters

Procedure

PROOF

CPU

CPU

CPU

CPU

CPU

CPU

TagDB

RDB

Proc.C

Proc.C

Proc.C

Proc.C

Proc.C

DB1

DB4

DB5

DB6

DB3

DB2

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

Unsec

ure

or S

RP (S

LAC)

auth

entic

atio

n to

day

TNC2002, 03-06.06.2002 Roberto Barbera

PROOF: Parallel ROOt Facility

Page 18: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

18Roberto Barbera

Experiences with DataGrid

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

Page 19: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

19Roberto Barbera

Experiences with DataGrid

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

Page 20: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

20Roberto Barbera

Experiences with DataGrid

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

Page 21: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

21Roberto Barbera

Experiences with DataGrid

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002The f

irst e

vent o

n

the E

DG testb

ed

Dec, 1

1, 20

01

Page 22: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

22Roberto Barbera

Automatic check of the Testbed

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

Page 23: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

23Roberto Barbera

The future: AliEn as a meta-grid

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

AliEn User Interface

AliEn stackiVDGL stack EDG stack

Page 24: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

Roberto Barbera

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

Application: AliRoot

Data Persistency: RootJob parallelisation: Root/PROOF

Job submission/control/monitoring: AliEn

Data Catalogue: AliEn

AliRoot AliEn API/PROOF

AliEn Services (shell, web)

ROOT

IVDGL EDG/EDT

By P.Cerello

Interfacing the Grid(s) - I

Page 25: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

Roberto Barbera

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

AliEn Job

AliEn Job

AliEn Job

AliEn Job

AliEn Job

AliEn Job

AliEn Job

AliEn Job

EDG RB

EDG CE

EDG WN

AliEn DataCatalogue

EDG SE

Condor-G

Alice Farm

Alice User

I-LFN

I-PFN

O-PFN

O-LFN,O-PFN

MetaDataCatalogue

By P.Cerello

Interfacing the Grid(s) - II

Page 26: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

Roberto Barbera

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002

EDG WN

AliEn DataCatalogue

EDG SE1

I-LFN(s)

O-PFN3

I-PFN(s)

I-PFN3

MetaDataCatalogue

I-LFN(s)

EDG SE3

EDG SE2

EDG CE2

EDG CE3

I-PFN2

I-PFN1

O-PFN2O-PFN1

PROOF

By P.Cerello

Interfacing the Grid(s) - III

Page 27: 1 CHEP 2000, 10.02.2000Roberto Barbera Grid activities at the ALICE Experiment TNC2002, 03-06.06.2002 On behalf of the ALICE GRID Working Group: G. Andronico

27Roberto Barbera

Summary and conclusionsDue to its huge needs in terms of distributed computing power and mass storage grids are for ALICE not just an interesting computer science technology but a real “conditio sine qua non”.Grid activities at ALICE are successfully developing since almost two years already. Since the beginning the ALICE attitude has been very positive and “propositive”. If you want to see ALICE jobs running on the grid come to the DataGrid stand in the demonstrations’ area.

Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy

ALICE Collaboration

TNC2002, 03-06.06.2002