SLICESLICE Simulation for LHCb and Simulation for LHCb and

Integrated Control Integrated Control EnvironmentEnvironment

Gennady Kuznetsov & Glenn Patrick (RAL)

Cosener’s House Workshop23rd May 2002

Current ArchitectureCurrent Architecture

Production ManagerCreate no. of jobs (500 events each)Determine configurationRun executableCheck dataCopy data/logs

BookkeepingDatabase

PhysicsCoordinator

Physicist

Monitoring via PVSSSubmit jobs to distributed sitesSee what jobs are runningCheck configurationKill jobs, etc

Job Creation/Submission via WebIdentify outstanding requestsSelect workflowCreate scripts via Java servlets.

Updatebookkeepingdatabase

Transferdata tomass store

Data quality check

Submit jobs remotelyvia Web

Executeon farm

Analysis

LOGICALFLOW

PVSSII for ControlPVSSII for Control

PVSS is commercial SCADA

product from ETM.

Control framework forLHC Joint Controls Project(JCOP).

LHCb has adopted PVSSIIas prototype control andmonitoring system forMC production.

Available for Linux andWindows platforms.

Monitoring and Control Monitoring and Control ExamplesExamples

HistoryHistory

Distributed System has been running for 3+ years &processed many millions of events for LHCb design.Main production sites: CERN,Bologna,Liverpool,Lyon,NIKHEF & RALGlobus already used for job submission to RAL and Lyon

System interfaced to GRID and demonstrated atEU-DG Review and NeSc Opening.

For 2002 Data Challenges, adding new institutes:Bristol, Cambridge, Oxford, ScotGrid, Barcelona, Moscow. In 2003, add Germany, Switzerland & Poland.

Dubna

Moscow

RAL

Lund

Lisboa

Santander

Madrid

Valencia

Barcelona

Paris

Berlin

LyonGrenoble

Marseille

BrnoPrague

Torino

Milano

BO-CNAFPD-LNL

Pisa

Roma

Catania

ESRIN

CERN

HEP sites

ESA sites

IPSL

Estec KNMI

(>40)

Data ChallengesData Challenges

2002 Physics Data Challenges(PDC)are based on existing MC Production System – small amount of Grid.

Computing Data Challenges (CDC)will make more extensive use of Grid.

Extra Grid components will be incorporated into PDCs once proven in CDCs.

Current Use of Grid Current Use of Grid MiddlewareMiddleware

1. Authenticationgrid-proxy-init

2. Job submission to DataGriddg-job-submit

3. Monitoring and controldg-job-statusdg-job-canceldg-job-get-output

4. Data publication and replicationglobus-url-copy, GDMP

5. Resource scheduling – use of CERN MSSJDL, sandboxes, storage elements

Example 1:Example 1: Job Submission Job Submission

dg-job-submit /home/evh/sicb/sicb/bbincl1600061.jdl -o /home/evh/logsub/bbincl1600061.jdl:#Executable = "script_prod";Arguments = "1600061,v235r4dst,v233r2";StdOutput = "file1600061.output";StdError = "file1600061.err";InputSandbox = {"/home/evhtbed/scripts/x509up_u149","/home/evhtbed/sicb/mcsend","/home/evhtbed/sicb/fsize","/home/evhtbed/sicb/cdispose.class","/home/evhtbed/v235r4dst.tar.gz","/home/evhtbed/sicb/sicb/bbincl1600061.sh","/home/evhtbed/script_prod","/home/evhtbed/sicb/sicb1600061.dat","/home/evhtbed/sicb/sicb1600062.dat","/home/evhtbed/sicb/sicb1600063.dat","/home/evhtbed/v233r2.tar.gz"};OutputSandbox = {"job1600061.txt","D1600063","file1600061.output","file1600061.err","job1600062.txt","job1600063.txt"};

Job

Local disk

Compute Element

globus-url-copy

ReplicaCatalogue

NIKHEF - Amsterdam

CERN TESTBED

REST-OF-GRID

JobStorage Element

replica-get

publish

register-local-file

Storage Element

mss

Data Data

Data

Example 2: Data Example 2: Data Publishing & Publishing & ReplicationReplication

The Future?The Future?

The Gaudi framework will eventually be used forall LHCb software applications.

GANGA will be used to interface to Grid services.

New LHCb Data Management System being designed (Marcus Frank et al). Have to consider how the MC Control System interacts with: Monitoring,configuration & production dbases. Meta-data of production files. Output of running jobs. User Interface, etc.