USCMS Grid USCMS Grid Infrastructure Infrastructure Troubleshooting Troubleshooting

Shaowen Shaowen WangWang

USCMS & GROWUSCMS & GROW

OSG Operations & Support Centers OSG Operations & Support Centers WorkshopWorkshop

May 16, 2006May 16, 2006

Collaborative Collaborative TroubleshootingTroubleshooting A newly established USCMS Grid A newly established USCMS Grid

troubleshooting teamtroubleshooting team– Ransom BriggsRansom Briggs– Yan LiuYan Liu– Anand PadmanabhanAnand Padmanabhan– Eric ShookEric Shook– Shaowen WangShaowen Wang

The Tier-1 + 7 Tier2sThe Tier-1 + 7 Tier2s

Troubleshooting Troubleshooting HelpDeskHelpDesk

Interface to usersInterface to users– cms-help@list.uiowa.educms-help@list.uiowa.edu

FunctionsFunctions– TriagingTriaging– Solving USCMS Grid infrastructure problemsSolving USCMS Grid infrastructure problems

Interfacing with OSG and LCG GGUSInterfacing with OSG and LCG GGUS

– Directing CMS application-level problems to Directing CMS application-level problems to experts at the Tier-1 and Tier-2s when experts at the Tier-1 and Tier-2s when appropriateappropriate

FNAL RemedyFNAL Remedy

Grid-Related CMS Grid-Related CMS Application ToolsApplication Tools

CRAB CRAB – LCG LCG

LCG Resource Broker LCG Resource Broker – OSGOSG

Condor-GCondor-G SRM/dCacheSRM/dCache PhEDEx (PhEDEx (Physics Experimental Data Export)

– CMS data placement and file transfer systemCMS data placement and file transfer system Developing componentsDeveloping components

– gLitegLite– Condor GlidinCondor Glidin

Toward Achieving Toward Achieving Proactive ResponsesProactive Responses

CurrentlyCurrently– Understanding the complexity of troubleshooting Understanding the complexity of troubleshooting

GridsGrids– Reconciling monitoring servicesReconciling monitoring services

MonALISAMonALISA CondorCondor Other monitoring and information servicesOther monitoring and information services

FutureFuture– To diagnose with the support of OSG information and To diagnose with the support of OSG information and

accounting servicesaccounting services– To help establish troubleshooting flowchart and To help establish troubleshooting flowchart and

automatic alert mechanismsautomatic alert mechanisms– To leverage our troubleshooting experience for OSG To leverage our troubleshooting experience for OSG

useuse

Troubleshooting Troubleshooting WorkflowWorkflow

The secret is to follow the path.

Thanks!Thanks!

Questions and comments?Questions and comments?