Experiment Support

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

DBES

I. Dzhunov (IT-ES), S. Gayazov (PH-UAT), P. Karhula (PH-UAT), M. Nowotka (IT-ES),

P. Saiz (IT-ES)

Recent improvements in the SSB core and UI

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

ES

23 Nov 2011 Pablo Saiz CMS Monitoring Task Force

• Show behavior of sites– Based on user-defined metrics– Adding the metrics into views

• Overview of all the sites– And detailed explanation– And links to further information

• Historical data– See the evolution over time– Ranking plots

• Originally developed for CMS– Deployed also for ALICE, ATLAS and LHCb– Plenty of possible customization

Site Status Board

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

ES

33 Nov 2011 Pablo Saiz CMS Monitoring Task Force

• http://dashb-ssb.cern.ch

CMS SSB home page

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

ES

43 Nov 2011 Pablo Saiz CMS Monitoring Task Force

• Three sets of people:– SSB developers:

• Develop common functionality

– VO administrators:• Define data to collect: source, frequency, validity,

criticality…• Setup views• Need write access to the application

– Using X509 certificates• CMS: 100 metrics, 8 views

– End users:• Check the views defined by the VO administrators• Only read access to the application

– Unless using ‘under investigation’

How to use the SSB

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

ES

53 Nov 2011 Pablo Saiz CMS Monitoring Task Force

• Multiple sorting, paging, filtering, exporting data, update url

Improvements : Expanded table

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

ES

63 Nov 2011 Pablo Saiz CMS Monitoring Task Force

• Client-side plots, selection of sites

Improvements: Plots

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

ES

73 Nov 2011 Pablo Saiz CMS Monitoring Task Force

• Percentage in each state, rank, sort, search, filter…

And even more plots

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

ES

83 Nov 2011 Pablo Saiz CMS Monitoring Task Force

• Monitor frequency of collectors & time to insert data

• Very useful for developers– And important for the rest…

Improvements: collectors info

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

ES

93 Nov 2011 Pablo Saiz CMS Monitoring Task Force

• Checking the indexes, partitions and slow queries

• New table for colors• Split between frequency and validity• Changing structure of the ‘SITES’ table

– ‘Site Status Board’ is used also to monitor channels and queues

• Thanks to CERN IT database group!

Improvements: database

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

ES

103 Nov 2011 Pablo Saiz CMS Monitoring Task Force

Google analytics

• Users, visits, location…• Load Time• Might be replaced by piwik

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

ES

113 Nov 2011 Pablo Saiz CMS Monitoring Task Force

• Layout of the site• Simplified login procedure• Downtime information

– Collector from GOCDB and OIM, combined with topology info

And more…

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

ES

123 Nov 2011 Pablo Saiz CMS Monitoring Task Force

• Topology information• Aggregate data• NoSQL• Gridmap view• Testing framework• User support

To do…

CERN IT Department

CH-1211 Geneva 23

Switzerlandwww.cern.ch/

it

ES

133 Nov 2011 Pablo Saiz CMS Monitoring Task Force

• Monitoring application to display status of sites– Keep last status and historical evolution

• Deployed for several experiments• Lots of improvements over the last months:

– Better interface, better graphics, more functionality, better database layout…

• And lots of ideas for more improvements:– And open for suggestions/feedback

http://dashb-ssb.cern.ch

Site Status Board