14
CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

Embed Size (px)

Citation preview

Page 1: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

CAL DQM REPORT

T. Schörner-SadeniusHamburg University

CAL/HES Meeting, 4 January 2005

Page 2: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 2

HAPPY NEW YEAR!

Let’s hope for a working CAL and for lots of lumi.

Unfortunately recently many problems – see later

Page 3: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 3

A loose collection of incidents

Took over from Michele Sunday 20/12/04. CAL in reasonably good shape with 295 bad

channels (calibration version 3852). However, problem in time offsets version – please

always stick to the calibration procedures as posted on the web!

21/12/04 10am: FEC v3855 (297/0) 21/21/04 1pm: power glitch! 21/12/04 5pm: BC update v3856 (428/7) 23/12/04: BC update (452/9) 27/12/04: FEC v3861 (282/1) … and then a few more problems appeared ;-(

Page 4: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 4

A loose collection of incidents ctd’ 28/12/04 morning: CALDAQ (telamon) PC broken

Backup system for teucer/ajax Many DQM processes (HIP, cronjobs, …) Alessandro (with Kerstin and Ulf): Move everything to

menelaus (which is now also called caldaq/telamon – still problems with the names – you have to login to telamon).

By now everything seems to be back, but our HV monitoring and HIP histograms suffered for some time loss of about 300k events!

Various CQC runs with various problems R23 not filled (we had that before – TLT problem?) B22 HV off did not use a number of these runs for BC updates.

Page 5: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 5

A loose collection of incidents ctd’ Current situation

V3864 (314/2) DQM monitoring back (got the first SMS this

morning ;-( )

Page 6: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 6

Recent Problems

See new SOS page with a collection of recent problems and their solution:www-zeus.desy.de/components/CAL/ZEUS_ONLY/troubleshooting/sos-problems.html

Problems B21/22 off swithc back on (and control with UNO run) CAL DAQ broken HIP not updating restart readout (HIP server?) FCAL UNO bad channels because of beam situation ? Timing shift by ~50ns shake CFLTP-Nevis cable. DQM browser alarms for HV and online analysis

jobs???? Local RC stuck delete all lock files and kill all cal_rc

processes (careful!)

Page 7: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 7

Recent Problems: B22 off!

Page 8: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 8

New Web Tools

Zmon online In analogy to DQMCOC on the web cal_check

procedure should become simpler for the oncall person

References not yet there Calibration version cgi script New SOS collection New page layout Timing history script with link HV history script with link Please give feedback on the web pages and

the tools.

Page 9: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 9

New Web Tools: ZMON

Page 10: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 10

New Web Tools: Version script

Page 11: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 11

New Web Tools: Timing and HV

Page 12: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 12

Important for all oncall persons:

Please stick to the procedures as defined on the web. Where the definition is not so clear I will try to improve very soon Most important: Before each FEC/ADC-to-volts

calibration or trimming: update the bad channels and really change to the new calibration versions after the BC update!!! Reason: Time structure of GAFs!

I will create new web pages for all possible actions with very detailed instructions: BC update ADC-to-volts calibration Trimming FEC FEC after an access

Page 13: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 13

Example for FEC instruction

Page 14: CAL DQM REPORT T. Schörner-Sadenius Hamburg University CAL/HES Meeting, 4 January 2005

ZEUS Week Padova 10/2004 TSS: CAL Overview and DQM 14

Access Day Tomorrow

Change 3 SRTD front-end cards (Roberval/Wladimir)

Change 4 FCAL front-end cards (TSS/Wladimir)

Have another look at B16 (Bill?) HES? … ?