1
Modelling parameters
Jos Vermeulen, 2 June 1999
2
#1 MU6 freq 23000#2 2*MU6 freq 1000#3 MU6 + EM15I freq 64#4 MU6 + EM20I freq 20#5 MU6 + 2*EM15I freq 2.3#6 MU6 + J180 freq 1.3#7 MU6 + 3*J75 freq 2.8#8 MU 6 + 4*J55 freq 2.8#9 EM20I freq 11500#10 2*EM15I freq 1600#11 EM20I + 4*J55 freq 68#12 2*EM15 + 4*J55 freq 180#13 J180 freq 25#14 2*J180 freq 42#15 3*J180 freq 4#15 3*J75 freq 107#17 4*J75 freq 10#18 5*J75 freq 1#19 4*J55 freq 131#20 5*J55 freq 17#21 6*J55 freq 3#22 J180 + 2*J75 freq 63#23 J180 + 3*J75 freq 15#24 J180 + 4*J75 freq 7#25 J180 + 3*J55 freq 28#26 J180 + 4*J55 freq 7
#27 J180 + 5*J55 freq 2#28 2*J180 + 2*J55 freq 8#29 2*J180 + 3*J55 freq 3#30 TAU20 + XE30 freq 1340#31 2*TAU20 + XE30 freq 320#32 3*TAU20 + XE30 freq 110#33 4*TAU20 + XE30 freq 4.0#34 5*TAU20 + XE30 freq 2.0#35 J50 + XE50 freq 148#36 2*J50 + XE50 freq 31#37 3*J50 + XE50 freq 10#38 4*J50 + TAU20 + XE30 freq 16#39 4*J50 + 2*TAU20 + XE30 freq 7#40 4*J50 + 3*TAU20 + XE30 freq 7#41 5*J50 + TAU20 + XE30 freq 3#42 5*J50 + 2*TAU20 + XE30 freq 2#43 J50 + TAU20 + XE50 freq 100#44 2*J50 + TAU20 + XE50 freq 45#45 3*J50 + TAU20 + XE50 freq 45#46 4*J50 + TAU20 + XE50 freq 4#47 J50 + 2*TAU20 + XE50 freq 18#48 2*J50 + 2*TAU20 + XE50 freq 8#49 3*J50 + 2*TAU20 + XE50 freq 4#50 4*J50 + 2*TAU20 + XE50 freq 2#51 J50 + 3*TAU20 + XE50 freq 2#52 2*J50 + 3*TAU20 + XE50 freq 1#53 3*J50 + 3*TAU20 + XE50 freq 2#54 4*J50 + 3*TAU20 + XE50 freq 2#55 5*J50 + 3*TAU20 + XE50 freq 1
Low luminosity menu, menu item rates in Hz (com-daq-99-010)
Accept rate : 2kHz
3
1. confirm data muon detector, 75 % of RoIs accepted,2. confirm muon in tracker, 40 % of RoIs accepted,3. run TRT scan if at least one muon accepted in step 2,
check for isolation in calorimeter, 4 % of RoIs accepted.
1. confirm data muon detector for muon, 75 % of RoIs accepted, confirm data calorimeters for em RoIs, 9 % of RoIs accepted,2. check tracker data, 40 % of muon RoIs accepted, 1 % of em RoIs,3. run TRT scan if muon accepted in step 2, check muon for isolation in calorimeter, 4 % of RoIs accepted,4. Pixel - SCT data analysis (analysis steered by TRT scan, all data requested by trigger processor) if TRT scan is run.
1. confirm data muon detector, 75 % of RoIs accepted, confirm data calorimeters for jet RoIs, 100 % of RoIs accepted,2. confirm muon in tracker, 40 % of RoIs accepted,3. run TRT scan if at least one muon accepted in step 2, check for isolation in calorimeter, 4 % of RoIs accepted,4. Pixel - SCT data analysis (analysis steered by TRT scan, all data requested by trigger processor) if TRT scan is run.
Muon(s)
Muon(s) + Em(‘s)
Muon + Jet(s)
Processing sequence for low luminosity menu
4
1. confirm data calorimeters, 9 % of RoIs accepted,2. check tracker data, 1 % of RoIs accepted.
1. confirm data calorimeters for all RoIs, 9 % of em RoIs accepted,100 % of jet RoIs accepted,
2. check tracker data, 1 % of RoIs accepted.
1. confirm data calorimeters, 100 % of RoIs accepted.
1. confirm data calorimeters for taus, 20 % of RoIs accepted,2. check tracker data for taus, 8 % of RoIs accepted,3. missing energy only if at least one tau is confirmed.
1. confirm jets in calorimeter, missing energy trigger always runs.
1. confirm data calorimeters for taus,2. check tracker data for taus as specified above,3. all jets and missing energy only if at least one tau is confirmed.
Hadron(s) + XE
Hadron(s) + jet(s) +XE
Jet(s) + XE
Em
Em(‘s) + jet(s)
Jet
Processing sequence for low luminosity menu (cont’d)
5
Low luminosity : total RoI rates
Average number of sequential steps =1.75
0.0
5.0
10.0
15.0
20.0
25.0
30.0
muon detector calorimeters TRT SCT,Pixels LVL1 RoI rate
em RoIs hadron RoIs muon RoIs jet RoIs XE RoIs scan RoIs
6
#1 MU6 freq 3900#2 2*MU20 freq 300#3 2*MU6 freq 4000#4 EM30I freq 24300#5 2*EM20I freq 4900#6 J290 freq 47#7 2*J290 freq 49#8 3*J290 freq 2#9 3*J130 freq 130#10 4*J130 freq 8#11 5*J130 freq 1#12 4*J90 freq 141#13 5*J90 freq 15#14 6 *J90 freq 5#15 J290 + 2*J130 freq 52#16 J290 + 3*J130 freq 8#17 J290 + 4*J130 freq 1#18 J290 + 3*J90 freq 27#19 J290 + 4*J90 freq 5#20 2*J290 + 2*J90 freq 9#21 2*J290 + 3*J90 freq 1
#22 TAU60 + XE60 freq 910#23 2*TAU60 + XE60 freq 48#24 3*TAU60 + XE60 freq 3#25 J100 + XE100 freq 166#26 2*J100 + XE100 freq 54#27 3*J100 + XE100 freq 10#28 4*J100 + XE100 freq 10#29 4*J100 + TAU60 + XE60 freq 2#30 4*J100 + 2*TAU60 + XE60 freq 2#31 4*J100 + 3*TAU60 + XE60 freq 1.2#32 5*J100 + TAU60 + XE60 freq 2.2#33 5*J100 + 2*TAU60 + XE60 freq 2.2#34 5*J100 + 3*TAU60 + XE60 freq 1.4#35 J100 + TAU60 + XE100 freq 142#36 2*J100 + TAU60 + XE100 freq 74#37 3*J100 + TAU60 + XE100 freq 10#38 4*J100 + TAU60 + XE100 freq 16#39 J100 + 2*TAU60 + XE100 freq 10#40 2*J100 + 2*TAU60 + XE100 freq 10#41 3*J100 + 2*TAU60 + XE100 freq 10#42 4*J100 + 2*TAU60 + XE100 freq 9
High luminosity menu, menu item rates in Hz (com-daq-99-010)
Accept rate : 2kHz
7
1. confirm data muon detector, 75 % of RoIs accepted,2. confirm muon in tracker, 40 % of RoIs accepted,3. check for isolation in calorimeter, 4 % of RoIs accepted.
1. confirm data calorimeters, 9 % of RoIs accepted,2. check tracker data, 1 % of RoIs accepted.
1. confirm data calorimeters, 100 % of RoIs accepted.
1. confirm data calorimeters, 20 % of RoIs accepted,2. check tracker data, 8 % of RoIs accepted.
1. confirm data calorimeters for hadron(s),2. check tracker data for hadron(s),3. missing energy only if at least one hadron is confirmed.
1. confirm jets in calorimeter, 100 % of RoIs accepted,missing energy trigger always runs.
1. confirm data calorimeters for taus,2. check tracker data for taus as specified above,3. all jets and missing energy only if at least one tau is confirmed.
Muon
Em
Hadron
Jet
Hadron(s) + XE
Hadron(s) + jet(s) +XE
Jet(s) + XE
Processing sequence for high luminosity menu
8
High luminosity : total RoI rates
Average number of sequential steps =1.37
0.0
5.0
10.0
15.0
20.0
25.0
30.0
35.0
40.0
muon detector calorimeters TRT SCT,Pixels LVL1 RoI rate
em RoIs hadron RoIs muon RoIs jet RoIs XE RoIs
9
Em RoIs0.4 x 0.4 in calorimeters(LVL1 RoI min - 0.15 < < LVL1 RoI max + 0.15, LVL1 RoI min - 0.15 < < LVL1 RoI max + 0.15)
0.2 x 0.2 in trackers(LVL1 RoI min - 0.05 < < LVL1 RoI max + 0.05, LVL1 RoI min - 0.05 < < LVL1 RoI max + 0.05)
Tau RoIs0.4 x 0.4 in calorimeters(LVL1 RoI min - 0.15 < < LVL1 RoI max + 0.15, LVL1 RoI min - 0.15 < < LVL1 RoI max + 0.15)
0.2 x 0.2 in trackers(LVL1 RoI min - 0.05 < < LVL1 RoI max + 0.05, LVL1 RoI min - 0.05 < < LVL1 RoI max + 0.05)
Jet RoIs0.8 x 0.8 in calorimeters(LVL1 RoI min - 0.2 < < LVL1 RoI max + 0.2, LVL1 RoI min - 0.2 < < LVL1 RoI max + 0.2)
Muon RoIs0.3 x 0.16 - 0.26 in pixels and SCT(LVL1 RoI min - 0.1 < < LVL1 RoI max + 0.1, LVL1 RoI min - 0.0667 < < LVL1 RoI max + 0.0667)
0.4 x 0.3 - 0.4 in TRT(LVL1 RoI min - 0.15 < < LVL1 RoI max + 0.15, LVL1 RoI min - 0.133 < < LVL1 RoI max + 0.133)
0.4 x 0.3 - 0.4 in calorimeters(LVL1 RoI min - 0.15 < < LVL1 RoI max + 0.15, LVL1 RoI min - 0.133 < < LVL1 RoI max + 0.133)
0.3 x 0.26 or 0.52 or 0.8 in muon spectrometer(LVL1 RoI min - 0.15 < < LVL1 RoI max + 0.15, range determined by lay-out spectrometer)
RoI sizes used by the LVL2 system
10
Number of ROBs, size of event fragments :
Pixels : 62 ROBs * 1200 bytes
SCT : 92 ROBs * 1600 bytes
TRT : 256 ROBs * 600 bytes (low luminosity), 800 bytes (high luminosity)
Em calorimeter : 754 ROBs * ~ 1600 bytes (was : 738 ROBs * 2000 bytes)
Hadron Calorimeter : 98 ROBs * ~ 1600 bytes (was 2000 bytes)
µ-trigger : 48 ROBs * 380 bytes
µ-precision : 192 ROBs * 850 bytes
(NB all results for 738 ROBs for em calorimeter and 2000 bytes fragment sizefor both calorimeters, improved mapping for em calorimeter will result in smallerdifference between lower and upper limit for rates and data volumes)
11
ROBsPerRoIprogram
File with filenamesMuRoIs MuRoIAreas-99.txtEmRoIs EmRoIAreas.txtJetRoIs JetRoIAreas.txtPixel PixelMap-towers-62-99.txt MuRoIOverlap 0.1 0.0666666 EmRoIOverlap 0.05 0.05 JetRoIOverlap 0.2 0.2SCT SCTMap-layers-99.txt MuRoIOverlap 0.1 0.0666666 EmRoIOverlap 0.05 0.05 JetRoIOverlap 0.2 0.2TRT TRTMap-99.txt MuRoIOverlap 0.15 0.1333333 EmRoIOverlap 0.05 0.05 JetRoIOverlap 0.2 0.2EmCal EmcalMap-new-note-62.txt MuRoIOverlap 0.15 0.1333333 EmRoIOverlap 0.15 0.15 JetRoIOverlap 0.2 0.2HadCal HadCalMap-new-note-62.txt MuRoIOverlap 0.15 0.1333333 EmRoIOverlap 0.15 0.15 JetRoIOverlap 0.2 0.2MuPrec MuPrecMap-62-phi.txt MuRoIOverlap 0.1 0.0MuTrig MuTrigMap-62.txt MuRoIOverlap 0.1 0.0
Average number of ROBIns / ROBOuts per RoI
Look up table for computer model
Specification of LVL1 RoI sizes
Specificationof ROB mapsand of LVL2RoI sizes
12
64 -2.4 -2.364 -2.3 -2.264 -2.2 -2.1 • • • •64 2.2 2.364 2.3 2.464 2.4 2.5
16 -3.2 -2.816 -2.8 -2.416 -2.4 -2.0 • • • •16 2.0 2.416 2.4 2.816 2.8 3.2
96 -2.4250 -2.392096 -2.3920 -2.358696 -2.3586 -2.324896 -2.3248 -2.290796 -2.2907 -2.256596 -2.2565 -2.222196 -2.2221 -2.188196 -2.1881 -2.155096 -2.1550 -2.122896 -2.1228 -2.091496 -2.0914 -2.060896 -2.0608 -2.030296 -2.0302 -1.999096 -1.9990 -1.967596 -1.9675 -1.935696 -1.9356 -1.9178192 -1.9178 -1.8948192 -1.8948 -1.8695192 -1.8695 -1.8435192 -1.8435 -1.8169192 -1.8169 -1.7898192 -1.7898 -1.7624192 -1.7624 -1.7346192 -1.7346 -1.7066192 -1.7066 -1.6797192 -1.6797 -1.6538192 -1.6538 -1.6289192 -1.6289 -1.6051192 -1.6051 -1.5822192 -1.5822 -1.5604192 -1.5604 -1.5397192 -1.5397 -1.5198192 -1.5198 -1.5007192 -1.5007 -1.4821192 -1.4821 -1.4634192 -1.4634 -1.4440192 -1.4440 -1.4239192 -1.4239 -1.4029192 -1.4029 -1.3797192 -1.3797 -1.3545192 -1.3545 -1.3274192 -1.3274 -1.2989192 -1.2989 -1.2699192 -1.2699 -1.2403192 -1.2403 -1.2104192 -1.2104 -1.1815192 -1.1815 -1.1544192 -1.1544 -1.1289192 -1.1289 -1.1050192 -1.1050 -1.0821192 -1.0821 -1.0600192 -1.0600 -1.0387192 -1.0387 -1.0346
48 -1.0346 -0.948 -0.9 -0.848 -0.8 -0.748 -0.7 -0.6 • • • •48 0.7 0.848 0.8 0.948 0.9 1.0346
192 1.0346 1.0387192 1.0387 1.0600192 1.0600 1.0821192 1.0821 1.1050192 1.1050 1.1289192 1.1289 1.1544192 1.1544 1.1815192 1.1815 1.2104192 1.2104 1.2403192 1.2403 1.2699192 1.2699 1.2989192 1.2989 1.3274192 1.3274 1.3545192 1.3545 1.3797192 1.3797 1.4029192 1.4029 1.4239192 1.4239 1.4440192 1.4440 1.4634192 1.4634 1.4821192 1.4821 1.5007192 1.5007 1.5198192 1.5198 1.5397192 1.5397 1.5604192 1.5604 1.5822192 1.5822 1.6051192 1.6051 1.6289192 1.6289 1.6538192 1.6538 1.6797192 1.6797 1.7066192 1.7066 1.7346192 1.7346 1.7624192 1.7624 1.7898192 1.7898 1.8169192 1.8169 1.8435192 1.8435 1.8695192 1.8695 1.8948192 1.8948 1.917896 1.9178 1.935696 1.9356 1.967596 1.9675 1.999096 1.9990 2.030296 2.0302 2.060896 2.0608 2.091496 2.0914 2.122896 2.1228 2.155096 2.1550 2.188196 2.1881 2.222196 2.2221 2.256596 2.2565 2.290796 2.2907 2.324896 2.3248 2.358696 2.3586 2.392096 2.3920 2.4250
Per ROI : 2π / number in
min max
em / tau RoIs jet RoIs muon RoIs
Low etaLVL1 RoIs
13
RoI req rate fraction per ROBIn : pixels
0.00
0.01
0.02
0.03
0.04
0.05
0.06Em RoIs
RoI req rate fraction per ROBIn : pixels
0.00
0.01
0.02
0.03
0.04
0.05
0.06
0.07Muon RoIs
16 -2.5 -1.715 -2.5 0.015 0.0 2.516 1.7 2.5
Per ROB : 2π / number in
min max
Pixels
14
RoI req rate fraction per ROBIn : SCT
0.00
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.10Em RoIs
RoI req rate fraction per ROBIn : SCT
0.00
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.10Muon RoIs
8 -2.5 -2.08 -2.5 -1.68 -2.0 -1.44 -1.4 0.04 0.0 1.45 -1.4 0.05 0.0 1.46 -1.4 0.06 0.0 1.47 -1.4 0.07 0.0 1.48 1.4 2.08 1.6 2.58 2.0 2.5
Per ROB : 2π / number in
min max
SCT
15
RoI req rate fraction per ROBIn : TRT
0.000
0.002
0.004
0.006
0.008
0.010
0.012
0.014
0.016
0.018
0.020Em RoIs
RoI req rate fraction per ROBIn : TRT
0.020
0.021
0.021
0.022
0.022
0.023
0.023
0.024
0.024
0.025
0.025
Muon RoIs
96 -2.4 -0.732 -1.1 0.032 0.0 1.196 0.7 2.4
Per ROB : 2π / number in
min max
TRT
16
2 -1.8 -1.6 1 -1.6 -1.516 -1.47 0.016 0.0 1.471 1.5 1.62 1.6 1.8
2 -3.2 -2.51 -2.5 -2.48 -2.4 -2.28 -2.2 -2.08 -2.0 -1.98 -1.9 -1.88 -1.8 -1.78 -1.7 -1.68 -1.6 -1.51 -1.5 -1.432 -1.47 -1.232 -1.2 -0.832 -0.8 -0.432 -0.4 0.032 0.0 0.432 0.4 0.832 0.8 1.232 1.2 1.471 1.4 1.58 1.5 1.68 1.6 1.78 1.7 1.88 1.8 1.98 1.9 2.08 2.0 2.28 2.2 2.41 2.4 2.52 2.5 3.2
2 -3.2 -2.54 -2.5 -2.48 -2.4 -2.28 -2.2 -2.04 -2.0 -1.94 -1.9 -1.84 -1.8 -1.74 -1.7 -1.64 -1.6 -1.54 -1.5 -1.416 -1.47 -1.216 -1.2 -0.816 -0.8 -0.416 -0.4 0.016 0.0 0.416 0.4 0.816 0.8 1.216 1.2 1.474 1.4 1.54 1.5 1.64 1.6 1.74 1.7 1.84 1.8 1.94 1.9 2.08 2.0 2.28 2.2 2.44 2.4 2.52 2.5 3.2
2 -2.5 -2.44 -2.4 -2.24 -2.2 -2.02 -2.0 -1.92 -1.9 -1.82 -1.8 -1.72 -1.7 -1.62 -1.6 -1.516 -1.4 -0.816 -0.8 0.016 0.0 0.816 0.8 1.42 1.5 1.62 1.6 1.72 1.7 1.82 1.8 1.92 1.9 2.04 2.0 2.24 2.2 2.42 2.4 2.5
layer 1 (front) layer 2 (middle) layer 3
layer 0(presampler)
Per ROB : 2π / number in
min max
Electromagneticcalorimeter
17
RoI req rate fraction per ROBIn : em calorimeter
0.00
0.02
0.04
0.06
0.08
0.10
0.12
0.14Jets
18
RoI req rate fraction per ROBIn : em calorimeter
0.00
0.02
0.04
0.06
0.08
0.10
0.12Em RoIs
19
RoI req rate fraction per ROBIn : em calorimeter
0.00
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.10Mu RoIs
20
RoI req rate fraction per ROBIn : hadron calorimeter
0.00
0.02
0.04
0.06
0.08
0.10
0.12
0.14
0.16
0.18
0.20Jet RoIs1 -3.2 -2.5
1 -3.2 -2.54 -2.5 -1.64 -2.5 -1.64 -2.5 -1.61 -1.6 -1.51 -1.6 -1.51 -1.6 -1.564 -1.6 1.61 1.5 1.61 1.5 1.61 1.5 1.64 1.6 2.54 1.6 2.54 1.6 2.51 2.5 3.21 2.5 3.2
Per ROB : 2π / number in
min max
Hadron calorimeter
21
RoI req rate fraction per ROBIn : hadron calorimeter
0.00
0.02
0.04
0.06
0.08
0.10
0.12Em RoIs
RoI req rate fraction per ROBIn : hadron calorimeter
0.00
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.10Muon RoIs
1 -3.2 -2.51 -3.2 -2.54 -2.5 -1.64 -2.5 -1.64 -2.5 -1.61 -1.6 -1.51 -1.6 -1.51 -1.6 -1.564 -1.6 1.61 1.5 1.61 1.5 1.61 1.5 1.64 1.6 2.54 1.6 2.54 1.6 2.51 2.5 3.21 2.5 3.2
Per ROB : 2π / number in
min max
Hadroncalorimeter
22
RoI req rate fraction per ROBIn : muon precision detector
0.000
0.005
0.010
0.015
0.020
0.025
0.030Muon RoIs
RoI req rate fraction per ROBIn : muon trigger detector
0.000
0.005
0.010
0.015
0.020
0.025
0.030
0.035
0.040
0.045Muon RoIs
16 -2.7 -1.36 21PhiDivision16 -2.7 -1.05 21PhiDivision16 -2.0 -1.05 21PhiDivision16 -1.05 -0.8 21PhiDivision16 -0.8 -0.4 21PhiDivision16 -0.4 0.0 21PhiDivision16 0.0 0.4 21PhiDivision16 0.4 0.8 21PhiDivision16 0.8 1.05 21PhiDivision16 1.05 2.0 21PhiDivision16 1.05 2.7 21PhiDivision16 1.36 2.7 21PhiDivision
Per ROB : 2π / number in
min max
Muonprecision
8 -2.5 -1.0 EvenPhiDivision16 -1.2 0.0 21PhiDivision16 0.0 1.2 21PhiDivision8 1.0 2.5 EvenPhiDivision
Muon trigger
23
New version (3.0) of Excel spreadsheet,support for pixels and analysis of jets in tracker added
Tables for 1 - 128 ROBins per ROBOut included(generated with RoBsPerRoI program)
Lower and upper limits of rates calculated
Model of DAQ-1 Read-Out Crate withVME and PVIC bus included
Many graphs : all graphs shown are taken from the spreadsheet
Paper model
Jos Vermeulen, 2 June 1999
24
Present results
No analysis of jets in tracker
TRT scan leads to requesting all datafrom SCT and pixels
Processing parameters and process models asagreed on in January meeting and as documentedin MWD
Accept decisions combined with reject decisionsin blocks of 20 decisions multicasted to all ROBIns
TRT, SCT and pixel scan and missing energy RoI requests multicasted
NB : Processing sequence for em RoIs to be modified, resultingin reduction of RoI request rate for and of volume of data to besent by hadron calorimeter ROBIns (reduction factor probably ~ 6)
25
ROBIns
ROBOuts
PixelsSCTTRTEmCaloHadCaloµ-trig µ-prec
62922567389819248
369494812
Processor farm, one bi-directional networkport per processor
Supervisorprocessors
N
12 x 48 x 49 x 369 x
256 x 92 x 62 x
N x Event fragmentsRoI requests*)Decisions
To ROBsFrom ROBs
LVL1 RoI infoDecisionsbroadcastedto ROBs
Switch
(N = 5 incomputer model) (768 processors in
farm in computer model)*) Scan and Emiss RoI requestsare multi-casted
26
0.0000
2.0000
4.0000
6.0000
8.0000
10.0000
12.0000
14.0000
16.0000
18.0000
20.0000
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
RoI request rate per ROBIn (kHz)
RoI data volume per ROBIn (MByte/s)
Low luminosity with Emiss and B-physics triggers
27
Low luminosity without Emiss and B-physics triggers
0.0000
0.5000
1.0000
1.5000
2.0000
2.5000
3.0000
3.5000
4.0000
4.5000
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
RoI request rate per ROBIn (kHz)
RoI data volume per ROBIn (MByte/s)
28
0.00
2.00
4.00
6.00
8.00
10.00
12.00
14.00
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Lower limit RoI req rate per ROB (kHz)Average RoI request rate per ROB (kHz)Upper limit RoI req rate per ROB (kHz)
Low luminosity with Emiss and B-physics triggers
29
Low luminosity without Emiss and B-physics triggers
0.00
0.50
1.00
1.50
2.00
2.50
3.00
3.50
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Lower limit RoI req rate per ROB (kHz)Average RoI request rate per ROB (kHz)Upper limit RoI req rate per ROB (kHz)
30
0.00
5.00
10.00
15.00
20.00
25.00
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Lower limit data volume per ROB (MByte/s)Average data volume per ROB (MByte/s)Upper limit data volume per ROB (MByte/s)
Raw data volume event fragments : Pixels : 1200, SCT : 1600, TRT : 600, EmCalo : 2000, HadCalo : 2000, µ-trig : 380, µ-precision : 850 bytes
Low luminosity with Emiss and B-physics triggers
31
Low luminosity without Emiss and B-physics triggers
0.00
1.00
2.00
3.00
4.00
5.00
6.00
7.00
8.00
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Lower limit data volume per ROB (MByte/s)Average data volume per ROB (MByte/s)Upper limit data volume per ROB (MByte/s)
32
0.0
10.0
20.0
30.0
40.0
50.0
60.0
70.0
80.0
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Lower limit ROBIn occupancy (%) Average ROBIn occupancy (%)
Upper limit ROBIn occupancy (%)
Low luminosity with Emiss and B-physics triggers
33
Low luminosity without Emiss and B-physics triggers
0.0
5.0
10.0
15.0
20.0
25.0
30.0
35.0
40.0
45.0
50.0
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Lower limit ROBIn occupancy (%) Average ROBIn occupancy (%)
Upper limit ROBIn occupancy (%)
34
0.00
500.00
1000.00
1500.00
2000.00
2500.00
3000.00
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
RoI fragment total data volume (MByte/s) RoI fragment rate (kHz)
Low luminosity with Emiss and B-physics triggers
35
Low luminosity without Emiss and B-physics triggers
0.0
500.0
1000.0
1500.0
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
RoI fragment total data volume (MByte/s) RoI fragment rate (kHz)
36
Low luminosity mu-prec mu-trig e.m. cal hadron calNumber of ROBIns per ROBOut 4 4 2 2Volume RoI fragments per ROBOut (MByte/s) 1.06 1.04 4.54 9.45Total occupancy ROBOut (%) 17.52 24.23 20.90 36.75
Low luminosityMinimum number of processors 654Data volume per processor in (MByte/s) 9.64Fragment rate per processor in (kHz) 7.80Minimum number of supervisor processors 2
61 without Emissand B-physics triggers
37
0.0000
1.0000
2.0000
3.0000
4.0000
5.0000
6.0000
7.0000
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
RoI request rate per ROBIn (kHz)
RoI data volume per ROBIn (MByte/s)
High luminosity, with Emiss trigger
38
High luminosity, without Emiss trigger
0.0000
1.0000
2.0000
3.0000
4.0000
5.0000
6.0000
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
RoI request rate per ROBIn (kHz)
RoI data volume per ROBIn (MByte/s)
39
0.00
1.00
2.00
3.00
4.00
5.00
6.00
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Lower limit RoI req rate per ROB (kHz)Average RoI request rate per ROB (kHz)Upper limit RoI req rate per ROB (kHz)
High luminosity, with Emiss trigger
40
High luminosity, with Emiss trigger
0.00
2.00
4.00
6.00
8.00
10.00
12.00
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Lower limit data volume per ROB (MByte/s)Average data volume per ROB (MByte/s)Upper limit data volume per ROB (MByte/s)
Raw data volume event fragments : Pixels : 1200, SCT : 1600, TRT : 800, EmCalo : 2000, HadCalo : 2000, µ-trig : 380, µ-precision : 850 bytes
41
High luminosity, with Emiss trigger
0.0
10.0
20.0
30.0
40.0
50.0
60.0
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Lower limit ROBIn occupancy (%) Average ROBIn occupancy (%)
Upper limit ROBIn occupancy (%)
42
High luminosity, with Emiss trigger
0.00
500.00
1000.00
1500.00
2000.00
2500.00
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
RoI fragment total data volume (MByte/s) RoI fragment rate (kHz)
43
0.00
500.00
1000.00
1500.00
2000.00
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
RoI fragment total data volume (MByte/s) RoI fragment rate (kHz)
High luminosity, without Emiss trigger
44
High luminosity mu-prec mu-trig e.m. cal hadron calNumber of ROBIns per ROBOut 4 4 2 2Volume RoI fragments per ROBOut (MByte/s) 0.53 0.52 5.43 12.22Total occupancy ROBOut (%) 13.58 16.92 23.95 45.75
High luminosityMinimum number of processors 71Data volume per processor in (MByte/s) 39.57Fragment rate per processor in (kHz) 15.36Minimum number of supervisor processors 2
62 withoutEmiss
45
Maximum rate and volume of data to be sentto LVL2 per ROBIn
12 kHz / 20 MByte/s
Without Emiss and B-physics triggers :
3.5 kHz / 7 MByte/s
Low luminosity :
High luminosity : 5 kHz / 10 MByte/s
46
Read Out Crate Model
ROB ROB ROB
TRG EBIF LVL2IF
ROB
VME
PVIC(support forbroadcasts) Event
fragmentsout
RoI requestsin via TRG or via LVL2IF
Eventfragments
out
Decisionsin
muon-MDT muon-trig e.m. cal hadron cal TRT SCT PixelsNumber of ROBs per crate 16 16 16 16 16 16 16
TRG :RoI req's (only LVL2 RoI reqs broadcasted if PVIC is used) via : PVIC PVIC PVIC PVIC PVIC PVIC PVICTRG : Blocked reject decions via : VME VME VME VME VME VME VMETRG : Unblocked accept decisions via : VME VME VME VME VME VME VMELVL2 i/f : Event data in via : Local Local Local Local Local Local LocalLVL2 i/f : RoI requests out via : Local Local Local Local Local Local LocalEBIF : Event data in via : PVIC PVIC PVIC PVIC PVIC PVIC PVICEBIF : Discards out via : PVIC PVIC PVIC PVIC PVIC PVIC PVICROBs write event data to LVL2 I/F (in stead of reading from ROBs) No No No No No No NoROBs write event data to EBIF (in stead of EBIF reading from ROBs) No No No No No No No
47
VME : CPU protocol overhead (µs) 4.4VME : Bus utilization protocol (µs) 2.4VME : # of msgs for protocol 2.0VME : # of bytes / protocol msg 4.0
PVIC : CPU protocol overhead (µs) 2.1PVIC : Bus utilization protocol (µs) 0.13PVIC : # of msgs for protocol 2.0PVIC : # of bytes / protocol msg 4.0
VME - no DMA : CPU overhead for 1 transfer (µs) 0.0VME - no DMA : CPU utilization per 4 bytes read (µs) 1.2VME - no DMA : CPU utilization per 4 bytes write (µs) 1.2VME - no DMA : Bus utilization per 4 bytes read (µs) 1.2VME - no DMA : Bus utilization per 4 bytes write (µs) 1.2
VME - DMA : CPU overhead for 1 transfer (µs) 8.0VME - DMA : CPU utilization per 4 bytes read (µs) 0.0VME - DMA : CPU utilization per 4 bytes write (µs) 0.0VME - DMA : Bus utilization per 4 bytes read (µs) 0.125VME - DMA : Bus utilization per 4 bytes write (µs) 0.125
PVIC - no DMA : CPU overhead for 1 transfer (µs) 0.0PVIC - no DMA : CPU utilization per 4 bytes read (µs) 1.2PVIC - no DMA : CPU utilization per 4 bytes write (µs) 1.2PVIC - no DMA : Bus utilization per 4 bytes read (µs) 1.2PVIC - no DMA : Bus utilization per 4 bytes write (µs) 1.2
PVIC - DMA : CPU overhead for 1 transfer (µs) 6.6PVIC - DMA : broadcast : additional CPU overhead per destination (µs) 1.0PVIC - DMA : CPU utilization per 4 bytes read (µs) 0.0PVIC - DMA : CPU utilization per 4 bytes write (µs) 0.0PVIC - DMA : Bus utilization per 4 bytes read (µs) 0.065PVIC - DMA : Bus utilization per 4 bytes write (µs) 0.065
48
VME bus utilisation (%)
0.00
10.00
20.00
30.00
40.00
50.00
60.00
70.00
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Data transport
Protocol
PVIC utilisation (%)
0.00
20.00
40.00
60.00
80.00
100.00
120.00
140.00
160.00
180.00
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Data transport
Protocol
Low luminosity
49
TRG CPU utilisation (%)
0.00
20.00
40.00
60.00
80.00
100.00
120.00
140.00
160.00
muon-MDT muon-trig e.m. cal hadron cal SCT TRT TRT scan
Data transport
Protocol
EBIF CPU utilisation (%)
0.00
5.00
10.00
15.00
20.00
25.00
30.00
35.00
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Data transport
Protocol
Low luminosity
50
TRG CPU utilisation (%)
0.00
10.00
20.00
30.00
40.00
50.00
60.00
70.00
80.00
90.00
muon-MDT muon-trig e.m. cal hadron cal SCT TRT TRT scan
Data transport
Protocol
PVIC utilisation (%)
0.00
20.00
40.00
60.00
80.00
100.00
120.00
muon-MDT muon-trig e.m. cal hadron cal TRT SCT Pixels
Data transport
Protocol
Low luminosity, without RoIRs sent by TRG
51
LocalPixelSCTEmRoI 277.775LocalPixelSCTMuRoI 277.775LocalPixelSCTScanRoI 22222.22
LocalTRTMuRoI 327.775LocalTRTEmRoI 172.22
LocalCalMuRoI 55.555LocalCalEmRoI 55.555LocalCalJetRoI 55.555LocalCalEMissRoI 55.555
LocalMuonMuRoI 55.555LocalTRTScanRoI 27777.75
FEX processing times (µs)
DecisionBlockHandlingTime 55.5555IndexingTime 5.0Processing time per RoI 11.111
ROBIn processing times (µs)
Task switching time : 10 µs
RoIFormulateProcessTime 11.11111DecisionProcessTime 5.555MergeSpeed 80 MByte/sGlobal 55.55RequestPixSCTScanEarlyScanRequestMulticast EMissRequestMulticast
Processing times other processes in farm (µs)
52
Status : generic model of full pilot project system implementedand debugged, together with paper model (!)
Comparison with paper model OK, for both low and highluminosity
Diagnostics added : max. queue sizes, min. and max. occupancies, etc. .
Results : max LVL1 rate ≤ 30 kHz (low and high luminosity)low luminosity : bandwidth links limitationhigh luminosity : bandwidth ROBOut output link hadron calorimeter probably limiting factor
Computer model
Jos Vermeulen, 2 June 1999
53
SCT ROBIn proc 42.984509 OS 25.428434 sum 68.412943 (min 55.323167 max 71.510486) r-out 10.728606 v-out 17.509085 Ports - RoIR i 229925 b 53420 m 12 LVL2-out i 193926 b 0 m 0 EB-out i 35784 b 0 m 0 Buffers - Events total 3085 max 3385 RoIRs t 0.35 m 38 passed 193928 stored 160671 Buffers - LVL2Frags total 1.21 max 23 passed 193927 stored 139452 EFFrags t 0.00 m 6 p 35784 s 12731
Model C proc 76.158524 OS 8.081409 sum 84.239933 rcvlink 27.137319 r-in 6.630596 r-out 1.233981 v-in 8.142010 v-out 0.029408Model C proc min 55.323167 max 97.660100 Time fraction : RoIRInput 0.000000 FEXInput 0.000000 RoIFormulate 0.139874 FEX 75.730537 global 0.288113 out 0.000000 RoIROut 0.000000 # of schedules per LVL1A : RoIInput 0.999913 FEXinput 126.307386 RoIFormulate 2.417015 FEX 2.928056 # of schedules per LVL1A : global 1.746172 out 23.692406 RoIROut 0.000000 s / s EM_ROI Pix-SCT 0.757651 TRT 0.391600 cal 11.273719 s / s JET_ROI Pix-SCT 0.000000 TRT 0.000000 cal 3.268660 s / s MU_ROI Pix-SCT 7.395578 TRT 6.973313 cal 5.295127 mu 2.171090 s / s EMISS_ROI cal 8.433247 s / s TRTSCAN_ROI TRT 291.274888 s / s PIXELSCTSCAN_ROI Pix-SCT 244.375652 Ports - InPort i 119852 b 273 m 6 OutPort i 22304 b 0 m 0 Buffers - fragments in total 293 max 0 FEX results t 0 m 9 roirFormulatorInBuffer t 0.79 m 28 passed 1647 stored 355 Buffers - theGlobalOutBuffer total 0.13 max 49 passed 22305 stored 19092 Switch port -> InPort i 119889 b 117352 m 1436 Switch port <- OutPort i 22304 b 0 m 0
Example diagnostics
54
Paper model mu-MDT muon-trig e.m. cal hadron cal TRT SCT PixelsRoI request rate per ROBIn (kHz) 0.30 0.63 1.12 2.33 10.33 10.84 10.56Total average (Mbyte/s) 0.27 0.26 2.27 4.73 6.53 17.68 13.00Average ROBIn occupancy (%) 36.18 37.20 38.71 42.48 67.39 68.95 68.08
Computer model mu-MDT muon-trig e.m. cal hadron cal TRT SCT PixelsRoI request rate per ROBIn (kHz) 0.30 0.63 1.11 2.30 10.39 10.89 10.61Total average (Mbyte/s) 0.27 0.26 2.25 4.68 6.56 17.77 13.07Average ROBIn occupancy (%) 36.15 37.18 38.65 42.38 67.52 69.09 68.21
Paper / computer model - 1 mu-MDT muon-trig e.m. cal hadron cal TRT SCT PixelsRoI request rate per ROBIn 0.004 0.001 0.005 0.011 -0.006 -0.005 -0.005Total average -0.016 -0.001 0.008 0.010 -0.005 -0.005 -0.005Average ROBIn occupancy 0.001 0.001 0.002 0.002 -0.002 -0.002 -0.002
768 farm processorsFarm processor occupancy: paper model (%) 85.18Farm processor occupancy: computer model (%) 85.64Paper / computer model - 1 -0.0054
Low luminosity, 4014.8 Hz LVL1 rate, 140,082 events
55
Low luminosity, 30 kHz, links @ 15 MByte/s
112,251 events
56
Low luminosity, 28 kHz, links @ 15 MByte/s
121,385 events
57
713,000 events
Low luminosity, 40 kHz, links @ 30 MByte/s
58
713,000 events
Low luminosity, 40 kHz, links @ 30 MByte/s
59
Low luminosity, 40 kHz, links @ 30 MByte/s
713,000 events
60
Low luminosity, 40 kHz, links @ 30 MByte/s
713,000 events
61
High luminosity, 40 kHz, links @ 15 MByte/s
42,530 events
62
High luminosity, 30 kHz, links @ 15 MByte/s
580,309 events
63
High luminosity, 30 kHz, links @ 15 MByte/s
580,309 events