Alexandre Camsonne Jefferson Laboratory January 29 2018 ... · GEM Occupancy % Number of strips XY strips Strips per chambers Event size ( bytes ) Data rate 100 KHz MB/s 1 2.21 453

Alexandre Camsonne

Jefferson Laboratory

January 29th 2018

EIC Streaming Workshop

Introduction ◦ SoLID ◦ JLAB Pipeline DAQ ◦ GEM readout

PVDIS ◦ Calorimeter trigger ◦ Trigger rates ◦ Event sizes / data rates

SIDIS ◦ Electronics layout ◦ Trigger rates ◦ Event size / data rates

1/29/2018 SoLID DAQ - Streaming Workshop

II 2

PVDIS : inclusive electrons 50 uA on 40 cm target L = 5.4 1038cm-2.s-1

SIDIS : semi inclusive measurement : 15 uA on 40 cm He3 target L = 1037cm-2.s-1 J/Psi production : 3uA on 15 cm target LH2 L = 1037cm-2.s-1

1/29/2018

SoLID DAQ - Streaming Workshop II 3

Based on CLEO magnet with GEM trackers

EIC L = 1035cm-2.s-1

Detector PVDIS Channels Detector SIDIS Channels

Calorimeter 1830 Calorimeter 1830

Light Gas Cerenkov

270 Light Gas Cerenkov

270

GEM 141000 GEM 164000

Heavy Gas Cerenkov

360

MRPC 3300

Scintillators 180


II 4

PVDIS ◦ Parity measurement

◦ Inclusive : high energy scattered electron

◦ Pion background huge

◦ 600 KHz trigger rate

◦ 20 KHz with 30 independent sectors

◦ Full waveform readout

◦ Clustering calorimeter trigger

◦ FADC readout of cluster only

SIDIS J/psi ◦ Semi-inclusive

measurement

◦ High energy electron and pion or 2 high energy e+e-

◦ Pion can be anywhere in detector : centralized trigger

◦ minimum 80 KHz of trigger rate, ideally want 200 KHz

◦ Read integral and time of pulse


II 5


II 6

Detector segmented in 30 sectors


II 7

To neighbor VTP

To neighbor VTP


II 8

VT

P

Initially readout through VME backplane at 100 MB/s

Development of VXS readout for parallel readout 2 Gbps x 16 = 4 GB/s ( 40 times faster )

FADC not a bottleneck even reading out full waveform

( See Chris Cuevas talk )


II 9

CPU

SSP

SSP

SSP

SSP

CPU

TD

TD

TD

T

D

TS

GT

P

SD

TI


II 10

TCS ◦ e+e- trigger

Ay

Kaon SIDIS


II 11

High trigger rates

High occupancy

Large amount of data from trackers


II 12

Estimations based on APV25

128 channels analog memory 192 samples depth

inherent deadtime : ◦ 141x25 ns = 3.6 us deadtime per trigger

◦ 277 KHz for 1 sample

◦ 93 KHz for 3 samples

VME readout : bottle neck at 100 MB/s

Optical link option : limited at 1.2 GB/s


II 13

Rate

20 KHz

Total strips

occupancy

Sector X Y XY Bytes 3 samples

0 81.7 88.3 453 0.37 170 680 2040

1 73.3 75.6 510 0.29 148.9 595.6 1786.8

2 68.3 72.5 583 0.24 140.8 563.2 1689.6

3 56.4 58.2 702 0.16 114.6 458.4 1375.2

4 54.5 56.9 520 0.21 111.4 445.6 1336.8

Total hits / sector

574.3 2742.8 8228.4

Data rate / sector

54856000 164568000

Data rate ( sector Mb/s)

54.856 164.568

30 sectors about 5 GB/s


II 14

GEM Occupancy

%

Number of strips

XY strips Strips per chambers

Event size ( bytes )

Data rate 100 KHz

MB/s

1 2.21 453 906 27180 2402.712 24027120

0 240.2712

2 8.78 510 1020 30600 10746.72 10746720

00 1074.672

3 3.63 583 1166 34980 5079.096 50790960

0 507.9096

4 2.31 702 1404 42120 3891.888 38918880

0 389.1888

5 1.78 520 1040 31200 2221.44 22214400

0 222.144

6 1.3 640 1280 38400 1996.8 19968000

0 199.68

Total 20.01 3408 6816 204480 26338.656 26338656

00 2633.8656

Occupancies with one sample readout, rates for 100 KHz

GEM dominating 2.6 GB/s same order of magnitude as PVDIS Tracking efficiency might improve with reading more samples but data size increases too


II 15

Currently : 14 drives give 2.24 GB/s ( LTO4 to LTO6) up to 16 drives for now. With latest technology could be up to 1.1 GB/s per drive Bottomline : 3 GB/s is reasonable by 2020 Future : 2.75 GB/16 = 44 GB/s

2020 2025 ?


II 16


II 17

2010 2012 2015 2018 2020 2023

Days Data rate

Seconds Total data TB

Double

DLO5 in K$

DLO6 in K$

DLO7 in K$

DLO8 in K$

LTO 9 In K$

LTO10 In K$

E12-11-108

Pol proton 120 3900 1036800

0 40435

80870

4043 2426 970 473 242 126

E12-12-006

J/Psi 60 4000 5184000 20736 41472

2073 1244 497 243 124 64

E12-10-006

Transv. Pol. 3He

90 3400 7776000 26438 52877

2643 1586 634 309 158 82

E12-11-007

Long. Pol. 3 He

35 3400 3024000 10282 20563

1028 616 246 120 61 32

E12-10-007

PVDIS 169 6000 1460160

0 87610

175219

8760 5256 2102 1026 525 273

Total 474 4095360

0 18550

1 371002

18550 11130 4452 2173 1113 579

Assume 75 $ per tape

would simplify SIDIS case, can use PVDIS setup directly just adding additionnal detectors

most likely not doable to go fully streaming unless GEM data is heavily reduced

Mostly matter of cost for SILO / Network / tapes


II 18

Most likely SoLID cannot go full streaming yet

Same requirements as streaming DAQ ◦ high data bandwidth

◦ data processing on board for best algorithm to do data reduction

GEM ASIC and system ◦ sampling 20 MHz minimum 40 MHz or more

◦ 10 bit minimum, 12 bit ideal

◦ Zero suppression

◦ Advanced processing : clustering, coincidences between planes, pile-up treatment


II 19

APV25 ◦ 128 channels multiplexed

◦ 40 MHz sampling 192 samples analog chip

◦ 40 MHz readout

VMM3 ◦ 25 ns shaping time but multiple samples not clear

at high rate

◦ 10 bits ADC ( 200 ns conversion )

◦ 8 bit ADC for timing

◦ 12 bits TDC

◦ 640 Mbps ( effective 560 Mbps)


II 20


II 21

Analog, digital continuous , L0 mode (LHC)

SAMPA ◦ 10 or 20 MHz sampling rate FADC

◦ 32 channels

◦ 160 ns shaping time, 80 ns might be available

◦ need to check signal to noise with detector

◦ 4x320 Mbit link for data output

Might want a new dedicated chip ◦ SAMPA as baseline

◦ higher sampling frequency

◦ higher bit up to 12 bit

◦ larger data path

1/29/2018

SoLID DAQ - Streaming Workshop II 22

Edge fitting

clustering

coincidences between plane and detectors

In development as shown by Graham in SSP and VTP modules ( optical concentrators with large FPGA )


II 23

Streaming DAQ is an attractive idea ◦ can easily add additionnal physics channel

Streaming DAQ challenging for detector with many channels and high occupancy such as GEM trackers

Streaming and SoLID want high data bandwidth chips

Streaming DAQ requires improvement in network and tape storage for JLab

Or need capability to reduce data to be manageable on board


II 24

R&D for SoLID and EIC

Documents

Alexandre Camsonne Jefferson Laboratory January 29 2018 ... · GEM Occupancy % Number of strips XY strips Strips per chambers Event size ( bytes ) Data rate 100 KHz MB/s 1 2.21 453