WorldFIP Infrastructure E.Gousou | BE-CO |15 Oct 2014 | R2E | Maintenance | Availability

WorldFIP Infrastructure

E.Gousou | BE-CO |15 Oct 2014

| R2E | Maintenance | Availability

WorldFIP Infrastructure| Architecture


| R2E | Maintenance | Availability

front-end



masterclient node

client node

client node

diagnosticnode

user app

user app

user app

Cu-opt

Opt-Cu

Cu-Opt repeater

Cu-Cu repeater

Cryo, QPS, EPC, ..

front-end



masterclient node

client node

client node

diagnosticnode

user app

user app

user app

Cu-opt

Opt-Cu

Cu-Opt repeater

Cu-Cu repeater

Cryo, QPS, EPC, ..

Designed for reliability | Solid results Run1

| Run1 Lessons learnt

front-end



masterclient node

client node

client node

diagnosticnode

user app

user app

user app

Cu-opt

Opt-Cu

Cu-Opt repeater

Cu-Cu repeater

Cryo, QPS, EPC, ..

Designed for reliability | Solid results Run1Lower rad-tolerance of newer uFIP nodes

Obsolescence of WorldFIP components


front-end


WorldFIP Infrastructure| New Developments

masterclient node

client node

client node

diagnosticnode

user app

user app

user app

Cu-opt

Opt-Cu

Cu-Opt repeater

Cu-Cu repeater

Cryo, QPS, EPC, ..

Lower rad-tolerance of newer uFIP nodes



front-end



client node

client node

client node

diagnosticnode

user app

user app

user app

Cu-opt

Opt-Cu

Cu-Opt repeater

Cu-Cu repeater

Cryo, QPS, EPC, ..

Issues of master board in newer front ends

master

[Currently: short term solution]



[2015 Q4: proto of new master]

front-end



client node

client node

client node

diagnosticnode

user app

user app

user app

Cu-opt

Opt-Cu

Cu-Opt repeater

Cu-Cu repeater

Cryo, QPS, EPC, ..

Issues of master board in newer front ends

master





[2015-2016] master development

[2016] finalizing insourcing of repeaters

[2017] replacement of FielDrive/TR

Ro

ad

ma

p

Complete insourcing of the technology

[2010-2012] client node

front-end



client node

client node

client node

diagnosticnode

user app

user app

user app

Cu-opt

Opt-Cu

Cu-Opt repeater

Cu-Cu repeater

Cryo, QPS, EPC, ..

master



[2015-2016] master development

[2016] finalizing insourcing of repeaters

[2017] replacement of FielDrive/TR

Ro

ad

ma

p

Complete insourcing of the technology

[2010-2012] client node

| Radiation-tolerance: nanoFIP| New Developments



Location

RR|MB|MQ[95%]

TID

OK till 2035![>400Gy]

Run2+Run3Tech

ProASIC3

HL-LHC

< 1 SEU/y

SEEStock

10’000[> 100% current

inventory]

No need for relocations | no preventive maintenance[ageing tests to be scheduled]

< 1 SEU[till end of Run3]

Stock of 10’000 nanoFIP units enough till 2035[climate controlled storage]

In case of ProASIC3 obsolescence -> IGLOO2

client node

[system of 1’000 units]

| Radiation-tolerance: nanoFIP



Location

RR|MB|MQ[95%]

OK till 2035![>400Gy]

Run2+Run3Tech

ProASIC3

HL-LHC

< 1 SEU/y

SEEStock

10’000[> 100% current

inventory]


client node


| Radiation-tolerance: FielDrive/TR| Radiation-tolerance: nanoFIP

No need for relocations | no preventive maintenance[ageing tests to be scheduled]

Stock of 10’000 nanoFIP units enough till 2035[climate controlled storage]

In case of ProASIC3 obsolescence -> IGLOO2

TID | NIELTID



Location

RR|MB|MQ[95%]

TID | NIEL

OK till 2035![>400Gy][>6e12]

Tech

CMOS+Passive

Stock

4’000[~60% current

inventoryUsers+BE/CO]

FielDrive/TR

Plans for complete replacement of FielDrive/TR [2017]

Run2+Run3 HL-LHC

< 1 SEU/y

SEE



| Radiation-tolerance: FielDrive/TR

No need for relocations | no preventive maintenance[ageing tests pending]

Components still available for purchase



Location

RR|MB|MQ[95%]

OK till 2035![>400Gy]

Tech

CMOS

Stock

4’000[~60% current

inventoryUsers+BE/CO]

FielDrive/TR

Run2+Run3 HL-LHC

< 1 SEU/y

SEE



| Radiation-tolerance :FielDrive/TR| Radiation-tolerance: repeater

Plans for complete replacement of FielDrive/TR [2017]

No need for relocations | no preventive maintenance[ageing tests pending]

Components still available for purchase

TID | NIEL



Location

above MB OK till 2035![>300Gy]

Tech

AntifuseAntilatch-up

Stock

60[20%]

Run2+Run3 HL-LHC

< 1 SEE/y

SEE

< 1 SEE[till end of Run3]

[system of 200 units]

| Radiation-tolerance: repeater

No need for relocations | no preventive maintenance

Plan to produce more at CERN [2016]

In case of Antifuse obsolescence -> ProASIC3 -> IGLOO2

TID | NIEL


WorldFIP Infrastructure | Radiation-tolerance: repeater

Location


Tech

AntifuseAntilatchup

Stock

60[20%]

Run2+Run3 HL-LHC

< 1 SEE/y

SEE

< 1 SEE[till end of Run3]


No need for relocations | no preventive maintenance

Plan to produce more at CERN [2016]

In case of Antifuse obsolescence -> IGLOO2

TID | NIEL

| Run2 Inventory


WorldFIP Infrastructure| Run2 Inventory

masters

Cu-Opt repeater

nodes

diagnostic node

Cu-Cu repeater

PO QPS Cryo RadMon Survey BI

85 80 70 20 20 25

80 120 100 0 0 0

1’700 2’200 2’000 400 150 600

85 80 70 20 20 25

80 50 130 38 0 2



masters

Cu-Opt repeater

nodes

diagnostic node

Cu-Cu repeater

PO QPS Cryo RadMon Survey BI

85 80 70 20 20 25

80 120 100 0 0 0

1’700 2’200 2’000 400 150 600

85 80 70 20 20 25

80 50 130 38 0 2

Run2Total Qty

300

300

7’000

300

300



masters

Cu-Opt repeater

nodes

diagnostic node

Cu-Cu repeater

85 80 70 20 20 25

80 120 100 0 0 0

1’700 2’000 2’200 400 150 600

85 80 70 20 20 25

80 50 130 38 0 2

PO QPS Cryo RadMon Survey BIRun2

Total Qty

300

300

7’000

300

300



masters

Cu-Opt repeater

nodes

diagnostic node

Cu-Cu repeater

Run2Total Qty

300

300

7’000

300

300

Run2%Insourced

12%

1 - 16%

13%

100%

0 - 5% Partial migration to new masters during Run2



masters

Cu-Opt repeater

nodes

diagnostic node

Cu-Cu repeater

Run2Total Qty

300

300

7’000

300

300

Run2%Insourced

12%

1 - 16%

13%

100%

0 - 5%

17% [70 unt] RadMon0 - 65% [1100 unt] PO0% QPS0% Cryo0% Survey0% BI

Partial migration to new masters during Run2



masters

Cu-Opt repeater

nodes

diagnostic node

Cu-Cu repeater

Run2Total Qty

300

300

7’000

300

300

Run2%Insourced

12%

1 - 16%

13%

100%

0 - 5%

17% [70 unt] RadMon0 - 65% [1100 unt] PO0% QPS0% Cryo0% Survey0% BI

100%

allreplacements

16%

100%

Run3%Insourced

Run3Total Qty

no significant changesall

replacements

HL-LHCTotal Qty

HL-LHC%Insourced

Same as Run3

16%+CRYO?+QPS?


WorldFIP Infrastructure| Run2 Inventory| Availability improvement

masters

Cu-Opt repeater

nodes

diagnostic node

Cu-Cu repeater

Run2Total Qty

300

300

7’000

300

300

Run2%Insourced

12%

1 - 16%

13%

100%

0 - 5%

17% RadMon0 - 65% PO0% QPS0% Cryo0% Survey0% BI

100%

allreplacements

16%

100%

Run3%Insourced

Run3Total Qty

no significant changesall

replacements

HL-LHCTotal Qty

HL-LHC%Insourced

Same as Run3

16%+CRYO?+QPS?


WorldFIP Infrastructure| Availability improvement

Run1 2x Cu-Cu repeaters failure due to overheating

Repeaters overheating

Action: LS1 campaign for lowering their temperature

Last batches of uFIP were showing a high σ, giving SEUs in LHC

Client node SEUs

Action: nanoFIP development; σnanoFIP < x100 σuFIP

LS1 showed some misbehaving of the Master boards installed in newer computers

Master compatibility with newer computers

Action: masterFIP development


WorldFIP Infrastructure| Availability improvement

Run1 2x Cu-Cu repeaters failure due to overheating

Repeaters overheating

Action: LS1 campaign for lowering their temperature

Last batches of microFIP were showing a high σ, giving SEUs in LHC

Client node SEUs

Action: nanoFIP development; σnanoFIP < x100 σmicroFIP

LS1 showed some misbehaving of the Master boards installed in newer computers

Master compatibility with newer computers

Action: masterFIP development

| A new system?

2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025… 2035


WorldFIP Infrastructure| A new system?

LS1 Run3

2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025… 2035

HL-LHC

WorldFIP proven to be a reliable solution

Support till the end of HL-LHC

Run1 Run2 LS2 LS3



2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025

LS1Run1

…Run2 LS2 Run3 LS3

2035

HL-LHC

WorldFIP proven to be a reliable solution

Support till the end of HL-LHC



2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025

LS1Run1

…Run2 LS2 Run3 LS3

2035

HL-LHC

Do the users need a new system for HL-LHC?WorldFIP bandwidth issues?

o Expansion of WorldFIP to 5Mbpso Study of a new solution | Development in a centralized way | PH collaboration



LS1Run1 Run2 LS2 Run3 LS3

2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025… 2035

HL-LHC

Do the users need a new system for HL-LHC?WorldFIP bandwidth issues?

o Expansion of WorldFIP to 5Mbpso Study of a new solution | Development in a centralized way | PH collaboration

| Conclusions


WorldFIP Infrastructure| Conclusions

Actions for even higher availability

Good stock management & insourcing provide margins for maneuver if needed

Expansion of WorldFIP up to 5Mbps

Explore other systems

Compete insourcing of the WorldFIP technology

Run1 Experience

WorldFIP support will be essential till the end of life of the LHC | HL-LHC

Run2 & beyond

BE-CO to understand users’ needs

New system for HL-LHC



Location


Tech

AntifuseAntilatchup

Stock

not much[plan to produce]

Run2+Run3 HL-LHC

< 1 SEU/y

SEE



| Radiation-tolerance diagnostic

Need for dedicated tests

Plan to produce more at CERN

Case of Antifuse obsolescence -> IGLOO2

TID | NIEL

Documents

WorldFIP Infrastructure E.Gousou | BE-CO |15 Oct 2014 | R2E | Maintenance | Availability