Document Type Testing checklistDocument Number ESS-1957054Date Dec 20, 2019Revision 1 State ReleasedConfidentiality Level InternalInternalInternalPage 1 (13)

Test Readiness Review (TRR) procedure and checklist

Name Role/Title

Owner Ciprian Plostinar Accelerator and ICS Testing and Commissioning Manager

Reviewer Carlo BocchettaCecilia LoweHelen Boyer

Deputy Technical DirectorQuality Control OfficerOHS Group Leader

Approver Magnus Täcklind Deputy HoD EIS

Template: Chess Controlled Core Word (ESS-0060903 Rev: 3, Active date: Apr 8, 2017)

Document Type Review Report Date Dec 20, 2019Document Number ESS-1957054 State ReleasedRevision 1 Confidentiality Level Interna

lInternalInternal

TABLE OF CONTENT PAGE

1. TEST READINESS REVIEW.....................................................................

2. GLOSSARY.............................................................................................

3. REFERENCES.........................................................................................

4. DOCUMENT REVISION HISTORY...........................................................

APPENDIX 1 – TEST READINESS REVIEW CHECKLIST..........................................

2 (13)

Document Type Review Report Date Dec 20, 2019Document Number ESS-1957054 State ReleasedRevision 1 Confidentiality Level Interna

lInternalInternal

1. TEST READINESS REVIEW

The Test Readiness Review (TRR) as called out in the ESS Handbook for Engineering Management Error: Reference source not found (also known as EHB) has two main purposes:

• examine the final technical installation in view of establishing if the installation is ready for testing

• examine preparedness for

o local/individual testing (also known as phase B in the EHB).

o integrated testing (also known as phase C in the EHB). If this is not included in the TRR scope, a second TRR will be required to cover integrated testing.

Ultimately, the goal is to ensure that the product, its test equipment, support personnel, and test procedures are ready for the verification activities.

Test procedures may be in the form of verification/test plans, which are typically driven by requirements and specifications, i.e. these can and should be used to provide acceptance criteria. Examining preparedness for testing is achieved by evaluating the verification/test plans. As an example, these shall describe the methods and pass/fail criteria and shall address interfaces between the required components, subsystems and controls integration (including local controls for local testing). Furthermore plans, including safety plans and task risk assessments and method statements (RAMS), staff, as well as tooling and services required for the testing work itself should be addressed. For additional information, see Error: Reference source not found and [2].

Appendix 1 to this document includes a checklist that is to be used as a basis for the TRR. The Test Package Leader (TPL) is charged with organizing the TRR. The Test Coordinator for the area shall be Chairperson of the TRR committee, but this responsibility can be delegated. The Chairperson is also responsible for making sure the filled checklist is archived in CHESS and included in the overall TRR summary report or minutes of meeting.Typical review committee members can be chosen from the following:

• Test Coordinator

• Test package leader (system lead)

• Area coordinator

• Work package managers / Work Package Leads

• In-kind lead

3 (13)

Document Type Review Report Date Dec 20, 2019Document Number ESS-1957054 State ReleasedRevision 1 Confidentiality Level Interna

lInternalInternal

• Lead engineer

• System owner(s)

• Independent expert

• Contractor Supervisor (where applicable)

• SEC coordinator (where applicable)

• ES&H representative

• Quality representative

The Test Coordinator has the authority to approve/disapprove the TRR.

2. GLOSSARY

Term Definition

ESS European Spallation Source

IK In-Kind

IOI Inspection of Installation

NCR Non-Conformance Report

RAMS Risk Assessment and Method Statement

TRR Test Readiness Review

SSC Structure, System, Component

3. REFERENCES

[1] ESS-0092276 ESS Handbook for Engineering Management

[2] ESS-1957054 ESS Procedure for Preparation for Testing and for Testing

4. DOCUMENT REVISION HISTORY

Revision Reason for and description of change Author Date

1 First issue Eugene Tanke 18-Dec-2019

4 (13)

Document Type Review Report Date Dec 20, 2019Document Number ESS-1957054 State ReleasedRevision 1 Confidentiality Level Interna

lInternalInternal

5 (13)

APPENDIX 1 – TEST READINESS REVIEW CHECKLIST

Project/System(s):

Spoke cryomodule testing at the FREIA Laboratory

Area(s) affected: TRR Id:

TRR Chairperson: TRR Participants: Date:

Mark which testing scope this TRR covers

Local testing: ☐ Integrated testing: ☐

1. Project management

Under this section a check is made that necessary administrative activities are considered.

ID Activity Description Performed Not Performed

N/A

1 Courses All courses to get access performed?

☐ ☐ ☒

2 Registration All involved been registered? ID06?

☐ ☐ ☒

3 Office Offices and other support services (phone, wifi) arranged?

☒ ☐ ☐

4 Reporting Communication and reporting routines established?

☒ ☐ ☐

5 Collaboration Are (In Kind) Partners ready to proceed to verification?

☐ ☐ ☐

6 (13)This checklist belongs to document number: ESS-1957054, rev 1

Document Type Review Report Date Dec 20, 2019Document Number ESS-1957054 State ReleasedRevision 1 Confidentiality Level Interna

lInternalInternal

ID Activity Description Performed Not Performed

N/A

General comments:

7 (13) This checklist belongs to document number: ESS-1957054, rev 1

Document Type Review ReportDocument Number ESS-1957054Date Dec 20, 2019Revision 1 State ReleasedConfidentiality Level InternalInternalInternalPage 8 (13)

2. Installation

Under this section a check is made that required activities during the installation phase have been performed.

ID

Activity Description Performed Not Performed

N/A

6 IRR Has an IRR been performed on the installation?

Are there still some remaining items needing to be resolved?

☐

☐

☐

☐

☒

☒

7 CHESS All applicable documents appropriately approved and archived* in CHESS?

☐ ☐ ☒

8 SSM/AIB SSM approval** obtained?

IOI been created/issued?

☒

☒

☐

☐

☐

☐

9 Installation binder

Installation binder completed (e.g. with all the latest, as installed drawings, PID / WD, models released with a level of maturity R), reviewed, approved and communicated?

☐ ☐ ☒

10 NCRs/Incident investigations

Approved NCRs considered and communicated?

Any open NCRs? Any ongoing incident

investigations?

☐

☐ ☒

☐

☐ ☐

☒

☒ ☐

General comments:

*Appropriately archived means that the technical baseline has been populated, i.e. all relevant documents connected to the appropriate FBS nodes in CHESS** Typically required when radiation may occur as a consequence of testing (e.g. RF conditioning of cavities). Also applicable for SSCs with radiation safety functions.

Template: Report (ESS-0060987 Rev: 3, Active date: Apr 8, 2017)

Document Type Review Report Date Dec 11, 2019Document Number ESS-1957054 State ReleasedRevision 1 Confidentiality Level Interna

lInternalInternal

3. Test

Under this section a check is made that the content in the test binder is appropriate.

ID

Activity Description Performed

Not Performed

N/A

11 Test binder Test binder completed (to extent possible with test/verification plans, operations manuals etc), reviewed, approved and communicated?

Do the test/verification plans cover the requirement specifications (including for interfaces) of the systems, including adequate verification methods?

☒

☒

☐

☐

☐

☐

12 List of test equipment

Will all required testing equipment be on site prior to testing?

Is there traceability of the accuracy and last calibration of the test instruments / equipment?

☒

☐

☐

☒

☐

☐

13 Spare Parts Do you have critical spare parts available? If not, what is the backup plan?

☐ ☐ ☐

14 NCRs Process for initiating NCRs are understood and communicated?

☐ ☐ ☒

15 Scope of work Is the scope of work well described?

Responsibility matrix understandable and communicated?

Clear interfaces? RP involvement (if applicable)

☒

☒

☒ ☒

☐

☐

☐ ☐

☐

☐

☐ ☐

16 Organisation ESS/IK/Contractor resources and organisation well defined

☒ ☐ ☐

9 (13)

This checklist belongs to document number: ESS-1957054, rev 1 (7)

Document Type Review Report Date Dec 11, 2019Document Number ESS-1957054 State ReleasedRevision 1 Confidentiality Level Interna

lInternalInternal

ID

Activity Description Performed

Not Performed

N/A

(roles and responsibilities) and communicated?

All necessary testing equipment available?

Resources available? Backup for delays or prolonged testing?

Company’s and personal certificates.

Telephone/mail-list communicated?

☒

☒

☐

☐

☐

☐

☐

☐

☐

☐

☒

☒

17 Time Schedule Time schedule well understood and communicated?

Critical path understood? Is there a plan B, e.g. for if

testing lasts longer than expected? Develop a backup plan.

Transportation and installation interference check has been done? Transportation route planned?

☒

☒☐

☒

☐

☐☒

☐

☐

☐☐

☐

18 Risk Assessment / Safety

Have appropriate actions been taken to all risks identified during the installation phase?

Have appropriate task risk assessments (RAMS) been performed for testing activities, e.g. related to lifting, electrical safety, radioactivity, moving components, high pressure, chemicals?

If there is safety equipment required, is it in place?

☒

☒

☒

☐

☐

☐

☐

☐

☐

19 Temporary services Storage arranged? Considered storage time at site?

Temporary services, such as power and fluids established or arranged/planned?

Other services (e.g. tool rental, lifting) arranged?

☒

☐

☒☐

☐

☐

☐☐

☐

☒

☐☒

10 (13)

This checklist belongs to document number: ESS-1957054, rev 1 (7)

Document Type Review Report Date Dec 11, 2019Document Number ESS-1957054 State ReleasedRevision 1 Confidentiality Level Interna

lInternalInternal

ID

Activity Description Performed

Not Performed

N/A

Waste disposal (e.g. chemical, radioactive) planned?

20 Permits All specific certificates (e.g. electrical) approved by ESS?

Work orders submitted into the system?

Hot works (and other) permit arranged?

Authority permits* obtained

☐

☐

☐

☐

☐

☐

☒

☒

☒

21 Daily Diary Routines for Daily diary established? Where and to whom to communicate.

☒ ☐ ☐

22 QC – Test documentation

QC resources assigned to support documentation from beginning?

Have required independent operation safety tests been documented?

Third Parties assigned (if needed)?

Have measurement tools been calibrated and calibration date entered into test specification?

Calibration protocol if required?

Special conditions documented (e.g. related to interlock masks)?

☒

☐

☐

☐

☒

☐

☐

☐

☐

☒

☐

☐

☐

☒

☒

☐

☐

☐

* Example: Certain chemicals require permits from the authorities for either use or disposal.

11 (13)

This checklist belongs to document number: ESS-1957054, rev 1 (7)

Document Type Review Report Date Dec 11, 2019Document Number ESS-1957054 State ReleasedRevision 1 Confidentiality Level Interna

lInternalInternal

4. Site

Under this section a check is made that required activities on site are scheduled or being performed.

ID Activity Description Performed Not Performed

N/A

23 Site Is the building/area ready for testing?

Are all associated interfacing systems installed/ready?

Are all necessary installations finished and available?

Any temporary installations (other than test equipment)?

Considered lessons learned from earlier tests?

☒

☒

☒

☒

☒

☐

☐

☐

☐

☐

☐

☐

☐

☐

☐

24 Pre-job briefing Has a pre-job briefing with the team been scheduled?

☒ ☐ ☐

General comments:

12 (13)

This checklist belongs to document number: ESS-1957054, rev 1 (7)

Document Type Review Report Date Dec 11, 2019Document Number ESS-1957054 State ReleasedRevision 1 Confidentiality Level Interna

lInternalInternal

5. Other

Under this section other subjects or comments can be noted.

ID

Activity Description Performed

Not Performed

N/A

General comments:

6. Conclusion

Based upon the discussion and outcome during this TRR the judgement is that the project is:

Ready to start testing ☐

Ready to start testing with the following reservation(s):

______________________________________________________

______________________________________________________

______________________________________________________

☐

Not ready to start testing because

______________________________________________________

______________________________________________________

______________________________________________________

☐

_____________________________ _____________________________

TRR chairperson TRR chairperson role/position13 (13)

This checklist belongs to document number: ESS-1957054, rev 1 (7)