View
222
Download
6
Category
Preview:
Citation preview
INDUSTRY DAY
Testing
7 June 2016
DCC Public
AGENDA
Impact of Contingency Request on ‘Industry
Testing’ activities.
Interface Testing R1.2
End to End Testing R1.2
DCC Public 1
CONTINGENCY REQUEST IMPACT
DCC Public
PROPOSED DATE CHANGES
Proposed Testing Dates:
R1.2 User Entry Process Testing (UEPT): 4 July
R1.2 End-to-End Testing: 25 July
Other Dates:
DCCKI Live Certificates: 6 July
Remote Test Lab Service: TBC*
Prototype/Test CH (PTCH): TBC*
*Before R1.2 End to End Testing commences
DCC Public 3
IMPACT ON TESTING PARTICIPANTS
UEPT Readiness Assessment will be based against 4 July start
date for Large Supplier Parties and other Parties that wish to
test at this point:
Data required from Systems Integrator (SI)*
Access to Test Issue management tool provided by SI
Entry Gate Meeting conducted by DCC
End to End Testing Service can be used as soon as it is
available and the Testing Participant has completed UEPT in
respect of a defined User Role:
Entry criteria must be met
Entry Gate Meeting conducted by DCC
* Test Data Plan provided to DCC for review on 6 June
DCC Public 4
ADDRESSING CONCERNS
Please contact your Industry Testing Analyst to discuss impact of the
contingency request on a bilateral basis if you have any concerns.
Escalation contacts:
Industry Test Manager: Rupal Patel rupal.patel@smartdcc.co.uk
Project Director, Testing: Jane Eccles jane.eccles@smartdcc.co.uk
DCC Public 5
INTERFACE TESTING
DCC Public
INTERFACE TESTING SCOPE User Entry Process Testing (UEPT)
Change Of Supplier Test:
SI will co-ordinate the test between Large Supplier Parties conducting
UEPT in Interface Testing Stage
Devices used for UEPT will be transferred to another Large Supplier
and then back again
No overall loss of Devices
Will be conducted in parallel with/after UEPT
Details being finalised and will be discussed with TAG
Volume Test
SI will ask Parties conducting UEPT to send messages at same time to
DCC
Value of test will be reviewed with TDEG/TAG
DCC Public 7
EARLY UIT CONNECTIVITY TESTING Parties can connect to DCC User Integration Testing (UIT)
environment:
UIT environment used for Pre-UEPT, UEPT and End to End Testing
Pre-requisites:
User Gateway Connection
SMKI Test Certificates
DCCKI Test Certificates (Parties need to complete DCCKI RAPP to
extent required to obtain Test Certificates)
Scope of Test: transmission of a message and receipt of a
response.
Successful response in Pre-UEPT guide
DCC Public 8
PRE-UEPT Intended to de-risk UEPT
Service to enable Testing Participants to send 4 Service Requests
to DCC and receive valid (but standard) payload due 6 May 2016
Provision of service has been delayed due to multiple defects
Assurance activities on-going
No firm date for delivering Pre-UEPT yet available: pending
resolution of defects.
DCC Public 9
RE-CAP OF UEPT
User Entry Process Testing:
Undertaken in each User Role that a Party wishes to operate within.
Reliance can be placed on Adaptor Provider Testing and on testing
undertaken in different Licensee roles
‘Adaptor Providers’ are able to test in all User Roles
Scope set out in Common Test Scenarios Document (CTSD)
DCC will provide Devices:
Aim – to conduct UEPT on actual meters used in SIT
Smart Energy Code enables UEPT to be undertaken on meter emulators
– if SEC Panel agrees that they are fit for purpose
Possible the UEPT undertaken against a mix of emulators and meters
Emulators being assured against ‘meter test harness’
DCC Public 10
UEPT: PRE-TESTING ACTIVITIES
DCC Public 11
Activity TP DCC CSP SI DSP
Notification X
Initiation meeting X X
Manage slot booking X
Provision of meters X
Provision of Debug Capable PTCH
(DCPTCH)
X
Submit readiness reports X
Submit testing artefacts X
Review testing artefacts X
Provision of testing data X
Provision of Issue resolution tool X
Physical device set install X
Attend entry quality gate X
Approval to proceed certificate X
UEPT: TESTING
DCC Public 12
Activity TP DCC CSP SI DSP
Conducting testing X
Commissioning of Device (Non-
supplier)
X X
Commissioning of Device (supplier) X
Manage Issue Resolution X
Triage of issues X X X X X
Remove faulty Devices and replace X
Provide storage for Devices X
Asset tracking for installed and stored
Devices
X
Maintenance of Debug Capable PTCH X
Maintenance of meters X
Environment/release management X X X X
UEPT: POST TESTING ACTIVITIES
DCC Public 13
Activity TP DCC CSP SI DSP
Physical Device set removal X
Prepare Device for next Testing
Participant (TP)
X X
Submission of test evidence X
Review of test evidence X
Attend exit quality gate X
Issue test completion certificate X
Notify SEC Panel X
UEPT PROCEDURAL STEPS
DCC Public
2. Conduct UEPT Initiation
Meeting and confirm DCC
Test Lab Booking
3. TP Completes
Connection forms, RAPP
Forms and produces TRR
4. DCC reviews TRR
and provides feedback
5. TP produces Test Artefacts
and DCC progresses Gateway
Connection and RAPP forms
7. UEPT Execution 8. UEPT Completion 10. UEPT Test
Completion Certificate 6. UEPT Entry Quality
Gate
9. UEPT Exit Quality
Gate
1. TP Completes
Notification form including
DCC Test Lab request
14
END TO END TESTING
DCC Public
Parties can use the End to End Testing Service in a specific User
Role when:
They have completed UEPT in that User Role; AND
The End to End Testing Stage has started
End to End Testing can be conducted in a DCC Test Lab or
Remote Test Lab
Parties are able to test meters of their own choice and their Back
Office Systems against the DCC UIT environment subject to
meeting the pre-requisites in the Testing Approach Document
inc:
Devices are developed against SMETS2 specification
Devices are ZigBee Sep 1.2 a) compliant
Parties need to comply with procedures for raising Testing Issues
Relevant training course undertaken to use the CSP Test Labs
END TO END TESTING
DCC Public 16
DCC will provide meters that have been used successfully in SIT
for Parties to use during End to End Testing
Debug capable CH will be provided to support triage activities,
but will only be available in the DCC Test Labs
DCC will support triage and Testing Issue management activities
Change request has been raised to provide instrumented test CH
END TO END TESTING
DCC Public 17
NON-SUPPLIER?
DCC Public 18
Can test using DCC Test Lab
Upon request:
Device sets will be provided by DCC
Installation of device sets will be completed by CSP
Commissioning of device sets will be completed by the Systems
Integrator and CSP
Testing Issue resolution and triage process identical to Supplier
Party testing process.
END TO END TESTING: PRE TESTING
DCC Public 19
Activity TP DCC CSP SI DSP
Notification X
Initiation meeting X X
Manage slot booking X
Provision of meters X X
Ordering of Remote Test Lab (RTL) X
Ordering of PTCH for RTL X
Delivery of PTCH and RTL service X
Provision of PTCH for DCC Lab X X
Submit readiness reports X
Provision of testing data (non-supplier) X X
Provision of testing data (supplier) X X
Provision of Issue resolution tool X
Lab Induction meeting X X
Physical device set install for RTL X
Physical device set install for DCC Lab - Supplier X
Physical device set install for DCC Lab – non Supplier X
Attend entry quality gate X X
Approval to proceed certificate X
END TO END TESTING: TESTING
DCC Public 20
Activity TP DCC CSP SI DSP
Conducting testing X
Commissioning of Device (Non-supplier) X X
Commissioning of Device (supplier) X
Manage issue resolution X
Triage of issues X X X X X
Remove faulty devices and replace –
DCC devices X
Remove faulty devices and replace – TP devices X
Provide storage for Devices – DCC Labs X
Asset tracking DCC Devices for installed and stored
devices – DCC Labs X
Maintenance of DCPTCH - DCC Labs X
Environment / release management X X X X
END TO END TESTING: POST TESTING
DCC Public 21
Activity TP DCC CSP SI DSP
Physical device set removal - Supplier X
Physical device set removal - non Supplier X
Prepare lab and data for next TP X X
END TO END TESTING PROCEDURAL STEPS
DCC Public
2. Conduct E2E Initiation
Meeting and confirm DCC
Test Lab Booking*
3. TP Completes
Connection forms*, RAPP
Forms* and produces TRR
4. DCC reviews TRR
5*. DCC progresses Gateway
Connection and RAPP forms
7. E2E Execution 8. E2E testing
Completion
6. E2E Entry Quality
Gate
1. TP Completes
Notification form including
DCC Test Lab request*
*if required; TP’s may already have completed
these as part of UEPT or EUCT/Pre-UIT
22
CSP SUPPORT
1.0 DCC Public
USE OF DCC TEST LABS
DCC Public 24
Pre-requisite Description Additional Information
Induction • All TPs attending the DCC Labs must
have attended an induction session in
advance
• Induction is mandatory
• Only those attending induction may
attend the Test Labs
• Induction will cover topics including: • Health, Safety and Environment
Induction
• Overview of Site and Facilities
• Test Lab and Office Tour
• Non-Disclosure Requirements
• Routine on arrival
• Contact information
• Administration
• Other relevant information
• DCC to capture attendee
details including: • Name
• Organisation
• Contact Details
• Vehicle Registration
• Event date
• Duration : 2 Hours (max)
• Dates to be published by DCC
in due course
Testing Slot • TP must have a confirmed “Test Slot”
booking with the DCC
• Booking information will be
passed to CSPs by DCC
Onsite Induction • On-site induction on the day of arrival • Site specific and Security
matters to be covered
CSP SUPPORT Locations & Facilities
DCC Public 25
:
CSP Test Lab Location Facilities:
North & Scotland
(ARQIVA)
Arqiva
Crawley Court
Winchester
SO21 2QA
Lab opening Hours:
08:00 – 18:00 Mon-Fri
Facilities offered at the test labs include:
• Parking
• Coach transfer from local train
station**
• Desk allocation (not for 100%
utilisation)
• Wi-Fi Services
• Meeting Room booking facilities
• Canteen/Kitchenette
• Coffee areas
• Break out areas
• Separate Male/Female toilets
Note: may vary a little across sites or may be subject to some limitations
Central & South
(TELEFONICA)
Telefonica*
5 Reynoldston Close
(Brackmills Industrial Estate)
Northampton
NN4 7BX
Lab Opening Hours:
08:00 – 18:00 Mon-Fri
• * Second test lab will be provided at Runcorn if overflow required
• ** Arqiva only
TEST LAB SERVICES1
DCC Public 26
1 subject to some volumetric limitations 4 Redacted CH logs to be provided due to security limitations 2 subject to size limitations 5 where technically possible 3 not in Telefonica test labs 6 TBC 7 At CSP discretion
Support Service Will Do Optional services7
Administration • Assistance with facilities and meeting
room bookings
• Contact support for induction and testing
slots
• Arranging Wi-Fi access
• Open to considering requests
Device Services • Physical installation of CH6 & Meters for
UEPT and non suppliers for E2E
• Physical swap out of faulty Devices
• Storage of spare devices
• Asset Tracking for PTCH & Meters
• Security of Devices
• Assistance (hands on)
• Meter upgrades & Changes (firmware &
certificates)5
Testing
Services
• Storage lockers for TP test equipment2
• Knowledge Sharing
• Assistance with service testing (within the
DCC Lab)
Remote
Cameras
• Web based camera service3
Triage Support • Assistance with diagnostics within CSP
solution4
• Zigbee HAN traffic capture
• Meter Stubs
• De-bug capable Prototype Testing CH
• Triage assistance for meters (with
assistance from meter manufacturers)
REMOTE TEST LAB SERVICES1
DCC Public 27
1 subject to some volumetric limitations 2 At CSP discretion
Support Service Will Do Optional services2
Installation of
equipment at
remote site
• Carry out site survey
• Agree on suitable location for
remote test service equipment
ARQ: access node equipment
(Base Station)
TEF: Boost box
• Identify enabling work (to be
completed by the customer) before
CSP equipment can be installed
• ARQ: Supply & Install a test configuration
Base Station
• TEF: Supply necessary ‘plug and play’
Boost box(es) with installation guidance
• Supply of certified, registered
communications Hubs with on-going
• Configuration management
• Hardware and Firmware upgrades
(where required)
• Test Communication Hubs outside of the
warranty period
• Provide replacement PTCH
Testing
Services
• Practical knowledge sharing
Triage Support • Provide remote assistance to diagnose
faults with the supplied RTS equipment
• Support issue resolution/triage for test
execution in line with agreed processes
for E2E
• Confirm traffic generation of RTL lab
GENERAL SUPPORT TO INDUSTRY
TESTING PARTICIPANTS
DCC Public
Systems Integrator to manage Issue Resolution during office
hours
Testing Issues will be recorded in HP ALM or using spreadsheet
which will be held on DCC SharePoint in individual Party folder
Response times in line with guidelines agreed in Joint Test
Strategy (available on DCC website)
Regular teleconferences will be convened with Testing
Participants to discuss open Testing Issues.
Industry Test Support Analyst appointed to each Testing
Participant
INDUSTRY TESTING SUPPORT
DCC Public 29
Recommended