Embed Size (px)
Citation preview
Data Management Group
22nd June 2017
1
Agenda
2
Introductions
Actions From Previous Meetings
Data Migration Update
Data Reporting Update
Summary Incident Stats
Customer Feedback (Q&As)
Reporting Post Go-Live (In/Out Of Scope)
Settlement Topics - Final Pre Go-Live Position
AOB
Actions From Previous Meetings
3
Actions From Previous Meetings
Action Ref Detail Owner Xoserve Update Status
11.05.01 (iGT Pre Dbase) Agree reports to be sent to Group members by iGTs that do
not load into interim database and notify DMG members Xoserve/IGTs
The structure of the reports will mirror the sample reports
issued by Xoserve Closed
11.05.02 (iGT Post Dbase) Reports to be sent to DMG members by Xoserve that do not
migrate from interim database Xoserve
Reports to be issued in line with the Xoserve fallout
reports by end of day 9th June Closed
11.05.03 Slides to be updated to show when reports will be issued Xoserve Slides updated and republished on 19th May Closed
11.05.04 (Data Reporting Timeline) Confirm whether M03 files for estimated reads will be
legacy or new file Xoserve New M03 File Format will be issued Closed
11.05.05 (Data Reporting Timeline) Add iGT reports to the reporting timeline Xoserve Slides updated and republished on 19th May Closed
11.05.06 (iGT Winter Consumption) Provide MPRNs to affected parties alongside final
iGT portfolios Xoserve MPRNs sent to affected Shippers on 22nd May Closed
11.05.07 (iGT Winter Consumption) Where bucket values are used, affected parties to
utilise AQI file to provide previous WC values DMG Ongoing Closed
11.05.08 (WWU Presentation) Advise who DMSPs will send reconciliation reports to
within the Industry Xoserve
Further discussions have taken place on subsequent
DMG’s specifically for this subject. Closed
4
Data Migration Update
5
Data Migration Summary
• Cutover data migration activities have all completed to plan
• Fallout was experienced within the cycle as expected and prioritisation and fallout process practiced in IDR2/3 was utilised to manage these
• A fix plan was developed and deployed resulting in the vast majority of defects being resolved closed down within the fix windows in Cutover
• NED window was a fixed allotment of time which was maximised to fix priority defects for all sources , however a number remained open to
action/close defects during the remainder of cutover period.
• 6 Defects were open on 2/6/17 when Cutover Fallout Report 2 was produced
• These have all been resolved; 0 defects remain open
• Post Go Live activities continue (Custom loads closed out 07th June and EBF to Mid July).
• EBF activities progress to plan and good quality witnessed throughout cycle. May invoice files being generated in legacy systems are to be
reconciled and to be migrated into new world.
• Further communication on success of loads and any Fallout from the cycle will be published to the Industry with fallout position expected mid –
July and also tabled at the next DMG forum in July.
6
Data Dashboard
Summary of Current Workstream Plan Activities @ 22 June 17:
Origin Cycle Perf Quality Progress Response to RAID
Unique
Sites Cutover
B
B
Unique Sites achieved requisite performance for Cutover. Validation and fix cycle was undertaken as planned in NED
window fixing all critical defects
• Performance : Achieved plan timings in Cutover
• Issues : None
• Quality : Throughout Cutover, Prioritisation and fix cycle managed through the criticality matrix. All defects were
fixed as per the Fallout Management Process. Defects have been found, these are currently undergoing triage, root
cause analysis and fix. Final defect numbers will be confirmed once triage completes.
1. N/A
Data Defects Landscape Fallout from cycle
21 defects found – 10 Rejected; 11 mismatches resolved successfully 100% success achieved
iGT Cutover B B
IGT Test load in Cutover achieved Performance and Quality considerations were dealt with within cycle.
• Performance: Achieved requisite plan timings in Cutover
• Issues: None for period of reporting.
• Quality: Validation cycle and fix cycle undertaken and 14 mismatches were found, 7 rejected and 7 defects were
fixed
1. N/A
Data Defects Landscape Fallout from cycle
14 defects found – 7 Rejected; Remaining 7 mismatches resolved
successfully
100% success achieved
LPG N/A for Cutover
B
B
LPG Testing complete. Production Load complete wc 08 May 2017
• Performance: Proven through previous cycles.
• Issues : N/A
• Quality :LPG quality achieved as planned
1. N/A
Data Defects Landscape Fallout from cycle
N/A N/A
7
Data Dashboard Summary of Current Workstream Plan Activities @ 22 June 17:
Origin Cycle Perf Quality Progress Response to RAID
Delta
Delta as part of
Cutover
(Complete)
B B
Delta cycles complete in Cutover, Delta 1, 2, 3, 4, 5 have all performed to timescales and achieved good quality.
● Plan: Plan performance for Delta remains in line with expected performance.
● Issues: None
● Quality: Throughout Cutover, Prioritisation and fix cycle very closely managed through the criticality matrix, and
clear decisions on which defects to focus on and fix as per the fallout management process. A number of Delta
mismatches were successfully dealt with and resolved within Cutover as a result of this activity.
1. N/A
1. Data Defects Landscape 1. Fallout from cycle
72 defects in total – 7 Rejected; 65 mismatches resolved
successfully
100 % success achieved
In Flights
(Data)
Cutover
(Complete)
B B
In-Flight ETL and validation activities completed successfully for Cutover. Good Performance and quality witnessed in
Cutover.
● Performance: IF Performed ahead of Plan
● Issues : None
● Quality: In-Flight activities were very successful for both GT and IGT In-Flights. Very good quality achieved within
cycle resulting in InFlights having 0 defects found within Cutover.
1. N/A
1. Data Defects Landscape 1. Fallout from cycle
0 mismatches were found in the cycle 100 % success achieved
Custom Cutover
(Complete) B B
All Custom ETL activity completed successfully 07th June as part of transition activities. Good Performance and quality
witnessed in Cutover.
● Performance: As expected
● Issues : None
● Quality: All Mismatches found within the cutover period resolved - 0 Open defects
1. Data Defects Landscape 1. Fallout from cycle
19 defects in total – 3 Rejected; 13 mismatches resolved
successfully
1. All objects achieved 100% ETL success rates
8
Appendices
9
Fallout/Defect Management within data cycles in Cutover
Following Cutover Delta loads, the validation undertaken as part of the cycles has uncovered a number of defects and mismatches which were
plotted in the Xoserve Data Acceptance 4X4 criticality matrix to establish priorities for analysis and fix activities.
The DM team then fixed certain defects on this priority basis, seeking to resolve all critical defects. A small number of defects and staging
activities were outstanding as on 2nd of June – these have been now successfully resolved and closed down.
Cycle Total Resolved in
Cutover Period Rejected
Migrate As
Is
Parked
Total
Cutover Migration Delta 1 26 25 1 0 0
Cutover Migration Delta 2 34 31 3 0 0
Cutover Migration Delta 3 11 9 2 0 0
Cutover Migration Delta 4 1 0 1 0 0
Cutover Migration Delta 5 0 0 0 0 0
Cutover Period Post-Cutover
- -
- -
- -
- -
- -
Parked Defects Fix Plan Delta Fallout Picture for Cutover
Note: 1 previously open defect ‘parked ‘for rectification within the Cutover Period has been successfully resolved
10
Following Cutover loads for all other sources , the validation undertaken as part of the cycles has uncovered a number of defects and
mismatches which were plotted in the Xoserve Data Acceptance 4X4 criticality matrix to establish priorities for analysis and fix activities.
The DM team then fixed certain defects on this priority basis, seeking to resolve all critical defects. . A small number of defects and staging
activities were outstanding as on 2nd of June – these have been now successfully resolved and closed down.
Fallout/Defect Management within data cycles in Cutover
Cycle Total Fixed In Cutover Rejected Migrate As
Is
Parked
Total
IGTs inc. DMCSEPS 14 7 7 0 0
Unique Sites 21 11 10 0 0
Custom Load 19 16 3 0 0
Inflights 0 0 0 0 0
All Other Sources - Fallout Picture for Cutover
Cutover Period Post Cutover
- -
- -
- -
- -
Parked Defects Fix Plan
11
12
Severity
1-Critical 2-Major 3-Moderate 4-Minor
Pri
ori
ty
1-Very
High
2-High
3-
Moderat
e
4-Low
= 0 - 250
= 251 - 1000
= 1001 – 10,000
= 10,000 +
= 100,000 +
= 1m +
= 10m +
Legend Defect Magnitude
(no. of attribute, not MPRN,
errors)
Cutover Discovered Open Defect Landscape (consolidated for all sources)
= Under triage with
Wipro = Fix options known
= Fixed, proven in test,
awaiting Production
deployment
Defect Fix Status
Defect Rejected
13
Severity
1-Critical 2-Major 3-Moderate 4-Minor
Pri
ori
ty
1-Very
High
2-High
3-
Moderate
4-Low
= 0 - 250
= 251 - 1000
= 1001 – 10,000
= 10,000 +
= 100,000 +
= 1m +
= 10m +
Legend Defect Magnitude
(no. of attribute, not MPRN,
errors)
Cutover Discovered RESOLVED Defect Landscape (consolidated for all sources)
MET_ALL_VOLUME,
CORR_ALL_VOLUM
E,
UNCRR_ALL_VOLU
ME
- Defect 14208
ENERGY
- Defect 14164 MET_ALL_VOLUME,
CORR_ALL_VOLUM
E,
UNCRR_ALL_VOLU
ME- Defect 14209
MET_CORR_FACTO
R
- Defect 12680
MET_ALL_VOLUME,
CRR_ALL_VOLUME
&
UNCRR_ALL_VOLU
ME
- Defect 13925
READ REASON
- Defect 13574
Note: Defect ID# 13925- previously open defect & parked for resolution in Cutover Period – now
successfully resolved
Defect Fix Status
= Resolved via ETL
reprocess (Delta Change
Object) = DUG Approved no further action
= Manually updated via front-
end ISU transactions
= Resolved via standard
EMIGALL ETL object (insert)
= Closed as Rejected /
Duplicate
Data Reporting Update
14
Data Reporting Timeline
1st June 26th May 23rd May 9th June
Unique Sites
Confirmation
Reference
Numbers
---
Excel format
---
Via email to Unique
Sites Contacts and
Customer Lifecycle
Shipper Contacts
Final iGT Portfolio
Reports and Inflight
Confirmation
Report
---
Current format
(.csv)
---
Current distribution
method and
contacts
Migration Fallout
Reports
---
Excel or csv format
(depending on
size)
---
Via email to DMG
contacts
Estimated Read
(GT & IGT) Reports
---
M03 file format
---
Via email to DMG
contacts
iGT Data
Preparation Load
Fallout Reports
---
Excel or csv format
(depending on
size)
---
Via email to DMG
contacts by iGTs
15
Reporting Update
Issues have been identified with the final iGT portfolio reports where inflight change of
shipper records were missing from the final portfolio snapshot. Confirmation reference
numbers would have been in the previous months reports, but if you are missing any
details then these can be provided
Further to the estimated read files issued on the 9th/10th June additional files need to
be issued to shippers as further batches of estimated reads are being loaded this
week for both GT and iGT sites
16
Summary Incident Stats
17
Received/Resolved Incidents To Date (@20th June)
18
Received – By Stakeholder Resolved – By Stakeholder Open– By Stakeholder
Headline Ticket Status
TOTAL
Received 24
Resolved 17
Open 7
TOTAL
GT 8
IGT 1
SHIPPER 10
UIP 5
24
TOTAL
GT 7
IGT 1
SHIPPER 4
UIP 5
17
TOTAL
GT 1
SHIPPER 6
7
Data fixes Carried Out (@15th June)
19
Data fixes Undertaken Between 1st June – 15th June
Received – 14
Resolved – 14 Type Count
SPA 3
RGMA 2
Reads 7
Other 2
14
The datafix figures are carried out as a result of incidents raised by any of the PIS work streams
Customer Feedback (Q&As)
20
Reporting – Post Go-Live
21
22
Post Go Live – Reports In Scope
Data Topic Type Reported In Location Pre 1st June Post 1st June Reason
CA/CL MP Status GT/iGT Monthly Progress DMG webpages DMG/Perf Pack Perf Pack Included in monthly pack
Conf No Asset GT/iGT Monthly Progress DMG webpages DMG/Perf Pack Perf Pack Included in monthly pack
No Reads 2/3/4yrs GT/iGT Monthly Progress DMG webpages DMG/Perf Pack Perf Pack Included in monthly pack
Potentially incorrect CFs GT/IGT Monthly Progress DMG webpages DMG/Perf Pack Perf Pack Included in monthly pack
Read Factors/Units GT/iGT Monthly Progress DMG webpages DMG/Perf Pack Perf Pack Included in monthly pack
Blank MAMs GT/iGT S.Perf Pack S.Perf Pack Customer Relationship Perf Pack Included in monthly pack
COR747 GT/iGT S.Perf Pack S.Perf Pack Customer Relationship Perf Pack Included in monthly pack
DE report GT/iGT S.Perf Pack S.Perf Pack Customer Relationship Perf Pack Included in monthly pack
Filter Failures GT/iGT S.Perf Pack S.Perf Pack Customer Relationship Perf Pack Included in monthly pack
Must Reads GT/iGT S.Perf Pack S.Perf Pack Customer Relationship Perf Pack Included in monthly pack
Read performance GT/iGT S.Perf Pack S.Perf Pack Customer Relationship Perf Pack Included in monthly pack
RGMA traffic flow GT/iGT S.Perf Pack S.Perf Pack Customer Relationship Perf Pack Included in monthly pack
ToG GT/iGT S.Perf Pack S.Perf Pack Customer Relationship Perf Pack Included in monthly pack
23
Post Go Live – Reports - Out Of Scope
Data Topic Type Reported In Location Pre 1st June Post 1st June Reason
CSEP rec stats GT Monthly Progress DMG webpages DMG N/A CSEP rec closed out
LPGs GT Monthly Progress DMG webpages DMG N/A Identified within SAP
CFs 0/Null GT/iGT Monthly Progress DMG webpages DMG N/A T Rule Applied
ELA GT/iGT Monthly Progress DMG webpages DMG N/A T Rule Applied
Emergency Contact Type GT/iGT Monthly Progress DMG webpages DMG N/A T Rule Applied
GT T Rules GT/iGT T Rules Progress DMG webpages DMG N/A T Rule Applied
iGT T Rules GT/iGT T Rules Progress DMG webpages DMG N/A T Rule Applied
Invalid Meter Status GT/iGT Monthly Progress DMG webpages DMG N/A T Rule Applied
Invalid MP Status GT/iGT Monthly Progress DMG webpages DMG N/A T Rule Applied
Pcode/Ezone GT/iGT Monthly Progress DMG webpages DMG N/A T Rule Applied
Settlement Topics – Final Pre Go-Live Position
24
Monthly Progress - GT
Topic Area Current O/SNewly Added In Last
MonthProgress % Complete
Correction Factors of 0.0 13 0 218 94%
Potentially Incorrect C/F 9,841 105 19,974 67%
No Reads >4yrs 45,841 1,051 54,414 62%
No Reads >3yrs 42,308 1,853 42,880 50%
No Reads >2yrs 154,348 11,168 125,344 45%
LPG Sites 0 0 24 100%
Confirmed No Asset 13,434 0 44,519 77%
Read Factors/Units 170 6 3,334 95%
Invalid Meter Models 886 22 5,241 86%
Totals 266,841 14,205 472,517 64%
Data as at 23rd May
25
Monthly Progress - iGT
Topic Area Current Month Previous Month Progress
Correction Factors of Null 489 491 2
Potentially Incorrect C/F 332 332 0
No Reads >4yrs 6,799 6,869 70
No Reads >3yrs 8,970 8,210 -760
No Reads >2yrs 31,977 30,124 -1,853
MP Status 305,041 299,579 -5,462
Meter Status 0 0 0
Confirmed No Asset 258,270 255,628 -2,642
Read Factors/Units 1 1 0
Invalid Meter Models 213,562 213,154 -408
Totals 825,441 814,388 -11,053
Data as at 23rd May
26
AOB
27
COR747 Issue Issue:-
There is a mismatch in the unit of measure held for the meter and convertor. The convertor is only billable when fitted. The problem is if the meter
is metric and the convertor is imperial the consumption will be based on the incorrect unit of measure as it will use the imperial convertor when
calculating consumption. Historically, this was not an issue as the unit of measure on the meter drove consumption calculation. New world, billable
attributes are held against each device, therefore creating a mismatch between data held on the meter and the convertor.
Required Action:-
Shippers to submit an RGMA ONUPD to amend the incorrect device details (unit of measure).
For class 1 meter points, where only estimated reading have been received since 1st June – no further action required because the consumption is
based on D-7 estimated volume, therefore the volume is correct.
For class 1 meter points, where actual readings have been received since 1st June – a consumption adjustment is required, shippers will need to
liaise with the relevant DMSP as the consumption will be based on the incorrect unit of measure.
For class 4 meter points, where actual readings have been accepted since 1st June (Note this is not the read date, but the process date) a
consumption adjustment (via RFA contact code within CMS) is required as the consumption will be based on the incorrect unit of measure.
28
For Information:-
COR747 is reported within your monthly Shipper Performance Pack, including the affected MPRNs. The current industry total is 78 (@ 15th May)
Market Sector Code Changes (iGT Data)
Issue:-
iGTs are receiving IDL files with a surprisingly high volume of market sector code changes in them. They are
predominantly changes from I&C to domestic. The AQ of these supply points have all been well over the 73,200
kWh threshold, and all have addresses that quite clearly indicate they are not domestic supply points, e.g. building
name is ‘Cinema’ or ‘retail unit’ etc.
Impacts:-
IGTS are rejecting the updates in their systems, which protects billing but means the data is then out of synch with
UKLink
Potential to impact iGT ability to invoice correctly.
29
Address Data (iGT)
Numerous queries have been raised by Shippers regarding the differences in address
data held in the old and new versions of Data Enquiry.
Address data was successfully migrated from the iGT migration database (with zero
fallout or defects) and therefore reflects the data provided and issued on the portfolio
reports
30
Upcoming Meetings
Next Scheduled Meeting:–
Tuesday 18th July, 10:00-1500, Xoserve Offices, Lansdowne Gate, Solihull
Future scheduled meeting dates for 2017 so far:-
Wednesday 16th August, 10:00-1500, Xoserve Offices, Lansdowne Gate, Solihull
Wednesday 20th September, 10:00-1500, Xoserve Offices, Lansdowne Gate, Solihull
31
Any comments to:-
[email protected] / [email protected] / [email protected]
DMG Web Pages:-
http://www.xoserve.com/index.php/our-change-programme/uk-link-programme/uk-link-programme-workstream-
updates/data-cleansing/
DMG Mailbox Account:-
32
