Developing Developing Performance Performance

Improvement MetricsImprovement Metrics

Developing Developing Performance Performance

Improvement MetricsImprovement MetricsNFO-TRNC-METRICNFO-TRNC-METRICNFO-TRNC-METRICNFO-TRNC-METRIC

INPO 05-005: Guidelines for Performance Improvement at Nuclear Power StationsINPO 05-005: Guidelines for Performance Improvement at Nuclear Power Stations

• Excellence in Performance Excellence in Performance Improvement Improvement – is embodied by the organization that views is embodied by the organization that views

improving performance as a never-ending improving performance as a never-ending journey rather than a finite destination.journey rather than a finite destination.

• Excellence in Performance Excellence in Performance Improvement Improvement – is embodied by the organization that views is embodied by the organization that views

improving performance as a never-ending improving performance as a never-ending journey rather than a finite destination.journey rather than a finite destination.

TERMINAL OBJECTIVETERMINAL OBJECTIVE

• When evaluating training requests for When evaluating training requests for performance improvement, develop performance improvement, develop appropriate actions to resolve appropriate actions to resolve performance gaps in accordance with performance gaps in accordance with EN-TQ-208, Evaluating Training EN-TQ-208, Evaluating Training Requests for Performance Requests for Performance Improvement.Improvement.

• When evaluating training requests for When evaluating training requests for performance improvement, develop performance improvement, develop appropriate actions to resolve appropriate actions to resolve performance gaps in accordance with performance gaps in accordance with EN-TQ-208, Evaluating Training EN-TQ-208, Evaluating Training Requests for Performance Requests for Performance Improvement.Improvement.

ENABLING OBJECTIVESENABLING OBJECTIVES

• EO 1.01EO 1.01– Name the three key attributes of INPO’s Name the three key attributes of INPO’s

Performance Improvement Model.Performance Improvement Model.

• EO 1.02EO 1.02– List the performance monitoring activities List the performance monitoring activities

used to identify a need for an improvement used to identify a need for an improvement in performance.in performance.

• EO 1.03EO 1.03– State the purpose of analyzing, identifying, State the purpose of analyzing, identifying,

and planning solutions.and planning solutions.

• EO 1.01EO 1.01– Name the three key attributes of INPO’s Name the three key attributes of INPO’s

Performance Improvement Model.Performance Improvement Model.

• EO 1.02EO 1.02– List the performance monitoring activities List the performance monitoring activities

used to identify a need for an improvement used to identify a need for an improvement in performance.in performance.

• EO 1.03EO 1.03– State the purpose of analyzing, identifying, State the purpose of analyzing, identifying,

and planning solutions.and planning solutions.

ENABLING OBJECTIVESENABLING OBJECTIVES

• EO 1.04EO 1.04– Apply the key element of analyzing, Apply the key element of analyzing,

identifying, and planning solutions to identifying, and planning solutions to determine performance gaps.determine performance gaps.

• EO 1.05EO 1.05– Describe the process for documenting Describe the process for documenting

performance goals and assessment performance goals and assessment metrics.metrics.

• EO 1.04EO 1.04– Apply the key element of analyzing, Apply the key element of analyzing,

identifying, and planning solutions to identifying, and planning solutions to determine performance gaps.determine performance gaps.

• EO 1.05EO 1.05– Describe the process for documenting Describe the process for documenting

performance goals and assessment performance goals and assessment metrics.metrics.

ENABLING OBJECTIVESENABLING OBJECTIVES

• EO 1.06EO 1.06– Given mock scenarios, develop Given mock scenarios, develop

performance goals and assessment performance goals and assessment metrics.metrics.

• EO 1.06EO 1.06– Given mock scenarios, develop Given mock scenarios, develop

performance goals and assessment performance goals and assessment metrics.metrics.

INPO’s Performance INPO’s Performance Improvement ModelImprovement ModelINPO’s Performance INPO’s Performance Improvement ModelImprovement Model

INPO 05-005: Guidelines for Performance Improvement at Nuclear Power StationsINPO 05-005: Guidelines for Performance Improvement at Nuclear Power Stations

• The organization strives at all levels to The organization strives at all levels to achieve high levels of performance by achieve high levels of performance by effective application in the three key effective application in the three key attributes of the performance attributes of the performance improvement model.improvement model.

• The organization strives at all levels to The organization strives at all levels to achieve high levels of performance by achieve high levels of performance by effective application in the three key effective application in the three key attributes of the performance attributes of the performance improvement model.improvement model.

EO 1.01EO 1.01

EO 1.01EO 1.01

Performance Performance Monitoring ActivitiesMonitoring Activities

Performance Performance Monitoring ActivitiesMonitoring Activities

Performance MonitoringPerformance Monitoring

• PROACTIVEPROACTIVE• PROACTIVEPROACTIVE

EO 1.02EO 1.02

Performance MonitoringPerformance Monitoring

• REACTIVEREACTIVE• REACTIVEREACTIVE

EO 1.02EO 1.02

What monitoring activities do we What monitoring activities do we use to identify a need for an use to identify a need for an

improvement in performance?improvement in performance?

What monitoring activities do we What monitoring activities do we use to identify a need for an use to identify a need for an

improvement in performance?improvement in performance?

EO 1.02EO 1.02

Monitoring ActivitiesMonitoring Activities

• Corrective Action ProgramCorrective Action Program• Assessment ReportsAssessment Reports• Operating ExperienceOperating Experience• Regulatory requirement changesRegulatory requirement changes• New or changed station process, procedures New or changed station process, procedures

or equipmentor equipment• Management observations Management observations • Performance Indicator reviewsPerformance Indicator reviews• Incumbent feedbackIncumbent feedback

• Corrective Action ProgramCorrective Action Program• Assessment ReportsAssessment Reports• Operating ExperienceOperating Experience• Regulatory requirement changesRegulatory requirement changes• New or changed station process, procedures New or changed station process, procedures

or equipmentor equipment• Management observations Management observations • Performance Indicator reviewsPerformance Indicator reviews• Incumbent feedbackIncumbent feedback

EO 1.02EO 1.02

Analyzing, Analyzing, Identifying, and Identifying, and

Planning SolutionsPlanning Solutions

Analyzing, Analyzing, Identifying, and Identifying, and

Planning SolutionsPlanning Solutions

Analyzing, Identifying, and Planning SolutionsAnalyzing, Identifying, and Planning Solutions

• The purpose of analyzing, identifying, The purpose of analyzing, identifying, and planning solutions is to develop and planning solutions is to develop appropriate actions to resolve appropriate actions to resolve performance gaps identified through performance gaps identified through various performance monitoring various performance monitoring activities as well as those gaps that activities as well as those gaps that become self-revealing and are captured become self-revealing and are captured as condition reports after the fact.as condition reports after the fact.

• The purpose of analyzing, identifying, The purpose of analyzing, identifying, and planning solutions is to develop and planning solutions is to develop appropriate actions to resolve appropriate actions to resolve performance gaps identified through performance gaps identified through various performance monitoring various performance monitoring activities as well as those gaps that activities as well as those gaps that become self-revealing and are captured become self-revealing and are captured as condition reports after the fact.as condition reports after the fact.

EO 1.03EO 1.03

Analyzing, Identifying, and Planning SolutionsAnalyzing, Identifying, and Planning Solutions

• The elements of analyzing, identifying, The elements of analyzing, identifying, and planning solutions are as follows:and planning solutions are as follows:– Problem AnalysisProblem Analysis– Action PlanningAction Planning– Management Review and ApprovalManagement Review and Approval– Business Planning ConsiderationsBusiness Planning Considerations

• The elements of analyzing, identifying, The elements of analyzing, identifying, and planning solutions are as follows:and planning solutions are as follows:– Problem AnalysisProblem Analysis– Action PlanningAction Planning– Management Review and ApprovalManagement Review and Approval– Business Planning ConsiderationsBusiness Planning Considerations

EO 1.03EO 1.03

The Key Element Of The Key Element Of Analyzing, Analyzing,

Identifying, And Identifying, And Planning SolutionsPlanning Solutions

The Key Element Of The Key Element Of Analyzing, Analyzing,

Identifying, And Identifying, And Planning SolutionsPlanning Solutions

Analyzing, Identifying, and Planning SolutionsAnalyzing, Identifying, and Planning Solutions

• Problem AnalysisProblem Analysis– using tools or combinations of tools to using tools or combinations of tools to

uncover the underlying causes of uncover the underlying causes of problems or adverse trends, problems or adverse trends, commensurate with their significance.commensurate with their significance.

• Problem AnalysisProblem Analysis– using tools or combinations of tools to using tools or combinations of tools to

uncover the underlying causes of uncover the underlying causes of problems or adverse trends, problems or adverse trends, commensurate with their significance.commensurate with their significance.

EO 1.04EO 1.04

Analyzing, Identifying, and Planning SolutionsAnalyzing, Identifying, and Planning Solutions

• Problem Analysis ToolsProblem Analysis Tools– root or apparent cause analysisroot or apparent cause analysis– common cause analysiscommon cause analysis– event investigationsevent investigations– human performance error investigationshuman performance error investigations– process analysisprocess analysis– training needs analysistraining needs analysis

• Problem Analysis ToolsProblem Analysis Tools– root or apparent cause analysisroot or apparent cause analysis– common cause analysiscommon cause analysis– event investigationsevent investigations– human performance error investigationshuman performance error investigations– process analysisprocess analysis– training needs analysistraining needs analysis

EO 1.04EO 1.04

Training Needs AnalysisTraining Needs Analysis

• Needs analysisNeeds analysis– a systematic process by which potential or a systematic process by which potential or

existing training needs are identified from existing training needs are identified from various inputs to determine the impact on various inputs to determine the impact on training programs. training programs.

• Needs analysisNeeds analysis– a systematic process by which potential or a systematic process by which potential or

existing training needs are identified from existing training needs are identified from various inputs to determine the impact on various inputs to determine the impact on training programs. training programs.

EO 1.04EO 1.04

When may a formal training When may a formal training needs analysis may be needs analysis may be

waived?waived?

When may a formal training When may a formal training needs analysis may be needs analysis may be

waived?waived?

EO 1.04EO 1.04

• Regulatory or INPO requirementsRegulatory or INPO requirements

• Operations Requal Program Operations Requal Program requirementsrequirements

• Accredited program guidelinesAccredited program guidelines

• Periodic refresher trainingPeriodic refresher training

• Regulatory or INPO requirementsRegulatory or INPO requirements

• Operations Requal Program Operations Requal Program requirementsrequirements

• Accredited program guidelinesAccredited program guidelines

• Periodic refresher trainingPeriodic refresher training

EO 1.04EO 1.04

Training Needs Analysis StepsTraining Needs Analysis Steps

• Gathering all available informationGathering all available information

• Identifying resources needed to Identifying resources needed to conduct analysis (SMEs, other conduct analysis (SMEs, other resources)resources)

• Review available informationReview available information

• Determining and listing gapsDetermining and listing gaps

• Identifying reasons these gaps existIdentifying reasons these gaps exist

• Examining solutions to the gapsExamining solutions to the gaps

• Gathering all available informationGathering all available information

• Identifying resources needed to Identifying resources needed to conduct analysis (SMEs, other conduct analysis (SMEs, other resources)resources)

• Review available informationReview available information

• Determining and listing gapsDetermining and listing gaps

• Identifying reasons these gaps existIdentifying reasons these gaps exist

• Examining solutions to the gapsExamining solutions to the gaps

EO 1.04EO 1.04

Examples:Examples:

• 10 of 15 Chemistry Technicians are 10 of 15 Chemistry Technicians are qualified to operate the ICP. Of the 10 qualified to operate the ICP. Of the 10 qualified individuals, only 3 routinely qualified individuals, only 3 routinely operate the ICP. At the last TRG, the operate the ICP. At the last TRG, the Chemistry Superintendent requested Chemistry Superintendent requested training on the ICP because all 10 training on the ICP because all 10 qualified technicians would be qualified technicians would be expected to operate the ICP during an expected to operate the ICP during an upcoming outage.upcoming outage.

• 10 of 15 Chemistry Technicians are 10 of 15 Chemistry Technicians are qualified to operate the ICP. Of the 10 qualified to operate the ICP. Of the 10 qualified individuals, only 3 routinely qualified individuals, only 3 routinely operate the ICP. At the last TRG, the operate the ICP. At the last TRG, the Chemistry Superintendent requested Chemistry Superintendent requested training on the ICP because all 10 training on the ICP because all 10 qualified technicians would be qualified technicians would be expected to operate the ICP during an expected to operate the ICP during an upcoming outage.upcoming outage.

EO 1.04EO 1.04

Examples:Examples:

• Five CRs were written over the past six Five CRs were written over the past six months related to violations of High months related to violations of High Radiation Area entry requirements. Radiation Area entry requirements. The RPM has submitted a TEAR for The RPM has submitted a TEAR for training on High Radiation Area Entries.training on High Radiation Area Entries.

• 2 CRs were for gates left open, 2 for 2 CRs were for gates left open, 2 for entry on the wrong RWP and one for entry on the wrong RWP and one for entry without proper dosimetry.entry without proper dosimetry.

• Five CRs were written over the past six Five CRs were written over the past six months related to violations of High months related to violations of High Radiation Area entry requirements. Radiation Area entry requirements. The RPM has submitted a TEAR for The RPM has submitted a TEAR for training on High Radiation Area Entries.training on High Radiation Area Entries.

• 2 CRs were for gates left open, 2 for 2 CRs were for gates left open, 2 for entry on the wrong RWP and one for entry on the wrong RWP and one for entry without proper dosimetry.entry without proper dosimetry.

EO 1.04EO 1.04

Documenting Documenting Performance Goals Performance Goals And Assessment And Assessment

MetricsMetrics

Documenting Documenting Performance Goals Performance Goals And Assessment And Assessment

MetricsMetrics

When is Attachment 9.1, When is Attachment 9.1, Training Goal Development Training Goal Development Worksheet, Worksheet, NOTNOT required? required?

When is Attachment 9.1, When is Attachment 9.1, Training Goal Development Training Goal Development Worksheet, Worksheet, NOTNOT required? required?

EO 1.05EO 1.05

EN-TQ-208 RequirementsEN-TQ-208 Requirements

• Attachment 9.1, Training Goal Attachment 9.1, Training Goal Development Worksheet, is Development Worksheet, is NOTNOT required when required when – analysis identifies a new task that analysis identifies a new task that

becomes part of an initial training becomes part of an initial training program, program,

– training that is regulatory driven, training that is regulatory driven, – OROR is at the discretion of management. is at the discretion of management.

• Attachment 9.1, Training Goal Attachment 9.1, Training Goal Development Worksheet, is Development Worksheet, is NOTNOT required when required when – analysis identifies a new task that analysis identifies a new task that

becomes part of an initial training becomes part of an initial training program, program,

– training that is regulatory driven, training that is regulatory driven, – OROR is at the discretion of management. is at the discretion of management.

EO 1.05EO 1.05

Is completion of a paper copy Is completion of a paper copy of Attachment 9.1 required to of Attachment 9.1 required to

be completed?be completed?

Is completion of a paper copy Is completion of a paper copy of Attachment 9.1 required to of Attachment 9.1 required to

be completed?be completed?

EN-TQ-208 RequirementsEN-TQ-208 Requirements

• Completion of a paper copy of Completion of a paper copy of attachment 9.1, Training Goal attachment 9.1, Training Goal Development Worksheet is Development Worksheet is NOTNOT mandatory.mandatory.

• To be used as a guide to help collect To be used as a guide to help collect information to complete the information to complete the Performance Improvement Tracking Performance Improvement Tracking Tabs in the TEAR software.Tabs in the TEAR software.

• Completion of a paper copy of Completion of a paper copy of attachment 9.1, Training Goal attachment 9.1, Training Goal Development Worksheet is Development Worksheet is NOTNOT mandatory.mandatory.

• To be used as a guide to help collect To be used as a guide to help collect information to complete the information to complete the Performance Improvement Tracking Performance Improvement Tracking Tabs in the TEAR software.Tabs in the TEAR software.

EO 1.05EO 1.05

Entering TEAR DataEntering TEAR DataEntering TEAR DataEntering TEAR Data

1111

1

14

1

15

1

16

11

1

17

1

18

1

19

20

1

21

22

23

24

25

1

26

1

27

1

28

29

30

31

32

33

34

Print a TQ-208 form from the TEAR databasePrint a TQ-208 form from the TEAR database• From the “FIND TEAR” screen select From the “FIND TEAR” screen select

“print”“print”

• Highlight the Fleet-TQ-208 form and Highlight the Fleet-TQ-208 form and select “OK”select “OK”

• Select plantSelect plant

• Select yearSelect year

• Select TEAR #Select TEAR #

• Select printer buttonSelect printer button

• From the “FIND TEAR” screen select From the “FIND TEAR” screen select “print”“print”

• Highlight the Fleet-TQ-208 form and Highlight the Fleet-TQ-208 form and select “OK”select “OK”

• Select plantSelect plant

• Select yearSelect year

• Select TEAR #Select TEAR #

• Select printer buttonSelect printer button

EO 1.05EO 1.05

Developing Developing Performance Goals Performance Goals And Assessment And Assessment

MetricsMetrics

Developing Developing Performance Goals Performance Goals And Assessment And Assessment

MetricsMetrics

Developing performance goals and assessment metricsDeveloping performance goals and assessment metrics• Metrics are developed from the Metrics are developed from the

performance gap that was identified in performance gap that was identified in needs analysisneeds analysis

• Metrics must be:Metrics must be:– MeasurableMeasurable– ObservableObservable– AchievableAchievable

• Metrics are developed from the Metrics are developed from the performance gap that was identified in performance gap that was identified in needs analysisneeds analysis

• Metrics must be:Metrics must be:– MeasurableMeasurable– ObservableObservable– AchievableAchievable

EO 1.06EO 1.06

Developing performance goals and assessment metricsDeveloping performance goals and assessment metrics• The ‘best’ metrics:The ‘best’ metrics:

– Reduce costsReduce costs

• The ‘best’ metrics:The ‘best’ metrics:– Reduce costsReduce costs

EO 1.06EO 1.06

Developing performance goals and assessment metricsDeveloping performance goals and assessment metrics• The ‘best’ metrics:The ‘best’ metrics:

– Reduce costsReduce costs– Increase capacityIncrease capacity

• The ‘best’ metrics:The ‘best’ metrics:– Reduce costsReduce costs– Increase capacityIncrease capacity

EO 1.06EO 1.06

Developing performance goals and assessment metricsDeveloping performance goals and assessment metrics• The ‘best’ metrics:The ‘best’ metrics:

– Reduce costsReduce costs– Increase capacityIncrease capacity– Reduce doseReduce dose

• The ‘best’ metrics:The ‘best’ metrics:– Reduce costsReduce costs– Increase capacityIncrease capacity– Reduce doseReduce dose

EO 1.06EO 1.06

ScenariosScenariosScenariosScenarios

EO 1.06EO 1.06

Scenario 1Scenario 1

• A review of the previous year’s A review of the previous year’s coaching cards identified 12 coaching cards identified 12 occurrences of poor questioning occurrences of poor questioning technique by Subject Matter Expert technique by Subject Matter Expert (SME) Instructors. (SME) Instructors.

• A review of the previous year’s A review of the previous year’s coaching cards identified 12 coaching cards identified 12 occurrences of poor questioning occurrences of poor questioning technique by Subject Matter Expert technique by Subject Matter Expert (SME) Instructors. (SME) Instructors.

EO 1.06EO 1.06

Scenario 2Scenario 2

• During the last outage, the refuel bridge During the last outage, the refuel bridge was out of service due to maintenance was out of service due to maintenance issues for 22 hoursissues for 22 hours

• A total of 18 hours of critical path time A total of 18 hours of critical path time was lost due to this unavailabilitywas lost due to this unavailability

• The outage went 10 hours beyond its The outage went 10 hours beyond its scheduled 25 days.scheduled 25 days.

• During the last outage, the refuel bridge During the last outage, the refuel bridge was out of service due to maintenance was out of service due to maintenance issues for 22 hoursissues for 22 hours

• A total of 18 hours of critical path time A total of 18 hours of critical path time was lost due to this unavailabilitywas lost due to this unavailability

• The outage went 10 hours beyond its The outage went 10 hours beyond its scheduled 25 days.scheduled 25 days.

EO 1.06EO 1.06

Scenario 3Scenario 3

• An emergency diesel generator An emergency diesel generator operational test should take 8 hours to operational test should take 8 hours to completecomplete

• The LCO for this test is set at 12 hoursThe LCO for this test is set at 12 hours

• The last two times this testing was The last two times this testing was performed, it took 10.5 hours and 11 performed, it took 10.5 hours and 11 hours, respectivelyhours, respectively

• An emergency diesel generator An emergency diesel generator operational test should take 8 hours to operational test should take 8 hours to completecomplete

• The LCO for this test is set at 12 hoursThe LCO for this test is set at 12 hours

• The last two times this testing was The last two times this testing was performed, it took 10.5 hours and 11 performed, it took 10.5 hours and 11 hours, respectivelyhours, respectively

EO 1.06EO 1.06

Scenario 4Scenario 4

• A review of your discipline’s PIs A review of your discipline’s PIs indicate that the HU precursor rate has indicate that the HU precursor rate has increased from 1.98 per 10,000 to 5.42 increased from 1.98 per 10,000 to 5.42 per 10,000 over the past 6 months.per 10,000 over the past 6 months.

• A review of your discipline’s PIs A review of your discipline’s PIs indicate that the HU precursor rate has indicate that the HU precursor rate has increased from 1.98 per 10,000 to 5.42 increased from 1.98 per 10,000 to 5.42 per 10,000 over the past 6 months.per 10,000 over the past 6 months.

EO 1.06EO 1.06

SummarySummary

• What attributes must valid performance What attributes must valid performance goals and assessment metrics goals and assessment metrics possess?possess?

– MeasurableMeasurable

– ObservableObservable

– AchievableAchievable

• What attributes must valid performance What attributes must valid performance goals and assessment metrics goals and assessment metrics possess?possess?

– MeasurableMeasurable

– ObservableObservable

– AchievableAchievable

ENABLING OBJECTIVESENABLING OBJECTIVES

• EO 1.01EO 1.01– Name the three key attributes of INPO’s Name the three key attributes of INPO’s

Performance Improvement Model.Performance Improvement Model.

• EO 1.02EO 1.02– List the performance monitoring activities List the performance monitoring activities

used to identify a need for an improvement used to identify a need for an improvement in performance.in performance.

• EO 1.03EO 1.03– State the purpose of analyzing, identifying, State the purpose of analyzing, identifying,

and planning solutions.and planning solutions.

• EO 1.01EO 1.01– Name the three key attributes of INPO’s Name the three key attributes of INPO’s

Performance Improvement Model.Performance Improvement Model.

• EO 1.02EO 1.02– List the performance monitoring activities List the performance monitoring activities

used to identify a need for an improvement used to identify a need for an improvement in performance.in performance.

• EO 1.03EO 1.03– State the purpose of analyzing, identifying, State the purpose of analyzing, identifying,

and planning solutions.and planning solutions.

ENABLING OBJECTIVESENABLING OBJECTIVES

• EO 1.04EO 1.04– Apply the key element of analyzing, Apply the key element of analyzing,

identifying, and planning solutions to identifying, and planning solutions to determine performance gaps.determine performance gaps.

• EO 1.05EO 1.05– Describe the process for documenting Describe the process for documenting

performance goals and assessment performance goals and assessment metrics.metrics.

• EO 1.04EO 1.04– Apply the key element of analyzing, Apply the key element of analyzing,

identifying, and planning solutions to identifying, and planning solutions to determine performance gaps.determine performance gaps.

• EO 1.05EO 1.05– Describe the process for documenting Describe the process for documenting

performance goals and assessment performance goals and assessment metrics.metrics.

ENABLING OBJECTIVESENABLING OBJECTIVES

• EO 1.06EO 1.06– Given mock scenarios, develop Given mock scenarios, develop

performance goals and assessment performance goals and assessment metrics.metrics.

• EO 1.06EO 1.06– Given mock scenarios, develop Given mock scenarios, develop

performance goals and assessment performance goals and assessment metrics.metrics.

TERMINAL OBJECTIVETERMINAL OBJECTIVE

• When evaluating training requests for When evaluating training requests for performance improvement, develop performance improvement, develop appropriate actions to resolve appropriate actions to resolve performance gaps in accordance with performance gaps in accordance with EN-TQ-208, Evaluating Training EN-TQ-208, Evaluating Training Requests for Performance Requests for Performance Improvement.Improvement.

• When evaluating training requests for When evaluating training requests for performance improvement, develop performance improvement, develop appropriate actions to resolve appropriate actions to resolve performance gaps in accordance with performance gaps in accordance with EN-TQ-208, Evaluating Training EN-TQ-208, Evaluating Training Requests for Performance Requests for Performance Improvement.Improvement.