Upload
others
View
4
Download
0
Embed Size (px)
Citation preview
Brent Read Compliance Engineer - Enforcement
NERC PER Standards January 29 2013
Compliance User Group
2
Personnel Training and Qualifications
3
ldquoSystem Operators are single handedly the most important people in the electric industryrdquo
-Thomas Edison maybe ldquoThe trouble with quotes on the internet is that
you can never know if they are genuinerdquo -Abraham Lincoln
4
bull BS in Mechanical Engineering Technology o Texas AampM University College Station TX
bull 7 Years at a TOTOP in TX Interconnection o 4 yrs in engineering group o 3 yrs supervisingmanaging the control room
bull Joined WECC Enforcement in June 2012 bull NERC Certified Transmission Operator
Background
5
Importance of the PER Standards
6
bull System Operators are the most important parts of the BES
bull System Operators are responsible for ensuring a stable and reliable BES
bull System Operators must be able to take proper actions in normal and emergency system conditions
bull System Operators must be able to respond quickly and appropriately
Importance of the PER Standards
7
bull Review PER Standards bull Discuss Best Practices and Resources for
working with PER standards bull Discuss the Enforcement Review Approach
to the PER Standards
Agenda
8
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
9
bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Standard Review PER-001-02
10
bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel
Standard Review PER-002-0
11
bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary
responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System
o R22 Positions directly responsible for complying with NERC standards
Standard Review PER-002-0
12
bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria
Standard Review PER-002-0
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
2
Personnel Training and Qualifications
3
ldquoSystem Operators are single handedly the most important people in the electric industryrdquo
-Thomas Edison maybe ldquoThe trouble with quotes on the internet is that
you can never know if they are genuinerdquo -Abraham Lincoln
4
bull BS in Mechanical Engineering Technology o Texas AampM University College Station TX
bull 7 Years at a TOTOP in TX Interconnection o 4 yrs in engineering group o 3 yrs supervisingmanaging the control room
bull Joined WECC Enforcement in June 2012 bull NERC Certified Transmission Operator
Background
5
Importance of the PER Standards
6
bull System Operators are the most important parts of the BES
bull System Operators are responsible for ensuring a stable and reliable BES
bull System Operators must be able to take proper actions in normal and emergency system conditions
bull System Operators must be able to respond quickly and appropriately
Importance of the PER Standards
7
bull Review PER Standards bull Discuss Best Practices and Resources for
working with PER standards bull Discuss the Enforcement Review Approach
to the PER Standards
Agenda
8
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
9
bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Standard Review PER-001-02
10
bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel
Standard Review PER-002-0
11
bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary
responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System
o R22 Positions directly responsible for complying with NERC standards
Standard Review PER-002-0
12
bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria
Standard Review PER-002-0
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
3
ldquoSystem Operators are single handedly the most important people in the electric industryrdquo
-Thomas Edison maybe ldquoThe trouble with quotes on the internet is that
you can never know if they are genuinerdquo -Abraham Lincoln
4
bull BS in Mechanical Engineering Technology o Texas AampM University College Station TX
bull 7 Years at a TOTOP in TX Interconnection o 4 yrs in engineering group o 3 yrs supervisingmanaging the control room
bull Joined WECC Enforcement in June 2012 bull NERC Certified Transmission Operator
Background
5
Importance of the PER Standards
6
bull System Operators are the most important parts of the BES
bull System Operators are responsible for ensuring a stable and reliable BES
bull System Operators must be able to take proper actions in normal and emergency system conditions
bull System Operators must be able to respond quickly and appropriately
Importance of the PER Standards
7
bull Review PER Standards bull Discuss Best Practices and Resources for
working with PER standards bull Discuss the Enforcement Review Approach
to the PER Standards
Agenda
8
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
9
bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Standard Review PER-001-02
10
bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel
Standard Review PER-002-0
11
bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary
responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System
o R22 Positions directly responsible for complying with NERC standards
Standard Review PER-002-0
12
bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria
Standard Review PER-002-0
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
4
bull BS in Mechanical Engineering Technology o Texas AampM University College Station TX
bull 7 Years at a TOTOP in TX Interconnection o 4 yrs in engineering group o 3 yrs supervisingmanaging the control room
bull Joined WECC Enforcement in June 2012 bull NERC Certified Transmission Operator
Background
5
Importance of the PER Standards
6
bull System Operators are the most important parts of the BES
bull System Operators are responsible for ensuring a stable and reliable BES
bull System Operators must be able to take proper actions in normal and emergency system conditions
bull System Operators must be able to respond quickly and appropriately
Importance of the PER Standards
7
bull Review PER Standards bull Discuss Best Practices and Resources for
working with PER standards bull Discuss the Enforcement Review Approach
to the PER Standards
Agenda
8
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
9
bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Standard Review PER-001-02
10
bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel
Standard Review PER-002-0
11
bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary
responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System
o R22 Positions directly responsible for complying with NERC standards
Standard Review PER-002-0
12
bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria
Standard Review PER-002-0
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
5
Importance of the PER Standards
6
bull System Operators are the most important parts of the BES
bull System Operators are responsible for ensuring a stable and reliable BES
bull System Operators must be able to take proper actions in normal and emergency system conditions
bull System Operators must be able to respond quickly and appropriately
Importance of the PER Standards
7
bull Review PER Standards bull Discuss Best Practices and Resources for
working with PER standards bull Discuss the Enforcement Review Approach
to the PER Standards
Agenda
8
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
9
bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Standard Review PER-001-02
10
bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel
Standard Review PER-002-0
11
bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary
responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System
o R22 Positions directly responsible for complying with NERC standards
Standard Review PER-002-0
12
bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria
Standard Review PER-002-0
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
6
bull System Operators are the most important parts of the BES
bull System Operators are responsible for ensuring a stable and reliable BES
bull System Operators must be able to take proper actions in normal and emergency system conditions
bull System Operators must be able to respond quickly and appropriately
Importance of the PER Standards
7
bull Review PER Standards bull Discuss Best Practices and Resources for
working with PER standards bull Discuss the Enforcement Review Approach
to the PER Standards
Agenda
8
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
9
bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Standard Review PER-001-02
10
bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel
Standard Review PER-002-0
11
bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary
responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System
o R22 Positions directly responsible for complying with NERC standards
Standard Review PER-002-0
12
bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria
Standard Review PER-002-0
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
7
bull Review PER Standards bull Discuss Best Practices and Resources for
working with PER standards bull Discuss the Enforcement Review Approach
to the PER Standards
Agenda
8
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
9
bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Standard Review PER-001-02
10
bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel
Standard Review PER-002-0
11
bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary
responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System
o R22 Positions directly responsible for complying with NERC standards
Standard Review PER-002-0
12
bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria
Standard Review PER-002-0
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
8
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
9
bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Standard Review PER-001-02
10
bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel
Standard Review PER-002-0
11
bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary
responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System
o R22 Positions directly responsible for complying with NERC standards
Standard Review PER-002-0
12
bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria
Standard Review PER-002-0
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
9
bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Standard Review PER-001-02
10
bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel
Standard Review PER-002-0
11
bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary
responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System
o R22 Positions directly responsible for complying with NERC standards
Standard Review PER-002-0
12
bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria
Standard Review PER-002-0
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
10
bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel
Standard Review PER-002-0
11
bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary
responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System
o R22 Positions directly responsible for complying with NERC standards
Standard Review PER-002-0
12
bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria
Standard Review PER-002-0
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
11
bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary
responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System
o R22 Positions directly responsible for complying with NERC standards
Standard Review PER-002-0
12
bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria
Standard Review PER-002-0
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
12
bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria
Standard Review PER-002-0
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
13
o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions
Standard Review PER-002-0
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
14
o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations
o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency
Standard Review PER-002-0
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
15
o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities
Standard Review PER-002-0
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
16
bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel
Standard Review PER-002-0
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
17
bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate
Standard Review PER-003-1
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
18
o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and
coordination
Standard Review PER-003-1
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
19
bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
20
o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive
o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator
Standard Review PER-003-1
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
21
bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates
Standard Review PER-003-1
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
22
o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination
o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator
Standard Review PER-003-1
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
23
bull PER-003-1 Footnote o Non-NERC certified personnel performing any
reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks
Standard Review PER-003-1
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
24
bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program
Standard Review PER-005-1
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
25
o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of
BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training
Standard Review PER-005-1
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
26
o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11
o R13 Each RC BA and TOP shall deliver the training established in R12
o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified
Standard Review PER-005-1
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
27
bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the
BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks
Standard Review PER-005-1
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
28
bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel
Standard Review PER-005-1
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
29
o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions
Standard Review PER-005-1
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
30
bull PER-001-02 o Operating Personnel Responsibility and
Authority bull PER-002-0 o Operating Personnel Training
bull PER-003-1 o Operating Personnel Credentials
bull PER-005-1 o System Personnel Training
Standards Review
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
31
Best Practices
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
32
bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating
personnel o Training programs can be overwhelming
Best Practices for Training Programs
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
33
bull Reliability Standard Measures are often overlooked
bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the
Requirements in the standard o Gives additional information to assist in
complying with the Requirements o Too often the Measures get overlooked
Best Practices Reliability Standard Measures
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
34
bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating
positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC
certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency
o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions
PER-003-1 Measures
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
35
bull Some standards require training and can strengthen the training program
bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the
content o Use the standards to track the level of detail in
the training program
Best Practices Cross Reference Standards
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
36
bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the
priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)
Best Practices Cross Reference Standards
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
37
bull Example of using the standards to provide content
PRC-001-11 R1 Each Transmission Operator Balancing
Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area
Best Practices Cross Reference Standards
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
38
bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16
Best Practices Cross Reference Standards
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
39
bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one
place o Duplication causes confusion
bull Specify the method of delivery of training
Best Practices Documentation
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
40
bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the
end of the year o Identifies available resources
bull Define Annual in your training program o If not defined we will default to Calendar year
Best Practices Documentation
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
41
bull Tell a good story o Use narratives to help explain the training
program training and learning objectives processes and procedures
bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity
Best Practices Documentation
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
42
bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other
Best Practices Use Available Resources
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
43
bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy
stem_Operator_Task_Listxls
bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1078pdf
Best Practices Use Available Resources
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
44
bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk111899pdf
bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1201pdf
Best Practices Use Available Resources
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
45
bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds
docshandbookhdbk1206pdf
Best Practices Use Available Resources
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
46
bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20
bull RSAWs o httpwwwweccbizcomplianceUnited_States
DocumentsComplete20set20of20RSAWszip
Best Practices Use Available Resources
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
47
bull The Measures section of each standard provides clear guidance
bull Cross reference all applicable standards bull Invest time in your documentation The devil
is in the details bull Use existing resources
Review of Best Practices
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
48
Enforcement Review Approach
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
49
bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards
bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES
Enforcement Review Approach
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
50
bull Does your training program provide Initial and continuing training for operating personnel
bull Does your training program have clear training and learning objectives
bull For individual standard requirement Audit Approaches use the RSAWs
Enforcement Review Approach
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
51
bull PER-001-02 R1 o Evidence that the entity provides (and has
provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System
Enforcement Review Approach RSAW Example
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
52
Enforcement Review Approach RSAW Example
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
53
Too much
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
54
bull Reviewed the PER Standards bull Discussed Best Practices and Resources
available bull Discussed the Enforcement Review
Approach used when reviewing training programs and documentation
A Look Backhellip
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
55
bull Is this your reaction when we call you or you have to call us
WECC Staff
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
56
bull Our goal is the same as yours we want to improve the reliability of the BES
bull Take the time to review your training program on a regular basis
bull Utilize all of the available resources you can find
bull Remember the devil is in the details
Wersquore Here to Help
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions
Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz
Questions