Rev. 9E Form ES-201-1 Task Description (Reference) Examiner's £c:L · 2012-12-01 · ES-201, Rev. 9E Examination Preparation Checklist Form ES-201-1 Facility: Browns Ferry Date of

ES-201, Rev. 9E Examination Preparation Checklist Form ES-201-1

Facility: Browns Ferry Date of Examination: 12/8 - 19/08

Examinations Developed by: Facility

Written / Operating Test Written / Operating Test

Target Chief

Date * Task Description (Reference) Examiner's

Initials

-180 1. Examination administration date confinned (C.1.a; C.2.a and b) £c:L -120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) Afi -120 3. Facility contact briefed on security and other requirements (C.2.c) £ f -120 4. Corporate notification letter sent (C.2.d) ~j [-90] [5. Reference material due (C.1.e; C.3.c; Attachment 2)] ~ t {-75 } 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-

301-1, ES-301-2, ES-301-5, ES-D-l's, ES-401-1I2, ES-401-3, and ES-401-4, as applicable (C.1.e and f; C.3.d)

{ -70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)}

{ -45} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4,

~j ES-301-5, ES-301-6, and ES-401-6), and reference materials due (C.1.e, f, g and h; C.3.d)

-30 9. Preliminary license applications (NRC Form 398's) due (C.Ll; C.2.g; ES-202) ~ ;1 -14 10. Final license applications due and Form ES-201-4 prepared (C.Ll; C.2.i; ES-202) ~j -14 11. Examination approved by NRC supervisor for facility licensee review

~j (C.2.h; C.3.f)

-14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) ~;f -7 13. Written examinations and operating tests approved by NRC supervisor ~j (C.2.i; C.3.h)

-7 14. Final applications reviewed; lor 2 (if >.10) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent ~;l (C.2.i; Attachment 4; ES-202, C.2.e; ES-204)

-7 15. Proctoring/written exam administration guidelines reviewed with facility licensee ~cf-(C.3.k)

-7 16. Approved scenarios, job performance measures, and questions distributed to ~cf NRC examiners (C.3.i)

* Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee. [Applies only] {Does not apply} to examinations prepared by the NRC.

ES-201 Examination Outline Quality Checklist Form ES-201-2

Facility: Browns Ferry Date of Examination:12/08/2008

Item

1. W R I T T E N

2.

S I

M U L A T o R

3.

W 1 T

4.

G E N E R A L

a.

b.

c.

d.

a.

b.

c.

a.

b.

c.

a.

b.

c.

d.

e. f.

a. Author

Task Description

Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.

Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 and whether all KIA categories are appropriately sampled.

Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

Assess whether the justifications for deselected or rejected KIA statements are appropriate.

Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major transients.

Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity, and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated. from the applicants' audit test(s), and scenarios will not be repeated on subsequent days.

To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.

Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2: (1) the outline(s) contain(s) the required number of control room and in-plant tasks

distributed among the safety functions as specified on the form (2) task repetition from the last two NRC examinations is within the limits specified on the form. (3) no tasks are duplicated from the applicants' audit test(s)

Initials

a b* c#

(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria ::.. -::;;il

on the form_'- 'N~ Verify that the administrative outline meets the criteria specified on Form ES-301-1: (1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified i3i no more than one task is repeated froin the last two NRC licensinq examinations Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.

Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam section.

Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

Ensure that KIA importance ratings (except for plant-specific priorities) are at least 2.5.

Check for duplication and overlap among exam sections.

Check the entire exam for balance of coverage.

Assess whether the exam fits the appropriate job level (RO or SRO).

r-r.rint~nature Robert M. Soadoni .~. A

Date 12/01/2008

b. Facility Reviewer (*) E. Robert Scillian £K J j ....... ~. ~;. ""'.J 1210112008

c. NRC Chief Examiner (#) £d'&-IJI/7 LL:A..;r:.7~'//1. -""~"-'_ /2. ~uu. -r.: W'lN ....... AI / ~. ~ .1' /f}!:;:;?

d. NRC Supervisor

NOTE: # Independent NRC Reviewer initial items in Column "c"; chief examiner concurrence required.

ES-201, Page 25 of 27

ES-301 Administrative Topics Outline

/>rJi1.. / Form ES-301-1

Facility: BFN (NRC EXAM) Date of Examination: 12/08/08

Examination Level (circle one): RO/SRO Operating Test Number HLT0707

Administrative Topic Type Describe Activity to be performed

(see Note) Code*

A. Conduct of Operations N Demonstrate correct method for Independent

(550) (Generic 2.1.29) Verification (SPP-IO.3rl) (RO/SRO)

(Admin A)

B. Conduct of Operations M Overtime Eligibility (540) (Generic 2.1.5) (OPDP-l,OSIL 25, SPP-l.5) (RO/SRO)

(Admin B)

C. Equipment Control D Evaluate Recombiner Efficiency (3-01-66 r56)

(510) (Generic 2.2.44) (RO/SRO)

(Admin C)

D. Radiation Control D Review a Radiological Survey Map (548) (Generic 2.3.4) (RO/SRO)

(Admin D)

E. Emergency Plan N/S Classify the Event per the REP (Loss of all Pwr to (480TC) (Generic 2.4.41) 4kv SID bds > 3 hrs) (SRO Only)

(Admin E) (EPIP-l r 431 EPIP-5 r37)

NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

*Type Codes & Criteria: (C)ontrol room (D)irect from bank (:S 3 for ROs;:S 4 for SROs & RO retakes) (N)ew or (M)odified from bank (~ 1) (P)revious 2 exams (:S 1; randomly selected) (S)imulator

ES-301, Page 22 of27

E$-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 1?/B-I"l-/tS' as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination

To ~he best of my knowle ~e, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered dUring the week(s) of ."2., Ii- I( From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

Sr.A1p f

sm I ~-'o'f

~=:.::...::;)..~~~.:::r-r ---';~==::!::J:w:...:. -=~::.::r=~l':...!.:-------4~~~~~"""""'--..!...<~~ '.../.~WJU..1~~~ l~iVfg ..I.¢:!>~~~.....J:!~~ -~S\J?.o::-,;'~----.."..-:---~{Ei:;Z~~----j'----- -=="'--~ --I4~~;;;:::::::...-!rL....-- r'~~ .~~~~~~~--- ___ ~S~~~~€~v~~~~~,~cae~hJ~~~~'~~\4aL-___ ~~~~~~---------~--~~7Z~~~~---~~

ES-201, Page 2'7 of 28

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 1ft -/ z).s;s of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management Qr the NRC ~hief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination

To the best of my knowlydge, did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of l'Z/I.- /. If'. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

SIGNATURE (2) DATE NOTE

ES-201, Page 27 of 28


1. Pre-Examination

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 1,# -IZ»as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination

To the best of my knowl dge, I gid not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of t 'iJ-Il./S. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY DATE DATE NOTE

1. ~ V.titIMJ JdJ~ • 2. ~~t.:(. ~/.4/''''; ~'4T' 1

~: ~~:( ~~Mct%iu t)~ ~~ ~"--;-'-:;-;/(,"'r.-'''rr''---.-....so.....:=:::::--r~ i}fr.c? ~:fV1~o~S 1-_:::~"=s9*"'-=------"'~~==_ ~-""":""';;~=";;"-:--' -- 1111~168t?B 7. ,-,,-,,,<, <9~~ skdw --=~ .ilL~ 8. tiAt&1iA P1~ ~/V$. 11.(u4r> 9. _________ _____________ _ ____ _ 10., _________________________________________________ _ 11. ________________________________________________ _ 12. _________________________________________________ _ 13. _________________________________________________ _ 14., ______________________________ ,--__________________ _ 15.=~ ________________ _ NOTES: ------------------------ ------

(J) #,3 ~_rs .0. C4ffr ;.( -1,ItJ ~N1~-v t:-phVfO

ES-201, Page 27 of 28


1. Pre-Examination

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of pfB- J11>""as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately repor£ to facility management or the NRC ch!ef examiner any indications or suggestions that examination security may have been compromised. .

2. Post-Examination

To the best of my knOW~dge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of I 'B -lif of From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1) DATE DATE NOTE

ES-201, Page 27 of 28

'1 :l..

)

r )

)

..., l) )

)

L )

, • ...•

.'

£~W1r:====--------------~~~~~~~---------------- --.Examination Securitt Agreement Form ES-201.:!

1. f.re'E~ml~t{oJl

I ack.nowt~e that I have acquirf~d S . 1I !!/f~ {fl.,>, d t of my signature. I a ree that J will n pacla ~ed k"?wledge a~out the NRC ticensillg examinations scheduled for the week(s} of ~ ~s. of iM 3 iii NRC chief examiner9 I d ot knoWIngly divulge any mformation aoout these examinations to any per&ons who have not been aurhonzed by the these licensing e);a~i utjn er$tand that I am nO,t to fnstruct. evatuate, or provide performance feedback to those app~c:ants schedufed to be admlnistered {e.g., ac~ing as a Sjm:':to~':o:om thIs date untIl com~letion ?( exan1inatio~ administration, except as specifically n.oted below and a~tholized by ~e .NRC teedbacl(). Furthermo I th operator Of co~muntcato( IS a~eptable rf the imfNidual does not select the training content or provIde direct or mdlrect IJnde(stand that lJiOlati~; :::: aware. of the ph~slcal security' measures and requirements (as qocumented In the facility licensee's procedures) alld the facility licen$e:e I vvill~ e ~?~d:tJOf'lS of 'hIs agreement may result in cancellation of the examinations arullor an enforcement action agai nst me o.t may have been co~prQmi:~e la e y report to facility management Of the NRC chief examiner any indications or sU9gestions that e:<arllinatiQn secunty

2. Post.Exami~ation

~urll1g the week(s} of I ~ _I l"'i F at divulge to any unauthoflzed persons any Information ("...oncernir'lg the NRC licensing examlOatrons a~mlnrst~red To !he best Qr my knO~~dge~ dig n . ., .' ' ..

Instruct. evaluate or provide ~ r()m the date that f entered into this S€<;urity agreement untit the completion of examination administration, I dId not bet(1Wand authorized by the ~~;rm3nce f~edback to those applicants who were administered these 'icens~n9 examinations. except as spedfic:;aUy noted

% .\

~ I,

~ .~

r

~: ~:w:-= ../J/ ~.::5t';Z=fWii~rv

PRINTEO NAME

1. _ !t,.;ut =r. iAkJ~ _ -~~~~il,;--~-=", ~. ~Z1i?e!;~~~ ;..:Jkj~~~~~ <\.-.J"~ .J., 5. 7#;rtist41 4.];~tL= ~,. t::....J.;).;.~::s.::::..-__

JOB TITLE I RESPONSIBILITY SIGNATURE (1) '1 "p,

.'l

6. .J c.rH~ACA-~ J/tVI7. tfl'U><A-t~

~: ~I}ii::;~ 6rti ff!:r;;l rd.utL=~~~Z~ ;~:m'dd is!1:~ t1(W;6<'L, ____

12·t~ ~ :t%c";: = ~~:ttiiiit;t,if; = i¥~~~Jl\td.t .15'-441AzL.:M ';}wu;:iJ;i:ZU;;;;;;;: ~;;W NOTES: J

~l'

(i) ..t'l L "T1" >I .)., 1<1 ;:;o.)t

E5-201. Page 27 of 28

(\J lSI

Q..

Rl ..-j

f") Ii) .-l CD CD CD .-l ['-. 1(1 " ~,

ie,

"f ro ..-j

en

o I--

2 z IT 0::: t-V) (l.. o

IT: P4

a IL LL

n r ,J IS' .-4

CD IS) o [\l , Q

~'l I

u W Q

"

ES·201 Examination Security Agreement Form ES-201-3,

1, Pre,Examination

I acknowledge lhat J have aoquired spec1alized knowtedge about the NRC licensing eKaminations scheduled for the week{s) of rfo~ 1¢5as of the date of my signature, t agree that I wi~1 not knowinglv dilfulge any information about these examinaHons to any persons who have not been authorized by the NRC chief examiller. I understandtnat I am nol I(} instruct, evaluate, or provide periormance feedback to those applicants scheduled to be administered these licensing elCaminations from this dale until oomp'e1ion of e)(amiriation administralloJ'l, excepl as specifically noted below and authorized by the NRC (e.g" acting as a simulator booth operator or commurlicatGr is acceptable if the individual doer. not select the training content or provide direcj or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures} and understal\d that violatLon of the conditions of this agreement may result in canc.ellatl<'li) oHhe examinalions and/or an enforcement action a~ainst me Of the facility licensee. I will immediately repmi to facility management or the NRC chief examiner any indicallons or suggestions that €xaminati()J) securjty may hava been compromised.

2. Po:st·Exartl i nation

To the best of my kf10V~:tge¥di~ not divulge to any unauthorized persons any information cormerning the NRC licensing examinations administered during the weekes) of I 'B-l 'i'i From the date that I entered into this security agreement until the complenon of examlna!ion administration, 1 did not instruct evaluate. or provlde performance feedback 10 those applicants who were administered these licensing e)(aminations, except as specifically nr>1ed below and authorized by the NRC,

PRINTED NAME JOB TITLE I RESPONSIBILITY

1. ({~{Ly :r. {t\JL\.l.t 2. T'':Ff~,'f!.IJA..ucF,,· ~ U.,..,.q l.W0 6f,.

3. ??hl1b CJ2~ Q~ 4 ... H~ .J"'I11\.~ 5. A1if'bti·"l4·JhlP.!r tAn .. + ()pv-s{ric':

6. ....Jifr:-f-~~~~ fLAil; tJfCPUM<M...... _ 7. )2~fl ? rl-1 ot>EPA-1~1rJN rW0 M6rZ:Z~: 6. 1iiiliD __ ..L_ O?".<t{,-Ol1's' /'

~o.1LJ,%rn~'U' ltt« t4p.,,;1.6tY- ~ 11. ~~ ...... h~c£r/Yv.-r;~,;:L/--=..-' ____ _

12. ~' ~~:~~~ ~ .. .-.vlr .:r:-=,·wf .... ,,<C h. c 13. ~~If.~_. ~ w~ .. .., --:=;C==N~du .. ~l,.I.i.,;k~£=--_~ __ 14._ l)~~ .s.I~a~ 11\tdt. • ~5. 5i4~7'df~ .£rt;7&?uttt1C.l£ ~_ NOTES:

(:0 .J.t.,L./ T, ~ \',,~. >: s:

SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE

;:y: Ja #'l£ ~ __

....,.."...., ... 0 ;;;r;;,t., - , £/10,/ o'il (2) ,..---------------

""'----- J.k2!1~ ~tJll,rtt!t8 w~- ~¢{ifM'! .

.. ~' ----:.JiT/VIl ___ _

ES-201, Page 27 of 28

N &

D...

..J CI t-0 t-

,....

"" " ~ 0 "

"" 0 0 00

>-3 c:: t'Il ,.... ~

0 >I'>

>-r:I > H

00 >I'> ~

00 01 ~l

,.... 00 00 00

::0 o to >-< Z w o z ;3 > >-< z >-< z Cl

[§J o o

""

ES-301 Control Room/ln Plant Systems Outline Form ES-301-2

'acility: BFN (NRC EXAM) Exam Level RO / &0-1 / SRO-U

Date of Examination: 12/08/08 o Test Number: HL TO?O?

Control Room Systems (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U, including 1 ESF)

Safety System / JPM Title Type Code* Function JPM Number

A. SLC Injection - Faulted - RWCU fails to isolate 1M

C. Emergency Venting Primary Containment - Faulted EOI 295024EA 1.1

K. Place 4kv SID bd 250v Battery Charger I/S -Faulted - voltage unstable (0-01-570)

K1. IN-PLANT C

ANELS

ADELS

ANL

3

4

6

55F-U2

201F-U2 401F-U3

115F-U2

All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

*Type Codes Criteria for RO / SRO-I / SRO-U

(A)lternate Path 4-6 / 4-6 / 2-3 (C)ontrol Room (D)irect from bank ::;9 / ::;8 / ::;4 (E)mergency or abnormal in-plant 2::1 / 2::1 / 2::1 (EN)gineered Safety Feature / / 2::1 (control room system) (L)ow-Power / Shutdown 2::1 / 2::1 / 2::1 (N)ew or (M)odified from bank including 1 (A) 2::2 / 2::2 / 2::1 (P)revious 2 exams ::;3 / ::;3 / ::;2 (randomly selected) (R)CA 2::1 / 2::1 / 2::1 Simulator

ES-301 Operating Test Quality Checklist (Final) Form ES-301-3

Facility: Browns Fer!y Date of Examination: 12108/2008 Operating Test Number: HL T 0707

1. GENERAL CRITERIA Initials

a b* c#

a. The operating test conforms with the previously approved outline; changes are consistent with

I~ 1l .tt sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).

b. There is no day-to-day repetition between this and other operating tests to be administered during

~ ~ lit this examination.

c. The operating test shall not duplicate items from the applicants' audit test(s)(see Section D.1.a). filN) 4 Itt d. Overlap with the written examination and between different parts of the operating test is within

1iI9 ~ J,t acceptable limits.

e. It appears that the operating test will differentiate between competent and less-than-competent

aufJ. ~ /;t applicants at the designated license level.

2. WALK-THROUGH CRITERIA -- -- --

a. Each JPM includes the following, as applicable: • initial conditions • initiating cues • references and tools, including associated procedures • reasonable and validated time limits (average time allowed for completion) and specific

designation if deemed to be time critical by the facility licensee • operationally important specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature - system response and other examiner cues - statements describing important observations to be made by the applicant - criteria for successful completion of the task - identification of critical steps and their associated performance standards - restrictions on the sequence of steps, if applicable

it U 1J. b. Ensure that any changes from the previously approved systems and administrative walk-through

outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified

~ It on those forms and Form ES-201-2. ~ 3. SIMULATOR CRITERIA -- -- --

The associated simulator operating tests (scenario sets) have been reviewed in accordance with

~ ~ ~t Form ES-301-4 and a copy is attached.

i~~~~ture Date

a. Author Robert M. SpadOni ~-J"1lIl ~ 12/1/2008

b. Facility Reviewer (*) E Robert Scillian :c k::2::1- Z 1'./ ~ 12/1/2008

c. NRC Chief Examiner (#) Ed".4.JiF? ~ (;d-. .fr.... / fJ.l. . J ~ 0,. IZL3h.DPF / / A /. 1!".

I I

d. NRC Supervisor ~f>W-"f" •. v.A·,.,~ • .L.I,," /Y.JIiIiiM.I'( 'lJ}..JI /2/6'1/g1 / ~ II

NOTE: * The facility signature is not applicable for NRC-developed tests # Independent NRC reviewer initial items in Column "c"; chief examiner concurrence is required.

ES-301, Page 24 of 27

ES-301 Simulator Scenario Quality Checklist (Final) Form ES-301-4

Facility: Browns Ferry Date of Exam: 12/0B/200B Scenario Numbers: 3-6/3-5/3-7/3-B_ Operating Test Number: HL T 0707

Initials QUALITATIVE ATTRIBUTES

a b* c#

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of <

~ ~ 1;/ service, but it does not cue the operators into expected events.

2. The scenarios consist mostly of related events. ~ ,~ /J -3. Each event description consists of

• the point in the scenario when it is to be initiated

• the malfunction(s) that are entered to initiate the event

• the symptoms/cues that will be visible to the crew

• the expected operator actions (by shift position)

~ • the event termination point (if applicable) ~ 4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario

l;u ~t without a credible preceding incident such as a seismic event. ~ 5. The events are valid with regard to physics and thermodynamics. i41JJ 4A It

--6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives. ~ M --tt

7. If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints.

I~ ~ .tt Cues are given.

B. The simulator modeling is not altered. I~ ~ £/ 9. The scenarios have been validated. Pursuant to 10CFR55.46(d), any open simulator

performance deficiencies or deviations from the referenced plant have been evaluated wJ 141 ~i to ensure that functional fidelity is maintained while running the planned scenarios.

10. Every operator will be evaluated using at least one new or significantly modified scenario.

M I~ til All other scenarios have been altered in accordance with Section D.5 of ES-301.

11. All individual operator competencies can be evaluated, as verified using Form ES-301-6

~ ~ 1:} (submit the form along with the simulator scenarios).

12. Each applicant will be significantly involved in the minimum number of transients and events 1l/iJ ~ ,lj speCified on Form ES-301-5 (submit the form with the simulator scenarios).

13. The level of difficulty is appropriate to support licensing decisions for each crew position. IfMJ -M .Ji Target Quantitative Attributes (Per Scenario; See Section D.S.d) Actual Attributes -- -- --

Scenario Order: 3-6 I 3-5 I 3-7 I 3-8 lat i -- -- --1. Total malfunctions (5-B) 10/5/81719 ~ ~ L-i 2. Malfunctions after EOP entry (1-2) 4/1/411/3 ItiM ~ ,,;;,7 3. Abnormal events (2-4) 3/2/2/3/2 "1iJ ~ ~j 4. Major transients (1-2) 1/1/2/3/2 ~ I~ IJ;t 5. EOPs entered/requiring substantive actions (1-2) 3/3/2/2/3 .~ I~ ltt 6. EOP contingencies requiring substantive actions (0-2) 1/1/0/2/2 ~ 1;tL{ ..ti-7. Critical tasks (2-3) 3/3/3/4/3 ~ I~ .-btl

ES-30 1, Page 25 of 27

ES-301 Transient and Event Checklist Form ES-301-5 (Final)

( : Browns Ferry Date of Exam: 12/08/2008 Operating Test Number: HL T 0707

A E Scenarios P V P E HLTS3-6 HL TS3-5 HL TS3-7 HLTS3-8 T M L N 0 I I T T N C CREW CREW CREW CREW A I A T POSITION POSITION POSITION POSITION L M N Y

~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ U T P E 0 C P 0 C P 0 C P 0 C P

M(*)

R I U

RO RX 2 1 2 1 ["t) 0 0 SRO-I NOR 1 1 ·······1:: 1 [g'J I/C

r---3,4,5 2,4,5 3 4 2 SRO-U ,6,7

0 MAJ 8 6 6,7 2 1

TS 3,4,6 2,3,4 0 2 7

RO RX 2 1 2 1 1 ~ 0 SRO-I NOR 1 1 1 I'

0 I/C 1

364 75 2,4,5 3,4 4 4 SRO-U

[g'J #1 MAJ 8 6 6,7 2 2

TS 3,4,6 2,3,4 2,4 0 2 7

RO RX 2 1 2 1 1 0 SRO-I NOR 1 1 1 ..... ',

,

0 I/C 13 64 i 2,4,5 3,4 4 4 SRO-U ." [g'J #2 MAJ 8 6 6,7 2 2

~ TS 3,4,6 2,3,4 2,4 0 2 7

RO RX 1 1 0 0 SRO-I NOR 1 1 1 0 I/C 4 4 2 SRO-U 0 MAJ 2 2 1

TS 0 2 2

Instructions:

1. Check the afglicant level and enter the operating test number and Form ES-D-1 event numbers for each event tyge; are not a~licable for RO applicants. ROs must serve in both the "at-the-controls (ATC)" and "ba ance-of-rlant (B P)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at leas two instrument or component (I/C) malfunctions and one major transient, in the ATC ~osition. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited oward the two I/C malfunctions required for the ATC position.

2. Reactivi~ manipulations may be conducted under normal or controlled abnormal conditions (refer to Section .5.d) but must be significant per Section C.2.a of Appendix D. P Reactivity and normal evolutions may be replaced with additional instrument or component mal unctions on a 1-for-1 basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's comcetence count toward the minimum requirements specified for the applicant's license level in he right-hand columns.

ES-301, Page 26 of 27


Facility: Browns Ferry Date of Exam: 12/08/2008 Operating Test Number: HL T 0707

A E Scenarios P V P E HLTS3-6 HLTS3-5 HLTS3-7 HLTS3-8 T M L N 0 I I T T N C CREW CREW CREW CREW A I A T POSITION POSITION POSITION POSITION L M N Y S A B S A B S A B S A B U T P R T 0 R T 0 R T 0 R T 0 M(*) E 0 C P 0 C P 0 C P 0 C P

R I U

RO RX 2 1 0 ~#1 SRO-I NOR 1 1 1 1

D I/C 3,5 2,4,5 4 2 SRO-U D MAJ 8 6 2 1

TS 2 2

RO RX 5 1 0 ~#2 SRO-I NOR 1 1 1 D IIC 4,6,7 2,4 4 2 SRO-U D MAJ 8 6 2 1

TS 2 2

RO RX 2 1 0 ~#3 SRO-I NOR 1 1

1 __ 1 1

D I/C 3,5 2,4,5 4 2 SRO-U D MAJ 8 6 2 1

ITS 2 2

IRO RX 5 1 0 ~#4 SRO-I NOR 1 1 1 D I/C 4,6,7 2,4 4 2 SRO-U ':,

D MAJ 8 6 2 1

TS 2 2

Instructions:

1. Check the afElicant level and enter the operating test number and Form ES-D-1 event numbers for each event tyge; are not a~licable for RO applicants. ROs must serve in both the "at-the-controls (ATC)" and "ba ance-of-rlant (B P)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at leas two instrument or component (I/C) malfunctions and one major transient, in the ATC Pc0sition. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited oward the two IIC malfunctions required for the ATC position.


3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's com8etence count toward the minimum requirements specified for the applicant's license level in he right-hand columns.

ES-301, Page 26 of 27


lity: Browns Ferry Date of Exam: 12/08/2008 Operating Test Number: HL T 0707

A P V P E L N I T C A T N Y S T P R E 0

RX [gI #5

NOR SRO-I 0 I/C SRO-U 0 MAJ

TS

HLTS3-6

CREW POSITION

A B T 0 C P

2

1

3,5

8

HLTS3-5

CREW POSITION

S A B R T 0 o C P

1

2,4,5

6

5

1

4,6,7 2,4

8 6

2

1 1

3,5 2,4,5

8 6

5

1

4,6,7 2,4

8 6

Scenarios

HLTS3-7

CREW POSITION

S A B R T 0 o C P

S R 0

HLTS3-8

CREW POSITION

A B T 0 C P

T M 0 I T N A I L M

U M(*)

4

2

2

4

2

2

4

2

2

1

4

2

2

Instructions:

1.

2.

3.

Check the ap(Jlicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not apJllicable for RO applicants. ROs must serve in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one IIC malfunction can be credited toward the two I/C malfunctions required for the ATC position.

Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basis.

Whenever practical both instrument and component malfunctions should be included; only those that require verifiab(e actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.

ES-301, Page 26 of 27

U

0

1

2

2

0

2

2

0

2

2

0

2

2


Facility: Browns Ferry Date of Exam: 12/08/2008 Operating Test Number: HL T 0707

A E Scenarios P V P E HLTS3-6 HLTS3-5 HLTS3-7 HLTS3-8 T M L N 0 I I T T N C CREW CREW CREW CREW A I A T POSITION POSITION POSITION POSITION L M N Y S A B S A B S A B S A B U T P

E R T 0 R T 0 R T 0 R T 0 M(*) 0 C P 0 C P 0 C P 0 C P

R I U

'RO RX 2 2 1 0 ~#9 SRO-I NOR 1 1 1 D IIC 3

4,5,6 4 2 SRO-U 7

D MAJ 6,7 8,9 2 1

TS 2 2

RO RX 3 1 0 ~#10 SRO-I NOR 1 1 1 D I/C 4,8 4,5 4 2 SRO-U D MAJ 6,7 8,9 2 1

TS 2 2

~O RX 1 1 0

SRO-I NOR 1 1 1 D I/C 4 4 2 SRO-U D MAJ 2 2 1

TS 0 2 2

RO RX 1 1 0 D SRO-I NOR 1 1 1 D I/C 4 4 2 SRO-U D MAJ 2 2 1

TS 0 2 2

Instructions:

1. Check the a.p~licant level and enter the operating test number and Form ES-D-1 event numbers for each event tYFee; are not a~licable for RO applicants. ROs must serve in both the "at-the-controls (ATC)" and "ba ance-of-flant (B P)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at leas two instrument or component (I/G) malfunctions and one major transient, in the ATC Pc0sition. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited oward the two I/C malfunctions required for the ATC position.


3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's comcetence count toward the minimum requirements specified for the applicant's license level in he right-hand columns.

ES-301, Page 26 of 27

ES-301 Competencies Checklist (Final) Form ES-301-6

Facility: Browns Ferry Date of Examination: 12/08/2008 Operating Test No.: HLT 070

APPLICANTS

Competencies

Interpret! Diagnose Events and Conditions Comply With and Use Procedures Operate Control Boards (2) Communicate and Interact Demonstrate Su Abi Comply With and Use Tech Specs. (3)

Notes:

RO SRO-I SRO-U

7,8 5,6

8 2

7,8 2

7 5,6

RO SRO-I SRO-U1

(1) Includes Technical Specification compliance for an RO. (2) Optional for an SRO-U. (3) Only applicable to SROs.

Instructions:

RO SRO-I SRO-U2

RO SRO-I SRO-U

Check the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate evelY applicable competency for evelY applicant.

ES-301, Page 27 of 27

( ES-301

Facility: Browns Ferry

Competencies

Interpret! Diagnose Events and Conditions Comply With and Use Procedures (1 Operate Control Boards Communicate and Interact Demonstrate Supervisory Ability (3) Comply With and Use Tech Specs. (3)

Notes:

Competencies Checklist (Final)

Date of Examination: 12/08/2008

RO 1 SRO-I 0 SRO-U 0 SCENARIO 124

3,5 2,5,6

123 1,2,4 " ,5,6

1,2,3 1,2,4 ,7 ,5,6

358 1,2,4 " ,5,6

R02 SRO-I 0 SRO-U 0 SCENARIO

1 2 3 4


Instructions:

Form ES-301-6

Operating Test No.: HL T 0707

R03 SRO-I 0 SRO-U 0 SCENARIO 124

R04 SRO-I 0 SRO-U 0 SCENARIO

1 2 4

Check the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

ES-301, Page 27 of 27

ES-301


Competencies

Interpret! Diagnose Events and Conditions Comply With and Use Procedures (1) Operate Control Boards (2) Communicate and Interact Demonstrate Supervisory Ability (3) Comply With and Use Tech Specs. (3)

Notes:




Instructions:

Form ES-301-6

Operating Test No.: HLT 0707

Check the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate eve/}' applicable competency for eve/}' applicant.

ES-30 1, Page 27 of 27

ES-301


Competencies

InterpreU Diagnose Events and Conditions Comply With and Use Procedures Operate Control Boards Communicate and Interact

Notes:




Instructions:

Form ES-301-6

Operating Test No.: HLT 0707

RO SRO-I D SRO-U D SCENARIO

Check the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate evel)l applicable competency for evel)l applicant.

ES-301, Page 27 of 27

I E8-401 R , ev. 9 BWRE xamma ti on o tf" u Ine F orm ES-401 1l -I

Facility: Date of Exam:

I RO KIA Category Points SRO-Only Points

Tier Group

I K K K K K K A A A A G A2 G* Total 1 2 3 4 5 6 1 2 3 4 * Total I

1. 1 3 3 3 4 3 4 20 3 4 7 I Emergency &

2 1 1 1 2 1 1 7 1 2 3

I Abnormal Plant N/A N/A Evolutions Tier Totals 4 4 4 6 4 5 27 4 6 10

1 2 1 2 2 3 2 3 2 3 3 3 26 2 3 5

2. 1 1 1 1 1 1 1 1 1 2 1 12 1 2 3 Plant

2

Systems Tier Totals 3 2 3 3 4 3 4 3 4 5 4 38 3 5 8

3. Generic Knowledge and Abilities 1 2 3 4 10 1 2 3 4 7 Categories 2 3 2 3 2 2 1 2

1. Ensure that at least two topics from every applicable KIA category are sampled within each tier ofthe RO and SRO-only outlines (i.e., except for one category in Tier 3 ofthe SRO-only outline, the ATier Totals@

in each KIA category shall not be less than two).

2. The point total for each group and tier in the proposed outline must match that specified in the table. The final point total for each group and tier may deviate by 1;t1 from that specified in the table

I based on NRC revisions. The final RO exam must total 75 points and the SRO-only exam must total 25 points.

3. Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do

not apply at the facility should be deleted and justified; operationally important, site-specific systems that are

not included on the outline should be added. Refer to ES-401, Attachment 2, for guidance regarding

the elimination of inappropriate KIA statements.

4. Select topics from as many systems and evolutions as possible; sample every system or evolution

in the group before selecting a second topic for any system or evolution.

5. Absent a plant-specific priority, only those KIAs having an importance rating (IR) of 2.5 or higher shall be

selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.

6. Select SRO topics for Tiers 1 and 2 from the shaded systems and KIA categories.

7. *The generic (G) KIAs in Tiers 1 and 2 shall be selected from Section 2 of the KIA Catalog, but the topics

must be relevant to the applicable evolution or system.

8. On the following pages, enter the KIA numbers, a brief description of each topic, the topics= importance

ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter

the group and tier totals for each category in the table above; iffuel handling equipment is sampled in other

than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note

# 1 does not apply). Use duplicate pages for RO and SRO-only exams.

9. For Tier 3, selecttopics from Section 2 ofthe KIA catalog, and enter the KIA numbers, descriptions, IRs,

and point totals (#) on Form ES-401-3. Limit SRO selections to KIAs that are linked to 10 CFR 55.43.

ES-401. REV 9

KA NAME I SAFETY FUNCTION:

295001AK1.03

295003AK1.02

295004AA2.03

295005AA2.04

295006AK1.03

Partial or Complete Loss of Forced Core Flow Circulation 11 & 4

Partial or Complete Loss of AC 16

Partial or Total Loss of DC Pwr 16

Main Turbine Generator Trip 13

SCRAM I 1

295016G2.4.41 Control Room Abandonment 17

295018AK2.01 Partial or Total Loss of CCW ! 8

T1G1 BWR EXAMINATION OUTLINE

IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G

RO SRO

3.6 4.1 ~ [] D D D D D D D D D Knowledge of the operational implications of the following concepts as they apply to the (ABNORMAL PLANT EVOLUTION):(CFR: 41.8 to 41.10/45.3)

3.1 3.4 Vi D D D D D D D D D Knowledge of the operational implications of the following concepts as they apply to the (ABNORMAL PLANT EVOLUTION):(CFR: 41.8 to 41.10! 45.3)

FORM ES-401-1

TOPIC:

Thermal limits ....................................... .

Load shedding ........................................ .

---------2.8 2.9 D D D D D D ~ [] D D Battery voltage ...................................... .

Ability to determine and interpret the following as they apply to ABNORMAL PI-ANT EVOLUTION):(CFR: 41.10/43.5/45.13)

3.7 3.8 LJ D D D D D D ~ D D D Ability to determine and interpret; the following as they apply to ABNORMAL PLANT EVOLUTION):(CFR: 41.10/43,5/45.13)

3.7 D[]DC] [I Knowledge of the operational implications of the following concepts as they apply to the (ABNORMAL PLANT EVOLUTION):(CFR: 41.8 to 41.10! 45.3)

2.9 4.6 D D D D 0 ~

This is a Generic, no stem statement is associated.

3.3 3.4 11 ~ D D [J D D D D D D Knowledge of the interrelations between (ABNORMAL PLANT EVOLUTION) and the foliowing:(CFR: 41.7/45.7/45.8)

Page 1 of 3

Reactor pressure ..................................... .

Reactivity control.. ................................. .

Knowledge of the emergency action level thresholds and classifications.

System loads ......................................... .

3/28/2008 10:30 PM

ES-401, REV 9


295019AA 1.04 Partial or Total Loss of Inst. Air 18

295021 G2.2.36 Loss of Shutdown Cooling I 4

295023AK3.03 Refueling Acc Cooling Mode f 8

~s

295024EA1.07 High Drywell Pressure / 5


IR K1 K2 K3 K4 KS K6 A1 A2 A3 A4 G

RO SRO

3.3 3.2 !! [] 0 0 0 0 ~ 0 0 0 0 Ability to operate and I or monitor the following as they apply to (ABNORMAL PLANT EVOLUTION):(CFR: 41.7 14S.S f 45.6)

3.1 4.2 i i 0 0 0 [J [] 0 0 0 0 ~ This is a Generic, no stem statement is associated.

FORM ES-401-1

TOPIC:

Service air isolations valves: Plant-Specific ....... .

Ability to analyze the effect of maintenance activities, such as degraded power sources, on the status of limiting conditions of operations

-----~-----~~- --------3.3 3.6 L. . ...l o 0 0 0 Ventilation isolation ................................ .

Knowledge of the reasons for the following responses as they apply to (ABNORMAL PLANT EVOLUTION):(CFR: 41.S/41.10 I 45.6/45.13)

3.8 3.9 0 0 0 0 0 0 ~ 0 0 0 0 Ability to operate and I or monitor the following as they apply to (EMERGENCY PLANT EVOLUTION):(CFR: 41.7/45.5/ 45.6)

PCIS/NSSSS ........................................... .

29S02SG2.1.31 High Reactor Pressure 4.6 4.3 r·.... :'''-'1 r"-l · .. ··1 II i-II II r·····1 II 1;;/1 Ability to locate control room SWitches, controls and

295026EK3.01 Suppression Pool High Water Temp. IS


3.8 4.1 LJ 0 ~ 0 0 0 0 0 0 0 Knowledge of the reasons for the following responses as they apply to (EMERGENCY PLANT EVOLUTION):(CFR: 41.5 f 41.10 / 45.6/45.13)

Page 2 of 3

indications and to determine that they are correctly reflecting the desired plant lineup.

Emergency/normal depressurization .................... .

3/28/2008 10:30 PM

ES-401, REV 9


295028EK2.03

295030EA2.03

295031 EK3.01

295037EA 1 .04

295038EK2.03

600000AA1.01

High Drywell Temperature / 5

Low Suppression Pool Wlr Lvl/5

Reactor Low Water Levell 2

SCRAM Condition Present and Power Above APRM Downscale or Unknown 11

High Off-site Release Rate 19

5'(0 Plant Fire On Site / 8


IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G

RO SRO

3.6 3.8 il ~ 0 0 0 0 0 0 0 0 Knowledge of the interrelations between (EMERGENCY PLANT EVOLUTION) and the foliowing:(CFR: 41.7 /45.7/45.8)

FORM ES-401-1

TOPIC:

Reactor water level indication ....................... .

3.7 3.9 [J[] DO ~ 0 [] [J Reactor pressure ..................................... .

Ability 10 determine and interpret the following as they apply to (EMERGENCY PLANT EVOLUTION):(CFR: 41.10/43.5145.13)

3.9 4.2 L! 0 ~ 0 0 0 0 0 0 0 Knowledge of the reasons for the following responses as they apply to (EMERGENCY PLANT EVOLUTION):(CFR: 41.5/ 41.10 I 45.6145.13)

4.5 4.5 LJ 0 0 0 0 0 ~ 0 0 0 0 Ability to operate and I or monitor the following as they apply to (EMERGENCY PLANT EVOLUTION):(CFR: 41.7145.5 / 45.6)

3.6 3.8 ~ 0 I] [] [J [] IJ [] [] Knowledge of the interrelations between (EMERGENCY PLANT EVOLUTION) and the foliowing:(CFR: 41.7 [ 45.7 [ 45.8)

3.0 2.9 0 0 0 ~ 0 [J 0 0 Ability to operate and I or monitor the following as they apply to (ABNORMAL PLANT EVOLUTION):(CFR: 41.7/45.51 45.6)

Automatic depressurization system actuation .......... .

SBLC ................................................. .

Plant ventilation systems ............................ .

Respirator air pack

700000G2.4.34 Generator Voltage and Electric Grid 4.2 4.1 l __ iOOOOOf-l[] O~ Knowledge of RO tasks performed outside the main control room during an emergency and the resultant operational effects

Distrurbancecs This is a Generic, no stem statement is associated.

Page 3 of3 3/28/2008 10:30 PM

ES-401, REV 9


295008AK3.04 High Reactor Water Level! 2

295009AK2.02 Low Reactor Water Level 12

295012AK1.02 High Drywell Temperature 15

295020AA1.01 Inadvertent Cont. Isolation 15 & 7

295034EA1.03 Secondary Containment Ventilation High Radiation / 9

"7 295035EA2.02 Secondary Containment High

Differential Pressure I 5

(p~


IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G

RO SRO

3.3 3.5 0 ~ 0 0 0 0 0 0 0 0 Knowledge of the reasons for the following responses as they apply to (ABNORMAL PLANT EVOLUTION):(CFR: 41.5/41.101 45.6145.13)

3.9 3.9 [;2] 0 0 0 0 0 0 0 0 Knowledge of the interrelations between (ABNORMAL PLANT EVOLUTION) and the foliowing:(CFR: 41.7/45.7/45.8)

FORM ES-401-1

TOPIC:

R~actor feed pump trip: Plant-Specific ............. ..

Reactor water level control ......................... ..

------------------.------------- --3.1 3.2 ~ o 0 0 0 0 0 Reactor power level control.. ........................ .

Knowledge of the operational implications of the following concepts as they apply to the (ABNORMAL PLANT EVOLUTION):(CFR: 41.8 to 41.10 145.3)

3.6 3.6 ! i 0 0 0 0 ~ 0 0 0 0 Ability to operate and 1 or monitor the following as they apply to (ABNORMAL PLANT EVOLUTION):(CFR: 41.7/45.51 45.6)

4.0 3.9 0 II [] [] ~ 0 0 [] Ability to operate and I or monitor the following as they apply to (EMERGENCY PLANT EVOLUTION):(CFR: 41.7 145.5 / 45.6)

2.8 4.1 0 0 0 0 ~ 0 0 Ability to determine and interpret the following as they apply to (EMERGENCY PLANT EVOLUTION):(CFR: 41.10/43.5/45.13)

Page 1 of 2

PCIS/NSSSS ........................................... .

Secondary containment ventilation .................... .

Off-site release rate: Plant-Specific .............. ..

3/2812008 10:30 PM

ES-401, REV 9

KA NAME f SAFETY FUNCTION:

295036G2.4.34 Secondary Containment High Sump/Area Water Level/5

~'5'


IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G

RO SRO

4.2 4.1 n [] D D D DOD D D ~ This is a Generic, no stem statement is associated.

Page 2 of 2

FORM ES-401-1

TOPIC:

Knowledge of RO tasks performed outside the main control room during an emergency and the resultant operational effects

3/28/2008 10:30 PM

ES-401, REV 9


203000G2.4.20 RHR/LPCI: Injection Mode


205000A3.02 Shutdown Cooling

205000A3.03 Shutdown Cooling


IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G

RO SRO

3.8 4.3

4.2 4.1

3.2 3.2

DDDDDDDDDD~ This is a Generic, no stem statement is associated.

LJuDD[][]D[] []~

This is a Generic. no stem statement is associated.

DDDDDDDD~DD Ability to monitor automatic operations of the (SYSTEM) including:(CFR: 41.7 /45.5)

3.5 3.3 D D D [J 0 0 ~ 0 0 Ability to monitor automatic operations of the (SYSTEM) including:(CFR: 41.7 145.5)

FORM ES-401-1

TOPIC:

Knowledge of operational implications of EOP wamings, cautions and notes.

Knowledge of RO tasks performed outside the main control room during an emergency and the resultant operational effects

Pump trips

Lights and alarms

206000A2.04 HPCI 2.7 3 0 0 0 0 0 0 0 ~ 0 0 0 A.C. failures: BWR-2,3,4

209001 K1.13 LPCS

Ability to (a) predict the impacts of the following on the (SYSTEM) and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal operation:(CFR: 41.5/43.51 45.31 45.13)

2.8 3.0 ~ 0 LJ 0 0 0 0 0 0 Knowledge of the physical connections andlor cause-effect relationships between (SYSTEM) and the foliowing:(CFR: 41.2 to 41.9/45.7 to 45.8)

Page 1 of 4

Leak detection

3/28/2008 10:30 PM

ES-401, REV 9


211000K6.04 SLC

212000A 1.06 RPS

212000KS.01 RPS

215003G2.4.8 IRM

21S004A2.02 Source Range Monitor

21S005K2.02 APRMI LPRM



RO SRO

2.7 2.8 i [ 0 0 0 0 ~ U 0 0 0 0 Knowledge of the effect that a loss or malfunction of the following will have on the (SYSTEM):(CFR: 41.7/45.7)

FORM ES-401-1

TOPIC:

Core spray system: Plant-Specific

-------- ... _-4.2 4.2 o [] 0 [J [ill o 0 Reactor power

2.7 2.9

Ability to predict and/or monitor changes in parameters associated with operating the (SYSTEM) controls including:(CFR: 41.SI 45.S)

oo~o DO o Knowledge of the operational implications of the following concepts as they apply to the (SYSTEM):(CFR: 41.S' 45.7)

3.8 4.S 0 0 0 0 0 0 ~


3.4 3.7 i [ 0 0 0 0 [ill 0 0 0 Ability to (a) predict the impacts of the following on the (SYSTEM) and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal operation:(CFR: 41.5/43.51 4S.3/45.13)

2.6 2.8 ~ 0 0 0 0 0 0 0 0 0 Knowledge of electrical power supplies to the foliowing:(CFR: 41.7)

Page 2 of 4

Fuel thermal time constant

Knowledge of how abnormal operating procedures are used in conjunction with EOPs.

SRM inop condition

APRM channels

3/28/2008 10:30 PM

ES-401, REV 9


217000K3.04 RCIC

218000K6.03 ADS



RO SRO

3.6 3.6 ii D ~ D D D D D D D D

3.8 3.9

Knowledge of the effect that a loss or malfunction of the (SYSTEM) will have on the foliowing:(CFR: 41.7/45.6)

r·····1 LJ D[]~[]DDDD

Knowledge of the effect that a loss or malfunction of the following will have on the (SYSTEM):(CFR: 41.7/45.7)

223002K3.20 PCIS/Nuclear Steam Supply Shutoff 3.3 3.4 ~ D D D D D D

lti 239002A4.02 SRVs

239002A4.04 SRVs

259002A4.01 Reactor Water Level Control

261000K4.03 SGTS

Knowledge of the effect that a loss or malfunction of the (SYSTEM) will have on the foliowing:(CFR: 41.7/45.6)

3.6 3.7 !! DODOO~O Ability to manually operate and/or monitor in the control room:(CFR: 41.7/45.5 to 45.8)

4.3 4.3 0 [J DOD 0 0 0 ~ 0

3.8 3.6

Ability to manually operate and/or monitor in the control room:(CFR: 41.7/45.5 to 45.8)

[]l]O[]O[] lillO Ability to manually operate and/or monitor in the control room:(CFR: 41.7/45.S to 45.8)

2.S 2.7 0 ~ 0 0 0 0 0 0 Knowledge of (SYSTEM) design feature(s) and or interlock(s) which provide for the foliowing:(CFR: 41.7)

Page 3 of4

FORM ES-401-1

TOPIC:

Adequate core cooling

Nuclear boiler instrument system (level indication)

Standby gas treatment system

Tail pipe temperatures

Suppression pool temperature

All individual component controllers in the manual mode

Moisture removal

3128/2008 10:30 PM

ES-401, REV 9


262001 KS.01 AC Electrical Distribution

262002A 1 .02 UPS (AC/DC)

263000A1.01 DC Electrical Distribution

263000KS.01 DC Electrical Distribution

264000A3.05 EDGs

300000K4.02 Instrument Air

400000K1.03 Component Cooling Water



RO SRO

3.1 3.4 D D D ~ D DODD 0

2.S 2.9

Knowledge of the operational implications of the following concepts as they apply to the (SYSTEM):(CFR: 41.S / 45.7)

o DD~LI [J 0 Ability to predict and/or monftor changes in parameters associated with operating the (SYSTEM) controls including:(CFR: 41.S / 45.S)

2.S 2.8 0 D 0 ~ D 0 D Ability to predict and/or monHor changes in parameters associated with operating the (SYSTEM) controls including:(CFR: 41.5 / 45.5)

2.6 2.9 D DOD ~ DOD D D D

3.4 3.5

Knowledge of the operational implications of the following concepts as they apply to the (SYSTEM):(CFR: 41.5/45.7)

[J ~] [] [] Ability to monitor automatic operations of the (SYSTEM) including:(CFR: 41.7 / 45.5)

3.0 3.0 D ~ 0 DOD DOD Knowledge of (SYSTEM) design feature(s) and or interlock(s) which provide for the foliowing:(CFR: 41.7)

2.7 3.0 ~ [.1 D [] D [J 0 0 [J Knowledge of the physical connections and/or cause-effect relationships between (SYSTEM) and the foliowing:(CFR: 41.2 to 41.9/45.7 to 45.8)

Page40f 4

FORM ES-401-1

TOPIC:

Principle involved with paralleling two A.C. sources

Motor generator outputs

Battery charging/discharging rate

Hydrogen generation during battery charging .....

Load shedding and sequencing

Cross-over to other air systems

Radiation monitoring systems

3/2812008 10:30 PM

ES-401, REV 9


201001A2.04 CRD Hydraulic

201003A4.02 Control Rod and Drive Mechanism

201 006K5.1 0 RWM

_..... . ................. _--_._-_ ....... _. 202002A4.05 Recirculation Flow Control

226001 K2.02 RHR/LPCI: CTMT Spray Mode

233000A3.02 Fuel Pool Cooling/Cleanup

245000K4.05 Main Turbine Gen. I Aux.


IR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G

RO SRO

3.8 3.9 0 ClOD 0 0 0 ~ 0 0 0 Ability to (a) predict the impacts of the following on the (SYSTEM) and (b) based on those prediclions, use procedures 10 correcl, control, or mitigate the consequences of those abnormal operation:(CFR: 41.5! 43.5/ 45.3/45.13)

3.5 3.5 Lj 0 0 Ability to manually operate and/or monitor in Ihe control room:(CFR: 41.7/45.51045.8)

3.2 3.3 0 0 ~ 0 0 0 [J 0 0

3.4 3.4

2.9 2.9

Knowledge of the operational implications of the following concepts as they apply to the (SYSTEM):(CFR: 41.5/45.7)

nDDDDDDD[J~[J Ability to manually operate and/or monitor in the control room:(CFR: 41.7/45.5 to 45.8)

[I II Knowledge of electrical power supplies to the following:(CFR: 41.7)

2.6 2.6 U 0 0 0 0 0 [J [J ~ 0 0 Ability to monitor automatic operations of the (SYSTEM) including:(CFR: 41.7 145.5)

2.9 3.0 [J D ~ 0 0 [J D D D 0 Knowledge of (SYSTEM) design feature(s) and or interlock(s) which provide for the following:(CFR: 41.7)

Page 1 of 2

FORM ES-401-1

TOPIC:

Scram conditions

CRD mechanism position: Plant-Specific

Withdraw error: P-Spec(Not-BWR6)

Reactor level

Pumps

Pump tripes)

Turbine protection

3/28/2008 10:31 PM

ES-401, REV 9


2680ooK3.04 Radwaste

271000K6.02 Offgas

2880ooG2.2.44 Plant Ventilation

6(P

290001 A 1 .01 Secondary CTMT

37 290003K1.04 Control Room HVAC



RO SRO

2.7 2.8 D ~ D D D D D D D D Knowledge of the effect that a loss or malfunction of the (SYSTEM) will have on the foliowing:(CFR: 41.7/45.6)

3.0 3.2 [J [] [J ~ [] D D Knowledge of the effect that a loss or malfunction of the following will have on the (SYSTEM):(CFR: 41.7/45.7)

4.2 4.4 D D D D D D D D ~ This is a Generic, no stem statement is associated.

3.1 3.1 DOD 0 0 ~ 0 0 0 0

3.2 3.3

Ability to predict and/or monttor changes in parameters associated with operating the (SYSTEM) controls including:(CFR: 41.51 45.5)

!ill [J [J [] Knowledge of the physical con nections and/or cause-effect relationships between (SYSTEM) and the foliowing:(CFR: 41.2 to 41.9/45.7 to 45.8)

Page 2 of 2

FORM ES-401-1

TOPIC:

Drain sumps

Process radiation monitoring system

Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions

System lineups

Nuclear steam supply shut off system (NSSSS/PCIS): Plant-Specific

3/28/2008 10:31 PM

ES-401, REV 9

KA NAME / SAFETY FUNCTION:

G2.1.2 Conduct of operations


G2.2.17 Equipment Control



G2.3.15 Radiation Control

"1/ G2.3.4 Radiation Control

T3 BWR EXAMINATION OUTLINE

IR K1 K2 K3 K4 K5 KB A1 A2 A3 A4 G

RO SRO

3 4 n[JOOOOOOOO~

2.8 3.7 0 Ol]OCILJ[]btl

2.6 3.8 noD 0 0 0 0 0 0 ~

3.6 4.5 0 0 0 0 0 0 0 0 0 [i?J

-----------------2.9 3.6 [.J 0 0 0 0 0 0 0 [] ~

2.9 3.1 CI [] I:;{]

3.2 3.7 i! 0 0 0 0 0 0 0 0 ~

Page 1 of2

FORM ES-401-1

TOPIC:

Knowledge of operator responsibilities during all modes of plant operation.

Knowledge of the refueling processes

Knowledge of the process for managing maintenance activities during power operations.

Ability to determine Technical Specification Mode of Operation

Knowledge of the process for conducting special or infrequent tests

Knowledge of radiation monitOring systems

Knowledge of radiation exposure limits under normal and emergency conditions

3/28/2008 10:31 PM

ES-401, REV 9


G2.4.20 Emergency Procedures/Plans



T3 BWR EXAMINATION OUTLINE

IR K1 K2 K3 K4 K5 K6 A 1 A2 A3 A4 G

RO SRO

3.8 4.3 0 [] 0 0 0 0 0 0 0 0 ~

3.4 4.4 ["·····1 : ; O[]O[JOO[JO~

4.2 4.1 DO OOOOOO~

Page 2 of2

FORM ES-401-1

TOPIC:

Knowledge of operational implications of EOP warnings, cautions and notes.

Knowledge of the bases for prioritizing emergency procedure implementation during emergency operations.

Knowledge of annunciators alarms, indications or response procedures

3i2812008 10:31 PM

ES-401, REV 9


295001AA2.0S Partial or Complete Loss of Forced Core Flow Circulation 11 & 4

29S006G2.2.42 SCRAM 11

29S016G2.2.3 Control Room Abandonment 17

29S025G2.1.19 High Reactor Pressure 13

295038EA2.04 High Off-site Release Rate I 9

;5K.o :5' 600000AA2.07

700000G2.1 .23

Plant Fire On Site 1 8

Generator Voltage and Electric Grid Distrurbancecs

SRO T1G1 BWR EXAMINATION OUTLINE


RO SRO

3.1 3.4 il 0 0 0 0 0 0 ~ 0 0 0 Ability to determine and interpret the following as they apply to ABNORMAL PLANT EVOLUTION):(CFR: 41.10 143.S i 45.13)

3.9 4.6 r1 0 0 [J [J [J 0 0 [J 0 ~ This is a Generic, no stem statement is associated.

3.8 3.9 0 0 0 0 0 0 0 0 0 ~ This is a Generic, no stem statement is associated.

3.9 3.8 0 0 0 0 0 0 0 ~ This is a Generic, no stem statement is associated.

4.1 4.S LJ 0 0 0 0 0 0 ~ 0 0 0 Ability to determine and interpret the following as they apply to (EMERGENCY PLANT EVOLUTION):(CFR: 41.10 1 43.S/4S.13)

FORM ES-401-1

TOPIC:

Jet pump operability: Not-BWR-1 &2 ................... .

Ability to recognize system parameters that are entry-level conditions for Technical Specifications

(multi-unit license) Knowledge of the design, procedural and operational differences between units.

Ability to use plant computer to evaluate system or component status.

Source of off-site release ............................ .

2.6 3.0 CJ 0 [] [] [] I~I [] [] [] Whether malfunction is due to common-mode electrical

4.3 4.4

Ability to determine and interpret the following failures as they apply to ABNORMAL PLANT EVOLUTION):(CFR: 41.10/43.S/45.13)

nOD DDDDDD~ This is a Generic, no stem statement is associated.

Page 1 of 1

Ability to perform specific system and integrated plant procedures during all modes of plant operation.

3/2812008 10:31 PM

ES-401, REV 9


295009G2.4.18 Low Reactor Water Level 12

295014AA2.04 Inadvertent Reactivity Addition 1 1

295033G2.1.20 High Secondary Containment Area Radiation Levels 19

5I?D \0


IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G

RO SRO

3.3 4.0 r-l [J D D D D D D D D ~

4.1 4.4


DDDDD~ D Ability to determine and interpret the following as they apply to ABNORMAL PLANT EVOLUTION):(CFR: 41.10/43.5145.13)

4.6 4.6 D D D D D D D D ~ This is a Generic. no stem statement is associated.

Page 1 of 1

FORM ES-401-1

TOPIC:

Knowledge of the specific bases for EOPs.

Violation of fuel thermal limits ..................... .

Ability to execute proced ure steps.

3i2812008 10:31 PM

ES-401, REV 9



215003G2.128 IRM

215005A2.06 APRMI LPRM

239002G2.42 SRVs

259002A2.01 Reactor Water Level Control


IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G

RO SRO

3.4 4.7 [J 0 0 ~ This is a Generic, no stem statement is associated.

4.1 4.1 0 [] I;?I

3.4 3.5


Ability to (a) predict the impacts of the following on the (SYSTEM) and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal operation:(CFR: 41.5 i 43.5 j 45.3 j 45.13)

4.5 4.6 '-'1 11 - 1 1--1 1-1 r--l II [-1 ~

3.3 3.4


Ability to (a) predict the impacts of the following on the (SYSTEM) and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal operation:(CFR: 41.5/43.5 J 45.3/45.13)

Page 1 of 1

FORM ES-401-1

TOPIC:

Ability to apply technical specifications for a system.

Knowledge of the purpose a nd function of major system components and controls.

Recirculation flow channels upscale

Knowledge of system set points, interlocks and automatic actions associated with EOP entry conditions.

Loss of any number of main steam flow inputs

3/28/2008 10:31 PM

ES-401, REV 9

KA NAME / SAFETY FUNCTION:

239001 G2.2.25 Main and Reheat Steam

245000A2.06 Main Turbine Gen. fAux.

256000G2.2.44 Reactor Condensate



RO SRO

3.2 4.2 i , 0 0 0 0 0 0 0 0 0 ~ This is a Generic, no stem statement is associated.

2.9 3.1 [1 0 0 [J 0 0 ~ 0 [J 0 Ability to (a) predict the impacts of the following on the (SYSTEM) and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal operation:(CFR: 41.5/43.51 45.3/45.13)

4.2 4.4 [1 0 0 0 0 0 0 0 0 0 ~ This is a Generic, no stem statement is associated.

Page 1 of 1

FORM ES-401-1

TOPIC:

Knowledge of the bases in Technical Specifications for limiting conditions for operations and safety limits.

Loss of extraction steam

Ability to interpret control room indications to verify the status and operation of a system. and understand how operator actions and directives affect plant and system conditions

312812008 10:31 PM

ES-401, REV 9






G2.3.13 Radiation Control


G2.4.50 Emergency ProcedureS/Plans

SRO T3 BWR EXAMINATION OUTLINE

IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G

RO SRO

3 4 nDDDDDDDDD~

3.9 3.8 0 0 0 0 0 0 [] [J [J ~I

3.9 4.5 L .. ..i 0 0 0 0 0 0 0 0 ~

3.0 3.3 0 0 [J 0 0 0 0 D~

FORM ES-401-1

TOPIC:

Knowledge of operator responsibilities during all modes of plant operation.

Knowledge of RO duties in the control room during fuel handling.

Knowledge of less than one hour technical specification action statements for systems.

Knowledge of the process used to track inoperable alarms

---------:-:----3.4 3.8 U 0 0 0 0 [J 0 0 0 ~ Knowledge of radiological safety procedures pertaining to

licensed operator duties

3.2 3.8 [] [J [] []DDD~I

4.2 4.0 0 0 0 0 0 0 0 0 0 ~

Page 1 of 1

Knowledge of emergency communications systems and techniques.

Ability to verify system alarm setpoints and operate controls identified in the alarm response manual.

3/2812008 10:31 PM

ES-401 Record of Rejected K/ As Form ES-401-4

Tier / Randomly Reason for Rejection Group Selected K/ A T2/G1 211000K6.04 Too closely related to 209001 K1.13 to prevent double jeopardy on narrow

topic. Replaced with random KIA 211 000K6.03 by Chief Examiner.

T3 G2.4.43 Inability to develop question with sufficient LOD. Randomly replaced with G.2.4.23 by Chief Examiner.

28

ES-401 Written Examination Quality Checklist Form ES-401-6

Facility: Browns Ferry Date of Exam: 12/08/2008 Exam Level: RO~SROD

Initial

Item Description a b* c#

1. Questions and answers are technically accurate and applicable to the facility. ~ -w.S ILl 2. a. NRC K1As are referenced for all questions.

b. Facility learning objectives are referenced as available. ~ ~ .,tj 3. SRO questions are appropriate in accordance with Section D.2.d of ES -401 ,~ i.6 ~l 4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions

I~ £5 ii-were repeated from the last 2 NRC licensing exam, consult the NRR OL program office).

5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate: 6 the audit exam was systematically and randomly developed; or _ the audit exam was completed before the license exam was started; or 6 the examinations were developed independently; or 6 the licensee certifies that there is no duplication; or

~ ~ Lj _other (explain)

6. Bank use meets limits (no more than 75 percent Bank Modified New

from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO -only 25 8 42

~ ~ ~j question distribution(s) at right.

7. Between 50 and 60 percent of the questions on the RO Memory CIA

exam are written at the comprehension /analysis level; the SRO exam may exceed 60 percent if the randomly 31 44 selected KAs support the higher cognitive levels; enter 41% 59%

1&lu4- U ~;l the actual RO / SRO question distribution(s) at righ t.

8. References/handouts provided do not give away answers

I~ .¢tf Joj or aid in the elimination of distractors.

9. Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned;

~ ~ 1f deviations are justified

10. Question psychometric quality and format meet the guidelines in ES Appendix B. ~ ~ £j 11. The exam contains the required number of one-point, multiple choice items;

~ ~ zj the total is correct and agrees with value on cover sheet

,;~atu"' Date

a. Author Robert M. Soadoni .L 12/1/2008

b. Facility Reviewer (*) E Robert Scillian -£-m~ ;LX /J-----'" 12/1/2008

c. NRC Chief Examiner (#) /fda;}#? /, t:. ;J. -rr.-.a~ ~k ~, ri::: d. NRC Regional Supervisor 1.I/tLCIJf-/.A. (. WI ~fol / J ~~L I ~ -\.

Note: * The facility reviewer'S initials/signature are not applicable for NRC-developed examinations.

# Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

ES-401, Page 29 of 33

ES-401 Written Examination Quality Checklist Form ES-401-6

=;aCility: Browns Ferry Date of Exam: 12/08/2008 Exam Level: RODSRO~

Initial

Item Description a b* r?

1. Questions and answers are technically accurate and applicable to the facility. ~ ~ ~L 2. a. NRC KlAs are referenced for all questions.

~ b. Facility learning objectives are referenced as available. ~ . .,t.L 3. SRO questions are appropriate in accordance with Section D.2.d of ES -401 ~ ~ AI:.-t 4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions r;ae Lj. were repeated from the last 2 NRC licensing exam, consult the NRR OL program office). ~.

5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate: 6 the audit exam was systematically and randomly developed; or _ the audit exam was completed before the license exam was started; or

~1 6 the examinations were developed independently; or 6 the licensee certifies that there is no duplication; or

~ 4A-_other (explain) ......

6. Bank use meets limits (no more than 75 percent Bank Modified New

from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO -only 6 1 18

~ 4- .,tj question distribution(s) at right.

7. Between 50 and 60 percent of the questions on the RO Memory CIA

exam are written at the comprehension /analysis level; 6 19 the SRO exam may exceed 60 percent if the randomly

selected KAs support the higher cognitive levels; enter the actual RO / SRO question distribution(s) at righ t.

24% 76% ~ 46 -'1

8. References/handouts provided do not give away answers

~ Ld-or aid in the elimination of distractors. ~ 9. Question content conforms with specific KIA statements in the previously approved

examination outline and is appropriate for the Tier to which they are assigned; ~ ~ £j deviations are justified

10. Question psychometric quality and format meet the guidelines in ES Appendix B. I~ ~ ~~ 11. The exam contains the required number of one-point, multiple choice items;

~ ~~- Z:J the total is correct and agrees with value on cover sheet

Q"'" Name I 8'g"""''' Date

Robert M. Soadoni ~ a. Author 12/1/2008

b. Facility Reviewer (*) E Robert Scillian -f tid!. ~X .... 12/1/2008

c. NRC Chief Examiner (#) !;dLA.. n Liz-:> ..;:r;.. JL.LI.L L~a 12Mb a' L.lAUMJJ~. WIf>JlIsf'W / ~ 7Lj / MfO.l' d. NRC Regional Supervisor

Note: * The facility reviewer's initials/signature are not applicable for4tR'C-developed examinations.

# Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

ES-401, Page 29 of 33

ES-401 Written Examination Review Worksheet -- RO Form ES-401-9 - -----------

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOO

(F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only

Instructions [Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOO) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information). The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc). The answer choices are a collection of unrelated true/false statements. The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable. One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified: . The question is not linked to the job requirements (Le., the question has a valid KIA but, as written, is not operational in content). The question requires the recall of knowledge that is too specific for the closed reference test mode (Le., it is not required to be known from memory). The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check t~at (M)odified questions meet criteria of ES-401 Section 0.2.f.

7. Based on the reviewer'S judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOO

(F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N UlE/S Explanation Focus Oist. Link units ward KIA Only

1 1 N E LOO As written, the question is not very challenging. Consider rewriting the question not using the fill-in the blank format. (11/12/08 - REWROTE QUESTION -- OK)

2 H 2 N S (OK)

3 H 2 N S (OK)

4 H 3 N S (OK) ------

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only

5 H 3 X N !! Distractors A and B are not I2lausible. (CHANGED QORDING IN STEM AND MODIFITED DISTRACTORS - QUESTION WRITTEN SUCH THAT DISTRACTORS ARE PLAUSIBLE - ONLY MINOR CHANGES REQUIRED"***** QUESTIONS SHOULD NOT HAVE BEEN A U DUE THE FACT THAT ONLY MINOR CHANGES WERE REQUIRED TO RESOLVE CONERNI

6 H 3 B S (OK)

7 F 2 B S (OK)

8 H 3 X X N utE Reword to directly match KIA. We do not talk about power in any of the distractors. Location of "inserting a Y, scram should be changed. Was the y, scram initiated as a part of the procedure? (***** QUESTION WAS OK AS WRITTEN - PROVIDED JUSTIFICATION WHY*****)

9 F 2 N S (OK)

10 H 3 N E/S Is information associated with 1-EOI-2 required? Rearrange information identifying sequence of events. Consider: Following a reactor scram on Unit 1', the following plant conditions were observed: Not all control rods fully inserted; RPVis (-) 15" and rising; IRM are fully inserted and reading on Range 5 and lowering ...... (REWORDED QUESTION -- OK)

11 H 3 B S (OK)

12 H 2 N S (OK)

13 H 2 X X N S? What caused the valve to lose light indication? Is more information required? If it is only valve position indication, the valve could open when a signal is received and injection will occur. If this is the case, B would be correct. (MADE MINOR CHANGES TO STEM -QUESTION IS OK)

14 i-I 2 X X N U KIA does not match. Distractor analysis incorrect. Not able to locate documentation to support bases. Distractor A could be a correct answer. (WILL REWRITE QUESTION) (11/13/08 --WROTE NEW QUESTION - OK)

15 H 3 X N utE Distractors B & D do not appear to be plausible. Based on the conditions given explain why we would expect to get steam tunnel high temp and what would cause a G1 isolation? (PROVIDED REASON WHY STEAM TUNNEL TEMPERABURE WOULD INCREASE - REARRANGED WORDES IN DISTRACTOR BAND D .... QUESTION IS OK AS ORGINALLYWRITTEN *********)

16 F 2 N S (OK) I ---- --



17 H 3 N S (OK)

18 H 3 X N Y It al2l2ears there could be more than one correct answer. "An (WILL LOOK AT THE QUESTION AGAIN} (11/13/08 THERE IS NOT PROCEDURAL GUIDANCE TO PERFORM THE ACTION IN DISTRACTOR "An. THIS WAS THE JUSTIFICATION PROVIDED BY THE LICENSEE. ACCEPTED THERE ARGUMENT - OK***** QUESTION SHOULD NOT HAVE BEEN IDENTIFIED AS USAT}

19 F 2 X N Y There is no correct answer. The guestion asks what is what is the alarm and tril2 set 120int. 80 is the alarm and 180 is the tril2. i

The bases 1l0U12rovide in the distractors do not match what is in TS. (****** PROVIDED INFORMATION TO SHOW THAT THE ORIGINAL QUESTION WAS CORRECT - DID CHANGE THE WORDING IN THE DISTRACTORS***** QUESTION SHOULD NOT HAVE BEEN USAT - OK}

20 H 2 X X N U/E You ask for bases, but appear to give reason for what occurs. Stem should be rewritten. (MADE CHANGES TO STEM THAT. QUESTION NOW ASK FOR REASON NOT BASES --- QUESTION SHOULD NOT HAVE BEEN IDENTIFIED AS UNSAT******** OK)

21 H 3 B S (OK)

22 F 2 N S? Need to make sure there are not two correct answers. Need to review information on Appendix R fire to make sure there is not a 30 or 60 min requirement. Need clarification on what you are calling a battery board. How many batters make up a board? (QUESTION APPEARS TO BE OK - COULD NOT LOCATE INFORMATION ASSOCIATED WITH 60 MINUTE REQUIREMENT FOR APPENDIX RFIRE-OK)

23 F 2 B S (OK) -- MADE A MINOR CHANGE TO DISTRACTOR D.

24 H 3 N S (OK)

25 F 2 B S (OK)

26 H 3 M S Not sure if this is an RO question. We are requiring the RO to use steps in the EOI to determine answer. (MADE CHANGES TO THE DISTRACTORS - LICENSEE SAID IT WAS AN RO QUESTION --OK)

27 H 3 N S Not sure if this is an RO question. We are requiring the RO to use steps in the EOI to determine answer. (QUESTION IS OK - RO MUST KNOW WHAT TO DO TO RESET A SCRAM - OK)

28 H 2 B S (OK)

/.--....","

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. I

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation

I Focus Dis!. Link units ward KIA Only

29 H 3 N S (OK)

30 H 2 N U/E The second part of distractors A and B have plausibility problems:

1 ) Not plausible that the trip of one RFP will result in total feed flow dropping below 19%, and (MODIFIED DISTRACTORS -- OK)

31 H 3 N S (OK)

32 H 3 X B U KIA dose not match. Question dose not address automatic trips. (CHANGED KIA -- QUESTION OK)

33 F 2 B S (OK)

34 F 2 N S (OK)

35 H 3 B S (OK)

36 H 3 X N U Distractors do not appear to be plausible. Insufficient documentation to support answer. (REPLACED QUESTION - OK)

37 F 2 x B E Distractor 0 is implausible. While the SGT system does evacuate the HPCI gland exhausters, it doesn't take suction off the HPCI system. (CHANGED WORDING IN DISTRACTOR 0 - OK)

38 H 3 B S (OK)

39 F 2 N S (OK)

40 F 2 B S While conditions were added or re-arranged in the stem of the question, the changes did not change the test item focus or the correct answer. Credit should not be taken as a modified bank question. (CHANGED TO BANK - OK)

41 H 3 x M U The use of Battery: Charger '1' in distractors C and D is not Qlausible. Need more information on the actions associated with the alarm associated with 2A Battery: Charger. {CHANGED TO BATTERY CHARGER 3, -- OK - THE USE OF BATTERY CHARGER 1 WAS OK AFTER THE REVIEW - CHANGE WAS MORE PLAUSIBLE - SHOULD NOT HAVE BEEN CONSIDERED IMPLAUSIBLE************}

42 H 3 B S (OK)

43 H 5 x B E Suggest deleting the phrase "Control Rod insertion" in Distractors C

I and 0 and rephrasing as actions to be consistent with Distractors A

I and B. (OK)

--


(F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N UlE/S Explanation Focus Dist. Link units ward KIA Only

44 F 2 x N U Two correct answers -- believe distractor 'C' is also correct. If only 15 minutes have elapsed since control room abandonment and backup control from Panel 25-32 has not been established then the classification would be an Alert. (CHANGED WORDING IN STEM -OK)

45 F 2 x M U Two correct answers since plant would be in the same configuration at 47 psig as it would when the isolation occurs at 57 psig .. Also, the conditions in the stem of the questions and the distractors did not significantly change to take credit for this question as a "Modified" bank question. (CHANGED NUMBERS IN DISTRACTOR - OK****)

46 F 2 M U Question has potentially has two correct answers since plant would be in same configuration at 85 psig and 70 psig. (CHANGE NUMBERS IN TWO DISTRACTORS - OK)

47 H 3 B S Is this an RO question? (LICENSEE WANTED TO USE QUESTION)

48 H 3 M S (OK) ,

49 H 2 X N U Distractors A & B are not (;!Iausible. Ex(;!lain how a valve lineu(;! is unaffected bl/: a failure, l/:et cause a change in (;!Iant dDll!l!ell (;!ressure {CHANGED DlSTRACTOR "B". PROVIDED ADEQUATE JUSTIFICATION FOR DISTRACTOR "A". ****** QUESTION SHOULD NOT HAVE BEEN IDENTIFIED AS UNSAT-Q!g

50 H 2 N S (OK)

51 F 2 X N U Distractors B & D do not appear to be plausible. I do not see the relationship between injecting SLC and pH. (CHANGED WORDING IN STEM AND DISTRACTORS - OK)

52 H 2 M S (OK) I

53 F 2 N E You do not describe a reason in the distractors (CHANGED WORDING IN STEM)

54 H 3 X N E The distractors do not discuss a bases. It appears that they give a reason for what is occurring (CHANGED WORDING IN STEM - OK)

55 H 2 X M E LOD Correct grammar in stem (MADE CORRECTIONS - OK)

56 F 2 X X B E capitalization and spacing in stem. Remove "at the current radiation level from:' distractor A. There may also be unnecessary words in other distractors as well. (CORRECTED ITEMS IDENTIFIED AND REVISED DISTRACTOR D - OK)

/C-""



57 F 2 N S (OK)

58 F 3 N S (OK)

59 F 2 N S (OK)

60 H 3 N S LOD (OK)

61 H 2 X N U Distractors not coml2lete. Distractors answers l2art of the guestions {QUESTION SHOULD NOT HAVE ASKED FOR THE BASES - LICENSEE NOTIFIED ME BEFORE THE EXAM OF THE CONCERN ******* WOULD NOT HAVE BEEN MAKRED AS UNSAT ****1

62 F 2 B S? Please provide documentation which provide location of reset switch. (MADE CHANGE TO STEM - OK)

63 F 2 X M ?E/U LOD. It is ever possible for an upscale condition and a downscale condition to result in an isolation? (QUESTION IS OK - NEED TO UNDERSTAND LOGIC TO ANSWER QUESTION"'" SHOULD NOT HAVE BEEN IDENTIFIED AS UNSAT IT IS NOT A LOD QUESTION)

64 H 3 B S? Not sure about giving out EOI-3. Are there other questions associated with EOI-3 that could be answered based on having EOI-3? Look at question 65 and maybe others. Is this an RO question? (QUESTION USED ON LAST NRC EXAM - NO CHALLENGES BEFORE???? DECIDED TO KEEP THE QUESTION AT THE LICENSEE'S REQUEST) NEED TO BLOCK OUT INFORMATION ON FLOW CHART - ENTRY CONDITIONS (OK)

65 F 2 N S? Need additional information. Alarms associated with water level radwaste control room indications. (OK)

66 H 2 X B E This was identified as "minor format change." The answer for each question is different. In reviewing the questions as written, there may be more than one correct answer. - Same question -different answers - (CHANGE IN ANSWER WAS BASED ON PROCEDURE REVISION -- NEED TO LOOK AT PROCEDURE WHEN THEY RETURN TO THE PLANT - OK)

67 F 2 N S (OK)

I

68 F 2 N S (OK)

I 69 H 2 N S (OK)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. I

Q# LOK LOD

I


70 F 2 X M U KIA does not match. The guestion does not address knowledge of the Qrocess. (CONVIENCED ME THAT THE KIA MATCHES. KNOWLEDGE OF THE PROCESS IMPLIES IDENTIFYING WHAT PROCEDURES SHOULD BE USED TO DETERMINE TYPE OF TESTING - OK -- ******* QUESTION SHOULD NOT HAVE BEEN IDENTIFIED AS UNSATl

71 F 2 B S (OK)

72 H 1/2 B (OK)

73 F 2 X B E Distractor C is not plausible (ADDED INFORMATION TO THE STEM TO MAKE DISTRACTORS MORE PLAUSIBLE - OK)

74 F 2 N S (OK)

75 H 3 B S (OK) --- ----- ----- ------ _ .. _--

ES-401 Written Examination Review Worksheet -- SRO Form ES-401-9

E-~~---1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD


Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information). The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc). The answer choices are a collection of unrelated true/false statements. The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable. One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified: The question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content). The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory). The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewer'S judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).


(F/H) (1-5) Stem Cues TIF Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N UlE/S Explanation Focus Dist. Link units ward KIA Only

1 H 2 X N U Not SRO only. Question appears to as "when is jet pump operability required to be performed." NOTE in 1-01-68, page 43 states:

4) Performance of 1-SR-3.4.2.1 is required 24 hours after reaching> 25% RTP and/or 4 hours after returning a Recirc Pump to service. Is this something that the RO should know based on knowledge of startup procedure and start requirements for Recirc Pumps. Look at 01-68 (NOTES). (CHANGED DISTRACTOR "B." SROMUST MAKE DETERMINATION WHEN SURV MUST BE PERFORMED - OK AS SRO QUESTION)

--~

I

c"-""',



2 F 2 X X X N U There are two correct answer. "B" is also correct. Initiating a RX scram would be consistent with requirements identified in TS ....... Plant procedures are a direct result of TS, therefore I would think that actions taken according with TS are consistent whit requirements ... (AFTER LOOKING AT THIS A SECOND TIME, I AM NOT SURE THIS MATCHES THE KIA-ALSO IS THIS A GOOD KIA FOR AN SRO BASED ON OUR GUIDANCE .. (CHANGED DISTRACTORS )

3 F 2 X N U/E The second part of the question ask for bases. I do not think that when discussing bases, it means historical bases. Bases typically come form TS or procedures. I do not see documentation to support the answer. *********** (DECIDED TO USE QUESTION-PROVIDED DOCUMENTATION REQUESTED) *****************

4 H 3 X N U Not SRO only. It appears that only basic system knowledge is required to answer the questions. Once an operator determines that components are operable, they should know that maintaining plant parameters within normal limits are required. Operators know what normal limits are. (*****WILL LOOK AT REWRITING THIS QUESTION******) (11/12/08 -- WROTE NEW QUESTION - OK. CONCERNS ADDRESSED)

5 H Y, N S LOD (*****CHANGED INFORMATION IN THE STEM ******)

6 H 3 X N U KIA not matched as written. (******WILL LOOK AT 11'*******) (11/12/08 - WROTE NEW QUESTION - OK)

7 H 3 X N 1! Not sure if this is an SRO only questions. In observing the given condition, would one expect the operator to make adjustments to make sure that frequency is at proper Hz or system voltage is equal to 520KV? (********* QUESTION IS OK AS WRITTEN ***** IT IS SRO*******)

8 H 2 B S (***** REMOVED INFORMATION FROM STEM******)

9 H 2 X N U Not an SRO only question. Appears to be a general knowledge question. (********* WILL LOOK AT REWRITTING THE QUESTION*******) (11/11/08 MADE CHANGES TO QUESTION--OK)

10 H 2 B S (******MADE ONE CHANGE TO THE STEM)

11 H 2 B S OK ~


(F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only

12 H 3 X B !!. Not SRO only (---CHANGED DISTRACTORS --- PROVIDED PROOF THAT THIS WAS ACCEPTABLE FOR SRO ONLY QUESTION ••••• NOT A U)

13 F 2 N U Not SRO only. Response to this problem would be taken by the RO. Do your procedures prevent youR RO from taking these actions? Will he/she not tell the SRO what must be do to resolve the problem? (········WILL LOOK AT REWRITTING QUESTION""") (11/11/08 --- WROTE NEW QUESTION - OK - LOD 3)

14 H 3 N S (OK)

15 H 3 X N U Not SRO only. Are you saying that is SRO only because permission from the SRO is required? (11/11/08 - REWROTE THE QUESTION -- OK)

16 F 2 X N U The answer you identified as correct is incorrect. "A" could be correct. Need to review additional documentation (11/11/08-CHANGED QUESTIONS TO MAKE SURE THAT THERE ARE NOT TWO CORRECT ANSWERS -- OK)

17 H 3 N S (OK)

•

18 H 3 N S (OK)

19 H 2 X N !!. LOD This appears to be the bases for an admin JPM. Are shift requirements not the same for any licensed operator? If so what makes this unique to SRO knowledge level? (""'AFTER LOOKING AT THIS QUESTION DECIDED IT COULD BE USED AS A SRO QUESTION - OK"""')

20 H 3 X N E There could be two correct answers. Words missing in distroctor "0". (ADDED WORDES TO STEM AND DISTRACTORS -- OK)

21 H 2 B S (OK)

I 22 H 1/3 X N E As written the question has a LOD. Rewrite the question to have the

applicant determine what type of evaluation is required instead of telling them. (REVISED QUESTIONS --- OK)

i 23 F 1/3 B U Very LOD. Every operator is required to know this. Directions from I the SRO is not required to perform actions. (WILL REVISE

QUESTION TO SRO LEVELS) (11/12/08 - WROTE NEW QUESTION - OK)



24 H Y, M U Very LOD. See if the question can be written such that it is a bit more challenging. Other than determining the level of classification, the RO can answer this question, Need to make sure that giving the I applicant the entire procedure will not aid in answering other questions. (REPLACED KIA WILL WRITE NEW QUESTION) (11/13/08 -- NEW QUESTION IS OK)

25 H 2 X M !! No need to put "valid signal in the stem." "Upon" is not needed in the stem. This may not be an SRO only questions. In looking at ARP OG POST TRTMT RAD MONITOR HI-HI-HIlINOP (9-4C; 35), there are immediate actions associated with this alarm. Are the immediate actions associated with ARP not required to be known by the ROs? Base on the other control room indications, would we not expect the RO to determine what actions are required? (ACCEPTED QUESTION WITH --- SRO MUST DETERMINE WHICH PROCEDURE IS REQUIRED TO IMPLEMENT BASED ON INITICAL CONDITION - QUESTION DETERMINED TO BE OK. ONLY MADE MINOR CHANGES ... :.)

-----

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist

·Iity: Browns Ferry Date of Exam: 12/18/2008 Exam Level: RO [gJ SRO D

Item Description

1. Clean answer sheets copied before grading

2. Answer key changes and question deletions justified and documented

3. Applicants' scores checked for addition errors (reviewers spot check >25% of examinations)

4. Grading for all borderline cases (80% ± 2% overall and 70 or 80, as applicable, .:±: 4% on the SRO-only) reviewed in detail

5. All other failing examinations checked to ensure that grades are justified

6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants

a. Author

b. Facility Reviewer(*)

c. NRC Chief Examiner(*)

d. NRC Supervisor(*)

a

Initials

b c

Date

12/18/2008

12/18/2008

~c?J ~

(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 5 of 5

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist

Facility: Browns Ferry Date of Exam: 12/18/2008 Exam Level: RO D SRO IS;]

Item Description

1. Clean answer sheets copied before grading

2. Answer key changes and question deletions justified and documented

3. Applicants' scores checked for addition errors (reviewers spot check >25% of examinations)

4. Grading for all borderline cases (80% ± 2% overall and 70 or 80, as applicable, 2: 4% on the SRO-only) reviewed in detail

5. All other failing examinations checked to ensure that grades are justified

6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants

a. Author

b. Facility Reviewer(*)

c. NRC Chief Examiner(*)

d. NRC Supervisor(*)

Initials

Date

12/18/2008

12/18/2008

(*) The facility reviewer'S signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 5 of 5

Documents

Rev. 9E Form ES-201-1 Task Description (Reference) Examiner's £c:L · 2012-12-01 · ES-201, Rev. 9E Examination Preparation Checklist Form ES-201-1 Facility: Browns Ferry Date of