Summative Assessment Training

Day

Tidworth College

16 September 2005

What are Formative and Summative Assessment?

Formative assessment continues throughout the GPR year involves feedback to help you establish your

needs and to help you improve performance

Summative assessment an end-stage assessment of competence

What is Summative Assessment for GP Training?

A test of minimal competence required for an independent practitioner in general medical practice

Looks at knowledge skills attitudes

The vast majority of GPRs and Returners should have no difficulty in passing SA

Why have Summative Assessment?

Some GPRs aren’t ready for independent practice at the end of their GPR year

SA identifies those that need extra support, or more time

So, Summative Assessment is easy

BUT it must be approached professionally

If you don’t pass SA…

You can’t work in General Practice locum, assistant, or partner money

What does SA involve?

1) M C Q

2) Written submission of practical work usually an audit

3) Assessment of consulting skills usually a video

4) Structured Trainer’s report

The National Office for Summative Assessment

http//:www.nosa.org.uk

The MCQ

Positively marked 170 True/False questions 80 Extended Matching questions 10 Single Best Answer questions

The MCQ

Not recommended until completed 3 months as GPR but SHOs in hospital do pass!

Unlimited attempts permitted 4 sittings per annum

Feb/May/Sept/Dec

The MCQ – true/false

Itching is commonly a presenting symptom in: Atopic dermatitis T/F Hodgkin’s disease T/F Lichen planus T/F

The MCQ - Extended Matching Questions

A patient has difficulty swallowing. Which of the following investigations would help most with the diagnosis in the following clinical presentation:

A 19 year old male has been unwell for 10 days with a fever, sore throat, difficulty swallowing and general malaise

A, Barium Swallow B, Bronchoscopy C, Endoscopy D, Manometry E, Monospot F, Serum Iron G, Thyroid Function Tests H, Throat swab I, Video fluoroscopy

The MCQ – Single Best Answer Questions

Meningitis A Benzyl penicillin (IV) B Erythromycin (IV) C Oxygen via a face mask D Phenoxymethylpenicillin (oral) E Prednisolone (IV) Which is the SINGLE best treatment from the above

list of options? A 4 year old boy is drowsy and shocked. He

demonstrates neck stiffness and has a purpuric rash which doesn’t blanch on pressure. He has no known allergies.

The Structured Trainer’s Report

The Structured Trainer’s Report

To be completed 1-2 months before the completion of training

The Structured Trainer’s Report

BUT should be read by Trainer and Registrar at the onset of the GPR year

AND reviewed regularly throughout the year

What is it?

Minimum standard of competence To identify the incompetent or unready

35 basic competencies Must pass on all items

Collection of Evidence

Specific Clinical Skills (12) Patient Care (12)

Making a Diagnosis Patient Management Clinical Judgement

Personal Skills (11) Organisation Skills Professional Values Personal & Professional Growth

Formative use of Trainer’s report

Start using it now!

Formative use of Trainer’s report

Identify problems early Share problems with Course Organisers and

Associate Directors early Develop a strategy to deal with areas of

difficulty

The Written Submission

The Written Submission

Completed Audit Cycle or National Project Marking Schedule

(NPMS)

The Audit – a recipe for success Must contain the following:

Title Reason for choice Criteria chosen Reasons for choice of criteria Standards set and why? Preparation and planning

The Audit – a recipe for success Must contain the following:

First data collection - include charts and graphs Conclusions drawn from data Change to be implemented Second data collection – after change made Conclusion and learning Points

The Audit – a recipe for success

K

I

S

S

EEP

T

IMPLE

TUPID!

The Audit – a recipe for success

Follow the recipe!

Audit Timetable

Month 1 Choose Topic Month 2 First Data Collection Month 3 Put in place changes Month 4 Second Data Collection Month 5 Completion + submit to

Deanery

Audit checklist

Is the audit anonymous? Layout

Double spaced Pages single-sided and stapled Pages numbered GPR Number on each page

Word Count – not more than 3000 Practice list size Appropriate references Audit declaration and consent form

Audit tips

Listen to your tutor today KISS Follow the recipe Check out my audit website

www.mharris.eurobell.co.uk/contents.htm

MRCGP/SA Single Route

Submission of a single video for theMRCGP and Summative Assessment

Pass in MRCGP Video Module = Pass in SA Consulting Skills component

Single route video

Common video logbook summary sheet consent form

Different standard - anticipate 20%+ failure at MRCGP video 5% failure at SA video

Single route video

Register with RCGP for video component of MRCGP – 7 February 2006

Submit tapes to the Deanery by 28 April 2006 MRCGP and SA Results issued separately:

SA by Deanery office on 30 June 2006 MRCGP video by RCGP on 21 July 2006

Simulated Surgery

Examined in Leicester Deanery Wednesday evenings or Saturday afternoon Must have permission from Director of

Postgraduate GP Education before application is submitted

Your Deanery contact…

Vanessa Trickett 01962 892729 Vanessa.Trickett@sevwesdeanery.nhs.uk

Audit Submission

2 first level assessorsPASS

Result to GPR

One or both REFER

2 second level assessors agree

outcome

PASS REFER

Return to GPR to RESUBMIT

Resubmission New or revised

audit

2 second level assessors

PASS REFER

2 National level

assessorsFAIL