31
Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Embed Size (px)

Citation preview

Page 1: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Teaching in the Office: Assessment and

Evaluation

Joan E. St. Onge, M.D.

UMMSM

August 15, 2014

Page 2: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Case Based Learning

5 rules for effective teaching have been described by Neher and coworkers as a practical model of case based learning.- Combines expert consultation with the technique to address learner and patient needs efficiently and effectively.

Neher JO, Gordon KC, Meyer B, Stevens N. A five step microskills model of clinical teaching. J Am Board pf Fam Prac.1992;5:419-24.

Page 3: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

5 Micro Skills for Effective Teaching

1: Get a Commitment2. Probe for Supporting evidence3. Teach the general rule4. Reinforce positive behavior5. Correct mistakes

Page 4: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

1. Get a CommitmentGet the learner to commit to some decision or plan of action• “ What do you think is going on?” • “Would you recommend a surgical approach to this problem?”• “Why do you think this patient is on three Antihypertensive

medications?”

Unhelpful methods“Sounds like pneumonia. Right?”“Can you think of anything else?”Questions do not probe for understanding, but can be answered by

yes or no.

Page 5: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

2. Probe for supporting evidence

Questions that ask the learner to demonstrate his or her thinking as it pertains to the case

AVOID the “GUESS WHAT I AM THINKING?” questions!

Helpful approaches:“What about his presentation led you to this diagnosis?”“What did you find on the exam that makes you think it is a surgical abdomen?”

Unhelpful: “What are the possible causes of dyspnea on exertion?”“This seems like a clear case of gout to me, how about you?”

-Does not allow learner to demonstrate critical thinking skills.

Page 6: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

3. Teach the general rule

• Whenever possible, attempt to teach the general rule “ the rule of thumb”– Helpful approaches:

• “In a young patient with low back pain, Xrays are not indicated initially.”

• “It is helpful to address code status when the patient is healthy.”

– Unhelpful approaches• “Mr. Smith does not need an xray today”• “Why don’t we discuss code status with Mrs. Jones today?”

Page 7: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

4. Reinforce What Was Done Right

• Provide positive feedback– Builds confidence, promotes self esteem, heightens

awareness to corrective criticism• Helpful:

“You evaluated this patient in a stepwise fashion and considered the patient’s preferences in your recommendations.”“You did a good job in noting the possible role of medications side effects in the diagnosis.”

• Unhelpful:“Strong work!”“Great Job!”

Page 8: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

5. Correct Mistakes

• Choose appropriate time and place to present this to the resident

• Have learners review their own performance• Follow up with your own comments

Page 9: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Correct Mistakes

• Helpful– “I agree that Goodpasture’s could be a cause of

this patients symptoms, but bacterial sinusitis is a more likely cause based on disease prevalance and lack of other findings.”

• Unhelpful– “I can’t believe you know so little at this point in

the third year.”

Page 10: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

SNAPPS:A Learner Centered Model for Outpatient Education

• Summarize history and physical• Narrow the differential to 2-3 possibilities• Analyze the differential• Probe the preceptor by asking questions• Plan management • Select a case related issue for self directed

learning

Page 11: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

• Summary– Concise– Not more than 50% of discussions– Relevant

Page 12: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

• Narrow the differential– Avoid the zebras– What caused the exacerbation?– Therapuetic options

Page 13: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

• Analyze the differential– Compare and contrast possibilities– Relevance– Enhances preceptor’s Ability to understand the

resident’s level of critical thinking

Page 14: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

• Probe the precptor– Remember: this is learner centered—– The resident should be able to identify gaps in

knowledge that he or she needs help with.

Page 15: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

• Plan the management– The learner initiates this, and must offer at least a

brief management plan

Page 16: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

• Select a case related issue for self-directed learning.

Page 17: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Constructive Feedback

Page 18: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Descriptive, not evaluative

• Describes the behavior you observe without attributing value to it

• Good example:

“You did not make eye contact with the last patient during the interview”

• Poor example:

“You are not interested in patient care”

Page 19: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Specific, not general

• Identifies the precise behavior you wish to highlight, avoiding generalities

• Good example:

“You were able to convey empathy and understanding during the interview”

• Poor example:

“You did a good job”

Page 20: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Focused on issues the learner can control

• Provides tips on how to improve

• Good example:

“When taking the history, speak slower and check for understanding”

• Poor example:

“My patients cannot understand you because of your accent”

Page 21: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Well timed

• Makes feedback an expectation, not an exception

• Good example:

When it is provided regularly throughout the learning experience and as close as possible to the event that brought about the feedback

• Poor example:

When it is provided only at the end of the rotation

Page 22: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Limited in amount

• Make the message memorable

• Good example:

When it focuses on a single, important message

• Poor example:

When the learner is overwhelmed with information

Page 23: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Addresses learner goals

• Use of “Student Contract”

• Good example:

When it addresses goals that were identified by the learner at the beginning of the office experience

• Poor example:

When the learner’s goals are ignored

Page 24: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

• Feedback should be ongoing and frequent• Most common complaints from students is that nobody tells

them how they are doing

• Give the feedback as soon as possible after a critical incident

• Use notes to help you recall points you wish to make• Describe the observed behavior • Be as specific as possible• End the feedback with detailed instructions for

improvement• Follow-up with positive feedback when the

improvements occur

Page 25: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Patient satisfaction survery

Page 26: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Independent Learning

Page 27: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Identify the need

• After the presentation, have the student either identify the learning question(s) or ask the following:

• “Based on your patients today, what questions do you have?“

• “What one area would you like to learn more about?”

• “What troubled you today?”• “What would you like to improve on?”

Page 28: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Make an assessment

• Ask the student to formulate the question

• Ask the student to research the answers to the question

• Specify a time for the student to report back to you with the results of the research

Page 29: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Identify potential resources

• Medline or other databases

• Textbooks

• Journal articles

• Consultants

Page 30: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

“Close the Loop”

• The student reports back on the research

• Gives an oral presentation• Incorporates it into a patient write-up or

assessment• Submits a written outline

Page 31: Teaching in the Office: Assessment and Evaluation Joan E. St. Onge, M.D. UMMSM August 15, 2014

Reference

• “Teaching in Your Office, A Guide to Instructing Medical Students and Residents”

ByPatrick C. Alguire, MD, Dawn E. DeWitt, MD,

Linda E. Pinsky, MD, Gary S. Ferenchick, MD