Evalua&ngCME:Howdoweknowifwe’vebeeneffec&ve?

EuropeanCMEForum–2016

Amsterdam

Aworkshop…•  Reflec&on

– WhatisCMEtoyou?– Toyourlearners?– Totheirpa&ents?

•  Designingeduca&ontochange…•  Evalua&ngeduca&onforchange…•  Tableexercise• Whatwillyoudodifferently?

Accredita&onintheUS:•  Ac&vity-basedCriteria

–  Basedonprofessionalprac&cegap– Designedtochange–  Evaluatedforchange–  Independence

•  Program-basedCriteria–  CMEmissionwithexpectedresults–  Evaluateeffec&venessofmission

Achieves Outcomes

The provider demonstrates improvement in the performance of learners.

C36

The provider demonstrates

healthcare quality improvement.

C37

The provider demonstrates the

impact of the CME program on

patients or their communities.

C38

CMEisanopportunitytocreate…

Con&nuingmedicaleduca&onisanopportunitytocreate…

• Engagement• Rela&onships• Self-awareness•  Improvement• Change

CMEcanconnect…

CMEcanconnect…

•  TheCEprofessionalwiththelearner•  Acrossthemedicaleduca&oncon&nuum

– MedicalSchool,GraduateMedicalEduca&on

•  Interprofessionalteams• Withqualityimprovement• Withpublichealth

Whatareyoutryingtochange…

Whatareyoutryingtochange…•  Knowledge•  Competence(Skill/Strategy/AStude)•  Performance

–  Learner–  Team

•  Pa&entOutcomes•  Popula&onHealth

Howwillyouknowifyouaresuccessful…

Howwillyouknowifyouaresuccessful…

•  Changesinknowledge?•  Changesincompetence(skill/strategy/aStude)•  Changesinperformance?•  Changesinpa&entoutcomes?

….

•  Overallimprovementsinpopula&onhealth?

Howcanweevolveoureduca&onalac&vi&esfromknowledgetransfer…

…tocrea&veandsocialengagementtopromotecogni&ve/skilldevelopment

andbeYerpa&entoutcomes?

1.LearningApproach

Passive Ac&ve

2.Time

SingleEvent LongitudinalConnec&on

3.LearnerFocus

Physician Team

4.Goal

ATendance Engagement/Par&cipa&on

5.Modality

SingleModality BlendedApproach

6.ProgramOversight

CourseDirector Course+CMEdirectors

7.ChoosingTeacher

AcademicRank TeachingExcellence

8.Outcomes

Sa&sfac&on HigherLevelOutcomes

Whattheliteraturetellus…

•  Evolvetoac&ve,par&cipatorylearning•  Focusonlongitudinalcurricula•  Engagetheteamandpa&ents• Measureyourimpact

…howareyoucurrentlyevalua0ngyourac0vi0es?

Evalua&on…•  Case-baseddiscussion•  Reflec&vestatement•  Self-reportofchange•  Quiz/ARS•  Observa&on•  Simula&on•  Prac&ce-data

Here’sourproblem…Theincidenceofpediatricasthmahassignificantlyincreasedinthelocalcommunityoverthepast10years.Approximately1in5childrenbetweentheagesof5and12inthiscommunityhavebeendiagnosedwithasthma.Whencomparedtochildrenwithoutasthmainthesamecommunity,childrenwithasthmaaremorelikelytomissschool,arelesslikelytopar&cipateinextracurricularac&vi&es,andconsumesignificantlymorehealthcaredollarsperchild.Parentsofchildrenwithasthmaarealsomorelikelytomissworkwhencomparedtoparentsofchildrenwithoutasthma.Arecentevalua&onofpopula&onhealthconductedbythelocalhealthdepartmentdemonstratedthatsignificantlymorechildrenwithasthmawereoverweightorobesewhencomparedtochildrenwithoutasthma.

•  Emergencydepartmentvisitshaveincreasedby25%inthelastyearduetoasthmaaYacksinchildren.

•  EDphysiciansreportparentsdon’tunderstandtheimportanceofpropermedica&onmanagementforlong-termcontrolofasthma.

•  Nursesreportthatlimited&meisspentondischargeinstruc&ons.

•  Pharmacistsreportthatmedica&onrefillsarepastdue.•  Localpediatricsocietyhasimplementedaseriesofparent/

childeduca&onworkshops–aYendanceispoor.

Reportoutfromtables…•  Who are your learners? •  What are you trying to change?

•  What kind(s) of CME intervention?

•  How will you measure change?

•  Any other variables to success?

Reflectonyourownchange?