WELCOMEtothe1st EverUNMEvaluationLabSummerInstitute

Drs.MelissaBinder&SoniaBettezmbinder@unm.edu /spbettez@unm.edu

evallab.unm.eduSummer2018

WelcomeOrganizations

7/29/18 2018UNMEvaluationLabSummerInstitute 2

BehavioralHealthServicesDivision NationalHispanicCulturalCenterCABQFamily&CommunityServices NewMexicoAsianFamilyCenterCentroSávila NewMexicoImmigrantLawCenterDoñaAnaCountyHealth&HumanServices NorthwestNewMexicoFirstBornProgramEnlaceComunitario PB&JFamilyServicesFirstNationsCommunityHealthsource ProjectECHOJFMaddoxFoundation SouthwestCenterforHealthInnovationLasCumbresCommunityServices UNMLatinAmericanandIberianInstituteMPPStudents YDIHeadStart

Introductions

7/29/18 2018UNMEvaluationLabSummerInstitute 3

MelissaSonia

Communityorganizer

Scholar

EvaluationLab

SocialWorker

Scholar

Mentor

7/29/18 2018UNMEvaluationLabSummerInstitute 4/38

Makingconnections

7/29/18 2018UNMEvaluationLabSummerInstitute 5

UNMEvaluationLab

OurmissionistobuildevaluationcapacityrootedintheneedsofcommunitiesinNewMexico.- Studenttrainingandcollaborationwithorganizationsonevaluationprojects.-Directorganizationtrainingandsupport:

SUMMERINSTITUTE&LEARNINGCOMMUNITYJuly30-August3

7/29/18 2018UNMEvaluationLabSummerInstitute 6/38

CreatingaLearningCommunity

7/29/18 2018UNMEvaluationLabSummerInstitute 7

Learningbydoing

Classroomlearningisok,butwhereyoureallylearnhowtodostuffiswhenyoutryityourself,andwhenyougetideasfromotherpractitioners

Evaluationislifelessuntilitisapplied

DuringtheSummerInstitutewewillpresentanevaluationelementandhaveyoucreateitimmediately

7/29/18 2018UNMEvaluationLabSummerInstitute 8

Learningbysharing

ALearningCommunityisawaytosharepractitionerknowledgeHowourLearningCommunitywillwork

DuringSummerInstitute:• Shareevaluationproductsinsmallgroups,thenafewwillvolunteertosharewithentiregroup• 5LearningCommunitysessionsAfterSummerInstitute:• ProjectECHOLearningCommunity• 3-monthcommitment/6sessions/lunchtimeThursdays• Bi-weekly

7/29/18 2018UNMEvaluationLabSummerInstitute 9

ProjectECHOmovement

A-Amplification:UseTechnologytoleveragescarceresources(Zoomvideoconference)

B-BestPractices:Sharebestpracticestoreducedisparity

C-CaseBasedLearning:tomastercomplexity

D-Database:tomonitoroutcomes

7/29/18 2018UNMEvaluationLabSummerInstitute 10

PLUS: Everybodylearning,everybodyteaching

Collaborationagreement

• Seepacket• We’llreviewonThursday

7/29/18 2018UNMEvaluationLabSummerInstitute 11

Creatinganevaluationplan

7/29/18 2018UNMEvaluationLabSummerInstitute 12

Elementsofanevaluationplan

LogicmodelRubricsDatacollectionEmbedding- Missiontime- Evaluationcoordinator- Feedbackloop

7/29/18 2018UNMEvaluationLabSummerInstitute 13

Logicmodel

tellsyouhowyourorganizationoperatesandwhatoutcomesitachieves

7/29/18 2018UNMEvaluationLabSummerInstitute 14

Rubrics

arethemeasuringstick

7/29/18 2018UNMEvaluationLabSummerInstitute 15

Datacollectionprocess

WHATinformationdoyouneedtobeabletosaywhetheryourorganizationisoperatingasplannedandachievingdesiredoutcomes?

HOWdoyoucollectthisinformation?- Operationaltoolsareusedinorganization’sactivities(intakeanddischargeforms,cliniciannotes)- Specializedevaluationtoolscollectinformationforevaluation(surveys,focusgroups)

WHOcollectsthedataandWHEN?

7/29/18 2018UNMEvaluationLabSummerInstitute 16

Missiontime*•Movingreflectionworkfrommeetingsimposedbyyourevaluatortotimeimposedbyyou- Agendaitemforstaffandboardmeetings- Internalevaluationcoordinator/evaluationteam

•Makingtimeforevaluationmeansyourorganizationwillbemovingintherightdirection• Plusmissiontimebringsjoy

*DavidGrant.2015.TheSocialProfitHandbook:TheEssentialGuidetoSettingGoals,AssessingOutcomes,andAchievingSuccessforMission-DrivenOrganizations. WhiteRiverJunction,VT:ChelseaGreenPublishing.

7/29/18 2018UNMEvaluationLabSummerInstitute 17/38

TheSummerInstituteisMissiontime

Bigtime

7/29/18 2018UNMEvaluationLabSummerInstitute 18

Feedbackloop

Whoisinvolved?Whendoesithappen?

7/29/18 2018UNMEvaluationLabSummerInstitute 19

Collectdata

Analyzedata

Improveprogram

EvaluationLabprinciples

• measuringwhatmatters(andeverythingcanbemeasured)• embeddedevaluation(evaluationisalwayshappening)• participatoryevaluation(asinclusiveaspossible)

7/29/18 2018UNMEvaluationLabSummerInstitute 20

EvaluationPlanWorkbook

7/29/18 2018UNMEvaluationLabSummerInstitute 21

TheSummerInstitute

7/29/18 2018UNMEvaluationLabSummerInstitute 22

BrindleFoundation UNMProvost’sOffice InstituteforSocial

Research

ConAlmaHealthFoundation DepartmentofEconomics UNMPublicPolicy

McCuneCharitableFoundation DepartmentofSociology

7/29/18 2018UNMEvaluationLabSummerInstitute 23

We gratefully acknowledge financial, logistical, and moral support from the following foundations and UNM departments:

Logistics- physical

• Restrooms• Parking• Eating

7/29/18 2018UNMEvaluationLabSummerInstitute 24

Logistics- learning

• Electronicresourcesor:evallab.unm.eduè SummerInstitute- Seeslightlyrevisedagenda!

• Readings- Russ-Eft&Preskill:EvaluationinOrganizations- Grant:TheSocialProfitHandbook- CrenshawonIntersectionality

• Timetoworkonevaluationplan• Learningcommunities• Workbook

7/29/18 2018UNMEvaluationLabSummerInstitute 25

ElectronicResources

http://evallab.unm.edu/learning-center/summer-institute-materials1/index.html

http://evallab.unm.edu è LearningCenterè SummerInstituteMaterials

Readingsareinpassword-protecteddirectory

7/29/18 2018UNMEvaluationLabSummerInstitute 26

Projects

• Biggroupsandsmallgroups• Students

7/29/18 2018UNMEvaluationLabSummerInstitute 27

Yourrole

7/29/18 2018UNMEvaluationLabSummerInstitute 28

TransitiontologicmodelsKeepingmissionfirstandforemostincreatinglogicmodels

7/29/18 2018UNMEvaluationLabSummerInstitute 29

Yourorganization...

...doeswhat

2-5words!

7/29/18 2018UNMEvaluationLabSummerInstitute 30

TheUNMEvaluationLab...

...buildsevaluationcapacity

7/29/18 2018UNMEvaluationLabSummerInstitute 31/38