WELCOME TO SUMMER INSTITUTEevallab.unm.edu/learning-center/summer-institute... · 7 Habits of Highly Effective People ... -Designing effective data collection tools-Collecting data-Analyzing

WELCOME2nd AnnualUNMEvaluationLabSummerInstitute

Drs.MelissaBinder&[email protected] /[email protected]

evallab.unm.eduSummer2019

WelcomeOrganizations

22July2019 2019UNMEvaluationLabSummerInstitute 2

Access,Albuquerque NAVAEducation Foundation,Albuquerque

AlbuquerqueHealthCarefortheHomeless,Albuquerque NewMexicoAppleseed,Albuquerque

AllFaiths,Albuquerque NewMexicoLegalAid,Albuquerque

CasadeSalud,Albuquerque Notah BegayIIIFoundation,SantaAnaPueblo

CentroSávila,Albuquerque PB&JFamilyServices,Albuquerque

CityofAlbuquerque,Albuquerque RapeCrisisNewMexico,Albuquerque

EleValle,Albuquerque S.A.F.EHouseInc.,Albuquerque

Explora ScienceCenter&Children’sMuseumofAlbuquerque ThornburgFoundation,SantaFe

HealingAddictioninOurCommunity/SerenityMesa,Albuquerque Tobosa DevelopmentalServices,Roswell

JFMaddoxFoundation,Hobbs UNMOfficeofAssessment,Albuquerque

LANLFoundation,Española

Introductions


22July2019 2019UNMEvaluationLabSummerInstitute 4/38

Melissa

RanjanaAudrey

CharlaClaudiaSonia

EmmaLogisticsFacilitatorSeniorFellow

OutgoingEvaluationLabDirector

SummerInstituteDirector

IncomingEvaluationLabDirector

ECHOLearningCommunityCoordinator

Makingconnections


UNMEvaluationLab

OurmissionistobuildevaluationcapacityrootedintheneedsofcommunitiesinNewMexico.


• EvaluationLabFellowship:studenttraininginpartnershipwithcommunityorganizations

• Directtrainingandsupportforcommunityorganizations:

SUMMERINSTITUTE&LEARNINGCOMMUNITY

CreatingaLearningCommunity


Learningbydoing

Classroomlearningisok,butwhereyoureallylearnhowtodostuffiswhenyoutryityourself,andwhenyougetideasfromotherpractitioners

Evaluationislifelessuntilitisapplied

DuringtheSummerInstitutewewillpresentanevaluationelementandhaveyoucreateitimmediately


Learningbysharing

ALearningCommunityisawaytosharepractitionerknowledgeHowourLearningCommunitywillwork

DuringSummerInstitute:• Shareevaluationproductsinsmallgroups,thenafewwillvolunteertosharewithentiregroup• 7LearningCommunitysessionsAfterSummerInstitute:• ProjectECHOLearningCommunity• Monthlysessions• Continuedtrainingandsharing


ProjectECHOmovement

A-Amplification:UseTechnologytoleveragescarceresources(Zoomvideoconference)

B-BestPractices:Sharebestpracticestoreducedisparity

C-CaseBasedLearning:tomastercomplexity

D-Database:tomonitoroutcomes


PLUS: Everybodylearning,everybodyteaching

Collaborationagreement

• Seebinder• We’llreviewonThursday


Creatinganevaluationplan


Elementsofanevaluationplan

LogicmodelTheoryofChangeRubricsEvaluationQuestionsDatacollectionEmbedding- Missiontime- Evaluationcoordinator- Feedbackloop


tellsyouhowyourorganizationoperatesandwhatoutcomesitachieves

articulateswhyyourprogramwillleadtointendedoutcomes

arethemeasuringstick

keepyoufocusedonwhatitisyouwanttolearnaboutyourprogram

Datacollection

WHATinformationdoyouneedtoanswerevaluationquestions?

HOWdoyoucollectthisinformation?

- Administrativeandprogramdata- Surveys,focusgroups,interviews

WHOcollectsthedataandWHEN?


EmbeddingI:Missiontime•Movingreflectionworkfrommeetingsimposedbyyourevaluatortotimeimposedbyyou- Agendaitemforstaffandboardmeetings- Internalevaluationcoordinator/evaluationteam

•Makingtimeforevaluationmeansyourorganizationwillbemovingintherightdirection• Plusmissiontimebringsjoy

DavidGrant.2015.TheSocialProfitHandbook:TheEssentialGuidetoSettingGoals,AssessingOutcomes,andAchievingSuccessforMission-DrivenOrganizations. WhiteRiverJunction,VT:ChelseaGreenPublishing.


CoveyQuadrants


StevenCovey7HabitsofHighlyEffectivePeopleHabit3:“PutFirstThingsFirst.”

https://www.franklincovey.com/the-7-habits/habit-3.html

CoveyQuadrants


FranklinCovey.https://www.franklincovey.com/the-7-habits/habit-3.html

MissionTimeEvaluation

TheSummerInstituteisMissiontime

Bigtime


EmbeddingII:Evaluationcoordinator&evaluationteam• Someoneinyourorganizationneedstoberesponsibleforevaluation• Andthey’llneedhelpin- Designingeffectivedatacollectiontools- Collectingdata- Analyzingand(especially)interpretingdata- Communicatingdata(tostaff,participants,Board,community)


EmbeddingevaluationIII:Feedbackloop

Whoisinvolved?Whendoesithappen?


Collect&analyzedata

Reviewdata

Improveprogram

EvaluationLabprinciples

• measuringwhatmattersandeverythingcanbemeasured

• embeddedevaluationevaluationispartofthedailyroutine,andisusedtoachieveorganization’smission

• participatoryevaluationevaluationworksbestwhenlotsofpeoplerepresentinglotsofgroupsareinvolved:leadership,front-linestaff,BoardofDirectors,participants(orformerparticipants),communitymembers


EvaluationPlanWorkbook


TheSummerInstitute


BrindleFoundation

UNMCollegeofArts&Sciences

UNMInstituteforSocialResearch

McCuneCharitableFoundation

UNMDepartmentofEconomics UNMPublicPolicy


We gratefully acknowledge financial, logistical, and moral support from the following foundations and UNM departments:

Logistics- physical

• Restrooms• Parking• Eating


Logistics- learning

• Electronicresources evallab.unm.eduè SummerInstitute

• Readings- Russ-Eft&Preskill:EvaluationinOrganizations- Grant:TheSocialProfitHandbook- CrenshawonIntersectionality

• Timetoworkonevaluationplan• Learningcommunities• Workbook


ElectronicResources

http://evallab.unm.edu/learning-center/summer-institute-materials1/index.html

http://evallab.unm.edu è LearningCenterè SummerInstituteMaterials

Readingsareinpassword-protecteddirectory


Projects

• Biggroupsandsmallgroups• Students


Yourrole


TransitiontologicmodelsKeepingmissionfirstandforemostincreatinglogicmodels


Yourorganization...

...doeswhat

2-5words!


TheUNMEvaluationLab...

...buildsevaluationcapacity


Documents

WELCOME TO SUMMER INSTITUTEevallab.unm.edu/learning-center/summer-institute... · 7 Habits of Highly Effective People ... -Designing effective data collection tools-Collecting data-Analyzing