46
aracy.org.au Stephen Bartos CEO ARACY 9 November 2017 Measuring outcomes for children and youth

Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

StephenBartosCEOARACY

9November2017

Measuringoutcomesforchildrenandyouth

Page 2: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

Australia

Source thetruesize.com

Page 3: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

Australia haskangaroos

Austria hasschnitzels

Page 4: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

Australia&theUSA

Source thetruesize.com

Page 5: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

Australia• Largecountry,smallpopulation– only23million• 7millionchildrenandyouth(ages0-24)• Around5%ofthoseaged0-24areAboriginaland/orTorresStraitIslander

Page 6: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

Australia• Almost20%ofchildrenwerebornoverseas• Around25%ofchildrenspeakalanguageotherthanEnglishathome

• Ofwhom>halfspeakalanguagefromAsia

(Source:AustralianBureauofStatistics)

Page 7: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

AustralianEarlyDevelopmentCensus

Around1in5childrenweredevelopmentallyvulnerableinoneormoredomainin2015.

Page 8: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

ARACYseekstoimprovethelivesofyoungAustralians.Webaseourworkonevidence,transformingresearchintorelevantandusableinformationforpolicyandpracticestoimprovethewellbeingofchildrenandyoungpeople

AboutARACY

Page 9: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

WhyisARACYunique?• Theonlyorganisation inAustraliathatcoversallofthe

keydeterminantsofchildandyouthwellbeing• IdentifiedinTheNest(followingslides)

• Agerange0-24• Evidencefocus• Preventionandearlyintervention

Page 10: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

TheNestisaframeworktoalignandsupporttheeffortsofchildren,youngpeople,parents,serviceprovidersandpolicymakersinimprovingwellbeingandprospectsofchildrenandyouth

Firmlyevidencebased- codesignedwithover5000children,youth,parents,researchers,practitioners.

q Sixoutcomeareasq Prioritiesforinvestmentq Strategiestosupporttheseq Measurementframework

TheNest

Page 11: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

CULTURE AND IDENTITY

TheNestactionagenda

Page 12: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

TheNest- LovedandSafe

• Positive,supportivefamilyenvironment• Positiveparentingpractices• Positive,trustedpeerrelationships• Communitysafety• Childrennotplacedincare,youthnotindetention

Page 13: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

TheNest–MaterialBasics

• Foodandclothing• Housing• Incomeequality• Parentalandyouthemployment

Page 14: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

TheNest– Healthy

• Healthybirthweight• Immunisationrates• Nutrition,activityandhealthyweight• Dentalhealth• Mentalhealth

Page 15: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

TheNest– Learning

• Earlylearningparticipation(preschool)• Reduceddevelopmentalvulnerability• Parentalengagementinchildren’slearning• PerformanceinEnglish,MathsandScience• Schoolretentionandstudentengagement

Page 16: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

TheNest– Participating

• Youthabletohaveasayindecisionsthataffectthem• Votingenrolmentbyyoungpeople• Useandengagementoftechnologyandsocialmedia• Membershipofsocial,community,orcivicgroups

Page 17: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

Participation:whereadultsandkidsdisagreemost• Weconsultedmorethan5000peopleforTheNest,

including1400youngpeople• Mostlytheyagreedbut…

• Youngpeopleratedtheirabilitytoparticipatemuchlowerthandidadults• Dowegenuinely listentokids?

Page 18: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

TheNest– PositiveSenseofcultureandidentity

• Centraltothewellbeingofchildrenandyouth• ParticularlyimportantforIndigenous,refugeeandnonEnglishbackgroundchildren

• Includesspiritualwellbeing

Page 19: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

AcurrentcultureandidentityissueinAustralia:samesexmarriage

• Nationalsurveyonlegalisingsamesexmarriage–votingclosedtwodaysago,November7th

• PositivesenseofidentityessentialtowellbeingofchildrenofsamesexparentsandLGBTIyouth

Page 20: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

• Isthetoolwhichembodiestheoutcomesthinkingembedded byTheNest

• BasedonResultsBasedAccountability(RBA)Framework• Startswiththedesiredoutcomesandworksbackwards

toidentifythemostappropriatemeanstoachievethese

TheNest– ResultsScorecard

Page 21: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

• SoftwareallowsorganisationstodocumentandtrackprogresstowardsmeasurableNestindicatorsandoutcomes

• Captureswhatservices/activitieswereprovidedandhowwell

• OrganisationscanselectNestoutcomesandindicatorswhicharedirectlyrelevanttotheirsetting

TheNest– ResultsScorecard

Page 22: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

• Apracticalapproachtoimprovingthewellbeingofchildrenandfamilies

• BasedonTheNest

TheNest inActionTheCommonApproach

Page 23: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

TheCommonApproach–whatisit?

Aflexiblewayofworkingtohelpeveryone

havequalityconversationswithyoungpeopleandfamilies

aboutallaspectsoftheirwellbeing

Page 24: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

CommonApproach–WellbeingWheel

Page 25: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

FourpracticesaretheessenceoftheCommonApproach

• Child-centred• Strengths-based• Holistic• Workinginpartnershipwithfamilies

Page 26: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

CommonApproachresources

• WellbeingWheels

• QuestionBooklets

• Guide

• Wellbeingposter

Page 27: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

GroupDiscussion

Page 28: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

WhydoesTheNestlookfamiliar?

• Thereareotherframeworksthatmaylooksimilar

• It’stheirrelianceonresearch– forprogramdesignandmeasuringeffectiveness- thatmakesthemappearsimilar

Page 29: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

WhousesTheNest?

• MaribyrnongCityCouncil• MorelandCityCouncil• MooneeValley• GoldFields (allVictoria)• EveryChildSucceeds(Tas)• Palmerston:GrowWell

LiveWell(NT)• TheHiveMtDruitt(New

SouthWales)• ConnectingCommunity

forKids– Cockburn&Kwinana (WesternAust)

• TogetherintheSouth(SA)

Page 30: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

WhousesTheNest?

Logantogether- a10yearintegratedcommunityprogramtocreatethebestlifeopportunitiesforeverychildinLogan(adistrictinBrisbane,Queensland)

“WeareusingTheNest astheAustralianstandardfordescribingchildwellbeingandwerefertoitasanauthoritativesourceinthatregard.”

MatthewCox,Director,LoganTogether

Page 31: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

LoganTogether– casestudy

Evidencebased:

• 45,000childrenunder8yearsinLogan(2016)• Around13,000needextrahelptoreachtheirpotential

• Year3NAPLANresults(astandardisedschooltest)andtheAustralianEarlyDevelopmentCensus(AEDC)revealedagapinhowwellchildrenaredevelopinginLogancomparedwithStateandnationalaverages

Page 32: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

LoganTogether– theneed

0%

5%

10%

15%

20%

25%

30%

35%

PercentageofChildrenVulnerablein1+AEDCDomains

Logan Queensland Australia Victoria

Page 33: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

LoganTogether– scoreboard• BigResults-measuresoftheachievementofdevelopmentoutcomes

themselves

• BigInfluences - amuchlargergroupofmeasuresthatareeitherimportantdeterminantsofchilddevelopment(suchaskindergartenattendance),orimportantmeasuresofchildwellbeing(likegoodteeth),whichdon’tmeettheBigResultscriteria

• Datagapsidentified – particularlyalackofinformationabouthowchildrenaged1to3aredoing

Page 34: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

LoganTogether– scoreboard

Page 35: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

LoganTogether– scoreboard• Largelybasedondatasetsalreadycaptured

• Aretargeted

• Aremeasurableovertime

….anddatagapshavebeenidentifiedandarebeingworkedon.

Page 36: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

OtherRBA/ScorecardusersIntereach - Riverina Murray(RegionalNSW)Acommunityorganizationwhichdeliversarangeofservices;aged,disability,mentalhealthsupport• UsetheRBAframeworktoimproveperformanceincommunityserviceinteragencies andnetworks

• SeeRBAasoutcomes-focused,lowcostandimplementable• CreditRBAwithallowingthemtoclarifypriorities,assistplanninganddevelopment

Page 37: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

OtherRBA/ScorecardusersGatewayFamilyServices(BlueMountainsNSW)Welfareserviceforfamilies• ShiftedtoRBAwithgovernment/funderfocusonoutcomes• ScorecardandRBAprovidinginformationfundersrequire.• TheRBAFrameworkhasenabledadoptionofaformalprocesstoreinforceservicedeliverygoalsbackedbyevidence

Page 38: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

OtherRBA/Scorecardusers

TamworthFamilySupportServices(RegionalNSW)Childandfamilysupport,homelessnessservices• UsedRBAandScorecardtoaskhoweffectivetheywere• CredittheRBAframeworkwith:

Ø Forcingthemtoexamineeachprogramfromtheclient’sperspective- discoveredtheirideas/opinionswerenotalwaysthoseoftheclients

Page 39: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

OtherRBA/ScorecardusersParramatta/HolroydFamilySupport(SydneyNSW)Community-basedfamilysupportservice• RBAusedtodescriberesultsachievedwithfamiliesandreporttomanagementandfundingbodies

• Makespositiveimpactoftheservicemorevisible,whichisrewardingandmotivatingforfamiliesandstaff

• TheyseeRBAashelpingmaintainandthewisdomandknowledgeofexperiencedworkersandtransfertoothers

Page 40: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

TwopaperspreparedbyARACY:• Dataandcommunity:howCollectiveImpactinitiativesin

Australiausedatatosupportaction.• Buildingfromthebasics:approachestogovernanceand

collaborationinAustralianCollectiveImpactinitiatives.– FundedbytheAustralianDepartmentofSocialServices– Tobepublishedthismonth

CollectiveimpactinAustralia

Page 41: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

ThenewARACYworkrevealstheimportanceofdata• Datacollectionsupportscollaborationbycreatinganurgency

forchange,highlightingcoreissues,trackingprogramsuccessanddrivingshareddecisionmaking

• Datacollectionacrossstatesandterritoriesneedstobeoutcomesfocused,timely,consistent,andmorereadilyavailableinordertobeeffective

CollectiveimpactinAustralia

Page 42: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

Measurementistheexception

10%

70%

20%

Organisationsmeasuringoutcomes

Nomeasurement Developingmeasurement Developedmeasurement

Page 43: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

Whyismeasurementnotthenorm?

• Lackofdata– restricted,non-existent,non-consistent• Lackofcollaboration– betweenorganisationsanddatasets

&systems• Capacity – skillsandsystems• Feartheoutcomesofunfavourablefindings

Page 44: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

Aproposition:notonedollarshouldbespentonprogramsforchildren…

• Withoutevidencetosupportprogramdesign

• Withoutevidenceofeffectiveness(orforastart-up,afirmplantocollectthatevidence)

…yourthoughts?

Page 45: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

AustralianotasfardownthedataandmeasurementtrailasARACYwouldprefer

Lookingtolearnfromyourexperience

Page 46: Measuring outcomes for children and youth...•Use and engagement of technology and social media •Membership of social, community, or civic groups aracy.org.au Participation: where

aracy.org.au

Final comments and discussion