TB-ELI Outcome Evaluation

Framework & Toolkit

d

September 1st 2016

Agenda

• Introduce impact measurement – moving from traditional output

measurement to outcome measurement

• Collective impact model – TB-ELI’s 8 shared outcomes and how each

project can contribute to those outcomes.

• Social outcomes measurement toolkit – brief intro of the prototype

including screenshots

How Do We Measure Impact?

TB ELI Projects

Activity

+ve

Social

Impacts

Desired

Outcome

Traditionally, many social projects measured Outputs only Outputs only Outputs only Outputs only but OutcomesOutcomesOutcomesOutcomes can also be measured

Project Activity

• Training

Course for

Care Givers

Outputs

• Number of

Training

Courses Run

• Number of

trainees

• Feedback

Scores on

Trainers

Outcomes

• Improvement

in emotional

wellbeing of

caregiver

• Care giver

feeling

confident in

their ability to

care

8 TB-ELI Shared Outcomes for Projects

1. Persons with disabilities experience increased psychological and emotional well-being.

2. Persons with disabilities improve in their life skills (i.e. independent living skills, functional skills etc.) as much as their potential allows.

3. Persons with disabilities (or their proxies) are able to make informed decisions and planning via better support and access to information, programme and product navigation.

4. Persons with disabilities have more opportunities to participate in social, family, economic and community life.

5. Caregivers experience increased psychological and emotional well-being.

6. Caregivers feel confident of their ability to provide competent care and support to persons with disabilities.

7. Caregivers have greater access to support services, network and structure that sustain caregiving.

8. Caregivers have more opportunities to participate in social, family, economic and community life.

Example OutcomeOutcomeOutcomeOutcome Indicators

Stated Shared Outcome Example Outcome Indicator

Persons with disabilities experience increased psychological and emotional well-being.

Improved psychological and emotional state in person with disability

Decreased use of psychological and emotional support by person with disability

Persons with disabilities improve in their life skills (i.e. independent living skills, functional skills etc.) as much as their potential allows.

Increased length of time spent living independently experienced by person with disability

Increased length of free time experienced by caregiver

Decreased use of support by person with disability

Increased length of time spent on a specified "independent living" activity by person with disability

Persons with disabilities (or their proxies) are able to make informed decisions and planning via better support and access to information, programme and product navigation.

Increased take up of care or support services by person with disability

Increased satisfaction with care or support provision by person with disability

Decreased complaints associated with inappropriate care or support from person with disability

Increased knowledge of available care and support for person with disability

Decreased returns or cancellations of inappropriate care or support services by person with disability

Persons with disabilities have more opportunities to participate in social, family, economic and community life.

Increased length of time engaged in social, family, economic and community life activities by person with disability

Increased length of time spent working by person with disability

Decreased length of time spent alone by person with disability

Example OutcomeOutcomeOutcomeOutcome Indicators

Stated Shared Outcome Outcome Indicator

Caregivers experience increased psychological and emotional well-being.

Improved psychological and emotional state in caregiver

Decreased use of psychological and emotional support by caregiver

Caregivers feel confident of their ability to provide competent care and support to persons with disabilities.

Increased knowledge of available care and support for person with disability

Increased take up of appropriate care or support services for person with disability

Decreased take up of inappropriate care or support services for person with disability

Decreased use of selection support services by caregiver

Caregivers have greater access to support services, network and structure that sustain caregiving.

Increased take up of appropriate care or support services for person with disability

Increased knowledge of available care and support for person with disability

Caregivers have more opportunities to participate in social, family, economic and community life.

Increased length of time engaged in social, family, economic and community life activities by caregiver

Increased length of time spent working by caregiver

Decreased length of time spent caring by person by caregiver

Social Outcomes Measurement – Simple 4 Step

Process Stage 1:

PreparationFunding Awarded

Project Team Completes the

“Preparation Survey”*

“Preparation Survey” submitted to SG Enable for review

and approval

“Preparation Survey” defines the

indicators to be tracked for the specific project

Stage 2:

Before

Project Team executes

“Before Survey”

Stage 3:

During

Project Team completes the

‘Progress Survey”

“Progress Survey” tracks Activity

Indicators defined by the Project Team in

the “Preparation Survey”

Stage 4: After

Project Team completes the “After

Survey” at the “Impact Horizon”

Project Team produces “Impact

Case Studies”

Project Team reports performance

in terms of: Outcome Indicators, Activity Indicators,

and Case Study

Additionality determined using the baseline established

using the “Before Survey”

Supporting Toolkit & Capability Development

Supporting Tool Kit & Capability Development

Supporting Toolkit & Capability Development

Toolkit auto-generates a dashboard

of indicators that a project can use

to measure social outcomes

Supporting Toolkit & Capability Development

Toolkit will also assist the project in

selecting the most appropriate source of

data to track and measure the indicator. It

will also allow project to track data in the

tool

Toolkit Training Course

• Successful Grant recipients will

also attend training sessions at

NUS

• In addition, ad-hoc support will

be made available throughout

• All training sessions are practical,

hands on and focus on using the toolkit and helping each project