TB-ELI Outcome Evaluation Framework and Toolkit
1 like715 views
The TB-ELI Outcome Evaluation Framework focuses on transitioning from traditional output measurement to outcome measurement, emphasizing the collective impact model with shared goals for projects. Key outcomes include improved psychological well-being and increased opportunities for individuals with disabilities and their caregivers. The toolkit offers a structured process for measuring social outcomes through a series of surveys and training support for project teams.
TB-ELI Outcome Evaluation Framework and Toolkit
- 2. Agenda • Introduce impact measurement – moving from traditional output measurement to outcome measurement • Collective impact model – TB-ELI’s 8 shared outcomes and how each project can contribute to those outcomes. • Social outcomes measurement toolkit – brief intro of the prototype including screenshots
- 3. How Do We Measure Impact? TB ELI Projects Activity +ve Social Impacts Desired Outcome
- 4. Traditionally, many social projects measured Outputs onlyOutputs onlyOutputs onlyOutputs only but OutcomesOutcomesOutcomesOutcomes can also be measured Project Activity • Training Course for Care Givers Outputs • Number of Training Courses Run • Number of trainees • Feedback Scores on Trainers Outcomes • Improvement in emotional wellbeing of caregiver • Care giver feeling confident in their ability to care
- 5. 8 TB-ELI Shared Outcomes for Projects 1. Persons with disabilities experience increased psychological and emotional well-being. 2. Persons with disabilities improve in their life skills (i.e. independent living skills, functional skills etc.) as much as their potential allows. 3. Persons with disabilities (or their proxies) are able to make informed decisions and planning via better support and access to information, programme and product navigation. 4. Persons with disabilities have more opportunities to participate in social, family, economic and community life. 5. Caregivers experience increased psychological and emotional well-being. 6. Caregivers feel confident of their ability to provide competent care and support to persons with disabilities. 7. Caregivers have greater access to support services, network and structure that sustain caregiving. 8. Caregivers have more opportunities to participate in social, family, economic and community life.
- 6. Example OutcomeOutcomeOutcomeOutcome Indicators Stated Shared Outcome Example Outcome Indicator Persons with disabilities experience increased psychological and emotional well-being. Improved psychological and emotional state in person with disability Decreased use of psychological and emotional support by person with disability Persons with disabilities improve in their life skills (i.e. independent living skills, functional skills etc.) as much as their potential allows. Increased length of time spent living independently experienced by person with disability Increased length of free time experienced by caregiver Decreased use of support by person with disability Increased length of time spent on a specified "independent living" activity by person with disability Persons with disabilities (or their proxies) are able to make informed decisions and planning via better support and access to information, programme and product navigation. Increased take up of care or support services by person with disability Increased satisfaction with care or support provision by person with disability Decreased complaints associated with inappropriate care or support from person with disability Increased knowledge of available care and support for person with disability Decreased returns or cancellations of inappropriate care or support services by person with disability Persons with disabilities have more opportunities to participate in social, family, economic and community life. Increased length of time engaged in social, family, economic and community life activities by person with disability Increased length of time spent working by person with disability Decreased length of time spent alone by person with disability
- 7. Example OutcomeOutcomeOutcomeOutcome Indicators Stated Shared Outcome Outcome Indicator Caregivers experience increased psychological and emotional well-being. Improved psychological and emotional state in caregiver Decreased use of psychological and emotional support by caregiver Caregivers feel confident of their ability to provide competent care and support to persons with disabilities. Increased knowledge of available care and support for person with disability Increased take up of appropriate care or support services for person with disability Decreased take up of inappropriate care or support services for person with disability Decreased use of selection support services by caregiver Caregivers have greater access to support services, network and structure that sustain caregiving. Increased take up of appropriate care or support services for person with disability Increased knowledge of available care and support for person with disability Caregivers have more opportunities to participate in social, family, economic and community life. Increased length of time engaged in social, family, economic and community life activities by caregiver Increased length of time spent working by caregiver Decreased length of time spent caring by person by caregiver
- 8. Social Outcomes Measurement – Simple 4 Step Process Stage 1: Preparation Funding Awarded Project Team Completes the “Preparation Survey”* “Preparation Survey” submitted to SG Enable for review and approval “Preparation Survey” defines the indicators to be tracked for the specific project Stage 2: Before Project Team executes “Before Survey” Stage 3: During Project Team completes the ‘Progress Survey” “Progress Survey” tracks Activity Indicators defined by the Project Team in the “Preparation Survey” Stage 4: After Project Team completes the “After Survey” at the “Impact Horizon” Project Team produces “Impact Case Studies” Project Team reports performance in terms of: Outcome Indicators, Activity Indicators, and Case Study Additionality determined using the baseline established using the “Before Survey”
- 9. Supporting Toolkit & Capability Development
- 10. Supporting Tool Kit & Capability Development
- 11. Supporting Toolkit & Capability Development Toolkit auto-generates a dashboard of indicators that a project can use to measure social outcomes
- 12. Supporting Toolkit & Capability Development Toolkit will also assist the project in selecting the most appropriate source of data to track and measure the indicator. It will also allow project to track data in the tool
- 13. Toolkit Training Course • Successful Grant recipients will also attend training sessions at NUS • In addition, ad-hoc support will be made available throughout • All training sessions are practical, hands on and focus on using the toolkit and helping each project