Measuring Program Outcomes
- 1. Measuring Program Outcomes: Eight Steps to Success 1: Get Ready 2: Choose the outcomes you want to measure 3: Specify indicators for your outcomes 4: Prepare to collect data on your indicators 5: Try out your outcome measurement sheet 6: Analyze and report your findings 7: Improve your system 8: Use your findings
- 2. Inputs Through Outcomes: The Conceptual Chain Inputs Activities Outputs Outcomes Resources dedicated to or consumed by the program (i.e. money, volunteers/ volunteer time, equipment, facilities, etc.) What the program does with the inputs to fulfill its mission (i.e. provide job training, feed/shelter families experiencing homelessness, etc.) The direct product of program activities (i.e. number of classes taught, number of hours of service delivered, etc.) Benefits for participants during/after program activities (i.e. new knowledge, changed attitudes/ values, increased skills, etc.)
- 3. Step 1: Getting Ready • Assemble and orient an outcome measurement work group • Decide which programs to start with • Develop a timeline • Distribute your game plan to the key players ASSEMBLE!
- 4. Step 2: Choose the Outcomes You Want to Measure • Gather ideas for what your program’s outcomes are from a variety of sources • Construct a logic model for your program Logic Model: a description of how the program theoretically works to achieve benefits for participants. It is the “If-Then” sequence of changes that the program intends to set in motion through its inputs activities and outputs.
- 5. Step 3: Specifying Indicators for Your Outcomes • Specify one or more indicators for each outcome • Decide what factors could influence participant outcomes Outcome Indicators: the specific items of information that track a program’s success on outcomes. They describe observable, measurable characteristics or changes that represent achievement of an outcome. The number and percentage of program participants who demonstrate these characteristics or changes is an indicator of how well the program is doing, with respect to the outcome.
- 6. Step 4: Prepare to Collect Data on Your Indicators • Identify data sources for your indicators • Design data collection methods • Pretest your data collection instruments and procedures. Collecting data on your indicators Records Specific Individuals General public Trained observers Mechanical tests and measurements
- 7. Step 5: Try Out Your Outcome Measurement System • Develop a trial strategy • Prepare the data collectors • Track and collect outcome data • Monitor the outcome measurement process
- 8. Step 6: Analyze and Report Your Findings • Organize the data and check for errors • Tabulate the data • Analyze the data broken out by key characteristics • Provide explanatory information related to your findings • Present your data in a clear and understandable form
- 9. Step 7: Improve Your System • Review your trial run experience, make necessary adjustments and start full-scale implementation • Monitor and review your system periodically
- 10. Step 8: Use Your Findings Internal uses of outcome findings: • Provide direction for staff • Identify training and technical assistance needs • Identify program improvement needs and strategies • Support annual and long range planning • Guide budgets and justify resource allocation • Suggest outcome targets • Focus volunteers’ attention on policy and programmatic issues External uses of outcome findings: • Recruit talented staff and volunteers • Promote your program to potential participants and referral sources • Identify partners for collaborations • Enhance you program’s public image • Retain and increase funding