Better Data Collection to Support Planning and Evaluation
- 1. Session Objectives Lisa Osterman Community Solutions, Inc. 317-423-1770 losterman@communitysolutionsinc.net Better Data Collection to Support Planning and Evaluation 1. Learn a simple approach to understanding data and how it relates to your mission and your operations 2. Identify what information is needed/useful in your work 3. Develop a simple action plan for collecting AND using that information Measuring Outcomes Not everything that counts can be counted; not everything that can be counted, counts. – source debatable 1
- 2. The best job I ever had… “Demonstrating Impact” Cycle 1. What are you trying to achieve? MISSION Yuck We’re going to do that We can’t do that Three Critical Questions We already do that We sorta do that 2. What does success look like? GOALS/OUTCOMES/RESULTS 3. How will you know if you’ve done it? PERFORMANCE MEASURES/INDICATORS Jot down your mission on p. 1 of the worksheet 2
- 3. 1. What are you trying to achieve? • To enable all young • Who are you trying to people, especially those reach? CUSTOMERS who need us most, to • What do you want to reach their full potential achieve? OUTCOMES as productive, caring, responsible citizens. 1. What are you trying to achieve? Define “Who”: Define “What”: – Young People – Those who need us most – Geography? Reach potential as: – Caring – Productive – Responsible Citizen To enable all young people, especially those who need us most, to reach their full potential as productive, caring, responsible citizens. Now jot down your “who” and “what” 2. What does success look like? “What”: “Who”: – Young People • Youth ages 6-18 – Those who need us most • Economically disadvantaged • Single parent/other guardian household • Military kids – Geography • • • • Entire country Urban and Rural Military bases Native American reservations 2. What does success look like? Population: -All member youth Success: -Caring -All member youth -Productive – Caring • Kind to peers • Positive relationships with adults – Productive • School success/ HS graduation • Involved in Club activities – Responsible • Volunteer in Club • Summer employment • No juvenile delinquency -All member youth -Responsible Description/definition of success: •Kind to peers •Positive relationships with adults •School success/ HS graduation •Involved in Club activities •Volunteer in Club •Summer employment •No juvenile delinquency Complete p. 2 of worksheet 3
- 4. 3. How will you know if you’ve done it? 3.5 Types of Performance Measures Performance Measures! 3.5 types of performance measures: How much did we do? How well did we do it? Is anyone better off? Three Critical Questions 1. What are you trying to achieve? Productive Citizens Example Performance Measurement Grid How much did we do? How well did we do it? 3. How will you know if you’ve done it? High School Graduation % of youth participating in at least 8 of 10 sessions Is anyone better off? 2. What does success look like? School Success # youth served in School Success Program Is anyone better off? # high school graduates % high school graduates 4
- 5. Tracking BETTER OFF Performance Measures School Success Performance Measures Potential Data Source • Three mechanisms for data collection Example Direct Measurement Copies of report card Survey Annual OMTK Survey Partnerships 1. Direct Measurement 2. Surveys 3. Partnerships Data files from schools Exercise: Answering the Three Critical Questions 1. Choose an outcome/result that you teased out from your mission statement (HINT: Critical Question #2) 2. Identify 3 potential BETTER OFF performance measures that would demonstrate that this outcome or result has been achieved. 3. Clearly define each performance measure Identifying Good Outcomes and Indicators Outcome / Result A change in status, condition, or behavior High School Graduation Indicator / Performance Measure Indicator / Performance Measure Definition # and % of a defined population who do something measureable that has a reasonable connection to the desired outcome Any clarification, caveats, and additional meaning that helps you to be specific and accurate in your reporting # and % of members who graduate from high school High school graduation does not include completion of GED; calculate as a percentage of all seniors who enrolled in the Club as a member on or after the first day of 2013-2014 school year 5
- 6. Exercise—Part Two (AKA, The Hard Part) • Use the Outcomes Measurement Worksheet to draw up a plan! Outcomes Measurement Worksheet Outcome Perf. / Result Measure Source (where from?) Storage Owner Audience (where/ (who is (who how kept?) responsible?) cares?) Collection Reporting (when/ (format, how timeframe) often?) A few tips… • Focus on a few core outcomes – MISSION BASED • Choose performance measures that are: • Have a plan—and use it • Share the love! • Tell your story – Practical – Relevant – Actionable – Controllable Include How much? How well? And Better off? Measures 6