Monitoring process
- 2. Monitoring Process ď‚— ď‚— Monitoring is ongoing assessment of how activities and materials are being implemented by whom, for whom, with whom, how, when and where. Two important approaches to program evaluation are process and outcome evaluation which can be further divided into process and outcome monitoring. Process monitoring falls under the overall evaluation of a program.
- 3. Links between monitoring and evaluation Dimension Monitoring Evaluation Frequency Periodic, occurs regularly Episodic Function tracking / oversight Purpose Improve efficiency, provide information for reprogramming to improve outcomes Improve effectiveness, impact, value for money, future programming, strategy and policymaking Methods Routine review of reports, registers, administrative databases, field observations Scientific, rigorous research design, complex and intensive Information source Routine field observation, reports, progress reports, rapid assessment, program review meetings etc Same sources used for monitoring, plus population-based surveys, vital registration, special studies Assessment
- 4. Links between monitoring and evaluation Dimension Monitoring Evaluation Cost Consistent, recurrent costs spread across implementation period Episodic, often focused at the midpoint and end of implementation period
- 5. Who needs, uses M&E Information? To Inform and improve future programs Managers  To Improve program implementation…  Donors Governments   Inform stakeholders    Donors Governments Communities Beneficiaries
- 6. Who conducts M&E….? Program implementer Stakeholders Beneficiary Remember .. M&E Technical skills Participatory process
- 7. How to carry out M&E…? Key Features 1. Program Framework: Analyze and systematically lay out program elements 2. Identify key elements to monitor and evaluate. 3. Determine and describe the measures to be used for monitoring and evaluation 4. Develop M&E Framework and action plans, including data collection and analysis, reporting and dissemination of findings.
- 8. Framework for successful Process Monitoring Step 1 Determine Purpose and Uses Step 2 Develop Measurable Objectives Step 3 Develop Evaluation Questions Step 4 Collect/Gather Credible Evidence Step 5 Analyze Information & Develop Conclusions Step 6 Report Findings
- 9. Program Framework What do you know about your program….?
- 10. Step 1 - Determine Purpose and Uses for Your Process Monitoring Purpose The main purpose of process monitoring is to improve how things get done by answering questions about program operations, implementation, and service deliver Uses ➡ To improve program implementation ➡ Context for understanding effectiveness ➡ Accountability ➡ Quality management
- 11. Program Framework  Systematic lay out of the program elements and path showing what the program plans to: do ……………..achieve!
- 12. Step 2 - Develop Measurable Process Objectives  Process objectives are statements that describe the specific implementation activities of an intervention for a specified population within a given timeframe. Process objectives focus on “implementation activities”
- 13. Step 3 - Develop Process Evaluation Questions Once objectives are identified, you need to develop specific questions that you want your evaluation to answer. The focus of evaluation questions in process monitoring is describing the intervention activities including the human and other ď‚— resources needed to carry them out, the level of effort needed to accomplish each activity, and the time frames in which ď‚— the activities will be conducted. ď‚—
- 14. Step 4 - Collect/Gather Credible Evidence for Process Monitoring ď‚— Process data can be collected at two levels: student-level and programlevel.
- 15. Step 5 - Analyze Data & Justify Conclusions about Your Process Monitoring  Data Analysis – the process of categorizing, ordering, manipulating, and summarizing data to obtain answers to evaluation questions.
- 16. Step 6 - Report Findings about Your Process Monitoring Often times process monitoring serves an accountability function. Specifically, ď‚— data from process measures can provide information about the quality of the program or services. ď‚—
- 17. Scope of Monitoring ď‚— ď‚— ď‚— From an accountability perspective From a management perspective From an evaluators perspective
- 18. M&E Questions ď‚— Monitoring questions â—¦ â—¦ â—¦ â—¦ â—¦ â—¦ â—¦ â—¦ What is being done? By whom? Target population? When? How much? How often? Additional outputs? Resources used? (Staff, funds, materials, etc.)