MGSLG Monitoring and Evaluation as a Function of Management
0 likes3,744 views
1. Monitoring and evaluation are important functions of management that allow leaders to assess results, improve processes, promote learning, and ensure accountability. 2. Key aspects of monitoring include systematically collecting and analyzing information over time to identify changes and measure progress against plans. Evaluation analyzes the effectiveness and direction of activities by making judgments about impact and progress. 3. Monitoring and evaluation are important school leadership tools to assess whether objectives are being met, adapt plans as needed, identify lessons learned, understand stakeholder perspectives, and ensure efficient and appropriate use of resources.
MGSLG Monitoring and Evaluation as a Function of Management
- 1. ACE - School Leadership Monitoring and Evaluation as a function of Management Dr Muavia Gallie (PhD) 21 September 2009 MGSLG - Benoni Office 1 Introduction 1. Teaching to fish is better than providing fish; 2. Leadership is a decision, not a position or set of skills; 3. Leaders breed leaders, not follower; and 4. You don’t need facilitators to be a Quality Principal! 2 1
- 2. 2. There is no management without monitoring and evaluation 3 Monitor 4 2
- 3. Evaluate 5 6 3
- 4. What is Monitoring and Evaluation? Monitoring is the systematic, regular collection and occasional analysis of information to identify and possibly measure changes over a period of time. Evaluation is the analysis of the effectiveness and direction of an activity and involves making a judgment about progress and impact. The main differences between monitoring and evaluation are the timing and frequency of observations and the types of questions asked. However, when monitoring and evaluation are integrated, the line between the two becomes rather blurred. Participatory monitoring and evaluation (PM&E) is the joint effort or partnership of two or more stakeholders to monitor and evaluate, systematically, one or more research or development activities (Vernooy et al., 2003). 7 Why should we M&E? In general, the purpose of monitoring & evaluation can be: • To assess results - to find out if and how objectives are being met and are resulting in desired changes. • To improve management and process planning - to better adapt to contextual and risk factors such as social and power dynamics that affect the research process. • To promote learning - to identify lessons of general applicability, to learn how different approaches to participation affect outcomes, impact, and reach, to learn what works and what does not, and to identify what contextual factors enable or constrain the participatory research. • To understand different stakeholders' perspectives - to allow, through direct participation in the monitoring and evaluation process, the various people involved in the organisation to better understand each others views and values and to design ways to resolve competing or conflicting views and interests. • To ensure accountability - to assess whether the organisation is effectively, appropriately, and efficiently executed to be accountable to they key agencies (Estrella and Gaventa, 1998). 8 4
- 5. Methods and Techniques of Monitoring Programmes even with a good planning, adequate organisational machinery and sufficient flow of resources cannot automatically achieve the desired result. • There must be some warning mechanism, which can alert the organisation about its possible success and failures, off and on. • Constant watching not only saves wastage of scarce resources but also ensure speedy execution of the programmes. • Thus monitoring enables a continuing critique of the programme implementation. 9 Defining Monitoring Monitoring means keeping a track of implementation process. • Monitoring involves watching the progress of a project against time, resources and performance schedules during the execution of the project and identifying lagging areas requiring timely attention and action. • Monitoring is defined as a management function to guide in the intended direction and to check performance against pre – determined plans. • Monitoring means periodic checking of progress of works against the targets laid down in order to ensure timely completion of the programme. 10 5
- 6. Reasons for Monitoring Efficiency refers to the amount of time and resources put into the programme relative to the outputs and outcomes. A programme evaluation may be designed to find out if there was a less expensive, more appropriate, less time-consuming approach for reaching the same objectives. •Effectiveness describes whether or not the organisational process was useful in reaching programme goals and objectives, or resulted in positive outcomes. •Relevance or appropriateness describes the usefulness, ethics, and flexibility of a programme within the particular context. Combined, these criteria enable judgment about whether the outputs and outcomes of the programme are worth the costs of the inputs. Effectiveness, efficiency and appropriateness can be considered for the different methods, tools and approaches rather than questioning the value of the approach as a whole. 11 Purpose of Monitoring Programme monitoring helps to provide constructive suggestions like. •Re-scheduling the programme (if the programme run behind the schedule) •Re-budgeting the programme (appropriating funds from one head to another; avoiding expenses under unnecessary heading). •Re–assigning the staff (shifting the staff from one area to other; recruiting temporary staff to meet the time schedule). 12 6
- 7. What to Monitor Understanding the conditions before the programme was initiated is useful in order to provide a point of comparison for monitor and evaluating changes that occur during the programme. •Baseline survey conducted at the beginning of the programme can provide a point of reference for comparison and for understanding changes. •It is useful to distinguish between the different kinds of results generated from the programme: outputs, processes, outcomes, impact and reach. 13 Different kinds of Results in Monitoring These can be briefly defined as follows: •Outputs describe the concrete and tangible products of the organisation as well as the occurrence of the activities themselves. •Processes describe the methods and approaches used for the programme. •Outcomes describe the changes that occur that can be attributed, at least in part, to the programme process and outputs. •Impact describes overall changes that occur which the programme is one of many contributing factors. •Reach describes who is influenced by the programme and who acts because of this influence. 14 7
- 8. Steps in Monitoring Identifying the different units involved in planning & implementation • Identifying items on which feedback is required. • Developing pro-forma for reporting. • Determining the periodicity of reporting. • Fixing the responsibility of reporting at different levels. • Processing and analysing the reports. • Identifying the critical / unreliable areas in implementation. • Providing feedback to corrective measures. 15 Meaning of Evaluation Evaluation has its origin in the Latin word “Valupure” which means the value of a particular thing, idea or action. Evaluation, thus, helps us to understand the worth, quality, significance amount, degree or condition of any intervention desired to tackle a social problem. • Finding out the value of something. • The procedures of fact finding • Assessments whether or not certain activities, treatment and interventions are in conformity with generally accepted professional standards. • Is any information obtained by any means on either the conduct or the outcome of interventions, treatment or of social change programme. • To provide systematic, reliable and valid information on the conduct, impact and effectiveness of the projects. • The study and review of past operating experience. 16 8
- 9. Purpose of Evaluation 1. From an accountability perspective: • To make the best possible use of funds by the programme managers who are accountable for the worth of their programmes. • Measuring accomplishment in order to avoid weaknesses and future mistakes. -Observing the efficiency of the techniques and skills employed -Scope for modification and improvement. -Verifying whether the benefits reached the people for whom the programme was meant. 2. From a knowledge perspective: • To establish new knowledge about social problems and the effectiveness of policies/programmes designed to alleviate them. • Understanding people’s participation & reasons for the same. • Evaluation helps to make plans for future work. 17 Money taken by Administration 18 9
- 10. Principles of Evaluation 1. Evaluation is a continuous process (continuity). 2. Evaluation should involve minimum possible costs (inexpensive). 3. Evaluation should be done without prejudice to day to day work (minimum hindrance to day to day work). 4. Evaluation must be done on a co-operative basis in which the entire staff and the board members should participate (total participation). 5. As far as possible, the organisation should evaluate its programme but occasionally outside evaluation machinery should also be made use of (external evaluation). 6. Total overall examination of the organisation will reveal strength and weaknesses (organisation/programme totality). 7. The result of evaluation should be shared with all in the organisation (sharing). 19 Criteria for Developing Evaluation Assistance 20 10
- 11. Steps in Evaluation 1. Learning about the programme; 2. Creating an evaluation plan and indicators; 3. Brief the concerned people about the evaluation plan and indicators; 4. Revising and elaborating on the evaluation plan; 5. Initiating evaluation, and; 6. Utilising/ sharing the information. 21 Phases in Evaluation 22 11
- 12. Types of Evaluation (1) 1. By timing (when to evaluate?) Formative evaluation • Done during the programme (development stages) Summative evaluation • Done at the end of the programme (assessment) 2. By organization (who is evaluating?) Internal evaluation • It is a process/impact, done by management External evaluation • Unbiased,objective detailed assessment by outsider 3. By stage (how frequent?) On going (during the implementation) Terminal (at the end of or immediately after completion) Ex-post (after a time lag from completion) 23 Types of Evaluation (2) 24 12
- 13. Views about Evaluation Evaluation primarily perceived from three perspectives. 1. Evaluation as an analysis - determining the merits or deficiencies of a programme, methods and process. 2. Evaluation as an audit - systematic and continuous enquiry to measure the efficiency of means to reach their particular preconceived ends. 3. Evaluation as administration - appraisal or judgement of the worth and effectiveness of all the processes (e.g. planning, organising, staffing, etc.) designed to ensure that the organisation accomplishes its objectives. 25 Areas of Evaluation Purpose: • The review the objectives of the organisation/programme and how far these are being fulfilled. Programmes: • Aspects like number of beneficiaries, nature of services rendered to them, their reaction to the services, effectiveness and adequacy of services, etc. may be evaluated. Staff: • The success of any programme depends upon the type of the staff an organisation employs. Their attitude, qualifications, recruitment policy, pay and other benefits and organisational environment. These are the areas which help to understand the effectiveness of the organization/programme. Financial Administration: • The flow of resources and its consumption is a crucial factor in any organisation. Whether the money is rightly consumed, any over spending in some headings, appropriation and misappropriation. These are some of the indicators that reveal the reasons for the success or failures of organisations. General: • Factors like public relations strategies employed by the organisation, the constitution of the organisation or governing body and their contribution to future plans of the organisation are 26 important to understand the success or failures of an organisation. 26 13
- 14. Evaluation ... 27 Thank You! You can download this presentation from www.slideshare.net - search “Muavia Gallie” 28 14