Project Evaluations methodology collections
- 1. TECHNICAL PROPOSAL FOR PROJECT EVALUATION FOR INCLUSIVE HAMRO PROJECT (Period: 19 Dec. 2019- 31 March 2023) RDM Consultancy Nepal Kathmandu 27/01/2023
- 2. Research Development and Media (RDM) Consultancy Pvt. Ltd (2009) grew out of the need to cater a wide range of project management services to development organizations and private companies. Hence, its products and services are designed to improve performances, strengthen processes and mobilize people. Services Capacity Development (organization and Individual) Policy formulation and Strategic documents Cooperative Governance and Business Development Evaluation, Research and Development Elevating performance, process and people Human Resources Governance and Democratization Resilient Livelihood Business and Enterprise Development Youth leadership Development Monitoring and Evaluations Values Innovation Integrity Confidentiality Empowerment
- 3. Presentation Outline •Understanding the Project •Objective of the Assignment •Methodology •Time Schedule •Deliverables
- 4. Understanding the Project •Funding Agency: Disability Inclusive Development (DID) program •Consortium Patterns Light for the World (LFTW)- Task Order Management Organization Cordaid- Evaluation Lead National Federation of the Disabled Nepal (NFDN)- Advocates for the rights, interests, and entitlements of persons with disabilities
- 5. Understanding the Project • Project Location Melamchi of the Sindhupalchok Mandandeupur Municipalities of the Kavre districts Kathmandu • Objectives of the Program To make a viable livelihood for the people with disabilities by improving their access in the coffee value chain
- 6. Objective of the Assignment • Measure outcomes and the impact for the project Disability Inclusive Hamro Coffee’ project • Produce a quality endline evaluation report based on the project results framework adopting OECD evaluation criteria • Provide recommendations to the consortium on project design
- 7. Evaluation Indicator/ Questions • Impact indicator 1: Income or value of assets increase through access to the coffee value chain for women and men with disabilities L. Q.: To what extent have livelihoods improved under the project? • Impact indicator 2: Technical Assistance Facility has contributed to reduced discrimination and barriers in the coffee value chain L. Q.: To what extent has participation in the CVC increased?
- 8. Evaluation Indicator/ Questions L. Q.: How has the project improved the confidence, ability, and self-worth of people with disabilities? L. Q.: To what extent have advocacy efforts supported better inclusion and accessibility for communities at the municipality level? L. Q.: To what extent and how has the project contributed to reducing the gap in livelihoods outcomes between people with disabilities and persons without disabilities?
- 9. Evaluation Indicator/ Questions L. Q : What worked well and why? What did not work well and why? L. Q : Has there been any unintended consequences (positive or negative) of the programme? L. Q : How successful was Disability Inclusive Development programme targeting the most vulnerable people with disabilities?
- 10. Evaluation Criteria: OECD Criteria Key concern on evaluation Relevance To what extent project objectives and design respond to the needs of the beneficiaries, Government and consortium partners strategy, policies, and priorities ? Coherence: How well does the project intervention fit? To what extent project intervention supports the Nepal’s development agenda with synergies (local government as well as SDGs) Effectiveness: Is the project intervention achieving its objectives? To what extent project intervention has achieved its intended results at different levels of the results chain? Efficiency: How well are resources being used by the project during its implementation to generate or lead intended results within the intended timeframe? Impact: Has the intervention caused a significant change in the lives of the people with disability to find employment and increase income? Is the project leading to “scalable” or “replicable” results? How will the project contribute to changing stereotype of thinking about the people with disability for the better? Sustainability: Will the benefits that generated from the project last?
- 12. Evaluation Cycle
- 13. Data collection methods and Sample Methods •An introductory field visit –to have good understanding on types, level and degree of disability •Desk review and Consultation with project implementing team and consortium partners •Execution field survey -Washington Group of Questions •FGD and KII •Field Observation and interaction •Other Methods - Livelihood assessment, case study, Oral history-documentation and temporal photo analysis Sampling Procedures •Both probability and non-probability sampling methods (preferably- Random) •Sample size -will be determined with the consultation of the consortium partners adopting statistically valid approach during inception. •Given the small number of beneficiaries (90), the evaluation will consider 50% of the target beneficiaries with the survey tools. •The specific target groups, cafes, processors; OPDs etc. will be selected purposively. •ToR Says, 90 farmers and 30 trainees , 5 cafes, 5 processors, 5 OPDs and two municipalities
- 14. Data Analysis, Team and Deliverables Data Analysis and Team •Both descriptive and inferential statistical (correlation, ANOVA and Regression etc.) •Graphs, averages, frequencies, ratios, growth rates, case study, and causal relation •Team Dr. Hari Sharma Neupane as value chain expert Krishna Gahatraj as Disability Inclusion expert Raju Sharma as the Project Evaluation expert Deliverables and Budget •Inception Report with implementation plan and work schedule including risk planning, and methodology with constructive survey tools. •Consolidated Draft report: It should include findings and data required for result framework •Final Report- It should incorporate feedback received from the consortium partners •Data Set •Budget- NPR 13,39,615.00
- 15. Thanks