Program Evaluation (1).pdf

1
© 2015 Company Name Inc All Rights Reserved.
PITCH DECK
PROGRAM EVALUATION

2
PITCH DECK
Program Evaluation Introduction
UNIT 1

3
PITCH DECK
By the end of this unit, learners will be able to:
✓ Explain common myths about program evaluation, including
why they are myths.
✓ Write your own concerns of program evaluation and
compare your concerns with those presented in this unit.
✓ Explain the role of program evaluation and the facts that
support it
Learning Objectives
Purpose
The purpose of this unit is to introduce common myths, concerns
and facts about program.

4
PITCH DECK
Concerns
✓ Evaluations will divert resources away
from the program and therefore harm
participants.
✓ Evaluations will increase the burden on
the program staff.
✓ If an evaluation is negative, the program
or individuals may look bad.
Facts
The main goal of an evaluation is to provide
useful feedback to various audiences,
including sponsors, donors, client groups,
administrators, staff, and other
constituencies.
Myths
 Evaluation is a costly activity that
generates tedious data with limited
conclusions.
 It is a one-time tool used to determine
the success or failure of a program.
 It must be done at a specific time, be
conducted a certain way and include
outside experts.

5
PITCH DECK
Types of Program Evaluation
UNIT 2

6
PITCH DECK
✓ Define, compare and give examples of the two types of
required government funder evaluations: formative and
summative evaluations.
✓ Define, compare and contrast the three reasons for
conducting an evaluation: goal-based, process-based and
outcome-based.
Learning Objectives
Purpose
The purpose of this unit is to discuss the major types of program
evaluation.

7
PITCH DECK
Summative Evaluation
Measurements and/or
judgments that allow
conclusions to be drawn
about the impact, outcome
or benefit of a program.
Types of Program Evaluation
Goal-Based
Evaluation
Determines if and to what
extent the overall program
goals are being met.
Process-Based
Evaluation
Designed to determine
how a program really
works and how it
produces results.
Outcome-Based
Evaluation
Designed to examine
the long-term effects of
the program in terms of
morbidity and mortality
rates.
Formative Evaluation
Analysis of a program’s
strengths and weaknesses
to gain improvement.

8
PITCH DECK
Logic Models
UNIT 3

9
PITCH DECK
✓ Explain what a logic model is intended to do.
✓ Develop a logic model for programs.
Learning Objectives
Purpose
The purpose of this unit is to identify the reasons logic models are
use in program evaluation.

10
PITCH DECK
Strategies Target population Theory of change Short-term outcomes Long-term impact
Goals
Logic Model
A way of illustrating a program with a diagram or picture. Elements of a Logic model include:
The immediate changes
that are expected in
individuals, organization, or
communities.
The risk and protective
factors that your program is
addressing.
The people who participate
in or are influenced by the
program.
The final consequences.
The procedures and
activities that will be
implemented.
The program assumptions
about why those changes
will occur.

11
PITCH DECK
The Planning-Evaluation Cycle
UNIT 4

12
PITCH DECK
✓ Explain the relationship between planning and evaluation.
✓ Examine the stages of an evaluation phase.
Learning Objectives
Purpose
The purpose of this unit is to understand the planning-evaluation
cycle as it relates to organizational impact.

13
PITCH DECK
The Planning-Evaluation Cycle
Evaluation Phase Planning Phase
UTILIZATION of
results
FORMULATION of
questions
CONCEPTULIZATI
ON of possible
strategies
EVALUATION of
alternatives and
selection of best
IMPLEMENTATION
of selected
strategies
FORMULATION
of questions
CONCEPTUALIZATI
ON of how to
measure the
program
DESIGN of the
evaluation
ANALYSIS of data

14
PITCH DECK
UNIT 5
Assembling an Evaluation Team

15
PITCH DECK
✓ Identify the components of an evaluation team.
✓ Describe the role and importance of the lead evaluator.
✓ Define key stakeholders for one’s organization.
✓ Differentiate between internal and external evaluation.
Learning Objectives
Purpose
The purpose of this unit is to learn how to build an evaluation team
so that the components necessary for the purposes of an
individual’s organization are included.

16
PITCH DECK
Guidelines for Compiling a Collaborative Group
The decision-makers and other persons who assist in guiding the program can help focus efforts on the design of the
evaluation and questions that address specific areas.
The leader must coordinate the team as well as maintain continuity throughout the process.
The program’s history, purpose and practical operation in the field must be included in the description of the
program.
Stakeholders may have varying levels of team involvement that correlate with their personal perspectives,
skills and concerns.
Key aspects to making a team effective:

17
PITCH DECK
Members of the Evaluation Team
It is important to include them in
the evaluation development
process if you really want them to
help improve your initiative.
University-based researchers
This is the most obvious category
of stakeholders, because it
includes the staff and/or
volunteers involved in your
initiative or project.
Community groups Grant makers and funders
It is a good idea to find out
what sort of information you
will need to have for any
future grants for which you
might apply.

18
PITCH DECK
Internal vs. External Evaluation
Internal evaluators have the advantage of being closer to the program staff and activities, which make it easier and
less expensive to collect relevant data and information. However, external evaluators are not connected to the
program, this type of evaluator may be isolated, lacking the knowledge of and familiarity of the program that an
internal evaluator would possess.

19
PITCH DECK
Developing an Evaluation Plan
UNIT 6

20
PITCH DECK
✓ Develop their own evaluation plan.
✓ Define the reasons for the development of an evaluation plan.
✓ Describe the timeline for evaluation.
Learning Objectives
Purpose
The purpose of this unit is to assist in the formulation of an
evaluation plan for any program.

21
PITCH DECK
Developing the Plan
There are four main steps to developing an evaluation plan:
 Clarify the program objectives and goals.
 Clarify the program objectives and goals.
 Develop evaluation methods.
 Set up a timeline for evaluation activities.
Purpose
Few reasons why developing such a plan is important:
✓ It acts as a guide through each step of the evaluation process.
✓ It helps you determine what type of information you and your
stakeholders need.
✓ It keeps you from wasting time gathering irrelevant information.
Timeline
The timeline should follow the following stages:
 Planning.
 Data Collection.
 Data Analysis.
 Reporting
 Application.

22
PITCH DECK
Conducting the Evaluation
UNIT 7

23
PITCH DECK
✓ Identify the steps in program evaluation.
✓ Identify the purpose of the evaluation framework.
✓ Conduct program evaluations.
Learning Objectives
Purpose
The purpose of this unit is to detail the evaluation process itself.

24
PITCH DECK
02 04
06
01
Steps in Program Evaluation
Engage
stakeholders
Describe the program
Justify conclusions
Gather credible
evidence
Focus on the design
Ensure use and share
lessons learned
05
03

25
PITCH DECK
Program Surveillance and Documentation
UNIT 8

26
PITCH DECK
✓ Understand the process of surveillance through the gathering of
credible evidence, collection of data and justification of evaluation
conclusions.
✓ Cite the relevance of credible indicators, sources of evidence,
quality and quantity of evidence, and the role of logistics in regards
to the establishment of credible evidence supporting your
evaluation results.
✓ Identify what method of data collection is appropriate for the
various types of information needed for evaluation and
documentation.
✓ Explain and outline the five principles that govern the elements
leading to justifiable conclusions based on credible evidence.
Learning Objectives
Purpose
The purpose of this unit is to examine the basic components of
program surveillance and the essentials of documentation. The
topics covered will give insight on how to assess obtainable
objectives, the program effect on learners and the impact on the
community as a whole.

27
PITCH DECK
Credible Evidence
Examples of credible indicators
include: capacity to deliver services,
the participation rate, the level of
client satisfaction, the changes in
participants’ behavior, and the
changes in community condition and
norms.
Methods Of Data Collection
The most popular methods of data
collection for the purpose of
evaluation are questionnaires,
surveys, checklists, interviews,
documentation review, observation,
focus groups and case studies.
Justifiable Conclusions
Five elements are key to this justification
process: standards, analysis and
synthesis, interpretation, judgment, and
recommendations.

28
PITCH DECK
Ensuring Evaluation Capacity Building
UNIT 9

29
PITCH DECK
✓ Understand the cyclic nature of feedback, follow-up and
information dissemination and how it gives birth to ongoing
capacity building.
✓ Understand that a standardized plan for dissemination has to be
agreed upon by all stakeholders involved in the evaluation as well
as in the program in general.
Learning Objectives
Purpose
The purpose of this unit is to examine the various components that
ensure sustainable evaluation capacity building.

30
PITCH DECK
Capacity Building
Feedback Follow-up Dissemination

31
PITCH DECK
UNIT 10
Standards for Effective Evaluation

32
PITCH DECK
✓ Understand the various components of an effective evaluation in
regards to its utility, feasibility, propriety and accuracy.
✓ Assess whether the information needs of the evaluation are met
in relation to all stakeholders involved.
✓ Understand the procedures utilized to ensure the evaluation
makes sense to all stakeholders and interested parties.
✓ Explain why propriety standards are essential to ensuring that
the evaluation is done ethically.
✓ State further how program evaluation capacity can be aided by
sound accuracy standards.
Learning Objectives
Purpose
The purpose of this unit is to examine the overall guidelines and
standards for effective evaluation as adopted from the Joint
Committee on Education Evaluation. The principles are general
rules that are meant to be adapted to individual program
evaluations. They are established to aid program evaluation as a
general checklist of guiding principles.

33
PITCH DECK
Feasibility Standards
Designed to ensure that the
evaluation makes sense and
that the planned steps are
both viable and pragmatic.
Propriety Standards
Ensure that the evaluation is
ethical and done with regard for
the rights and interests of those
involved.
Accuracy Standards
Ensure that the evaluation
findings are considered
correct.
Utility Standards
Ensure that the information
needs of the evaluation
users are satisfied.
Standards for Effective Evaluation

34
PITCH DECK
Challenges to Program Evaluation
UNIT 11

35
PITCH DECK
✓ Identify various abuses of program evaluations that may occur
and present a list of alternatives or solutions.
✓ Recognize the importance and role of cultural sensitivity and
how it may strengthen or weaken the overall program evaluation
and results.
✓ Recognize the long-term challenges to the evaluation process
and adjust accordingly.
✓ Understand the complexity of evaluating the program’s failures
and weaknesses and how they relate to the overall evaluation
conclusions and results.
Learning Objectives
Purpose
The purpose of this unit is to identify various challenges to program
evaluation and control for these challenges in the design and
implementation of the program evaluation.

36
PITCH DECK
Challenges to Program Evaluation
Challenges to program
evaluation
Difficulty measuring
long-term impact
Learning from program’s
failures
Abuses of program
evaluations
Cultural sensitivity

37
PITCH DECK
THANKS FOR COMING

Program Evaluation (1).pdf

More Related Content

Similar to Program Evaluation (1).pdf (20)

Recently uploaded (20)

Program Evaluation (1).pdf