Training Course on Program Evaluation and Impact Assessment

Module 1 – Foundations of Program Evaluation
Subtopics:
Purpose and scope of evaluation in public health and development.
Types of evaluation: formative, process, outcome, impact.
Principles of accountability, learning, and continuous improvement.
Evaluation standards: utility, feasibility, propriety, accuracy.
Stakeholder engagement in evaluation design.
Practical Activities:
Case Study: Reviewing an evaluation report of a health program.
Exercise: Mapping stakeholders for an evaluation plan.

Module 2 – Designing Evaluation Frameworks and Logic Models
Subtopics:
Logic models and theory of change in evaluation.
Developing evaluation questions and key performance indicators.
Selecting appropriate evaluation designs: experimental, quasi-experimental, non-experimental.
Sampling strategies in evaluation research.
Building evaluation matrices and frameworks.
Practical Activities:
Workshop: Building a logic model for a maternal and child health program.
Exercise: Drafting an evaluation framework.

Module 3 – Methods and Tools for Data Collection and Analysis
Subtopics:
Quantitative methods: surveys, structured questionnaires, secondary data.
Qualitative methods: focus groups, interviews, participatory appraisal.
Mixed-methods approaches for triangulation.
Data analysis techniques: descriptive and inferential statistics, content analysis.
Tools and technologies for M&E (DHIS2, KoboToolbox, NVivo, SPSS).
Practical Activities:
Simulation: Designing a survey tool for program evaluation.
Hands-On Exercise: Analyzing a sample dataset to measure outcomes.

Module 4 – Impact Assessment and Economic Evaluation
Subtopics:
Difference between monitoring, evaluation, and impact assessment.
Measuring impact: attribution vs. contribution.
Counterfactual approaches: randomized control trials (RCTs), difference-in-differences, propensity score matching.
Economic evaluation: cost-effectiveness, cost-benefit, and cost-utility analysis.
Integrating equity and sustainability in impact assessment.
Practical Activities:
Case Study: Impact evaluation of an immunization campaign.
Exercise: Conducting a cost-effectiveness analysis using real or simulated data.

Module 5 – Communicating Findings and Using Evidence for Decision-Making
Subtopics:
Writing clear and actionable evaluation reports.
Data visualization and storytelling for evaluation results.
Dissemination strategies for different stakeholders (policy briefs, presentations, dashboards).
Building a culture of evidence-based decision-making.
Ethical issues and cultural sensitivity in evaluation.
Practical Activities:
Capstone Project: Developing a mini evaluation report and presentation.
Group Discussion: Barriers and solutions to using evaluation evidence in policymaking