Monitoring, Evaluation and Learning

Training for Local Partners

June 25-27, 2024

2/25/21`1 FOOTER GOES HERE 1

Opening Remarks
Eleanor TanPiengco,
Deputy Mission Director
2
MEL Training Overview

3
 MEL TRAINING STRUCTURE
Day 1 Day 2 Day 3

9:00 - 12:00 Module I: Module III: Module V:

PM Introduction to Monitori Developing Perform Operationalizing CLA
ng, Evaluation, and Lear ance Indicators and
ning at USAID Setting Baselines an
d Targets

12:00 - 1:00 Lunch Break Lunch Break Lunch Break

PM

1:00 - 4:00 PM Module II: Module IV: Module VI:

Theory of Change (TOC) Overview of Data Qu Activity Monitoring, Eval
and Results Framework ality Assessment (D uation, and Learning (M
s QA) Learner Objectiv EL) Plans
es

2/25/21 4
 SAMPLE MODULE STRUCTURE

50 minutes Lecture and Resource

Review

20 minutes Q&A

15 minutes BREAK

1 hour 35 Practice Activity in

minutes Breakout Groups

2/25/21 5
HOUSEKEEPING
• Use the restrooms when
needed.
• You will receive a soft copy
of all of the slides after the
training is complete.
• Write questions on post-it
notes and hold them for the
Q&A session after each
lecture. There will be
additional time for Q&A in
breakout rooms.

6
 TRAINING
OBJECTIVES
• Introduce Monitoring, Evaluation,
Learning (MEL), and Collaboration
Learning Adaptation (CLA) concepts and
practice.
• Explain the role and importance of MEL
(including CLA) in programming as a tool
for adaptive management, and why MEL
is essential for effective program design,
implementation, and management.
• Build understanding of Theories of
Change (TOC), Logic Models/Results
Frameworks, and their importance for
achieving strong program results.
• Build understanding of and ability to
create and use a MEL plan

2/25/21 7
Module 1

8
MODULE 1 Time Topic Location

Objectives & Agenda 9:00 -

9:30
Opening
Remarks &
Plenary
Ballroom
Introductions
By the end of the training, learners 9:30- Introduction to Plenary
will be able to: 10:10 Monitoring, Ballroom
Evaluation and
• Describe USAID’s Program Learning at
Cycle and define key terms USAID
● USAID’s
• Describe the role of MEL in Program
Cycle
USAID programming ● MEL
definitions
• Explain MEL as a tool that and
improves decision-making concepts

10:10- Q&A Plenary

10:40 Ballroom

10:40- BREAK Haile Lobby 9

11:00
Why do we do
monitoring,
evaluation, and
learning?

10
MEL LEADS TO BETTER DECISION-MAKING
MONITORING EVALUATION
Is it going according to What happened? Why?
plan? How?

LEARNING
What are the
takeaways?

BETTER (RE)DESIGN
BETTER MANAGEMENT
of existing and future
of the activity
activities

BETTER DEVELOPMENT RESULTS

USAID’S AUTOMATED DIRECTIVES SYSTEM
(ADS)
The ADS contains the policies and essential procedures that guide the
Agency’s programs and operations. It is organized into six functional
series:
• Series 100: Agency Organization and Legal Affairs
• Series 200: Programming
• Series 300: Acquisition and Assistance
• Series 400: Human Resources
• Series 500: Management Services
• Series 600: Budget and Finance

12
USAID’s Program
Cycle
ADS 201 Chapters
201.3.1 The Program Cycle
201.3.2 Strategic Planning
201.3.3 Project Design
201.3.4 Activity Design
201.3.5-3.7 MEL (incl. CLA)

13
USAID’s PROGRAM CYCLE PRINCIPLES

Apply analytic rigor to support evidence-based

decision-making

Manage adaptively through continuous learning

Promote sustainability through local

leadership and financing

Use a range of approaches to achieve results

14
KEY PLANNING AND MONITORING TOOLS
Planning/Design MEL Tool
COUNTRY Tool Country
Development Performance
STRATEGIC Cooperation Management
PLANNING Strategy Plan

PROJECT Project Project MEL

DESIGN & Development Plan
IMPLEMENTATION Document (PDD)

ACTIVITY Solicitation &

Award Activity
DESIGN & Statement of
MEL Plan
IMPLEMENTATION Work
15
MONITORING, EVALUATION & LEARNING IN
THE ADS 201
USAID uses three main processes to CLA

track results and develop evidence:

● Performance Monitoring Evaluatio
n
● Evaluation
● Collaborating, Learning and
Performanc
Adapting e
Monitoring

16
WHAT IS MONITORING?

“Monitoring is the
ongoing and
systematic tracking
of information relevant
to USAID’s strategies,
projects, and
activities.”
- ADS 201
17
WHY IS MONITORING
IMPORTANT?

• Monitoring data
gathered during
implementation
support learning and
adaptive
management. 18

• Monitoring data are the

backbone of the
accountability
TYPES OF MONITORING
Indicators → Context and Performance

Context Indicators Performance Indicators

Measure factors and conditions outside Measure expected outputs and

the control of USAID that have the outcomes of strategies, projects, or
potential to affect the achievement of activities based on a Mission’s Results
expected results at any level relevant of Framework or logic model to meet
a Results Framework or logic model. reporting requirements.

19
WHAT IS EVALUATION?
Systematic collection and
analysis of data and
information about the
characteristics and outcomes of
one or more organizations,
policies, programs, strategies,
projects, and/or activities…

…conducted as a basis for

judgments to understand and
improve effectiveness and
efficiency,

…timed to inform decisions

about current and future 20

programming.
PRINCIPLES AND STANDARDS OF
EVALUATION AT USAID
According to ADS 201, evaluations at USAID should be:

❏ Integrated into the Design of Strategies, Projects, and Activities

❏ Unbiased in Measurement and Reporting, Independent, and
Objective
❏ Relevant and Useful
❏ Based on Best Methods of Appropriate Rigor
❏ Oriented toward Reinforcing Local Ownership and National Self-
Reliance
❏ Transparent
❏ Conducted According to the Highest Ethical Standards

21
TYPES OF EVALUATION AT USAID
Impact Evaluation Performance Evaluation:

● Measures the change in a ● Often uses before and after

development outcome. comparison but lacks rigorous
● Attributable to an intervention. counterfactual.
● Cause-and-effect model. ● Can address a variety of topics,
● Employs a rigorous counterfactual such as:
○ Whether the theory of
change of a strategy, project,
or activity is valid;
○ Whether the expected results
of a particular strategy,
project, or activity have been
achieved;
○ How a particular Strategy,
When conducting evaluations, we also project,
align with the is being
or activity
Foundations for Evidence-Based Policy-Making Act of 2018.
implemented; 22

○ ...And many more

COLLABORATING, LEARNING & ADAPTING

23
CLA IN THE PROGRAM CYCLE

24
What does learning look
like in practice?

25
EXAMPLES OF
LEARNING
PRACTICES
• Conducting After Action
Reviews
• Adapting activities based on
monitoring and evaluation
findings
• Scenario Planning
• Consulting/building the
technical evidence base
• Sharing knowledge in
Communities of Practice
• Documenting/drawing on
institutional memory
26
MEL LEADS TO BETTER DECISION-MAKING
MONITORING EVALUATION
Is it going according to What happened? Why?
plan? How?

LEARNING
What are the
takeaways?

BETTER (RE)DESIGN
BETTER MANAGEMENT
of existing and future
of the activity
activities

BETTER DEVELOPMENT RESULTS

Resource Review

28
USAID RESOURCES

ADS CLA
Automated Directive System CLA Toolkit

MT ET
Monitoring Toolkit Evaluation Toolkit

29
USAID RESOURCES ADS
Automated
Directive System

30
USAID LEARNING LAB

31
USAID RESOURCES

CLA
CLA Toolkit

32
USAID RESOURCES

MT
Monitoring Toolkit

33
USAID RESOURCES

ET
Evaluation Toolkit

34
Questions?

35