Step 12: Assess effectiveness of the learning intervention and revise

Monitoring and evaluation are key elements in the development, implementation and ultimate success of a learning intervention. Developers analyze data collected during monitoring and evaluation activities and use it to make decisions about how to improve the effectiveness and efficiency of the learning intervention.

Monitoring is an ongoing process of collecting information about how a learning intervention is being implemented. Monitoring can determine whether:

Evaluation takes into account learner satisfaction and achievement at the end of a learning intervention and measures the overall effects of the learning intervention after implementation. Evaluations can determine whether:

If an intervention is complex, developers frequently conduct a pilot-test. A pilot-test is an experiment performed on a small scale that allows instructional developers to observe how various components of a learning intervention, such as the learner support system, function before going to full scale. If the scale of the intervention is small (e.g., adding a new module to an existing curriculum in a well-functioning structure) a pilot-test may not be necessary; regular monitoring and evaluation during the actual implementation may be sufficient.


Use Tool #14 Monitoring and Evaluation Plan to plan how the learning intervention will be monitored and evaluated, identify indicators and develop instruments and a schedule for the monitoring and evaluation (M&E) plan.

  1. Create a monitoring and evaluation plan. An M&E plan is a component of the instructional strategy (see Box 17) and should include:
    • What to monitor and evaluate: descriptions of indicators that will be used to measure attainment of the intervention objectives (e.g., learner achievement, usability of materials/tools, acceptability of the approach, costs of activities, job performance)
    • How and where: a description of monitoring and evaluation activities to be conducted during and after implementation (including plans for data collection, the instruments for collecting data, the data analysis and intervention revisions)
    • When: schedule for the monitoring and evaluation activities
    • Who: roles/responsibilities of the evaluation and implementation team
    • What resources: resources required to conduct evaluation activities (e.g., the equipment and tools to be used, computer applications for analyzing the data, mechanism for sharing data, funding).
    Many of the same indicators, instruments and data that are used for monitoring can also be used for evaluation. All indicators included on assessments and evaluations should inform a process and improve decision making, or they should not be used. Avoid the temptation to collect monitoring and evaluation data and "go fishing" for interesting results.
  2. Prepare to carry out the monitoring and evaluation plan:
    • develop instruments to collect data
    • train the monitoring and evaluation team (including trainers/instructors, data collectors, data analyzers) to ensure standardized scoring and observation rating
    • assemble the materials and resources required.
  3. Conduct the evaluation with users (including trainers/instructors, preceptors, learners/students, supervisors and other stakeholders).
    • observe the intervention activities, take notes about the process: challenges encountered by users, logistical issues
    • use evaluation instruments to collect user reactions and suggestions; ask users to complete questionnaires; interview the users either individually or in a focus group with a set of questions that address particular indicators; explore and understand suggestions shared by users
    • administer pre-/post-test (skills and knowledge) to measure learner achievement and ensure that the learning intervention is effective
  4. Analyze your observations, the comments and feedback offered by the users and the learners' achievements on pre-/post-tests. As indicated, make adjustments to the strategy, activities, materials, roles and responsibilities, procedures and evaluation instruments.
  5. If the evaluation plan includes assessing performance on the job or long-term impact on service delivery indicators, conduct follow-up evaluation activities as planned.

    Note: It this type of evaluation is planned, developers must have determined whether they have the necessary resources to conduct the evaluation. If non-training interventions were also implemented, the follow-up evaluation may include indicators specific to all the interventions.

Helpful Hints


  1. Monitoring and Evaluation Plan -- /