How to quantitatively assess the effectiveness of a training session

< Back
MONITORING AND EVALUATION  image
Overview
The Power of Measuring Results

• If you do not measure results, you cannot tell success from failure
• If you cannot see success, you cannot reward it
• If you cannot reward success, you are probably rewarding failure
• If you cannot see success, you cannot learn from it
• If you cannot recognize failure, you cannot correct it
• If you can demonstrate results, you can win public support

Source: Adapted from Osborne & Gaebler, (1992)
Competences addressed
After the completion of this tool, learners will be able to: 
• Manage and facilitate people from different cultural backgrounds helping them to work together effectively and smoothly
• Manage M&E projects in multicultural contexts
• Design and assess contingency plans for corrective actions in M&E systems
• Select and train staff with relevant skills to get involved in M&E projects
• Facilitate and promote interaction, understanding and collaboration amongst different stakeholders in a multicultural learning environment
OBJECTIVES
Design and write up a mini-survey which aims at recording, presenting and analyzing feedback from participants regarding the effectiveness of a session.
Group size
A regular class of medium size (8-12 trainees).
Time required
The tool design encapsulates two distinct phases:
1. The first entails the design of the survey’s parts (e.g. questions, sections, etc.). This first phase requires approximately 2 hours.
2. The second includes the quantitative and qualitative analysis of the responses and the presentation of the findings. This second phase (depending on the size of the sample and the number of questions) ranges between 4 and 6 hours.
RESOURCES
There are two types of resources necessary for the production of this tool.
1.    An electronic tool (e.g. survey monkey)
2.    Related bibliography regarding the design of research instruments

Note
For more information about point 2, you may click here to download the document which will be used in class for training purposes.
PROCESS
In class trainees are exposed to selected measuring tools (e.g. questionnaires and surveys) and they go through their key stages and characteristics. Then, they are asked to design their own instrument.
VARIATIONS
Based on the instrument designed trainees are asked to adapt it following different scenarios (e.g. research needs, audience, purpose, etc.)
Exercises
  • Exercise 1
  • On the basis of the texts How to develop a questionnaire for research: In-brief, and Likert Scale Type Response Anchors provided, complete the following task:

    • QUESTIONS TO REFLECT ON AT THE END OF THE ACTIVITY
      • Did trainees enjoy the activity?
      • Did trainees find the activity helpful and practical?
      • Did trainees collaborate during the activity?
      • Did the trainees experiment further with the material?


  • Exercise 2
    • Choose six categories from the Likert Scale text to produce your five questions per category on a topic of your own choice.
    • QUESTIONS TO REFLECT ON AT THE END OF THE ACTIVITY
      • Did trainees enjoy the activity?
      • Did trainees find the activity helpful and practical?
      • Did trainees collaborate during the activity?
      • Did trainees experiment further with the material?