Monitoring and evaluation of selected child wellbeing practices through Knowledge Management Outreach Sites (KMOS)

Overview
The Communication for Development (C4D) section of UNICEF and seven partner non-government organisations (NGOs) are implementing the “Engaging Communities for Social & Behavioral Change” project in seven hard-to-reach districts of Bangladesh. The aim of this project is to make a positive difference in the lives of children, their families and communities. The James P Grant School of Public Health, BRAC University (JPGSPH) has been assigned with the task to act as an external party to monitor the project and to assess the effectiveness of C4D approaches.

The objectives of the study are to capture the progress of overall programme activities, assess the implementation processes, and explain the reasons for any deviation in selected sentinel sites, as well as control sites. In addition, the project will also track the intended and unintended effects of C4D approaches in terms of trends in individual and community characteristics around selected behavioural themes. The knowledge gained and lessons learned from the study will be used to modify strategies and to strengthen the capacity of the C4D programme.

JPGSPH has successfully completed Phase I of the project. In Phase I, JPGSPH developed two separate but interconnected monitoring frameworks and necessary monitoring and evaluation tools for assessing the progress of the programme. In Phase II, JPGSPH has been implementing the tools developed during the previous phase to assess the programme’s effectiveness. Three quantitative surveys followed by qualitative studies will be conducted for results-based monitoring, followed by qualitative studies after each wave of quantitative data collection.

A baseline study (quantitative survey followed by qualitative study)has already been completed by JPGSPH. In addition, a formal training was provided to staffs from partner NGOs for the continuous collection of performance and process monitoring data.Data collection for the midline study is currently ongoing.

Activities
Phase I:
• From January-April 2014two separate but interconnected monitoring frameworks were developed:
1) Monitoring of the performance and process of the programme activities
2) Monitoring and evaluation of the results of the programme
Phase II:
• From the seven districts where C4D is implemented, seven sentinel sites and seven control sites were selected to conduct monitoring survey based on their geographical locations, similarity between sentinel and control sites, and accessibility.
• From February-March 2015, a total of 2,880 quantitative data were collected for baseline study using structured questionnaires from six sentinel and control sites.
• A total of 156 qualitative data were collected for the baseline study through focus group discussions and face-to-face, in-depth interviews with different target groups using semi-structured guidelines.
• After analysing both the quantitative and qualitative data, the final report was submitted to UNICEF.
• A unique software has been developed for monitoring performance and processes and proper documentation of project activities.
• From 30 November 2015, a second wave of data collection has commenced as part of the midline study.

Partners/donor
• UNICEF (Donor)

Highlights
• Two national level dissemination workshops have been organised to share the findings of the baseline study with UNICEF
• A training session on performance and process monitoring software was organised by JPGSPH for staffs from partner NGOs and district level C4D section heads of UNICEF.