Terms of Reference Endline Evaluation  BCCD Project

Assignment Information

1. About WaterAid 

WaterAid is an international not-for-profit, determined to make clean water, decent toilets, and good hygiene normal for everyone, everywhere within a generation. We have been working with government and non-governmental partners in Pakistan since 1992 to ensure that these essential services are available to poor and marginalized communities, especially women, persons with disabilities etc. WaterAid employs a public health and climate adaptation approach to addressing current water, sanitation and hygiene (WASH) service and behaviours requirements and sustaining them for the future. Hygiene behaviour change (including multiple behaviours), menstrual hygiene, rural and urban sanitation and safe water systems, WASH in institutions (healthcare facilities, schools, public places) and nature-based solutions for water conservation, groundwater recharge and waste-water treatment are some of the interventions used for achieving our objectives. We also work with sector partners to support and influence the behavioural, institutional and policy mechanisms for accelerating progress toward achieving safe and sustainable WASH access and behaviours for the poor and marginalized communities.

     For more information, please visit (www.wateraid.org) 

2. Project Description

The WAP (WaterAid Pakistan) has implemented the project Behaviour Change and Capacity Development (BCCD) as lead consortium. It is a joint venture between WaterAid Pakistan, SPO (Strengthening Participatory Organization) and M&C Saatchi. The WAP has been awarded with the project component of behaviour change and capacity development by Punjab Rural Municipal Services Company (PRMSC) that has been established as private entity under the Local Government and Community Development Department LG & CD). Government of the Punjab and World Bank are the sponsors of the 5-year project which has been initially piloted in 200 villages of Punjab. The Project components include: 

(a) Water Supply and Sanitation Infrastructural Development 

(b) Behaviour Change and Capacity Development 

(c) Service Delivery Improvement 

(d) Project Management and Monitoring.

The BCCD part of the  project aims to contribute on sustaining WASH services and reduce stunting through the identification of current behaviours and its determinants and developing BCC Strategy, Intervention Package and its capacity development plan to test Strategy and Capacity Building Plan in 200 Villages as a behaviour change proof of concept intervention. The project will be delivered in two phases which includes.

1. Developing an overall strategy for 2,000 revenue villages, developing basic behaviour change intervention packages (manual, tools/material) and building capacity and 

2. Implementing the devised strategy in 200 pilot revenue villages, using the behaviour change intervention developed for the purpose. 

WaterAid Pakistan, in collaboration with Strengthening Participatory Organisation (SPO) and M&C Saatchi, has implemented the project component focusing on 'behaviour change and capacity development'. This joint venture aims to contribute to sustaining WASH services and reducing stunting by promoting key behaviours. The project has been piloted in 200 villages of 15Tehsils in Punjab Province. This endline study is focusing on the pilot phase only.

The BCCD project has 03 outcomes, as follows:

• Outcome 1: Communities of 200 Villages are practicing Inclusive Health and Environment’ friendly Protective Behaviours

• Outcome 2: Communities are willing to pay for the Sustainability of WASH and SWM Services provided by PRMSC

• Outcome 3: Capacities of PRMSC Staff, Relevant Stakeholders and Community are built to sustain the Quality of services and Behavioural Change.

3. Project Achievements/progress:

The project will be successfully completed in October 2025 in all the 16 targeted Tehsils of Punjab, However the project achievements to-date are summarised as follows,

Implementation Phase:

• 200 Village Organizations has been formed / strengthened with male and female representatives.

• Modules / Material of six interpersonal exposures for the HHs developed and it will be executed in all 200 villages.

• 133,402 Households has been reached through 06 exposures throughout the project. 

• 8,490 children have been exposed to WaSH behaviours in 111 targets schools.

The hardware component of the project has been delivered by the PRMSC through different national contractors across all these villages/Tehsils, that are the pre-conditions for the BCCD component. These services include,

• Access to safe drinking water to the targeted Households.

• Establishing sanitation sewerage network services such as ‘central sewerage system and treatment plant” in the targeted community. Provision of solid waste management bins to each HHs (02 bins/HH).

All the project related documents, reports and material will be available to the consulting firm after the selection.

4. Project Re-alignment: 

During the implementation, following are the key shifts or adjustments has been made to the project that has an impact on the BCCD component. These are.

1. Provision of 4 months (July to Oct 2025) no-cost extension to JV partners by PRMSC to complete the remaining deliverables by the 31st of October 2025.

2. One out of 16 Tehsils has been moved from Phase 1 (Pilot phase) to the Phase 2 of the project by PRMSC. 

5. Scope and Purpose of the Endline Evaluation: 

The endline study on WASH, Baby WASH Hygiene Behaviors and waste management elements of the Project aims to assess the situation and behaviors related to WASH practices among the target population across 15 districts of Punjab, after the successful completion of the interventions. The study results will serve as the contribution of BCCD project toward the behavioral change. The endline results will be presented in comparison to the baseline results, to show the percentage change in the knowledge, social norms, practices and behavior in the targeted HHs. 

5.1. Scope of the Work:

• To assess household knowledge, social norms, behaviours and practice around 12 behaviours under the BCCD project as part of BCC strategy.

• To collect measurable information about WASH behaviours in line with key indicators and compare progress from baseline to endline evaluation.

• Interpretation of the analyzed data to demonstrate the project’s progress and extract meaningful insights and descriptions for the BCCD project. 

• Provide practical recommendations around the interventions and strategies for the next phase of the BCCD project that leads to improve WASH and Baby WASH practices based on the evidence both from project effectiveness analysis and evaluation. 

• To assess the relevancy and of effectiveness

•  5.2. Quality Criteria and related questions:

6. Proposed Methodology & Sampling: 

WA Pakistan suggests employing a cross-sectional study using mixed-methods approach to gather relevant data, combining both quantitative and qualitative techniques to evaluate the project’s performance. The consultant will finalize the methodology in consultation with WAP team, which will be approved during the inception phase. This may involve several discussions, pre-inception meetings, and desk review. The same baseline methodology including the 1333 household sample size will be replicated during the end-line covering the quantitative scope of work, however for qualitative scope a methodology would be defined. Additionally, while developing tools needs to focus on the indictors that has been assessed during baseline same will be assessed in endline. 

Data Collection Methods:

The data collection will involve both quantitative and qualitative approaches to assess the project's performance. Quantitative methods will focus on measurable outputs/ results including knowledge, reported behaviours & observed behaviours, while qualitative methods will provide deeper insights into stakeholders (JV Partner’s, PRMSC and the Village Organizations) experiences, desk review for all the project outputs, ensuring a comprehensive evaluation of the proposed criteria for BCCD project.

1. Quantitative & Qualitative Methods:

Survey: A pre-designed survey questionnaire that has been designed during the baseline study will be administered to households to assess their WASH, baby WASH, waste management related hygiene knowledge, social norms, diseases, socio-demo characteristics, behaviours etc. The questionnaire will gather data on 12 key behaviours from 1070 households as part of the BCC strategy.

Observational and Spot Checklist: A pre-designed household observational checklist/questionnaire that has been designed during the baseline study will be administered to households to assess their actual behaviours and practices around the WASH, Baby WASH, and waste management using structured observation methods for actual behaviours. The behaviours will be observed several hours in the house and assesses the outcomes. The spot check will include the assessment of WASH facilities, waste management facilities (availability, functionality, use) etc using the standard checklist. This will help confirm whether the reported survey data aligned with the physical conditions observed in the HHs, ensuring the accuracy and reliability of the survey results.

Desk review: This will be exploring the project outputs (strategy, reports, capacity building training, briefs, behaviour change packages, reported reach numbers etc). 

Sampling Strategy:

The WAP suggests having a multiple sampling approaches in-line with defined scope of work under the TOR. For conducting the survey (quantitative scope) it’s critical that Households are randomly sampled so that the results obtained are statistically representative but within the selected district. In this endline survey, the sample size will be drawn from the project targeted household. Same baseline approach will be adopted for endline, as in the baseline study the sample has been drawn from the entire households within the 200 targeted villages of 15 targeted Tehsils, the HH data was obtained from the Department of Statistics, Government of Punjab. Exclusion criteria will apply for the households or clusters that did not receive services from PRMSC and fall outside the intervention area are excluded from the study. The HH listing data will be provided at the time of inception phase to the selected consulting firm.

For qualitative aspect (KII, FGD’s and desk review), WAP would suggest using purposive sample, to have responses from the key informant for the relevant evaluation criteria. 

2. Calculating the sample size:

The project area covers 200 villages in 15 Tehsils of Punjab. The total HHs in these villages are 133,402 HHs.

The sample size depends on the required accuracy of the results, which is defined in terms of Confidence Level, and margin of error.  For now three exposures has been implemented in the targeted communities however the sample would be decided after completion of the six exposures:

For the purposes of this survey, it is proposed to use a sample size of 1070 HHs, which will provide a 95% confidence level 3% MoE.

The final sample strategy would be agreed with consultant at the time of inception report while considering the baseline sample size (i.e., 1070 HHs). The proportional to sample size (PPS) method would be used for sample distribution within the sample villages. Following is the sample size calculation formula.

Formula: n=Z2. p.(1-p)/E2

Where:

• n = required sample size

• Z = Z-value (the number of standard deviations from the mean; for a 95% confidence level, Z is typically 1.96)

• p = estimated proportion of the population (if unknown, use 0.5 for maximum sample size)

• E = margin of error (the desired precision level, expressed as a decimal)

To observe the prevailing practices and behaviours within the targeted population, a sub-sample to be drawn from the sampled HHs. A structured observational checklist would be used to collect the data. This observational data will be triangulated with the HHs survey results to complement the results.

7. Deliverables: 

The consultant is expected to produce the following:

1. A comprehensive inception report detailing the proposed methodology and approach for the endline evaluation along with a work plan that includes clear timelines for each phase of the assignment. An inception meeting will be held with WaterAid Pakistan’s BCCD project team and Technical Lead (HQ) to ensure alignment on expectations, methodology, and scope before initiating data collection.

2. WaterAid has developed the data collection tools for the baseline evaluation, including survey questionnaires and observational checklist. All designed to align with the project’s specific indicators and objectives. The same tools will be adapted to the endline. These tools will be provided to the consultant once selected. 

3. Data will be collected using mobile-based tools such as Kobo Collect or ODK.

4. Raw and clean datasets in data analysis format, including cleaned and anonymized data, along with necessary documentation or codebooks to assist in understanding the dataset, will be provided at the end of the assignment along with the report.

5. Presentation of key findings and recommendations to WaterAid Pakistan’s BCCD project team, JV partner’s and the PRMSC. This session will provide an opportunity for feedback, clarification, and alignment before finalising the endline evaluation report.

6. A comprehensive final endline/evaluation report including the collected data, clearly presenting key findings conclusion and recommendations. A draft report must be submitted (with a one-week review period) so that the WaterAid BCCD project team, technical lead and PRMSC can provide comments and feedback before it is finalised.  This report must be aligned with WaterAid’s reporting format and will require approval from WaterAid before final submission.

8. Supervision

The consultant will report to the Team Lead – BCCD Project (WAP), however keep Evaluation Manager in the loop.

9. Roles and Responsibilities:

Lead Consultant: Oversee the design, execution, and analysis of the survey. Ensure data quality and timely completion of deliverables.

Consultant’s Enumerators / Lead consultant: Conduct household surveys and observations, ensuring informed consent is obtained from participants. While the KII, desk review to be conducted by lead consultant with the key stakeholders (JV partners, PRMSC etc).

WaterAid BCCD project team: Provide technical oversight and support, including review of reports, and findings.

Evaluation Manager: A PM&E focal person form BCCD project team, he/she will be the bridge between consultant/consulting firm and the WAP. He/she will provide all the project related relevant data to consultant, facilitate the coordination and organizing the meetings with JV partners, provide support in sampling, tools finalization, field planning, ensure survey quality, coordinate the reports review process within the organization and JV partners, organize key finding presentations, ensure timely payments processes and finalize the report.

10. Ethics and risks

The consultant must ensure that all data collection activities adhere to ethical standards, including informed consent, voluntary participation, and the right to withdraw at any time. Data collected must be anonymised and securely stored. Special consideration must be given to the participation of vulnerable groups, including women and persons with disabilities. Any ethical risks must be identified and mitigated, and consultant must comply with other relevant WaterAid policies, such as the Contractor Code of Conduct and Global Safeguarding policy.

11. Application /Proposal 

The proposal should contain the following:

1. An expression of interest explaining your interest and suitability for the position against each of the selection criteria. Please explain as to how your skills match the tasks detailed in the ToR.

2. Description of methodology which will be used for the Project Endline cum Evaluation.

3. Company profile.

4. Personal profile/portfolio. (CVs of key proposed staff)

5. Sample of similar project endline study / evaluations conducted by the proposed consultant/firm. (please attach a sample of recent endline / evaluation conducted on the BCCD theme/topic)   

6. Financial proposal (In separate envelop, detailing the item wise budget needs of the assignment, including but not limited to daily rate and other costs inclusive of all taxes. The budget needs to be supplemented with budget narrative, rationalising the cost and its breakup). 

7. A workplan with deadline for each deliverable. 

12. Evaluation criteria

Candidate (consulting firms) shall submit technical and financial proposals in two separate sealed envelopes. Technical offers will first be evaluated according to the “Evaluation criteria” below and the technical qualification threshold point is “70”. 

Technical Evaluation Criteria for Shortlisting Consultancy Firms/academia:

Financial offer 

Please refer to clause 5 of section “10. Application /Proposal”. TheFinancial offer needs to

testify the fact that each deliverable is accounted for in the offer and syncs with the

workplan. All deliverables must be completed within the assignment duration. 

13. Application Process and Closing date

All proposals must be sent in hard copy via registered mail/courier to the following address on or before August 26, 2025. The consultancy title “WAP-01864/11-08-2025/ Endline Evaluation of BCCD Project “must be clearly marked on the envelope/email subject. 

Title:“WAP-01864/11-08-2025/ Endline Evaluation of BCCD Project “

Address: 

Head of Admin, Security and Government Relations 

WaterAid Pakistan, 

2nd Floor Executive Heights, 

65 West, Fazl ul Haq Road 

Blue Area Islamabad. 

Telephone No: +91 (0) 51 2806120-22