Evaluation of the Mwangaza Mashinani Pilot Project in Kilifi and Garissa Counties, Kenya 2019-2021

The Mwangaza Mashinani is a project that aims to enhance energy access for the most vulnerable segment of the Kenyan population. The project is targeted at vulnerable, off-grid households with school-going children who are enrolled in the GoK's cash transfer programme in Kilifi and Garissa. Once enrolled, households may choose to purchase a three-bulb solar home system for lighting and with a USB point for phone charging on a pay-as-you-go basis. To address the issue of affordability of these products, the project provides households with a bi-monthly cash top-up (i.e., a subsidy) which can be used to make repayments for the solar device over a one-year period.

Beyond improving access to clean energy for households, the project aims to increase children's and their families' well-being in terms of: Health - households reduce their use of kerosene and/or candles for lighting resulting in a reduction in indoor air pollution and fire hazards and, ultimately, a reduction in the prevalence of respiratory illness, burns and eye irritation; Education - children can increase the number of hours that they spend studying at night by using solar lighting resulting in improved educational outcomes; and Livelihoods - households can use the solar device to continue their productive activities at night, diversify livelihoods (e.g., by charging mobile phones for a fee), and reduce their net energy expenditure, resulting in an increase in household income.

UNICEF contracted OPM to conduct an independent evaluation of the Mwangaza Mashinani pilot project. The primary purpose of the evaluation was to render a summative assessment of the impact of the pilot project, and to generate scientifically robust evidence on whether and how the project has impact on the quality of life of children and their families in terms of education, health, and livelihoods. The evaluation also had a formative purpose, to improve the processes of the pilot project.

To fulfil these aims, a mixed methods research framework was designed. Broadly, this framework combines four methodologies: i) a quantitative research study to respond to questions of effectiveness and impact, and to support answers on relevance and sustainability. This study is based on a quasi-experimental design (using propensity score matching) and a quantitative household survey, which was implemented through an in-person survey at baseline and endline, and remotely through a mobile phone survey at midline; ii) a qualitative research study to respond to questions of relevance and effectiveness, and to provide initial indications of sustainability. This study is based on interviews with community leaders, community-based project support structures, and male and female household members; iii) an implementation review to respond to questions regarding the relevance and effectiveness of the project. This study is based on interviews with national-level stakeholders, including the GoK, UNICEF, and the implementing consortium and iv) a VfM study to respond to questions of efficiency. It relies on data from UNICEF and the implementing consortium.

The scope of the Evaluation of the Mwangaza Mashinani Pilot Project in Kilifi and Garissa Counties, Kenya 2019-2021 Survey includes the following themes:

Baseline Survey
- Member identification
- Member basics
- Member details
- Household members health
- Education expenses
- Household assets
- Access to energy
- Awareness of alternative sources of energy
- Exposure to intervention
- Woman time use
- Child time use
- Outcome

Midline Survey
- Solar Energy
- Exposure to intervention
- Member livelihoods
- Remittances
- Member education
- Member health
- COVID knowledge and behavior
Endline Survey
- Member basics
- Member details
- Household members health
- Education expenses
- Household assets
- Access to energy
- Solar panel (for non-beneficiary users)
- Solar panel (for beneficiaries)
- Promotion of solar devices
- Covid-19 behaviour and access
- Woman time use
- Child time use
- Covid-19 info for households
- Outcome