The Development Impact Evaluation Unit (DIME) of the World Bank will launch its new impact evaluation program with the World Food Programme as part of DIME’s effort to expand the use of data analytics and evidence-based methods in partner agencies.
From May 27-30, during the Rome Impact Evaluation Workshop on Cash-based Interventions and Gender, DIME will work with approximately 30 WFP staff based in 8 different countries (Afghanistan, Burundi, Bangladesh, El Salvador, Guinea, Kenya, Syria, and Turkey). The workshop's main objective is to work towards improving the design of Cash-Based transfer and Gender projects and to use rigorous evidence to achieve better program results by learning how to make interventions work.
The workshop will use eight (8) WFP financed projects that constitute a concrete basis of case studies and hands-on experimentation. The workshop will serve to:
Impact Evaluation Workshop on Cash-based Interventions and Gender
May 27th – 30th, 2019 – Rome, Italy
Day 1 - Monday May 27th | ||
8:30 - 9:00AM | Registration and Knowledge Test (Pre) | |
9:00 - 9:30AM | Opening Remarks | |
| -Andrea Cook, Director, Evaluation at the World Food Programme -Florence Kondylis, Senior Economist, DIME - World Bank Group | |
9:30 – 10:00AM | ||
| -Paul Christian, Economist, DIME - World Bank Group | |
10:00 - 10:45AM | Impact Evaluation for Real-Time Decision-Making | |
| - Florence Kondylis, Senior Economist, DIME - World Bank Group | |
10:45 - 11:15AM | Coffee Break | |
11:15 - 12:30PM | Measuring Impact I: Causal Inference & Experimental Methods | |
English, French, and Spanish parallel sessions | This session will introduce experimental methods. Topics covered include causal inference and randomization. -French: Chloë Fernandez, Research Analyst, DIME - World Bank Group -Spanish: Marcus Holmlund, Economist, DIME - World Bank Group -English: Saahil Karpe, Research Analyst, DIME - World Bank Group | |
12:30-1:30PM | Lunch | |
1:30 - 2:15PM | Impact Opportunities I: Can Development Lead to Gender Equality and Women’s Empowerment (GEWE)? | |
This session will present examples of how development and humanitarian programs can or cannot influence gender responsive issues. -Patrick Premand: Impacts of Labor-Intensive Public Work Programs on employment and earnings -Chloë Fernandez: Impact of a CDD program on GEWE in Eastern DRC -Paul Christian: Do social safety nets buffer women against natural disasters? | ||
2:15 - 2:30PM | Coffee Break | |
2:30 - 5:00PM | Group Work I – Identifying the central issue | |
Small groups | Each project team is assigned an IE specialist for the week. In this session, the group will establish a results chain for their project and identify which constraints the aim to address. | |
Day 2 - Tuesday May 28th | ||
9:00 - 10:15AM | Impact Opportunities II: Inclusion and targeting | |
| This session will provide examples of how to target the right population group and what this can entail in terms of designing an impact evaluation. -Aidan Coville: Targeting the ultra-poor in Afghanistan -Patrick Premand: Targeting vulnerable populations in rural DRC and Niger - Erin Kelley: Are psycho-social support programs targeting the most vulnerable refugees? -Lelys Dinarte: The Tracking-by-Violence Experiment in El Salvador
| |
10:15 – 10:30AM | Coffee Break | |
10:30 - 11:30PM | Measuring Impact II: Non-experimental Methods | |
English, French, and Spanish parallel sessions | This session will introduce non-experimental methods, such as Regression Discontinuity Designs and Difference-in-Difference. -French: Serge Adjognon, Economist, DIME - World Bank Group -Spanish: Lelys Dinarte, Economist - World Bank Group -English: John Loeser, | |
11:30 - 12:45PM | Impact Opportunities III: Can GEWE Create Economic Development? | |
| This session will focus on examples of gender responsive interventions and how these can contribute to development. The session will focus around 4 key clusters that are forced migration and mobility, mobile money, and retail engagement. -Florence Kondylis: Training women to be extension agents in Malawi and Mozambique -Paul Christian: Safety First, perceived risks of street harassment and education choices -Marcus Holmlund: Breaking stereotypes and building cohesion -Greg Lane: Credit Lines as Insurance | |
12:45 - 2:00PM | Lunch | |
2:00 - 2:45PM | WFP I: Presentation on CBT programs and gender | |
| Use and Generation of Evidence on CBTs -Stephane Meaux, OSZIC, WFP Gender and Cash Study: how CBIs can contribute to achieving GEWE -Jacqueline Paul, Gender Office, WFP | |
2:45 - 3:00PM | Coffee Break | |
3:00 - 5:00PM | Group Work II – Identifying Research Questions and Key Indicators | |
Small groups | Each team determines the research questions to be answered by the impact evaluation and the corresponding indicators and data. The results will be recorded in the PowerPoint template. | |
Day 3 - Wednesday May 29th | ||
9:00 - 10:00AM | Measuring Impact III: Sampling and Power Calculations | |
| Introduction of the concepts of sampling, randomization, and power calculations -Saahil Karpe, DIME, World Bank Group | |
10:15 - 10:30AM | Coffee Break | |
10:30 - 11:15PM | WFP II: Data on Gender | |
| -Kristen McCollum, OEV, WFP -McCartan Humphreys, Professor, Columbia University | |
11:15 - 12:30PM | Impact Opportunities IV: Measuring GEWE
| |
| This session will present novel methods which can be applied in fragile contexts to measure a program’s desired outcome(s). Specifically, we will focus on mobility, intra-household decision making, market access and financial inclusion. -Florence Kondylis: Implicit Association Tests of discrimination in Brazil -Serge Adjognon: Market Access in Senegal -Carolina Castilla: Using behavioral economics to measure intra-household decisions -Aidan Coville: Financial inclusion of Women in a Graduation Program in Afghanistan | |
12:30 - 1:30PM | Lunch | |
1:30 – 3:00PM | Group Work III – Impact Evaluation Identification Strategy | |
Small groups | Teams work with their facilitator to design an impact evaluation strategy for their chosen project. They will also think through the mechanisms worth evaluation and other design issues. The proposed design will be recorded in the project's PowerPoint template. | |
3:00 - 3:15PM | Coffee Break | |
3:30 - 5:00PM | Group Work IV– Impact Evaluation Plan
| |
Small groups | The group will work on the practical implementation plan of the impact evaluation including budget, timeline, and staffing. | |
Day 4 - Thursday May 30th | ||
9:00 - 10:30AM | Group Work V– Finalizing Impact Evaluation Presentations | |
| This last session will be used to finalized the different teams’ PowerPoints and prepare for the presentation. | |
10:30 - 10:45AM | Coffee Break | |
10:45 - 11:15PM | Knowledge Test (Post) | |
11:15 - 12:15PM | Impact Evaluation Designs I: Team Presentations | |
| Project teams present their proposed impact evaluation designs to the plenary group using their PowerPoint template. Practical feedback on the design, implementation and monitoring arrangements will be given by the impact evaluation specialists and the other teams. The IE specialists will verify that the proposed design is robust and that a well-specified process exists for mainstreaming the impact evaluation into project implementation. Each team will leave with a fully developed impact evaluation design and implementation plan | |
12:15 - 1:30PM | Lunch | |
1:30 - 2:30PM | Impact Evaluation Designs II: Team Presentations | |
| Project teams present their proposed impact evaluation designs to the plenary group using their PowerPoint template. Practical feedback on the design, implementation and monitoring arrangements will be given by the impact evaluation specialists and the other teams. The IE specialists will verify that the proposed design is robust and that a well-specified process exists for mainstreaming the impact evaluation into project implementation. Each team will leave with a fully developed impact evaluation design and implementation plan | |
2:30 - 3:00PM | Closing Remarks, Wrap-up and Next Steps | |
3:00 - 3:30PM | Coffee Break | |
Support Staff at the Workshop: