Learn how the World Bank Group is helping countries with COVID-19 (coronavirus). Find Out

Events

Impact Evaluation Workshop on Cash-based Interventions and Gender

May 27-30, 2019

Rome, Italy

Image

  • The Development Impact Evaluation Unit (DIME) of the World Bank will launch its new impact evaluation program with the World Food Programme as part of DIME’s effort to expand the use of data analytics and evidence-based methods in partner agencies.

    From May 27-30, during the Rome Impact Evaluation Workshop on Cash-based Interventions and Gender, DIME will work with approximately 30 WFP staff based in 8 different countries (Afghanistan, Burundi, Bangladesh, El Salvador, Guinea, Kenya, Syria, and Turkey). The workshop's main objective is to work towards improving the design of Cash-Based transfer and Gender projects and to use rigorous evidence to achieve better program results by learning how to make interventions work.

    The workshop will use eight (8) WFP financed projects that constitute a concrete basis of case studies and hands-on experimentation. The workshop will serve to:

    • Work with WFP staff to design rigorous Impact Evaluations (IE) through hands-on training on IE concepts, objectives, techniques, methods and management.
    • Develop a high-quality IE design and implementation plans for each selected project through targeted clinic sessions bringing together project teams, and IE Experts. Each plan will be the basis for a program of technical assistance to help projects conduct an IE and use resulting evidence to make policy decisions.

     

  • Impact Evaluation Workshop on Cash-based Interventions and Gender
    May 27th – 30th, 2019 – Rome, Italy

     

    Day 1 - Monday May 27th

     

    8:30 - 9:00AM

    Registration and Knowledge Test (Pre)

     

    9:00 - 9:30AM

    Opening Remarks

     

     

    -Andrea Cook, Director, Evaluation at the World Food Programme

    -Florence Kondylis, Senior Economist, DIME - World Bank Group

     

    9:30 – 10:00AM

    CBT and Gender – Evidence and Knowledge Gaps

     

     

    -Paul Christian, Economist, DIME - World Bank Group

     

    10:00 - 10:45AM

    Impact Evaluation for Real-Time Decision-Making

     

     

    - Florence Kondylis, Senior Economist, DIME - World Bank Group

     

    10:45 - 11:15AM

    Coffee Break

     

    11:15 - 12:30PM

    Measuring Impact I: Causal Inference & Experimental Methods

     

    English, French, and Spanish parallel sessions

    This session will introduce experimental methods. Topics covered include causal inference and randomization.

    -French: Chloë Fernandez, Research Analyst, DIME - World Bank Group

    -Spanish: Marcus Holmlund, Economist, DIME - World Bank Group

    -English: Saahil Karpe, Research Analyst, DIME - World Bank Group

     

    12:30-1:30PM

    Lunch

     

    1:30 - 2:15PM

    Impact Opportunities I: Can Development Lead to Gender Equality and Women’s Empowerment (GEWE)?

     
     

    This session will present examples of how development and humanitarian programs can or cannot influence gender responsive issues.

    -Patrick Premand: Impacts of Labor-Intensive Public Work Programs on employment and earnings

    -Chloë Fernandez: Impact of a CDD program on GEWE in Eastern DRC

    -Paul Christian: Do social safety nets buffer women against natural disasters?

     

    2:15 - 2:30PM

    Coffee Break

     

    2:30 - 5:00PM

    Group Work I – Identifying the central issue

     

    Small groups

    Each project team is assigned an IE specialist for the week. In this session, the group will establish a results chain for their project and identify which constraints the aim to address.

     
     
     

    Day 2 - Tuesday May 28th

     

    9:00 - 10:15AM

    Impact Opportunities II: Inclusion and targeting

     

     

    This session will provide examples of how to target the right population group and what this can entail in terms of designing an impact evaluation.

    -Aidan Coville: Targeting the ultra-poor in Afghanistan

    -Patrick Premand: Targeting vulnerable populations in rural DRC and Niger

    - Erin Kelley: Are psycho-social support programs targeting the most vulnerable refugees?

    -Lelys Dinarte: The Tracking-by-Violence Experiment in El Salvador

     

     

    10:15 – 10:30AM

    Coffee Break

     

    10:30 - 11:30PM

    Measuring Impact II: Non-experimental Methods

     

    English, French, and Spanish parallel sessions

    This session will introduce non-experimental methods, such as Regression Discontinuity Designs and Difference-in-Difference.

    -French: Serge Adjognon, Economist, DIME - World Bank Group

    -Spanish: Lelys Dinarte, Economist  - World Bank Group

    -English: John Loeser,

     
     

    11:30 - 12:45PM

    Impact Opportunities III: Can GEWE Create Economic Development?

     

     

    This session will focus on examples of gender responsive interventions and how these can contribute to development. The session will focus around 4 key clusters that are forced migration and mobility, mobile money, and retail engagement.

    -Florence Kondylis: Training women to be extension agents in Malawi and Mozambique

    -Paul Christian: Safety First, perceived risks of street harassment and education choices

    -Marcus Holmlund: Breaking stereotypes and building cohesion

    -Greg Lane: Credit Lines as Insurance

     

    12:45 - 2:00PM

    Lunch

     

    2:00 - 2:45PM

    WFP I: Presentation on CBT programs and gender

     

     

    Use and Generation of Evidence on CBTs

    -Stephane Meaux, OSZIC, WFP

    Gender and Cash Study: how CBIs can contribute to achieving GEWE

    -Jacqueline Paul, Gender Office, WFP

     

    2:45 - 3:00PM

    Coffee Break

     

    3:00 - 5:00PM

    Group Work II – Identifying Research Questions and Key Indicators

     

    Small groups

    Each team determines the research questions to be answered by the impact evaluation and the corresponding indicators and data. The results will be recorded in the PowerPoint template.

     
     
     

    Day 3 - Wednesday May 29th

     

    9:00 - 10:00AM

    Measuring Impact III: Sampling and Power Calculations

     

     

    Introduction of the concepts of sampling, randomization, and power calculations

    -Saahil Karpe, DIME, World Bank Group

     
     

    10:15 - 10:30AM

    Coffee Break

     

    10:30 - 11:15PM

    WFP II: Data on Gender

     

     

    -Kristen McCollum, OEV, WFP

    -McCartan Humphreys, Professor, Columbia University

     

    11:15 - 12:30PM

    Impact Opportunities IV: Measuring GEWE

     

     

     

    This session will present novel methods which can be applied in fragile contexts to measure a program’s desired outcome(s). Specifically, we will focus on mobility, intra-household decision making, market access and financial inclusion.

    -Florence Kondylis: Implicit Association Tests of discrimination in Brazil

    -Serge Adjognon: Market Access in Senegal

    -Carolina Castilla: Using behavioral economics to measure intra-household decisions

    -Aidan Coville: Financial inclusion of Women in a Graduation Program in Afghanistan

     

    12:30 - 1:30PM

    Lunch

     

    1:30 – 3:00PM

    Group Work III – Impact Evaluation Identification Strategy

     

    Small groups

    Teams work with their facilitator to design an impact evaluation strategy for their chosen project. They will also think through the mechanisms worth evaluation and other design issues. The proposed design will be recorded in the project's PowerPoint template.

     

    3:00 - 3:15PM

    Coffee Break

     

    3:30 - 5:00PM

    Group Work IV– Impact Evaluation Plan

     

     

     

    Small groups

    The group will work on the practical implementation plan of the impact evaluation including budget, timeline, and staffing.

     
     
     

    Day 4 - Thursday May 30th

     

    9:00 - 10:30AM

    Group Work V– Finalizing Impact Evaluation Presentations

     

     

    This last session will be used to finalized the different teams’ PowerPoints and prepare for the presentation.

     
     

    10:30 - 10:45AM

    Coffee Break

     

    10:45 - 11:15PM

    Knowledge Test (Post)

     

    11:15 - 12:15PM

    Impact Evaluation Designs I: Team Presentations

     

     

    Project teams present their proposed impact evaluation designs to the plenary group using their PowerPoint template. Practical feedback on the design, implementation and monitoring arrangements will be given by the impact evaluation specialists and the other teams. The IE specialists will verify that the proposed design is robust and that a well-specified process exists for mainstreaming the impact evaluation into project implementation. Each team will leave with a fully developed impact evaluation design and implementation plan

     

    12:15 - 1:30PM

    Lunch

     

    1:30 - 2:30PM

    Impact Evaluation Designs II: Team Presentations

     

     

    Project teams present their proposed impact evaluation designs to the plenary group using their PowerPoint template. Practical feedback on the design, implementation and monitoring arrangements will be given by the impact evaluation specialists and the other teams. The IE specialists will verify that the proposed design is robust and that a well-specified process exists for mainstreaming the impact evaluation into project implementation. Each team will leave with a fully developed impact evaluation design and implementation plan

     

    2:30 - 3:00PM

    Closing Remarks, Wrap-up and Next Steps

     

    3:00 - 3:30PM

    Coffee Break

     

     

    Support Staff at the Workshop:

    • Silvia Velez Caroco, DIME, Word Bank: Analyst