Impact Evaluation in Trade & Competitiveness
May 11-14, 2015Istanbul, Turkey

This workshop, hosted by Development Impact Evaluation (DIME) and the WB Trade & Competitiveness (T&C) Global Practice will bring together practitioners, subject matter experts, and researchers working to find solutions to challenges in T&C through IE.

Impact Evaluation to Development Impact (i2i) is a new global platform building partnerships to expand the use of impact evaluation (IE) for evidence-based policy. Members work together to improve the effectiveness of development policies and empower policymakers to test innovations and scale-up solutions to their development problems. The i2i platform is managed by the Development Impact Evaluation (DIME) Unit. The United Kingdom's Department for International Development (DFID) is an i2i donor.

Development Impact Evaluation (DIME) is housed in the Research Group of the World Bank with a mandate to generate high-quality and operationally relevant impact evaluation research to transform development policy. DIME’s objectives are to increase the use of impact evaluation in the design and implementation of public policy, improve the quality of the World Bank’s operations, strengthen country institutions for evidence-based policy making, and generate knowledge in strategic development areas. 


Agenda (in Spanish)


Last Updated: May 08, 2015


Monday (May 11)

8:00 - 8:45 AM


8:45 - 9:00 AM

Welcome Remarks


Klaus Tilmes, Director, Trade & Competitiveness Global Practice, World Bank Group (WBG)

9:00 - 9:30 AM

T&C Impact Evaluations: History, Lessons and Expectations


Christine Zhenwei Qiang, Practice Manager, Investment Climate, Trade & Competitiveness Global Practice, WBG

10:00 AM

Knowledge Exercise

10:00 - 11:00 AM

Impact Evaluation for Real Time Decision Making

Arianna Legovini, Manager, Development Impact Evaluation (DIME), Development Economics Research Group, WBG

11:00 - 11:15 AM

Coffee Break

11:15 – 12:00 PM

Designing Private Sector Interventions to Achieve Impact – Policy Gaps

William Maloney, Chief Economist, Trade & Competitiveness Global Practice, WBG

12:00 - 1:00 PM


1:00 - 2:00 PM

Impact Opportunities 1: From Capabilities to Opportunities – Driving SME Growth

Christopher Woodruff, Professor of Economics, University of Warwick

2:00 - 2:15 PM


Integrating Impact Evaluations Into the Design of Projects – Clinics Roadmap

Aidan Coville, DIME

Interactive guide for designing an impact evaluation based on a practical example. This presentation gives and overview of the group work sessions.

2:15 - 2:30 PM

Coffee Break

2:30 - 5:30 PM

Clinic 1: Project Description and Results Chain

Each project team is assigned an IE specialist who will work with them during all group work sessions. In this session, the group will establish a results chain for their project. They will identify which constraints their programs aim to address, and which other potential binding constraints might remain. At the end of the session, each group will submit their results chain in electronic format to their facilitator, using a PowerPoint template.

7:00 - 9:00 PM

Formal Opening Dinner with WB Management Team



Tuesday (May 12)

9:00 AM - 10:00 AM

Impact Opportunities 2: What all Interventions Should Take Seriously but Don’t – Targeting, Spillovers and Take-up


David McKenzie, Lead Economist, Development Economics Research Group, WBG

10:00 AM - 11:00 AM

Methods 1: Non-Experimental Methods

English: Bilal Siddiqi, DIME

French: Eric Mvukiyehe, DIME

Spanish: Guadalupe Bedoya, DIME

Portuguese: Caio Piza, DIME

11:00 AM - 11:15 AM

Coffee Break

11:15 AM - 12:15 PM

Ignite Session: The Role of Capital and Skills in Improving Firm Growth

Chair: Alexis Diamond, IFC

·        Capital Constraints in Micro-Enterprises: the Impact of Cash Transfers (Jeremy Shapiro, Princeton University)

·        Liquidity Constraints and Entrepreneurship (Rafael Ribas, University of Amsterdam)

·        Access to Financial Services in Developing Countries (Michael King, Trinity College)

·        Job training and Job Matching Programs in Developing Countries (Gareth Roberts and Volker Schöer, University of the Witswatersrand)

12:15 - 1:15 PM


1:15 - 2:00 PM

Ignite Session: Incentives and Firm Behavior

Chair: Alessandro Maffioli, Inter-American Development Bank  

·        Learning From the Experiments That Never Happened (Aidan Coville, DIME)

·        When Matching Grants Work – Which Firms Benefit and to What Extent? (Irani Arraiz, Inter-American Development Bank)

·        How to Be Sure Your Intervention is Tackling the Right Constraints? An Example of an Impact Evaluation of Multiple Interventions  (Tulio Cravo, UNU-WIDER)

2:00 - 2:15 PM

Behavioral Biases and Heuristics: A Primer

Syon Bhanot, Swarthmore College

2:15 - 3:15 PM

Methods 2: Experimental Methods

English: Dan Stein, DIME

French: Eric Mvukiyehe, DIME

Spanish: Marcus Holmlund, DIME

Portuguese: Astrid Zwager, DIME

3:15 - 3:30 PM

Coffee Break

3:30 - 5:30 PM

Clinic 2: Research Questions, Indicators, and Data

Each team determines the research questions to be answered by the impact evaluation and the corresponding indicators and data. The results will be recorded in the PowerPoint template.

7:00 - 8:00 PM




Wednesday (May 13)

9:00 - 9:45 AM

Overview and Knowledge Gaps

William Maloney, David McKenzie and Arianna Legovini, WBG

Research questions of projects presented for comment and discussion – how far do the current set of questions go towards filling identified knowledge gaps?



9:45 - 10:45 AM


Impact Opportunities 3: Psychological Interventions for Effective Entrepreneurial Mindsets

Michael Frese, Professor and Head of Department of Management and Organization, National University of Singapore

10:45 - 11:00 AM

Coffee Break

11:00 AM - 12:00 PM

Methods 3: Sampling

Aidan Coville, DIME

12:00 - 1:30 PM


1:30 - 2:15 PM

Methods 4: Case Study

The theoretical concepts discussed up to now in the policy and technical sessions will be reinforced through group work on a case study. The case study will focus on the various identification strategies and methods for constructing a counterfactual. Results of the exercise will be discussed in groups.

2:15 - 3:00 PM

Ignite Session: Making Institutions and Regulation More Effective

Chair: Arianna Legovini, DIME

·        How Can We Identify Other Constraints that May Be Limiting the Reform’s Effectiveness? Evidence from Brazil (David McKenzie, WBG)

·        How Complementary Interventions Can Help the Development Impact of Your Reform. Evidence from Malawi  (Francisco Campos, WBG)

·        What an IE Can Do for your Reform before Baseline. Experience from Kenya (Lupe Bedoya, WBG)

·        Using Behavioral Insights to Boost Reform Efforts (Syon Bhanot, Swarthmore College)

3:00 - 3:15 PM

Coffee Break

3:15 - 5:30 PM


Clinic 3: IE Methods and Implications in Roll Out Plans

Teams work with their facilitator to design an impact evaluation strategy to answer the questions they have identified. The proposed design will be recorded in the project's PowerPoint template.

7:00 - 8:00 PM



Thursday (May 14)

9:00 - 9:30 AM

Impact Evaluation Roadmap and Funding Opportunities

Ana Goicoechea, T&C Impact Program, IFC

9:30 - 10:00 AM

Knowledge Exercise

10:00 AM - 12:30 PM


Clinic 4: Outcome Measures and Implementation Plan

Teams will work on possible outcome measures and practical implementation plan of the IE including budget, timeline, and staffing and record discussion in PowerPoint template.

12:30 - 1:30 PM


1:30 - 3:30 PM

Clinic 5: Team Presentations: Group 1, Group 2, Group 3, Group 4


Teams split into four groups for a 7 min presentation:

Group 1: Georgia GENIE, Poland R&D, Poland Entrepreneurship, Myanmar Investment, Rwanda G2B Responsiveness, Dominican Republic MIRC

Group 2: Kuwait SME Development, Rwanda Pensions, Zambia Savings, Afghanistan Targeting the Ultra Poor, Senegal Warehouse Receipt System

Group 3: Brazil Vocational Training, Western Balkans Investment, Mexico Entrepreneurship, Egypt Employment, Dominican Republic SME

Group 4: Tunisia Exports, Nepal Trade, Ethiopia Trade, Philippines Shipping, Colombia Export, Mexico Competition

3:30 - 3:45 PM

Coffee Break

3:45 - 5:45 PM

Clinic 5 (cont.): Team Presentations



5:45 - 7:00 PM

Closing Ceremony and Dinner


Last Updated: Jun 08, 2015