Events
Image
Manage Successful Impact Evaluations
June 6-10, 2016Washington, DC

The course is designed to improve the skills and knowledge of staff and short-term consultants responsible for managing impact evaluations in the field.

The course is designed to improve the skills and knowledge of staff and short-term consultants responsible for managing impact evaluations in the field. The workshop is intended to improve the skills and knowledge of impact evaluation (IE) field coordinators, familiarizing them with critical issues in IE implementation, recurring challenges, and cutting-edge technologies.

The course will cover impact evaluation tools and concepts, but the primary focus is on how to successfully manage impact evaluations in the field. Participants will learn to plan for and supervise high-quality household surveys, to utilize new technologies for electronic surveys and geo-data, to manage complex survey data and produce descriptive analysis for policy makers, to successfully measure cost-effectiveness, to leverage qualitative research techniques for quantitative IEs, and to build client capacity for impact evaluation. Morning sessions will be lecture format, and afternoon sessions will be interactive lab sessions, giving participants a first-hand opportunity to apply what they have learned. All morning sessions will be live-streamed; remote participation is encouraged. 

Objectives:

Participants will learn to:

-        Plan for and supervise high-quality household surveys

-        Utilize new technologies for electronic surveys and geo-data

-        Manage complex survey data & produce descriptive analysis for policymakers

-        Successfully measure cost-effectiveness

-        Leverage qualitative research techniques for quantitative IEs

-        Build client capacity for impact evaluation.

Last Updated: May 16, 2016

Monday, June 6 Location Facilitator
 8:30 - 9:00 Registration & Breakfast   MC 5-100  
9:00 - 9:15 Participant Introductions   Maria Jones (DECIE)
9:15 - 10:00 Introduction to DIME & Impact Evaluation at the World Bank Arianna Legovini (DECIE)
10:00 - 11:30 Impact Evaluation: Methods Refresher MC 5-100 & MC 5-500 Kevin Croke (DECIE)
& Dan Rogger (DECIE)
11:30 - 12:00 Icebreaker  MC 5-100 Kristin Panier (DECIE)
12:00 - 1:00 Understanding World Bank Operations (in the context of IE) Aidan Coville (DECIE)
1:00 - 2:00 Lunch    
2:00 - 3:15 Lab, Track 1: Stata Basics Lab, Track 2: Stata Tips & Tricks Track 1
J B1-065

Track 2
J B1-089
Track 1: Maria Jones (DECIE)
Track 2: Kristoffer Bjarkefur (DECIE)
Stata interface and menus; do-files; log-files; variable and value labels; variables types; help files; macros Write code your research team can understand; increase transparency, efficiency, and replicability; use Stata help files
3:15 - 3:30 Coffee Break  
3:30 - 5:00 Lab 2: Randomization
Track 1: Paul Christian (DECIE)
Track 2:  Arndt Reichert (DECIE)
How to randomize using excel, tips & things to avoid; example of a simple randomization in stata How to do a stratified randomization in Stata, tips & things to avoid, dealing with uneven number of strata
6:00 - 8:00 Welcome Reception     
          
Tuesday, June 7    
 9:00 - 10:15 Prepare for and plan Household Surveys MC C2-137 Laura Costica, Emily Crawford & Maria Jones (DECIE)
questionnaire design, survey piloting, enumerator training, plan fieldwork
10:15 – 10:45 Budget for a Household Survey Laura Costica (DECIE)
guidance on line items and costs through practical examples
10:45 – 11:00 Coffee Break Coffee Break  
11:00 – 11:30 Work with survey firms Maria Jones (DECIE)
nuts & bolts of procurement process, relationship tips & tricks, to avoid
11:30 – 12:00 Ensure high quality data Kristoffer Bjarkefur (DECIE)
Backchecks, survey audits, real-time data checks
12:00 - 1:00 Small groups: each group discusses a different real-life example of a survey problem, and shares their solution with the full group   Laura, Emily, Maria, Chloe
1:00 - 2:00 Lunch Lunch  
2:00 - 3:30 Lab 3: Data Management & Cleaning Track 1: Paula Gonzalez (DECIE)
Track 2: Kristoffer Bjarkefur (DECIE)
Basic file structure and organization Focus on replicability & workflow
3:45 - 5:00 Lab 4: Real-time data quality checks Track 1: Laura Costica (DECIE)
Track 2: Kristoffer Bjarkefur (DECIE)
How to read and run a pre-written do-file for data quality checks; understanding and use output Prepare do-file to check data quality and output flags
          
Wednesday, June 8    
9:00 - 10:30 Measure Cost-Effectiveness MC 5-100 David Evans (AFRCE) & Anna Popova (AFRCE)
why and how to + practical example
 10:30 - 10:45 Coffee Break Coffee Break  
10:45 - 11:30 How to write a baseline report Eric Mvukiyehe (DECIE)
guidance on depth & breadth of analysis; template for content; examples of best practices
11:30 - 12:30 How to conduct effective focus groups Rachael Pierotti (GIL)
  guidance on using qualitative  techniques to inform intervention or survey design
12:30 - 1:30 Lunch    
1:30 - 3:00 Lab 5: Power Calculations   Track 1: Paula Gonzalez (DECIE)
Track 2: Maria Jones (DECIE)
Track 1: Intuition of power calculations, how to use Optimal Design to visualize tradeoffs Brief overview of potential challenges and complications; how to conduct power calcs in Stata (review different command packages)  
3:00 - 3:15 Coffee Break Coffee Break    
3:15 - 5:00 Lab 6: Descriptive Analysis Track 1
J B1-065
Track 2
J B1-089
Track 1: Kristoffer
Track 2: Paula
Generate summary statistics tables; create histograms & simple graphs How to run balance tests; generate tables and graphs for a policy audience
           
Thursday, June 9    
9:00 - 9:30 Introduction to i2i   MC C2-137 Florentina Mulaj (DECIE)
9:30 - 10:15 Practical skills for research funding Victor Orozco (DECIE)
how to apply to trust funds; how to write grant proposals and donor report. Request to go over actual proposal and highlight good / bad
10:15 - 10:30 Coffee Break  
10:30  - 11:00 "I'm in the field --- now what?" Lacey Ramirez & Chloe Fernandez (DECIE)
interact with Country Office and clients; logistics; troubleshoot
11:00 - 11:45 Small groups: examples of real field challenges Maria, Astrid, Lacey, Chloe, Kristin
11:45 - 12:00 Where do we go from here? Maria Jones (DECIE)
Open forum, discuss online platform for toolkits and discussion
12:00 - 1:00 Lunch    
1:00 - 5:00 Lab, Track 1: Program a HH Survey using SurveyCTO (beginner) Lab, Track 2: Program a HH Survey using SurveyCTO (intermediate) Track 1
J B1-065
Track 2
J B1-089
Chris Roberts (SurveyCTO) 
         
Friday, June 10    
9:00 - 10:30 Lab: GPS data collection J B1-065 Siobhan Murray (DECCT)
10:30 - 10:45 Coffee Break Coffee Break
10:45 - 1:00 Lab: GIS software tutorial Siobhan Murray (DECCT)

Last Updated: May 16, 2016

Contact Maria Jones
  • Email: mjones5@worldbank.org