DIME Impact Evaluation Workshop
Energy & Environment
October 13-17,2014
Lisbon, Portugal
(all listed times are local)
|
| Monday (October 13) |
| 8:30 - 9:00 AM |
Registration |
| 9:00 - 9:15 AM |
Welcome & Introductory Remarks |
| 9:15 - 10:00 AM |
Impact Evaluation for Real Time Policy Making |
|
Arianna Legovini, Manager, Development Impact Evaluation (DIME), World Bank |
| 10:00 - 11:00 AM |
What is the Problem? Development Challenges in Energy & Environment |
|
Chair: Jed Friedman, World Bank |
|
|
Forestry: Daniel Miller, World Bank
Water Management: Teevrat Garg, Cornell University
Energy: Michael Price, University of Tennessee - Knoxville |
| 11:00- 11:15 AM |
Coffee Break |
| 11:15 AM - 12:15 PM |
Measuring Impact 1: Causal Inference & Experimental Methods |
| (Parallel sessions by language) |
English - Dan Stein, DIME; Spanish - Lupe Bedoya, DIME; Portuguese - Arianna Legovini, DIME |
Impact Evaluation
Causality / Causal Inference
Randomization |
| 12:15 - 1:15 PM |
Lunch |
| 1:15- 1:45 PM |
Knowledge Test |
|
Maria Jones, DIME |
| 1:45 - 3:00 PM |
Impact Opportunities 1: Common Pool Resources and Externalities
|
| (Ignite-style) |
Chair: Darin Christensen, Stanford University |
Protected Areas - Juan Jose Miranda, World Bank
High-level coordination - Francisco Costa, Getulio Vargas Foundation
Community-level coordination - Dan Stein, DIME
Approaches to local regulation - Ty Turley, Brigham Young University
Individual incentives - Stefano Pagiola, World Bank |
| 3:00 - 3:30 PM |
Integrating Impact Evaluations Into the Design of Projects |
|
Aidan Coville, DIME |
|
Interactive guide for designing an impact evaluation based on a practical example. Gives overview of group work sessions |
| 3:30 - 3:45 PM |
Coffee Break |
| 3:45 - 6:00 PM |
Group Work I |
| (Small groups) |
Facilitators: IE researchers |
| Each project team is assigned an IE specialist who will work with them during all group work sessions |
| In this session, the group will establish a results chain for their project. They will identify which constraints their programs aim to address, and which other potential binding constraints might remain. At the end of the session, each group will submit their results chain in electronic format to their facilitator, using a powerpoint template |
|
|
| Tuesday (October 14) |
| 9:00- 10:15 AM |
Keynote Address: The Value of Experiments in Energy and Environment |
|
John List, Chairman, Department of Economics, University of Chicago |
|
|
| 10:15 - 11:15 PM |
Measuring Impact 2: Non-experimental Methods |
| (Parallel sessions by language) |
English - Arndt Reichert, DIME; Portuguese - Francisco Costa, Getulio Vargas Foundation; Spanish - Victor Orozco, DIME |
Discontinuity design
Difference-in-Difference and propensity score matching |
| 11:15 - 11:30 AM |
Coffee Break |
| 11:30 AM - 1:00 PM |
Impact Opportunities 2: Incentives |
| (Ignite-style) |
Chair: Jed Friedman, World Bank |
Conditional and unconditional incentives - Maarten Voors, Wageningen University
Non-monetary incentives - Andreas Leibbrandt, Monash University
Incentives and gender - Maria Jones, DIME
Once-off vs. continuous incentives - Stefano Pagiola, World Bank
Incentives for sustained behavior change - Arndt Reichert, DIME |
| 1:00 - 2:00 PM |
Lunch |
| 2:00 - 3:00 PM |
Impact Opportunities 3: Behavioral Responses |
| (Ignite-style) |
Chair: Arndt Reichert, DIME |
The rebound effect - Felipe Dunsch, DIME
The salience of information - Victor Orozco, DIME
Social norms and peer effects - Michael Price, University of Tennessee - Knoxville |
| 3:00 - 3:30 PM |
Coffee Break |
| 4:00 - 6:00 PM |
Group Work 2 |
| (Small groups) |
Facilitators: IE researchers |
| Each team determines the research questions to be answered by the impact evaluation and the corresponding indicators and data. The results will be recorded in the PowerPoint template |
| Wednesday (October 15) |
| 9:00 - 10:00 AM |
Operational Lessons Learned from Implementing IEs |
|
This session explores critical nodes in project implementation, where projects have experienced challenges in the past, how they have dealt them, and what available evidence can provide insights to mitigating these challenges in the future
Take up - Sao Paolo PES team
Data quality - Maria Jones, DIME
Sustainability - Florence Kondylis, DIME
Ensuring buy-in - Jed Friedman |
| 10:00 AM - 12:00 PM |
Case Study |
| (Small groups) |
The theoretical concepts discussed up to now in the policy and technical sessions will be reinforced through group work on a case study. The case study will focus on the various identification strategies and methodologies for constructing a counterfactual. Results of the exercise will be discussed in groups. |
| 12:00 -1:00 PM |
Lunch |
|
|
| 1:00 - 3:00 PM |
Group Work 3 |
| (Small groups) |
Facilitators: IE researchers |
| Teams work with their facilitator to design an impact evaluation strategy to answer the questions they have identified. The proposed design will be recorded in the project's PowerPoint template. |
|
|
| Thursday (October 16) |
| 9:00 - 10:00 AM |
New Technologies for Measuring Impacts |
|
Exploring innovative remote sensing technologies from satellite imagery to smart meters and water flow sensors to help improve continuous measurement of project outputs and outcomes |
Local Sensors - Aidan Coville, DIME
Remote Sensing - Astrid Zwager, DIME
An application in remote sensing - Teevrat Garg, Cornell University |
|
|
|
|
|
| 10:00 - 11:30 AM |
Measuring Impact 3: Sampling & Power Calculations |
| (Parallel sessions by language) |
English - Maria Jones, DIME; Portuguese - Astrid Zwager, DIME; Spanish - Christian Borja-Vega, World Bank |
| 11:30 - 11:45 AM |
Coffee Break |
| 11:45 AM - 12:30PM |
Identifying Knowledge Gaps |
|
Chair: Arianna Legovini, DIME |
| 12:30 - 1:30 PM |
Lunch |
| 1:30 - 6:00 |
Group Work 4 |
| (Small groups) |
Facilitators: IE researchers |
|
In this session, the group will work on possible outcome measures and practical implementation plan of the IE including budget, timeline and staffing |
|
|
