Learn how the World Bank Group is helping countries with COVID-19 (coronavirus). Find Out

Energy and Environment: Local Solutions to Global Challenges
October 13-17, 2014Lisbon, Portugal

This workshop, hosted by Development Impact Evaluation (DIME) will bring together practitioners, subject matter experts, and researchers working to find solutions to challenges in energy and environment through the use of impact evaluations.

Impact Evaluation to Development Impact (i2i) is a new global platform building partnerships to expand the use of impact evaluation (IE) for evidence-based policy. Members work together to improve the effectiveness of development policies and empower policymakers to test innovations and scale-up solutions to their development problems. The i2i platform is managed by the Development Impact Evaluation (DIME) Unit. The United Kingdom's Department for International Development (DFID) is an i2i donor.

Development Impact Evaluation (DIME) is a global program hosted in the World Bank's Development Research Group. Its purpose is to increase the use of impact evaluation in the design and implementation of public policy and increase institutional capacity and motivation for evidence-based policy. 

Last Updated: Oct 09, 2014

DIME Impact Evaluation Workshop
Energy & Environment
October 13-17,2014
Lisbon, Portugal 

(all listed times are local)

Monday (October 13) 
8:30 - 9:00 AM Registration
9:00 - 9:15 AM Welcome & Introductory Remarks
9:15 - 10:00 AM Impact Evaluation for Real Time Policy Making
Arianna Legovini, Manager, Development Impact Evaluation (DIME), World Bank
10:00 - 11:00 AM What is the Problem? Development Challenges in Energy & Environment
Chair: Jed Friedman, World Bank
Forestry: Daniel Miller, World Bank
Water Management: Teevrat Garg, Cornell University
Energy: Michael Price, University of Tennessee - Knoxville
11:00- 11:15 AM Coffee Break
11:15 AM - 12:15 PM Measuring Impact 1: Causal Inference & Experimental Methods
(Parallel sessions by language) English - Dan Stein, DIME; Spanish - Lupe Bedoya, DIME; Portuguese - Arianna Legovini, DIME
Impact Evaluation
Causality / Causal Inference
12:15 - 1:15 PM Lunch
1:15- 1:45 PM Knowledge Test
Maria Jones, DIME
1:45 - 3:00 PM Impact Opportunities 1: Common Pool Resources and Externalities
(Ignite-style) Chair: Darin Christensen, Stanford University
Protected Areas - Juan Jose Miranda, World Bank
High-level coordination - Francisco Costa, Getulio Vargas Foundation
Community-level coordination -  Dan Stein, DIME
Approaches to local regulation - Ty Turley, Brigham Young University
Individual incentives - Stefano Pagiola, World Bank
3:00 - 3:30 PM Integrating Impact Evaluations Into the Design of Projects
Aidan Coville, DIME
Interactive guide for designing an impact evaluation based on a practical example. Gives overview of group work sessions
3:30 - 3:45 PM Coffee Break
3:45 - 6:00 PM Group Work I
(Small groups) Facilitators: IE researchers
Each project team is assigned an IE specialist who will work with them during all group work sessions
In this session, the group will establish a results chain for their project. They will identify which constraints their programs aim to address, and which other potential binding constraints might remain. At the end of the session, each group will submit their results chain in electronic format to their facilitator, using a powerpoint template

Tuesday (October 14)
9:00- 10:15 AM Keynote Address: The Value of Experiments in Energy and Environment
John List, Chairman, Department of Economics, University of Chicago
10:15 - 11:15 PM Measuring Impact 2: Non-experimental Methods
(Parallel sessions by language) English - Arndt Reichert, DIME; Portuguese - Francisco Costa, Getulio Vargas Foundation; Spanish - Victor Orozco, DIME
Discontinuity design
Difference-in-Difference and propensity score matching
11:15 - 11:30 AM Coffee Break
11:30 AM - 1:00 PM Impact Opportunities 2: Incentives 
(Ignite-style) Chair: Jed Friedman, World Bank
Conditional and unconditional incentives - Maarten Voors, Wageningen University
Non-monetary incentives - Andreas Leibbrandt, Monash University
Incentives and gender - Maria Jones, DIME
Once-off vs. continuous incentives - Stefano Pagiola, World Bank
Incentives for sustained behavior change  - Arndt Reichert, DIME
1:00 - 2:00 PM Lunch
2:00 - 3:00 PM Impact Opportunities 3: Behavioral Responses
(Ignite-style) Chair: Arndt Reichert, DIME
The rebound effect - Felipe Dunsch, DIME
The salience of information - Victor Orozco, DIME
Social norms and peer effects - Michael Price, University of Tennessee - Knoxville
3:00 - 3:30 PM Coffee Break
4:00 - 6:00 PM Group Work 2
(Small groups) Facilitators: IE researchers
Each team determines the research questions to be answered by the impact evaluation and the corresponding indicators and data. The results will be recorded in the PowerPoint template
Wednesday (October 15)
9:00 - 10:00 AM Operational Lessons Learned from Implementing IEs
This session explores critical nodes in project implementation, where projects have experienced challenges in the past, how they have dealt them, and what available evidence can provide insights to mitigating these challenges in the future
Take up - Sao Paolo PES team
Data quality - Maria Jones, DIME
Sustainability - Florence Kondylis, DIME
Ensuring buy-in - Jed Friedman
10:00 AM - 12:00 PM Case Study
(Small groups) The theoretical concepts discussed up to now in the policy and technical sessions will be reinforced through group work on a case study. The case study will focus on the various identification strategies and methodologies for constructing a counterfactual. Results of the exercise will be discussed in groups.
12:00 -1:00 PM Lunch
1:00 - 3:00 PM Group Work 3
(Small groups) Facilitators: IE researchers
Teams work with their facilitator to design an impact evaluation strategy to answer the questions they have identified. The proposed design will be recorded in the project's PowerPoint template.

Thursday (October 16)
9:00 - 10:00 AM New Technologies for Measuring Impacts
Exploring innovative remote sensing technologies from satellite imagery to smart meters and water flow sensors to help improve continuous measurement of project outputs and outcomes
Local Sensors - Aidan Coville, DIME
Remote Sensing - Astrid Zwager, DIME
An application in remote sensing - Teevrat Garg, Cornell University
10:00 - 11:30 AM Measuring Impact 3: Sampling & Power Calculations
(Parallel sessions by language) English - Maria Jones, DIME; Portuguese - Astrid Zwager, DIME; Spanish - Christian Borja-Vega, World Bank
11:30 - 11:45 AM Coffee Break
11:45 AM - 12:30PM Identifying Knowledge Gaps
Chair: Arianna Legovini, DIME
12:30 - 1:30 PM Lunch
1:30 - 6:00 Group Work 4
(Small groups) Facilitators: IE researchers
In this session, the group will work on possible outcome measures and practical implementation plan of the IE including budget, timeline and staffing

Last Updated: Dec 04, 2014

  • Presentations can be found under the agenda tab and also at tinyurl.com/dime-lisbon Videos from various sessions are available at our IEKnow You Tube Website: https://www.youtube.com/channel/UCyFoaisUYH1l5a1wKruaozw