Events

Manage Successful Impact Evaluation Surveys

July 6-24, 2020

Virtual

Manage Successful Impact Evaluation Surveys photo with logos

OVERVIEW
AGENDA
SPEAKERS
Proceedings

Participants will become familiar with the workflow for primary data collection. The course will cover best practices at all stages of the workflow, from planning a survey to piloting survey instruments and monitoring data quality once fieldwork begins. There will be a strong focus throughout on research ethics and reproducible workflows. The course is designed for World Bank staff and consultants responsible for supervising primary data collection for a research project or interested in improving the quality of monitoring and evaluation data for an operational project. This course specifically focuses on surveys for impact evaluation, project monitoring, or other research purposes, typically implemented by private firms (differentiated by national statistics surveys). The course will be conducted entirely remotely. It will use a combination of virtual lectures, case studies, readings, and hands-on exercises. Participants who successfully complete all activities will receive a course certificate.
Participants will learn to:
Plan for and prepare a successful survey
Design high-quality survey instruments
Collaborate effectively with all survey stakeholders
Monitor survey implementation and ensure high-quality data
Handle confidential data securely

Week 1: Preparing for data collection

Welcome (Monday, live webinar)

Introduction to DIME
Course Overview

Prepare for a successful survey

Design a questionnaire

Pilot a questionnaire

Program a questionnaire for electronic data collection

Survey Mode Matters (Friday, live webinar)

Pros and cons of different survey modes
CAPI, CATI, PAPI, web-based, SMS

Week 2: Collecting Data Ethically

Welcome (Monday, live webinar)

Recap of week 1
Overview of week 2

Working with survey firms

Training enumerators

Case study: enumerator training (pre-recorded videos)

Research ethics

Protecting anonymity: de-identifying research data

Secure handling of confidential data

Keynote (Friday, live webinar)

Impact Evaluation at the World Bank

Keynote (Friday, live webinar)

Impact Evaluation at the World Bank

Week 3: Assuring high-quality data

Welcome (Monday, live webinar)

Recap of week 2
Overview of week 3: protocols for data quality assurance

Monitor data quality from the field

Case study: monitor data quality (pre-recorded videos)

High-frequency checks of data quality

Iefieldkit: a Stata package for high-quality data collection (pre-recorded video + online Q&A)

Manage Successful Surveys – Closing Remarks (Friday, live webinar)

Luiza Andrade
Luiza Andrade is a Data Coordinator in the Impact Evaluation department of the Development Research Group (DIME). As part of the DIME Analytics team, she helps researchers ensure quality, transparency and reproducibility of their data work. Her work focuses on disseminating best practices for data management and use of statistical software, particularly R and Stata. She also supports projects with the adoption of new data sources and tools, and contributes to public goods that make data work resources accessible to the development research community, most notably the ietoolkitand iefieldkit Stata packages. Luiza has a BA and an MA in Economics from the University of Sao Paulo, Brazil.

Erick Baumgartner

Erick has been a Research Field Coordinator working with Dime since 2017. He holds a Master in Economics from the University of São Paulo (USP), a Bachelor in Economics from the Free University of Berlin (FUB) and a Bachelor in International Relations from the State University of São Paulo (UNESP).

Jonna Margareta Bertfelt

Jonna is a Field Coordinator for DIME in East Africa. Since 2013 Jonna has been working to implement and support impact evaluations in areas of health and transport, currently for DIME and before that with Innovation for Poverty Action.

Kristoffer Bjarkefur
Kristoffer Bjarkefur is a Data Coordinator in the Impact Evaluation department of the Development Research Group (DIME). He is passionate to take concepts and best practices from the world of computer science and adapt them so that they are more accessible to researchers working with data intense research projects in development. He is especially interested in topics like coding best practices, data security and version control. Kristoffer has a BA in Economics from Lund University, a MA in International Relations from Johns Hopkins University and has studied computer science at Stanford University.

Benjamin Daniels
Benjamin Daniels is a Research Fellow in the gui2de group at the McCourt School of Public Policy at Georgetown University. Benjamin’s research focuses on the delivery of high-quality primary health care in developing contexts. His work on data from India, Kenya, South Africa, China, and other locations has highlighted the importance of direct measurement of health care provider knowledge, effort, and practice. He has supported some the largest research studies to date utilizing clinical vignettes, provider observation, and standardized patients. Benjamin is a member of the QuTUB Project team. Benjamin also works with DIME Analytics to improve the reproducibility, transparency, and credibility of development research. This work comprises code and process development, research personnel training, and direct support for data analysis and survey development. These tools include software products like iefieldkit and ietoolkit, research resources like the DIME Wiki and the Development Research in Practice resource guidebook.

Aram Gassama

Aram Gassama is a Research Analyst for the Development Impact Evaluation (DIME) unit at the World Bank. She supports the ieConnect team in the implementation of multiple impact evaluations through their different stages and in the supervision of field and research activities. She has also been working as a field coordinator with DIME in Senegal for two years. She holds a master’s degree in Public Policies and Development Economics and a bachelor’s degree in Economics and Law, both degrees obtained from Toulouse School of Economics. Her research interests focus on transport, gender and agriculture

Steven Glover

Steven Glover is a Field Analyst at DIME, working on the design and implementation of the rural development impact evaluation portfolio in Mozambique. He specializes in primary data collection, stakeholder coordination and field supervision of rural development impact evaluation programs. Prior to joining DIME in 2015, Steven had worked as an Overseas Development Institute (ODI) Fellow at the Ministry of Agriculture (MADER) in Mozambique, and afterwards with the Development Economics Research Group (DERG) at the University of Copenhagen. He holds an MSc in Development Economics from the School of Oriental and African Studies (SOAS), University of London, and a BSc in Economics from the University of York.

Judith Indalecio

Judith Indalecio is a Program Coordinator in the Development Impact Evaluation (DIME) unit of the World Bank. She supports ieConnect, a program of transport impact evaluations, and DIME Analytics, an initiative that works across the DIME portfolio to help research teams improve their impact evaluations. At DIME, she organizes program activities and disseminates high-quality research to help government clients with evidence-based policymaking. She completed a dual bachelor’s degree in International Affairs and Latin American Studies from the George Washington University in 2019.

Maria Ruth Jones
Maria Ruth Jones is a Survey Specialist in the DIME Group. Maria co-founded and leads DIME Analytics, an initiative to support transparent, high-quality and reproducible research at DIME. She also works on impact evaluations in agriculture and transport; current research projects focus on the impacts of large-scale rural infrastructure projects in Rwanda. Maria joined the World Bank in 2009. Previous roles at DIME include coordination of the Global Agriculture and Food Security Program impact evaluation portfolio (2012-16), and a program of impact evaluations with the government of Malawi (2009-11). Maria has an MA in International Relations / Development Economics from the Johns Hopkins School of Advanced International Studies, and a BA in Economics and Spanish from Amherst College.

Roshni Khincha
Roshni is an Impact Evaluation Analyst and Data Coordinator with Development Impact Evaluation (DIME). She works as a Data Coordinator for the DIME Analytics team where she supports development of best practices and capacity building activities in data and survey workflows. She also works as an Impact Evaluation Analyst on project management, and data quality assurance, and data analysis of agricultural impact evaluations in Rwanda. Previously, she has worked with Poverty Action Lab (J-PAL) and holds a Masters in Economics from London School of Economics (LSE).

Sékou Kone

Sékou Kone is a Field Coordinator in the Impact Evaluation department of the Development Research Group (DIME) at the World Bank Group. He works on Local governance and Private sector in Burkina Faso, in support Impact evaluations design and implementation, and focuses on Data collections preparation and monitoring with Client and survey firms, while working on Data quality insurance. He has 9 years of professional experience, including 3 with the Word Bank, but initially worked as an Operation officer in a Consultant firm for more than 4 years. Sékou has a Master's degree in Statistics and Economics in Ecole Nationale Supérieure de Statistique et d’Economie Appliquée d’Abidjan (ENSEA), Côte d'Ivoire.

Arianna Legovini
Arianna Legovini built and leads the Development Impact Evaluation (DIME) group of the World Bank, The purpose of this unit is to use research to improve development practice and policy outcomes. Since joining the Bank in 2004, she has worked to understand and develop the institutions (incentives and processes) required to engage researchers, operational staff and policymakers in improving the quality in the design and implementation of development projects. The idea was, first, to use problem-based research to generate useful data and evidence that would guide policy decisions and improve outcomes. Second, it was to leverage the billions of dollars in international assistance to test out solutions to development problems in specific contexts and help countries learn for themselves how to reach and expand their production frontiers. In 2004-2008, working with like-minded partners, the ideas were put in action with the creation of the Africa Impact Evaluation initiative and its programs in education, HIV, malaria, community development, agriculture and private sector. In 2009, she imported Africa-grown lessons, processes and programs into the global impact evaluation program. By 2013, with core funding from UK Aid, she designed i2i (impact evaluation to development impact) to support the expansion of the approach across many institutional partners and across under-evaluated sectors representing the majority of development aid, including infrastructure, fragility and conflict, public sector governance, and natural resource management sectors. i2i was critical in developing Bank-wide governance structures for this work and formalizing working relationships through an improved system of incentives. Arianna is currently responsible for a $145 million dollar research program, leveraging about $3billion in WB, DFID and other partners lending, in 60 countries across the globe.

Patricia Paskov
Patricia Paskov is an Analyst in the Impact Evaluation Unit of the Development Research Group. Her areas of interest are organizational and public economies, social networks, and behavioral economics. Patricia completed her Masters degree in Economics at Barcelona Graduate School of Economics, and her undergraduate dual-degree in Applied Economics and Latin American American Studies at The University of Wisconsin-Madison. Previously, she worked as a Field Research Associate with Innovations for Poverty Action Peru, and as a Project Manager with an inter-institutional research initiative on civil service and governance in Paraguay.

Beatriz Ribeiro

Beatriz Ribeiro is a consultant in the Development Impact Evaluation unit at the World Bank. She supports impact evaluations in Latin America in the areas of small and medium enterprises development and justice (with the DE JURE program). She holds a bachelor’s and a master’s degree in Economics from the Pontifical Catholic University of Rio de Janeiro.

Avnish Dayal

Avnish Dayal Singh is a Consultant with the DIME Analytics team, where he manages the content-creation and editing of the DIME Wiki, a public good which aims to increase the overall quality of development research. The DIME Wiki also acts as a supplement to resources like the Development Research in Practice resource guidebook, software tools like iefieldkit and ietoolkit, and regular training sessions conducted by DIME Analytics. Avnish has a Masters' in Quantitative Economics and Econometrics from Columbia University, and a Bachelors' in Economics from the University of Delhi. His interests involve combining development data with lessons from economic theory and field studies to improve the efficacy of development policy mechanisms globally.
298 people participated in DIME Analytics first virtual course, Manage Successful Impact Evaluation Surveys.
Related Materials
Course results
Course materials