Events

Manage Successful Impact Evaluation Surveys

June 6-24, 2022

Vitrual Self-Paced

Illustration of tree and logos making the tree leafs

OVERVIEW
AGENDA
SPEAKERS
Proceedings

The virtual Manage Successful Impact Evaluation Surveys (MSIES) course teaches the workflow for primary data collection. The course will cover best practices at all stages, from planning a survey to piloting survey instruments and monitoring data quality once fieldwork begins. There will be a strong emphasis throughout on research ethics and reproducible workflows.
This self-paced course will run for three weeks—from June 6 to June 24, 2022. All live sessions will be held the week of June 6th, and then participants will have two weeks to complete all course materials and quizzes. The course is designed for World Bank employees, development practitioners, and public servants involved with primary data collection for research or monitoring and evaluation. MSIES specifically focuses on surveys for impact evaluation, project monitoring, or other research purposes, typically implemented by private firms (differentiated from national statistics surveys).
The course will use a combination of pre-recorded lectures, live Q&As and panel discussions, case studies, readings, quizzes, and practice exercises. While this course does not require any previous technical or software programming knowledge, the hands-on exercises will include optional activities for participants that wish to improve their survey programming or statistical software skills.
Through this course, participants will learn to:
Plan for and prepare a successful survey
Design high-quality survey instruments
Effectively train surveyors (including remote training)
Monitor survey implementation and ensure high-quality data
Handle confidential data securely
Registration for the course is open through May 31, 2022 through this link.

Day 1: June 6, 2022
Time	Topic
9:00	Introductory remarks and introduction to DIME Arianna Legovini
10:00	Introduction to course Maria Jones
10:45	END OF DAY 1

Day 2: June 7, 2022
Time	Topic
9:30	Panel discussion: Surveys ++ - Maximize impact of survey data through data fusion Robert Marty, Maria Arnal Canudo, Caio Piza, Robin Audy, Daniel Rogger Moderator: Maria Jones
11:00	END OF DAY 2

Day 3: June 8, 2022
Time	Topic
9:30	Lightning talks: Research ethics and data privacy during data collection Anja Sautmann, Alexandra Avdeenko, Heather Lanthorn, Victor Orozco, Rachael Pierotti Moderator: Maria Jones
11:00	END OF DAY 3

Day 4: June 9, 2022
Time	Topic
9:30	ietoolkit and iefieldkit overview Kristoffer Bjarkefur, Benjamin Daniels
10:30	END OF DAY 4

Arianna Legovini

Arianna Legovini is founder and head of the Development Impact Evaluation (DIME) Department of the World Bank. She established this group in 2009 creating a model of collaboration between economic development research and practice to optimize the returns to development finance and build governments capacity for data and evidence-informed country policies. She raised $200 million to develop impact evaluation programs in under-evaluated sectors innovating in measurement and data systems, and using data analytics and experimental evidence to transform global development policy. She now presides over a team of 200 people working with 200 agencies in 60 countries shaping the design and adaptive implementation of $20 billion in development finance. She started similar groups in the Interamerican Development Bank and the Africa region of the World Bank. An economist by training, she has been providing advice to 30 multilateral and bilateral development agencies in the world.

Luíza Andrade

Luíza Andrade is a Junior Data Scientist with the Development Impact Evaluation department (DIME) at the World Bank Group. Her work on the DIME Analytics team focuses on promoting research transparency and reproducibility practices through trainings and code review. She also works across DIME's portfolio of impact evaluations to incorporate non-traditional data sources such as high-frequency crowdsourced and web-scraped data. Luíza has also developed original software tools for research, including web-based data interfaces and the ietoolkit and iefieldkit Stata packages. Her research work has focused on agriculture, gender, and environmental policy. She has a BA and an MSc in Economics from the University of São Paulo.

Jonna Bertfelt

Jonna Bertfelt is a Field Coordinator for DIME currently based in South Africa. Over the past 4 years Jonna has worked on a number of projects for DIME in Malawi, Tanzania, Uganda and Ethiopia, on IE’s in trade, transport, health and labour markets. In her role as an FC she manages the implementation of the project in-country. Jonna manages project progress and ensure its quality. This includes drafting implementation plans, development of data collection tools (drafting, piloting and programming), contracting and managing survey firms, report writing and supporting the data analysis. She has a Bachelor’s Degree in Public Health from Karolinska Institute and a Master’s Degree in International Public Health from Uppsala University, Sweden.

Kristoffer Bjarkefur

Kristoffer Bjarkefur is a Data Scientist consultant in the Impact Evaluation department of the Development Research Group (DIME). He is passionate to take concepts and best practices from the world of computer science and adapt them so that they are more accessible to researchers working with data intense research projects in development. He is especially interested in topics like coding best practices, data security/privacy and version control. Kristoffer has a BA in Economics from Lund University, a MA in International Relations from Johns Hopkins University and has studied computer science at Stanford University.

Benjamin Daniels

Benjamin Daniels is a Research Fellow in the gui2de group at the McCourt School of Public Policy at Georgetown University. Benjamin’s research focuses on the delivery of high-quality primary health care in developing contexts. His work on data from India, Kenya, South Africa, China, and other locations has highlighted the importance of direct measurement of health care provider knowledge, effort, and practice. He has supported some the largest research studies to date utilizing clinical vignettes, provider observation, and standardized patients. Benjamin is a member of the QuTUB Project team. Benjamin also works with DIME Analytics to improve the reproducibility, transparency, and credibility of development research. This work comprises code and process development, research personnel training, and direct support for data analysis and survey development. These tools include software products like iefieldkit and ietoolkit, research resources like the DIME Wiki and the Development Research in Practice resource handbook.

Rafael Dantas

Rafael Dantas is a Research Analyst with the Development Impact Evaluation Department (DIME) at the World Bank Group, supporting the Brazil Impact Evaluation Portfolio. Previously, Rafael worked as a Field Coordinator in Brazil, managing impact evaluation surveys and data collection in the Education and Private Sector Development Agendas. He has a bachelor's and master's degree in Economics from the University of Brasília.

Samih Ferrah

Samih Ferrah is a Research Assistant with DIME’s unit on Gender, Economic Opportunity, and Fragility. His current work focus on supervising baseline data collection, and supporting the implementation of the PARCA program. Prior to that, Samih's work with DIME include participation in the evaluation of the MAFITA program, aiming at improving skills and jobs for at-risk youth as well as reducing anti-social behavior. Before joining DIME, Samih has worked with academic researchers on various political economy focused impact evaluation in the Democratic Republic of the Congo. Samih holds a Master’s degree in Public Policy and Economics from the University Paris 1 Pantheon Sorbonne.

Marc-Andrea Fiorina

Marc-Andrea Fiorina is a second-year research assistant with DIME. He is currently supporting data collection and analysis in three countries to assess and compare the impact of gender-targeted cash transfers on women's economic outcomes and social norms. Prior to joining DIME, Marc-Andrea completed an MA in International Relations from John Hopkins SAIS and a BA in Philosophy, Politics, and Economics from the University of Oxford.

Mariana Garcia-Martinez

Mariana Garcia-Martinez is a Field Coordinator and Research Consultant with DIME's unit on Gender, Economic Opportunity, and Fragility. Her current work focuses on coordinating and implementing impact evaluations aimed at both improving skills and jobs for at-risk youth as well as building resilience, in the Sahel and Central America. Prior to joining DIME, Mariana worked at Innovations for Poverty Action (IPA) Mexico, the International Food Policy Research Institute (IFPRI), the Organization for Economic Cooperation and Development (OECD), and at Toulouse School of Economics. Mariana holds a Master’s degree in Public Politics and Development from Toulouse School of Economics and two Bachelor’s degrees in Economics from Universidad Autonoma de Nuevo Leon and Université Toulouse I Capitole.

Maria Ruth Jones

Maria Ruth Jones co-founded and now leads DIME Analytics, an initiative to improve the quality, transparency, and reproducibility of empirical research. Through DIME Analytics, she creates public goods to benefit the global research community, such as Development Research in Practice, the DIME Wiki, the Manage Successful Impact Evaluations course, and the Manage Successful Surveys course. Maria also works on impact evaluations in agriculture and transport; current projects focus on the impacts of large-scale, rural infrastructure projects in Rwanda. Maria joined the World Bank in 2009. Previous roles at DIME include coordination of the Global Agriculture and Food Security Program impact evaluation portfolio (2012–16) and a program of impact evaluations with the government of Malawi (2009–11). Maria has an MA in international relations / development economics from the Johns Hopkins School of Advanced International Studies, and a BA in Economics and Spanish from Amherst College.
Read More

Nausheen Khan

Nausheen Khan is a Research Analyst in Development Impact Evaluation (DIME)’s unit on Gender, Economic Opportunity, and Fragility at the World Bank. She works primarily on managing and designing IEs covering labor market and social protection interventions, often with a focus on gender. Her work also focuses on fragile, conflict & violence (FCV) contexts. Her main areas of interest are survey design, data analysis and translating evidence-based research into policy. Prior to DIME, she worked at Khan Foundation, a non-government organization in Bangladesh focusing on democracy, social development and human rights. She holds a Master’s degree in International Development Policy from Georgetown University, and a Bachelor’s in Economics and Politics from Mount Holyoke College.

Roshni Khincha

Roshni Khincha is a Research Analyst and Data Coordinator with Development Impact Evaluation (DIME). She works as a Data Coordinator for the DIME Analytics team where she supports development of best practices and capacity building activities in data and survey workflows. She also works as a Research Analyst on project management, and data quality assurance, and data analysis of the school based programming impact evaluation in collaboration with WFP nad agricultural impact evaluations in Rwanda. Previously, she has worked with Poverty Action Lab (J-PAL) and holds a Masters in Economics from London School of Economics (LSE).

Christophe Ndahimana

Christophe Ndahimana is a Research Analyst at Development Impact Evaluation’s World Bank Research Group in Rwanda, where he supports an Impact Evaluation portfolio in different sectors. He works closely with Field-Coordinators and Research Assistants on the Rwanda portfolio; supervising field activities and data analysis - providing analytical and managerial support as appropriate. Liaising between government officials, World Bank operations and research economists, he is closely involved with research design and program implementation with projects at various stages in the life cycle including pilot, baseline, midline, dissemination and scale-up. Prior to joining DIME, he was a Senior Research Associate at Innovations for Poverty Action (IPA), Field Manager at Mathematica Policy Research and other research institutions.

Luis Eduardo San Martin

Luis Eduardo San Martin is a Data Coordinator at the World Bank's Development Impact Evaluation (DIME) Analytics group, where he conducts code reviews to ensure the computational reproducibility of DIME's research and provides data science support for DIME's portfolio of impact evaluations. Before joining DIME Analytics, Luis Eduardo worked as Data Analyst for the Peruvian government and as Research Associate for Innovations for Poverty Action, where he designed and implemented the data acquisition components of impact evaluations. Luis Eduardo holds an MSc in Computational Analysis and Public Policy from the University of Chicago and a BSc in Economics Engineering from Universidad Nacional de Ingenieria in Lima.

Nupur Savani

Nupur Savani is a Program Assistant at the World Bank in the Development Impact Evaluation (DIME) unit. At DIME, Nupur coordinates program activities and operations for DIME Analytics, a team supporting data quality and knowledge sharing at DIME. She also supports the Knowledge Management team at DIME. She has a Bachelor’s degree in International Affairs with specializations in International Development and Africa from the George Washington University.

Avnish Dayal Singh

Avnish Dayal Singh is a Consultant and Research Assistant at the Development Impact Evaluation (DIME) department at the World Bank. He manages the DIME Wiki, and assists the DIME Analytics team with conducting reproducibility checks, periodic trainings, and other technical and analytical tools associated with development data. He also coordinates the work of the MyIE team, which tracks and disseminates annual reports on DIME’s global portfolio of impact evaluations through the MyIE dashboard. Avnish has a Masters' in Quantitative Economics and Econometrics from Columbia University (New York), and a Bachelors' in Economics from the University of Delhi (India). His interests involve combining development data with lessons from economic theory and field studies to improve the efficacy of development policy mechanisms globally. Previously, Avnish has worked at Ernst&Young (India), and the School of International and Public Affairs at Columbia University.

Borui Sun

Borui Sun is a second-year Research Assistant at the World Bank’s Development Impact Evaluation (DIME) unit. Borui provides survey collection and data analysis support for a variety of projects that cover topics in small firm growth, agricultural technology adoption, job search and gender biases. Borui holds a Master’s degree in Public Policy from the University of Chicago and a Bachelor’s degree in Political Science and from the George Washington University. Prior to joining DIME, Boruis worked as a Research Fellow at the Energy Policy Institute at the University of Chicago.
2724 students participated in the 3^rd edition of DIME Analytics flagship course, Manage Successful Impact Evaluation Surveys.
Related Materials
Course report
Course materials