|
A Manual for Planning and Implementing the LSMS Survey |
Table of Contents
The following is from:
Grosh, M. & Muņoz, J. 1996. A Manual
for Planning and Implementing the Living Standards Measurement
Study Surveys. LSMS Working Paper #126, The
World Bank.
Contents
Foreword . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
Abstract . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
Acknowledgments. . . . . . . . . . . . . . . . . . . . . . . .xii
Chapter 1. Introduction. . . . . . . . . . . . . . . . . . . . .1
A. What This Manual Covers. . . . . . . . . . . . . . . . .1
B. Who Should Read This Manual. . . . . . . . . . . . . . .1
C. Some Assumptions Implicit in the Manual. . . . . . . . .3
Chapter 2: An Overview of LSMS Surveys. . . . . . . . . . . . .5
Key Messages. . . . . . . . . . . . . . . . . . . . . . . .5
A. The "Prototype" LSMS Survey . . . . . . . . . . . . . .5
Purpose of LSMS Surveys. . . . . . . . . . . . . . . .6
Questionnaire Content. . . . . . . . . . . . . . . . .7
Quality Control. . . . . . . . . . . . . . . . . . . 14
Planning and Budgeting . . . . . . . . . . . . . . . 15
B. Variations from the Prototype . . . . . . . . . . . . 15
Common Variants. . . . . . . . . . . . . . . . . . . 17
Evolution in LSMS Surveys. . . . . . . . . . . . . . 18
Chapter 3. Questionnaire Development . . . . . . . . . . . . . 21
Key Messages. . . . . . . . . . . . . . . . . . . . . . . 21
A. Questionnaire Content . . . . . . . . . . . . . . . . 21
B. The Process of Questionnaire Development. . . . . . . 22
The Actors . . . . . . . . . . . . . . . . . . . . . 22
The Iterative Process. . . . . . . . . . . . . . . . 25
Field Test of the Questionnaire. . . . . . . . . . . 29
C. Questionnaire Format . . . . . . . . . . . . . . . . . 32
Chapter 4: Sampling. . . . . . . . . . . . . . . . . . . . . . 53
Key Messages. . . . . . . . . . . . . . . . . . . . . . . 53
A. Overview of Issues in Sample Design. . . . . . . . . . 53
B. Sampling Practice in LSMS Surveys. . . . . . . . . . . 60
C. Implementing a Sample Design . . . . . . . . . . . . . 64
Determining the Basic Sample Design Parameters . . . 64
Implementation of the First Sampling Stage . . . . . 66
Implementation of the Second Sampling Stage. . . . . 71
Selecting Random Persons in a Household. . . . . . . 81
Chapter 5: Field Operations. . . . . . . . . . . . . . . . . . 83
Key Messages. . . . . . . . . . . . . . . . . . . . . . . 83
A. Standard LSMS Organization of Field Work . . . . . . . 83
Four-Week Interview Cycle. . . . . . . . . . . . . . 83
Composition of Survey Staff. . . . . . . . . . . . . 87
Duties of Survey Team Members. . . . . . . . . . . . 88
Team Logistics . . . . . . . . . . . . . . . . . . . 94
Complexity of LSMS Field Operations. . . . . . . . . 94
Alternatives to LSMS Standard Field Procedures
and Their Implications . . . . . . . . . . . . . . . 95
B. Preparation for Field Work . . . . . . . . . . . . . .103
Personnel. . . . . . . . . . . . . . . . . . . . . .104
Training . . . . . . . . . . . . . . . . . . . . . .106
Manuals. . . . . . . . . . . . . . . . . . . . . . .110
Developing Supervision Forms . . . . . . . . . . . .112
Scheduling Field Work. . . . . . . . . . . . . . . .119
Ensuring Collaboration by Households . . . . . . . .121
Piloting Field Procedures. . . . . . . . . . . . . .123
Chapter 6. Data Management . . . . . . . . . . . . . . . . . .125
Key Messages. . . . . . . . . . . . . . . . . . . . . . 125
A. An Overview of LSMS Data Management Philosophy. . . .126
Objectives . . . . . . . . . . . . . . . . . . . . .126
Approach Developed . . . . . . . . . . . . . . . . .126
Implications for Survey Planning . . . . . . . . . .127
B. Requirements for the Data Management System . . . . .128
Ease of Analysis of Resulting Data Files . . . . . .128
Data Quality Checks During Data Entry. . . . . . . .130
After Data Entry . . . . . . . . . . . . . . . . . . . . . . .136
C. File Structure Used in LSMS Data Entry Program. . . .140
Correspondence Between Records and Individual
Units Observed . . . . . . . . . . . . . . . . . . .140
Variable Number of Records . . . . . . . . . . . . .140
Limiting the Length of a Record Type . . . . . . . .142
Identifiers. . . . . . . . . . . . . . . . . . . . .142
Transformation . . . . . . . . . . . . . . . . . . .144
Chapter 7: Beginning Data Analysis. . . . . . . . . . . . . .145
Key Messages. . . . . . . . . . . . . . . . . . . . . . 145
A. Policies and Project Components to Promote Data Use .146
B. Documentation and Dissemination of Data Sets. . . . .148
Data Use Policy. . . . . . . . . . . . . . . . . . .149
Basic Documentation. . . . . . . . . . . . . . . . .151
Unit Record Data Files . . . . . . . . . . . . . . .153
Filing System. . . . . . . . . . . . . . . . . . . .154
Setting Service Standards Assignment of
Responsibilities for Data Documentation
and Dissemination . . . . . . . . . . . . . . . . .154
C. The Abstract. . . . . . . . . . . . . . . . . . . . .155
D. Examples of Further Analysis . . . . . . . . . . . . .163
The Study of Poverty . . . . . . . . . . . . . . . .165
Understanding the Effects of the Economic
Environment . . . . . . . . . . . . . . . . . . . .168
Provision of Public Services . . . . . . . . . . . .172
Impact of Government Programs. . . . . . . . . . . .176
The Determinants of Household Decisions. . . . . . .181
Chapter 8. Developing a Budget and Work Program. . . . . . . .184
Key Messages. . . . . . . . . . . . . . . . . . . . . . 184
A. Assessing the Country's Statistical Capabilities . . .185
Assessing the Outputs of the Statistical Agency. . .185
B. Developing a Budget. . . . . . . . . . . . . . . . . .187
Actual Survey Budgets. . . . . . . . . . . . . . . .188
Base Case Prototype . . . . . . . . . . . . . . . .189
Discussion . . . . . . . . . . . . . . . . . . . . .198
Sensitivity Analysis . . . . . . . . . . . . . . . .198
C. Developing the Work Program. . . . . . . . . . . . . .199
Management and Logistics . . . . . . . . . . . . . .201
Questionnaire Development. . . . . . . . . . . . . .205
Sampling . . . . . . . . . . . . . . . . . . . . . .206
Staffing and Training. . . . . . . . . . . . . . . .208
Data Management. . . . . . . . . . . . . . . . . . .208
Field Work . . . . . . . . . . . . . . . . . . . . .210
Data Analysis and Documentation. . . . . . . . . . .210
Annex I. Description of Questionnaires from Viet Nam LSMS .212
Annex II. Annotated List of Selected References. . . . . . .222
Annex III. LSMS Working Papers. . . . . . . . . . . . . . . .229
Annex IV. Instructions for Price Questionnaire from
Kagera Health and Development Survey . . . . . . .233
Annex V. Calendar of Events in Kagera, Tanzania . . . . . .237
Annex VI. Full Questionnaire Verification Form Used
in Pakistan LSMS . . . . . . . . . . . . . . . . .238
Annex VII. Inter-Record Checks in the Romania
Integrated Household Survey . . . . . . . . . . .242
Annex VIII. Table of Contents from Abstract of
Pakistan Integrated Household Survey . . . . . . .254
Annex IX. Table of Contents from Abstract of the 1993
Jamaica Survey of Living Conditions. . . . . . . . .259
Annex X. Calculating Basic Consumption Aggregates . . . . .268
Bibliography . . . . . . . . . . . . . . . . . . . . . . . . .284
Tables
Table 2.1: Description of LSMS-Type Surveys by Country. . . . 16
Table 3.1: Units of Quantity. . . . . . . . . . . . . . . . . 50
Table 4.1: Sample Design in Selected LSMS Surveys . . . . . . 61
Table 7.1: Sample Size, Mean, and Standard Error of Estimate
of Per Capita Consumption, 1992 and 1993
Jamaica Survey of Living Conditions (SLC). . . . .161
Table 7.2: Some Characteristics of the Poor in Ecuador, 1994.166
Table 7.3: Determinants of Household Expenditure Levels . . .169
Table 7.4: Cote d'Ivoire 1985 Distributional
Characteristics of Coffee and Cocoa Farming . . .170
Table 7.5: Tunisia Estimated Nutritional Effects of
Alternative Price Policies: . . . . . . . . . . .171
Table 7.6: Changes in Welfare in Lima 1985 to 1990. . . . . .172
Table 7.7: Access to Infrastructure in Rural Viet Nam . . . .173
Table 7.8: Indonesia The Distribution of Selected Subsidies175
Table 7.9: Percent of women who have heard of, ever used,
or are currently using a modern method of
contraception, Ghana, 1988-89. . . . . . . . . . .183
Table 8.1: Approximate Survey Budgets from Selected
Countriesa . . . . . . . . . . . . . . . . . . . .188
Table 8.2: Generic, All-Inclusive Budget for a One Year,
3,200-Household Living Standards Survey. . . . . . .190
Table 8.3: Sensitivity Analysis on the Budget . . . . . . . .199
Boxes
Box 1.1: The Minimum Package of Reference Materials . . . . . .2
Box 1.2: Guide for Those Who Will Read Only Portions
of the Manual. . . . . . . . . . . . . . . . . . . . .3
Box 2.1: Common Uses of LSMS Data . . . . . . . . . . . . . . .8
Box 2.2: Using LSMS Data to Inform Government Policy Choices. .9
Box 2.3: Modules in LSMS Questionnaires . . . . . . . . . . . 11
Box 3.1: Levels of Refinement in Determining
Questionnaire Content . . . . . . . . . . . . . . . .23
Box 3.2: Synergy in Elements of Questionnaire Design. . . . . 24
Box 3.3: Translating the Questionnaire. . . . . . . . . . . . 26
Box 4.1: How Wrong Will Our Estimates Be? . . . . . . . . . . 55
Box 4.2: Sampling Error and Sample Size: A Case of
Diminishing Returns . . . . . . . . . . . . . . . . .56
Box 4.3: Sample Size and Population Size. . . . . . . . . . . 57
Box 4.4: Cluster Effects. . . . . . . . . . . . . . . . . . . 59
Box 5.1: Day 2 of a Typical Interviewer Training Session. . .108
Box 6.1: Levels of Observation in the Kagera Health and
Development Survey . . . . . . . . . . . . . . . . .130
Box 6.2: Setting Boundaries for Range Checks. . . . . . . . .131
Box 6.3: Sample Report of Inter-Record Checks . . . . . . . .134
Box 6.4: Sample Page of the Household Printout. . . . . . . .135
Box 6.5: File Structure, Identifiers and the
Interface Between Data Entry and Analysis. . . . . .137
Box 6.6: An Evaluation of Data Entry Packages'
Suitability for the LSMS . . . . . . . . . . . . . .141
Box 6.7: A Sample Data Entry Screen . . . . . . . . . . . . .143
Box 7.1: The Role of Different Actors in Analysis . . . . . .147
Box 7.2: Prototype Data Access Policy . . . . . . . . . . . .150
Box 7.3: The Difference Between a Good and Bad Table. . . . .159
Box 7.4: Data Cleaning During Analysis. . . . . . . . . . . .164
Box 8.1: Assessing the Products of a Statistical Institute. .186
Box 8.2: Assessing the Inputs of a Statistical Institute. . .187
Box 8.3: Contracting Out for Technical Assistance . . . . . .191
Figures
Figure 3.1: Illustration of Individual Identification
and Skip Codes . . . . . . . . . . . . . . . . . .35
Figure 3.2: Format When only One of a Unit of Analysis
is Observed . . . . . . . . . . . . . . . . . . . 36
Figure 3.3: Roster Arrangements . . . . . . . . . . . . . . . 39
Figure 3.4: Illustration of Precoding and an Open-Ended List. 41
Figure 3.5: Illustration of Case Conventions. . . . . . . . . 43
Figure 3.6: Flow Chart of Health Module . . . . . . . . . . . 45
Figure 3.7: Illustration of a Closed-Ended List . . . . . . . 47
Figure 3.8: Illustration of Respondent-Selected Units . . . . 49
Figure 4.1: List of First Stage Sampling Units. . . . . . . . 67
Figure 4.2: Cumulative Totals in the List of First Stage
Sampling Units . . . . . . . . . . . . . . . . . .68
Figure 4.3: Selecting the First Stage Sampling Units. . . . . 69
Figure 4.4: Assignment of Work Areas, Ghana Living Standards
Survey, 1988-89 72
Figure 4.5: An Algorithm to Produce a Random Permutation
of the Integers 1 to N 74
Figure 4.6: Typical Listing Form. . . . . . . . . . . . . . . 76
Figure 4.7: List of Selected Dwellings. . . . . . . . . . . . 80
Figure 4.8: Sticker Used for Selecting a Random
Individual Within the Household 81
Figure 5.1: Weekly Activities of the Field Members. . . . . . 85
Figure 5.2: A Calendar of Events. . . . . . . . . . . . . . . 93
Figure 5.3: Interviewer and Data Entry Operator
Training Program. 107
Figure 5.4: Interviewer Evaluation Form . . . . . . . . . . .114
Figure 5.5: Page One of Pakistan Questionnaire
Verification Form 116
Figure 5.6: Check-up Interview Form . . . . . . . . . . . . .118
Figure 5.7: Schedule for Field Work . . . . . . . . . . . . .120
Figure 7.1: Illustration of an Abstract for Primary Schools .158
Figure 7.2: Indonesia Percent of Those Ill in Last Month
Who Sought Health Care, by Decile and Place
Where Care Sought, According to 1990 SUSENAS 174
Figure 7.3: Selected Indicators of Quality of Health
Facilities in Jamaica, According to the Expanded
Health Module, 1989 Survey of Living Conditions 176
Figure 7.4: User Fee Simulations for Children's Health Care
in Sierra Regions of Peru, 1985 177
Figure 7.5: Workers' Income in the Bolivia Emergency
Social Fund 179
Figure 7.6: Response of Private Transfers to Public Transfer
Programs 180
Figure 7.7: Age-specific fertility rates by women's age and
consumption percentile, Cote d'Ivoire, 1985-87 183
Figure 8.1: Generic Time Table for Survey Management. . . . .200
Revised 08/06/97
 |
 |