Potential survey error due to a panel design: A review and evaluation of the National Crime Victimization Survey
Key Points
- Using data from the National Crime Victimization Survey (NCVS), the authors use a total survey error (TSE) approach to examine three major sources of non-sampling error in longitudinal, mixed-mode surveys: telescoping, mode effects, and fatigue.
- The findings determined that telescoping error and fatigue are likely sources of error whereas a mode effect caused by the mixed-mode design is not causing error in the survey estimates.
- Because it is not possible to identify which respondents were susceptible to telescoping or fatigue, the authors developed a model to show how victimization rates should behave across interview waves. The model was then used to develop adjustment methods to account for the sources of error and assess how well the adjustments met the model expectations.
- Even with the model, there is still some subjectivity that comes into determinations about the appropriate adjustment.
Abstract
We use a total survey error approach to examine and make recommendations on how to adjust for non-sampling error in longitudinal, mixed-mode surveys. Using data from the National Crime Victimization Survey (NCVS), we examine three major sources of non-sampling error: telescoping, mode effects, and fatigue. We present an assessment of each source of error from a total survey error perspective and propose alternative adjustments to adjust better for this error. Findings suggest that telescoping and fatigue are likely sources of error in the NCVS, but the use of mixed-modes is not. Furthermore, both telescoping and fatigue are present in longitudinal surveys and accounting for one but not the other results in estimates that under- or overestimate the measures of interest—in this case, the rate of crime in the United States.
© 2025 RTI International. This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Meet the Experts
Navigate to
Marcus Berzofsky
Marcus Berzofsky
Navigate to
Lynn Langton
