Non-random Study Attrition: Assessing Correction Techniques and the Magnitude of Bias in a Longitudinal Study of Reentry from Prison

• NCJ Number: 304595
• Journal: Journal of Quantitative Criminology Dated: 2021
• Author(s): M. M. Mitchell; et al
• Date Published: 2021
• Grant Number(s): 2014-MU-CX-0111
• Agencies: NIJ-Sponsored
• Publication Type: Research (Applied/Empirical)
• Award: Gangs on the Street, Gangs in Prison: Their Nature, Interrelationship, Control, and Re-Entry

Annotation

Since longitudinal data offer many advantages to criminological research yet suffer from attrition, namely in the form of sample selection bias, and attrition may undermine reaching valid inferences by introducing systematic differences between the retained and attrited samples, we explored (1) if attrition biases correlates of recidivism, (2) the magnitude of bias, and (3) how well methods of correction account for such bias.

 

Abstract

Using data from the LoneStar Project, a representative longitudinal sample of reentering men in Texas, we examined correlates of recidivism using official measures of recidivism under four sample conditions: full sample, listwise deleted sample, multiply imputed sample, and two-stage corrected sample. We compare and contrast the results regressing rearrest on a range of covariates derived from a pre-release baseline interview across the four sample conditions. Attrition bias was present in 44% of variables and null hypothesis significance tests differed for the correlates of recidivism in the full and retained samples. The bias was substantial, altering effect sizes for recidivism by a factor as large as 1.6. Neither the Heckman correction nor multiple imputation adequately corrected for bias. Instead, results from listwise deletion most closely mirrored the results of the full sample with 89% concordance. It is vital that researchers examine attrition-based selection bias and recognize the implications it has on their data when generating evidence of theoretical, policy, or practical significance. We outline best practices for examining the magnitude of attrition and analyzing longitudinal data affected by sample selection. (Publisher Abstract)