This study tests the reliability and validity of seven common propensity-score-modeling (PSM) methods in their ability to remove an artificial selection bias and replicate results from several randomized controlled trials (RCTs) in criminal justice data.
As a substitute, randomized controlled trial (RCT) researchers increasingly rely on propensity score modeling (PSM) to estimate causal effects. However, some warn about the dangers of placing too much blind faith in the abilities of PSM. Findings of the current study suggest PSM can be an effective means for simulating RCT results. Meta-analyses revealed that the average difference between PSM and RCT estimates were relatively small. Ultimately, our findings suggest that PSM can be an effective means for simulating an RCT while also harboring reason for concern. Researchers and policymakers should approach the use and interpretation of PSM with cautious optimism as it appears to provide a reliable and valid estimate of the treatment effect most of the time. (Publisher abstract provided)
Downloads
Related Datasets
Similar Publications
- Reliability of the longitudinal experts all data (LEAD) methodology for determining the presence of elver mistreatment
- Keeping Pace With the Evolution of Illicit Darknet Fentanyl Markets: Using a Mixed Methods Approach to Identify Trust Signals and Develop a Vendor Trustworthiness Index
- Forensic interlaboratory evaluations of a systematic method for examining, documenting, and interpreting duct tape physical fits