Summary: | <p>With the growing popularity, technological ease of using propensity score modeling (PSM), and the concern over its reliability and validity among scholars and practitioners, the researchers aimed to answer whether PSM methods can replicate the results from randomized controlled trials (RCTs). In this secondary data analysis, the researchers gathered the datasets of 10 publicly available and restricted RCT studies from the National Archive of Criminal Justice Data (NACJD), introduced an artificial selection bias into the treatment groups of these investigations, and then used each PSM technique to remove this selection bias. The team then compared the results generated from the PSM methods to those derived from the original RCT experiments, and meta-analyzed the findings across all studies to reveal the true reliability and validity of PSM in relation to RCTs using criminal justice data.</p> <p>For each study used in this analysis, the researchers created SPSS syntax for variable recodes and artificial bias creation and a codebook with original study items, recoded variables, and analytic variables. (In one study, two RCTs were conducted and thus two sets of syntax and codebooks were created.) Seven text files contain the Stata and R code used to run each PSM technique. These materials have been zipped into a package and are available for restricted download. Please refer to the ICPSR README for more information.</p>
|