Prediction of Violent Reoffending in People Released from Prison in England: External Validation Study of a Risk Assessment Tool (OxRec)

Overview

Journal J Crim Justice

Date 2024 Dec 9

PMID 39649777

Authors

Gabrielle Beaudry

Rongqin Yu

Owen Miller

Lewis Prescott-Mayling

Thomas R Fanshawe

Seena Fazel

Affiliations

Soon will be listed here.

Abstract

We aimed to externally validate the Oxford Risk of Recidivism (OxRec) tool to estimate 1- and 2-year risk of violent reoffending in people released from prison in England. We identified individuals using administrative data shared between official prison and police services. We extracted information on criminal history, clinical and sociodemographic risk predictors, and outcomes. Predictive ability was examined using measures of calibration and discrimination for predetermined risk thresholds. In total, 1770 individuals (median age = 33 [IQR 27-40]; 92% were male) were identified. 31% and 43% reoffended within 1 and 2 years, respectively. Discrimination was good, with AUCs of 0.71 (95% CI: 0.69-0.74) for 1 year and 0.71 (0.68-0.74) for 2-year follow up. At a pre-specified threshold of 40% for 2-year risk, sensitivity was 77% (74%-80%), specificity 54% (51%-58%), PPV 56% (53%-59%) and NPV 76% (73%-79%). Simple model validation found a systematic underestimation of the probability of reoffending. However, after updating the model, calibration was good. External validations of risk assessment tools can be conducted using linked data between prison and police, and may require recalibration before implementation. In this validation, OxRec had good performance on discrimination and calibration measures. It can be considered to be used to improve decision-making about risk of serious offending and the allocation of resources.

References

Beaudry G, Yu R, Alaei A, Alaei K, Fazel S . Predicting Violent Reoffending in Individuals Released From Prison in a Lower-Middle-Income Country: A Validation of OxRec in Tajikistan. Front Psychiatry. 2022; 13:805141. PMC: 9082534. DOI: 10.3389/fpsyt.2022.805141. View

Chang Z, Larsson H, Lichtenstein P, Fazel S . Psychiatric disorders and violent reoffending: a national cohort study of convicted prisoners in Sweden. Lancet Psychiatry. 2015; 2(10):891-900. PMC: 4629414. DOI: 10.1016/S2215-0366(15)00234-5. View

Gulati G, Upshaw J, Wessler B, Brazil R, Nelson J, van Klaveren D . Generalizability of Cardiovascular Disease Clinical Prediction Models: 158 Independent External Validations of 104 Unique Models. Circ Cardiovasc Qual Outcomes. 2022; 15(4):e008487. PMC: 9015037. DOI: 10.1161/CIRCOUTCOMES.121.008487. View

Janssen K, Donders A, Harrell Jr F, Vergouwe Y, Chen Q, Grobbee D . Missing covariate data in medical research: to impute is better than to ignore. J Clin Epidemiol. 2010; 63(7):721-7. DOI: 10.1016/j.jclinepi.2009.12.008. View

Pickard H, Fazel S . Substance abuse as a risk factor for violence in mental illness: some implications for forensic psychiatric practice and clinical ethics. Curr Opin Psychiatry. 2013; 26(4):349-54. PMC: 3907744. DOI: 10.1097/YCO.0b013e328361e798. View

Yukhnenko D, Sridhar S, Fazel S . A systematic review of criminal recidivism rates worldwide: 3-year update. Wellcome Open Res. 2020; 4:28. PMC: 6743246. DOI: 10.12688/wellcomeopenres.14970.3. View

Yu R, Molero Y, Langstrom N, Fanshawe T, Yukhnenko D, Lichtenstein P . Prediction of reoffending risk in men convicted of sexual offences: development and validation of novel and scalable risk assessment tools (OxRIS). J Crim Justice. 2022; 82:101935. PMC: 9755050. DOI: 10.1016/j.jcrimjus.2022.101935. View

Vergouwe Y, Steyerberg E, Eijkemans M, Habbema J . Substantial effective sample sizes were required for external validation studies of predictive logistic regression models. J Clin Epidemiol. 2005; 58(5):475-83. DOI: 10.1016/j.jclinepi.2004.06.017. View

Van Calster B, McLernon D, van Smeden M, Wynants L, Steyerberg E . Calibration: the Achilles heel of predictive analytics. BMC Med. 2019; 17(1):230. PMC: 6912996. DOI: 10.1186/s12916-019-1466-7. View

10.

The Lancet Public Health . Promoting health beyond prison walls. Lancet Public Health. 2022; 7(7):e573. PMC: 9242623. DOI: 10.1016/S2468-2667(22)00141-4. View

11.

Fazel S, Sariaslan A, Fanshawe T . Towards a More Evidence-Based Risk Assessment for People in the Criminal Justice System: the Case of OxRec in the Netherlands. Eur J Crim Pol Res. 2022; 28(3):397-406. PMC: 9458683. DOI: 10.1007/s10610-022-09520-y. View

12.

Fazel S, Chang Z, Fanshawe T, Langstrom N, Lichtenstein P, Larsson H . Prediction of violent reoffending on release from prison: derivation and external validation of a scalable tool. Lancet Psychiatry. 2016; 3(6):535-43. PMC: 4898588. DOI: 10.1016/S2215-0366(16)00103-6. View

13.

White I, Royston P, Wood A . Multiple imputation using chained equations: Issues and guidance for practice. Stat Med. 2011; 30(4):377-99. DOI: 10.1002/sim.4067. View

14.

Held U, Kessels A, Garcia Aymerich J, Basagana X, Ter Riet G, Moons K . Methods for Handling Missing Variables in Risk Prediction Models. Am J Epidemiol. 2016; 184(7):545-551. DOI: 10.1093/aje/kwv346. View

15.

Thornton D, Mann R, Webster S, Blud L, Travers R, Friendship C . Distinguishing and combining risks for sexual and violent recidivism. Ann N Y Acad Sci. 2003; 989:225-35; discussion 236-46. DOI: 10.1111/j.1749-6632.2003.tb07308.x. View

16.

Fazel S, Wolf A, Vazquez-Montes M, Fanshawe T . Prediction of violent reoffending in prisoners and individuals on probation: a Dutch validation study (OxRec). Sci Rep. 2019; 9(1):841. PMC: 6351626. DOI: 10.1038/s41598-018-37539-x. View

17.

BONTA J, Law M, Hanson K . The prediction of criminal and violent recidivism among mentally disordered offenders: a meta-analysis. Psychol Bull. 1998; 123(2):123-42. DOI: 10.1037/0033-2909.123.2.123. View

18.

Mallett S, Halligan S, Thompson M, Collins G, Altman D . Interpreting diagnostic accuracy studies for patient care. BMJ. 2012; 345:e3999. DOI: 10.1136/bmj.e3999. View

19.

Harel O, Mitchell E, Perkins N, Cole S, Tchetgen Tchetgen E, Sun B . Multiple Imputation for Incomplete Data in Epidemiologic Studies. Am J Epidemiol. 2017; 187(3):576-584. PMC: 5860387. DOI: 10.1093/aje/kwx349. View

20.

Collins G, Reitsma J, Altman D, Moons K . Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement. BMC Med. 2015; 13:1. PMC: 4284921. DOI: 10.1186/s12916-014-0241-z. View