Loading…

An Open Source Replication of a Winning Recidivism Prediction Model

We present results of our winning solution to the National Institute of Justice recidivism forecasting challenge. Our team, “MCHawks,” placed highly in both terms of accuracy (as measured via the Brier score), as well as the fairness criteria (weighted by differences in false positive rates between...

Full description

Saved in:
Bibliographic Details
Published in:International journal of offender therapy and comparative criminology 2022-11, p.306624X221133004-306624X221133004
Main Authors: Circo, Giovanni M., Wheeler, Andrew P.
Format: Article
Language:English
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present results of our winning solution to the National Institute of Justice recidivism forecasting challenge. Our team, “MCHawks,” placed highly in both terms of accuracy (as measured via the Brier score), as well as the fairness criteria (weighted by differences in false positive rates between White and Black parolees). We used a non-linear machine learning model, XGBoost, although we detail our search of different model specifications, as many different models’ predictive performance is very similar. Our solution to balancing false positive rates is trivial; we bias predictions to always be “low risk” so false positive rates for each racial group are zero. We discuss changes to the fairness metric to promote non-trivial solutions. By providing open-source replication materials, it is within the capabilities of others to build just as accurate models without extensive statistical expertise or computational resources.
ISSN:0306-624X
1552-6933
DOI:10.1177/0306624X221133004