Algorithmic Bias and Place of Residence: Feedback Loops in Financial and Risk Assessment Tools
Keywords:
algorithmic bias, feedback loops, risk-need assessment tools, financial scoring systems, place of residence
Abstract
This article explores how criminal risk-need assessment algorithms (e.g., COMPAS) and financial scoring systems (e.g., FICO) create feedback loops that perpetuate systemic biases, disproportionately affecting already financially marginalized groups. It examines the intersection of these tools, particularly how factors like place of residence, financial instability, and access to resources influence both systems. Using a theoretical critique, this study indirectly analyzes (1) criminological theories, (2) algorithmic design principles, and (3) evidentiary standards. The criminological theories considered-including Social Class and Crime, Strain Theory, Subcultural Perspectives, Labeling and Marxist/ Conflict Theories, Control Theories, and Differential Association Theory-share a consensus that environmental factors contribute to crime. While this research does not aim to verify their conclusions, it investigates how algorithmic models incorporate personal financial data and place of residence. It also examines the relevance of these to observing non-virtuous behaviors, as supported by the previously mentioned criminological theories, although the findings of these theories may differ regarding the levels of relevance of the environment to criminal occurrences. Additionally, evidentiary standards and numerical reasoning help assess how these inputs shape potentially biased and unfair scores.
Downloads
How to Cite
References
S. White, M. Spengler, P. (2006) The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. 34, 341-382.
D. Andrews, Craig Dowden (2008) The Risk-Need-Responsivity Model of Assessment and Human Service in Prevention and Corrections: Crime-Prevention Jurisprudence. 49(4), 439-464. https://doi.org/10.3138/cjccj.49.4.439
J. Angwin, J. Larson, S. Mattu, L. Kirchner (2016) Machine bias: There's software used across the country to predict future criminals. https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
V. Barnett (1973) Comparative Statistical Inference.
I. Brunton‐Smith, P. Sturgis (2011) DO NEIGHBORHOODS GENERATE FEAR OF CRIME? AN EMPIRICAL TEST USING THE BRITISH CRIME SURVEY*. 49(2), 331-369. https://doi.org/10.1111/j.1745-9125.2011.00228.x
J. Bonta, D. Andrews (2024) Psychology of Criminal Conduct, 7th ed.
R. Carnap (1950) Logical Foundations of Probability.
Julia Dressel, Hany Farid (2018) The accuracy, fairness, and limits of predicting recidivism. 4(1), 5580. https://doi.org/10.1126/sciadv.aao5580
M. Etienne (2009) Legal and practical implications of evidence-based sentencing by judges. 1, 43-60.
J. Ferrer Beltrán (2007) La valoración racional de la prueba.
J. Ferrer Beltrán (2021) Prueba sin convicción.
I. Good (1983) Good Thinking: The Foundations of Probability and its Applications.
K. Hannah-Moffat (2005) Criminogenic needs and the transformative risk subject: Hybridizations of risk/need in penality. 7(1), 29-51.
K. Hannah-Moffat (2013) Actuarial Sentencing: An "Unsettled" Proposition. 30(2), 270-296. https://doi.org/10.1080/07418825.2012.682603
K. Heilbrun (2009) Risk assessment in evidencebased sentencing context and promising uses. 1, 127-142.
James Kanan, Matthew Pruitt (2002) Modeling Fear of Crime and Perceived Victimization Risk: The (In)Significance of Neighborhood Integration. 72(4), 527-548. https://doi.org/10.1111/1475-682x.00033
D. Kaye (1988) Introduction What is Bayesianism?.
L. Laudan (2016) The Law's Flaws. Rethinking Trial and Errors? Milton Keynes.
Jennifer Logg, Julia Minson, Don Moore (2019) Algorithm appreciation: People prefer algorithmic to human judgment. 151, 90-103. https://doi.org/10.1016/j.obhdp.2018.12.005
Doris Mackenzie (2001) Corrections and Sentencing in the 21st Century: Evidence-Based Corrections and Sentencing. 81(3), 299-312. https://doi.org/10.1177/0032885501081003001
J. Mackie (1973) Truth, Probability and Paradox: Studies in Philosophical Logic.
M. Marcus (2009) MPC-The root of the problem: Just deserts and risk assessment.
M. Marcus (2009) Conversations on evidencebased sentencing.
B. Dietvorst, J. Simmons, C. Massey (2015) Algorithm aversion: people erroneously avoid algorithms after seeing them err. 144(1), 114. https://doi.org/10.1037//xge0000033
Northpointe Inc (2015) Practitioner's guide to COMPAS core. 16-06. https://archive.epic.org/algorithmic-transparency/crim-justice/EPIC-16-06-23-WI-FOIA-201600805-COMPASPractionerGuide.pdf
Valeria Saladino, Oriana Mosca, Filippo Petruccelli, Lilli Hoelzlhammer, Marco Lauriola, Valeria Verrastro, Cristina Cabras (2021) The Vicious Cycle: Problematic Family Relations, Substance Abuse, and Crime in Adolescence: A Narrative Review. 12, 673954. https://doi.org/10.3389/fpsyg.2021.673954
M. Santos (2024) The Lack of Evidentiary Standards to Define "Sufficient Evidence of Authorship" in Pretrial Detentions in Brazil: The Jurisprudence of the Brazilian Constitutional Court. 15, 1784-1813. https://doi.org/10.4236/blr.2024.153102
L. Savage (1954) The Foundations of Statistics.
Antonia Sorge, Giovanni Borrelli, Emanuela Saita, Raffaella Perrella (2022) Violence Risk Assessment and Risk Management: Case-Study of Filicide in an Italian Woman. 19(12), 6967. https://doi.org/10.3390/ijerph19126967
R. Warren (2007) Evidence-based practices and state sentencing policy: Ten policy initiatives to reduce recidivism. 82, 1312-1314.
M. Wolfe (2008) Evidence-based judicial discretion: Promoting public safety through state sentencing reform.
Published
2025-04-21
Issue
Section
License
Copyright (c) 2025 Authors and Global Journals Private Limited

This work is licensed under a Creative Commons Attribution 4.0 International License.