The Problem of Infra-marginality in Outcome Tests for Discrimination

Outcome tests are a popular method for detecting bias in lending, hiring, and policing decisions. These tests operate by comparing the success rate of decisions across groups. For example, if loans made to minority applicants are observed to be repaid more often than loans made to whites, it suggest...

Full description

Saved in:  
Bibliographic Details
Main Author: Corbett-Davies, Sam (Author)
Contributors: Simoiu, Camelia ; Goel, Sharad
Format: Electronic Article
Language:English
Published: 2017
In: The annals of applied statistics
Year: 2017
Online Access: Volltext (kostenfrei)
Volltext (kostenfrei)
Journals Online & Print:
Drawer...
Check availability: HBZ Gateway
Keywords:

MARC

LEADER 00000caa a22000002c 4500
001 1866304887
003 DE-627
005 20250115054909.0
007 cr uuu---uuuuu
008 231019s2017 xx |||||o 00| ||eng c
024 7 |a 10.1214/17-aoas1058  |2 doi 
035 |a (DE-627)1866304887 
035 |a (DE-599)KXP1866304887 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 2,1  |2 ssgn 
100 1 |a Corbett-Davies, Sam  |e VerfasserIn  |4 aut 
245 1 4 |a The Problem of Infra-marginality in Outcome Tests for Discrimination 
264 1 |c 2017 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
520 |a Outcome tests are a popular method for detecting bias in lending, hiring, and policing decisions. These tests operate by comparing the success rate of decisions across groups. For example, if loans made to minority applicants are observed to be repaid more often than loans made to whites, it suggests that only exceptionally qualified minorities are granted loans, indicating discrimination. Outcome tests, however, are known to suffer from the problem of infra-marginality: even absent discrimination, the repayment rates for minority and white loan recipients might differ if the two groups have different risk distributions. Thus, at least in theory, outcome tests can fail to accurately detect discrimination. We develop a new statistical test of discrimination---the threshold test---that mitigates the problem of infra-marginality by jointly estimating decision thresholds and risk distributions via a hierarchical Bayesian latent variable model. Applying our test to a dataset of 4.5 million police stops in North Carolina, we find that the problem of infra-marginality is more than a theoretical possibility, and can cause the outcome test to yield misleading results in practice.Comment: To appear in The Annals of Applied Statistics, 201 
650 4 |a Research 
700 1 |a Simoiu, Camelia  |e VerfasserIn  |4 aut 
700 1 |a Goel, Sharad  |e VerfasserIn  |4 aut 
773 0 8 |i Enthalten in  |t The annals of applied statistics  |d Beachwood, Ohio : Inst. of Mathematical Statistics (IMS), 2007  |g (2017)  |h Online-Ressource  |w (DE-627)53744680X  |w (DE-600)2376910-5  |w (DE-576)267763565  |x 1941-7330  |7 nnas 
773 1 8 |g year:2017 
856 4 0 |u http://arxiv.org/abs/1607.05376  |x Verlag  |z kostenfrei  |3 Volltext 
856 4 0 |u https://doi.org/10.1214/17-aoas1058  |x Resolving-System  |z kostenfrei  |3 Volltext 
935 |a mkri 
951 |a AR 
ELC |a 1 
LOK |0 000 xxxxxcx a22 zn 4500 
LOK |0 001 4392948404 
LOK |0 003 DE-627 
LOK |0 004 1866304887 
LOK |0 005 20231019043626 
LOK |0 008 231019||||||||||||||||ger||||||| 
LOK |0 035   |a (DE-2619)CORE24815808 
LOK |0 040   |a DE-2619  |c DE-627  |d DE-2619 
LOK |0 092   |o n 
LOK |0 852   |a DE-2619 
LOK |0 852 1  |9 00 
LOK |0 935   |a core 
OAS |a 1 
ORI |a SA-MARC-krimdoka001.raw