Fairness in Automated Decision-Making—FairADM

Project Directors Prof. Dr. Frauke Kreuter, Dr. Ruben L. Bach, Dr. Christoph Kern Baden-Württemberg Stiftung-funded 2020 – 2023

Research question/goal:

In the rapidly evolving landscape of algorithmic decision-making (ADM), questions surrounding its potential reinforcement of social inequality have gained considerable attention. The project investigated critical aspects of ADM, focussing on its profound implications for the social sciences and the broader societal landscape.

Our main goal was to address the relationship between ADM and social inequality, algorithmic fairness, and distributive justice. In a first paper, we demonstrated the potential of the social sciences to enrich the discourse on ADM by emphasising the importance of uncovering and mitigating biases in training data, understanding data processing and analysis, and exploring the social contexts in which algorithms operate. In a second paper, we introduced a crucial distinction between algorithmic fairness and distributive justice in data-driven decision-making, fostering a systematic investigation of their interplay. We proposed the concept of ‘error fairness’ as a new measure of algorithmic fairness and provided arguments for the explicit inclusion of distributive justice principles in allocation decisions. In a third paper, we evaluated the practical application of ADM in public employment services, with a focus on predicting jobseekers' risk of long-term unemployment. We emphasised the significance of transparent modelling decisions and systematic evaluations in the implementation of statistical profiling techniques.

Collectively, these papers highlight the crucial role of the social sciences in mitigating the unintended consequences of ADM. They argue for a holistic understanding of fairness and justice in algorithms that goes beyond mere predictive accuracy. ‘Error fairness’ offers a novel perspective on evaluating fairness in algorithms, emphasising that prediction errors should not systematically differ across individuals.

In conclusion, our project shows ways for the social sciences to contribute to a more fairer use of ADM. By addressing biases, understanding the interplay of fairness and justice, and emphasizing transparency, we provide valuable insights to gain a comprehensive understanding of the social impacts of algorithmic decision-making.


Publications

Book Chapters

  • Atkinson, Paul, Sara Delamont, Alexandru Cernat, Joseph W. Sakshaug (Eds.) Kern, Christoph, Richard Williams (2020): Machine Learning Interpretation Tools. 1-12 (e-only). London, SAGE. More

Reports

  • Kaiser, Patrick, Christoph Kern, David Rügamer (2022): Uncertainty-aware predictive modeling for fair data-driven decisions. 11. Ithaca, NY, Cornell University. More
  • Kuppler, Matthias, Christoph Kern, Ruben L. Bach, Frauke Kreuter (2021): Distributive Justice and Fairness Metrics in Automated Decision-making: How Much Overlap Is There?. 22. Ithaca, NY, Cornell University. More
  • Kern, Christoph, Ruben L. Bach, Hannah Mautner, Frauke Kreuter (2021): Fairness in Algorithmic Profiling: A German Case Study. 33. Ithaca, NY, Cornell University. More