562
Views
97
Downloads
18
Crossref
N/A
WoS
20
Scopus
N/A
CSCD
In response to public scrutiny of data-driven algorithms, the field of data science has adopted ethics training and principles. Although ethics can help data scientists reflect on certain normative aspects of their work, such efforts are ill-equipped to generate a data science that avoids social harms and promotes social justice. In this article, I argue that data science must embrace a political orientation. Data scientists must recognize themselves as political actors engaged in normative constructions of society and evaluate their work according to its downstream impacts on people’s lives. I first articulate why data scientists must recognize themselves as political actors. In this section, I respond to three arguments that data scientists commonly invoke when challenged to take political positions regarding their work. In confronting these arguments, I describe why attempting to remain apolitical is itself a political stance—a fundamentally conservative one—and why data science’s attempts to promote “social good” dangerously rely on unarticulated and incrementalist political assumptions. I then propose a framework for how data science can evolve toward a deliberative and rigorous politics of social justice. I conceptualize the process of developing a politically engaged data science as a sequence of four stages. Pursuing these new approaches will empower data scientists with new methods for thoughtfully and rigorously contributing to social justice.
In response to public scrutiny of data-driven algorithms, the field of data science has adopted ethics training and principles. Although ethics can help data scientists reflect on certain normative aspects of their work, such efforts are ill-equipped to generate a data science that avoids social harms and promotes social justice. In this article, I argue that data science must embrace a political orientation. Data scientists must recognize themselves as political actors engaged in normative constructions of society and evaluate their work according to its downstream impacts on people’s lives. I first articulate why data scientists must recognize themselves as political actors. In this section, I respond to three arguments that data scientists commonly invoke when challenged to take political positions regarding their work. In confronting these arguments, I describe why attempting to remain apolitical is itself a political stance—a fundamentally conservative one—and why data science’s attempts to promote “social good” dangerously rely on unarticulated and incrementalist political assumptions. I then propose a framework for how data science can evolve toward a deliberative and rigorous politics of social justice. I conceptualize the process of developing a politically engaged data science as a sequence of four stages. Pursuing these new approaches will empower data scientists with new methods for thoughtfully and rigorously contributing to social justice.
R. Wexler, Life, liberty, and trade secrets: Intellectual property in the criminal justice system, Stanford Law Review, vol. 70, no. 5, pp. 1343–1429, 2018.
Z. Obermeyer, B. Powers, C. Vogeli, and S. Mullainathan, Dissecting racial bias in an algorithm used to manage the health of populations, Science, vol. 366, no. 6464, pp. 447–453, 2019.
J. Buolamwini and T. Gebru, Gender shades: Intersectional accuracy disparities in commercial gender classification, Proceedings of the 1st Conference on Fairness,Accountability and Transparency, vol. 81, pp. 77–91, 2018.
A. D. I. Kramer, J. E. Guillory, and J. T. Hancock, Experimental evidence of massive-scale emotional contagion through social networks, Proceedings of the National Academy of Sciences, vol. 111, no. 24, pp. 8788–8790, 2014.
S. Vosoughi, D. Roy, and S. Aral, The spread of true and false news online, Science, vol. 359, no. 6380, pp. 1146–1151, 2018.
M. Kosinski, D. Stillwell, and T. Graepel, Private traits and attributes are predictable from digital records of human behavior, Proceedings of the National Academy of Sciences of the United States of America, vol. 110, no. 15, pp. 5802–5805, 2013.
Y. -A. de Montjoye, L. Radaelli, V. K. Singh, and A. S. Pentland, Unique in the shopping mall: On the reidentifiability of credit card metadata, Science, vol. 347, no. 6221, pp. 536–539, 2015.
B. J. Grosz, D. G. Grant, K. Vredenburgh, J. Behrends, L. Hu, A. Simmons, and J. Waldo, Embedded EthiCS: Integrating ethics across CS education, Communications of the ACM, vol. 62, no. 8, pp. 54–61, 2019.
N. Seaver, Algorithms as culture: Some tactics for the ethnography of algorithmic systems, Big Data&Society, vol. 4, no. 2, p. 205395171773810, 2017.
G. Neff, A. Tanweer, B. Fiore-Gartland, and L. Osburn, Critique and contribute: A practice-based framework for improving critical data studies and data science, Big Data, vol. 5, no. 2, pp. 85–97, 2017.
B. Joerges, Do politics have artefacts? Social Studies of Science, vol. 29, no. 3, pp. 411–431, 1999.
S. Woolgar and G. Cooper, Do artefacts have ambivalence: Moses’ bridges, Winner’s bridges and other urban legends in S&TS,Social Studies of Science, vol. 29, no. 3, pp. 433–449, 1999.
D. Haraway, Situated knowledges: The science question in feminism and the privilege of partial perspective, Feminist Studies, vol. 14, no. 3, pp. 575–599, 1988.
C. A. MacKinnon, Feminism, marxism, method, and the state: An agenda for theory, Signs:Journal of Women in Culture and Society, vol. 7, no. 3, pp. 515–544, 1982.
R. Abebe and K. Goldner, Mechanism design for social good, AI Matters, vol. 4, no. 3, pp. 27–34, 2018.
B. Berendt, AI for the common good?! Pitfalls, challenges, and ethics pen-testing, Paladyn,Journal of Behavioral Robotics, vol. 10, no. 1, pp. 44–65, 2019.
A. Karakatsanis, The punishment bureaucracy: How to think about “criminal justice reform”, The Yale Law Journal Forum, vol. 128, pp. 848–935, 2019.
A. M. McLeod, Confronting criminal law’s violence: The possibilities of unfinished alternatives, Unbound:Harvard Journal of the Legal Left, vol. 8, pp. 109–132, 2013.
A. L. Hoffmann, Where fairness fails: Data, algorithms, and the limits of antidiscrimination discourse, Information,Communication&Society, vol. 22, no. 7, pp. 900–915, 2019.
T. Smyth and J. Dimond, Anti-oppressive design, Interactions, vol. 21, no. 6, pp. 68–71, 2014.
B. Green, T. Horel, and A. V. Papachristos, Modeling contagion through social networks to explain and predict gunshot violence in Chicago, 2006 to 2014, JAMA Internal Medicine, vol. 177, no. 3, pp. 326–333, 2017.
W. R. Frey, D. U. Patton, M. B. Gaskell, and K. A. McGregor, Artificial intelligence and inclusion: Formerly gang-involved youth as domain experts for analyzing unstructured twitter data, Social Science Computer Review, vol. 38, no. 1, pp. 42–56, 2020.
S. Goel, J. M. Rao, and R. Shroff, Precinct or prejudice? Understanding racial disparities in New York City’s stop-and-frisk policy The Annals of Applied Statistics, vol. 10, no. 1, pp. 365–394, 2016.
R. Voigt, N. P. Camp, V. Prabhakaran, W. L. Hamilton, R. C. Hetey, C. M. Griffiths, D. Jurgens, D. Jurafsky, and J. L. Eberhardt, Language from police body camera footage shows racial disparities in officer respect, Proceedings of the National Academy of Sciences, vol. 114, no. 25, pp. 6521–6526, 2017.
D. McQuillan, Data science as machinic neoplatonism, Philosophy&Technology, vol. 31, pp. 253–272, 2018.
C. Harrington, S. Erete, and A. M. Piper, Deconstructing community-based collaborative design: Towards more equitable participatory design engagements, Proceedings of the ACM on Human-Computer Interaction, vol. 3, no. CSCW, pp. 1–25, 2019.
A. Meng and C. DiSalvo, Grassroots resource mobilization through counter-data action, Big Data&Society, vol. 5, no. 2, p. 205395171879686, 2018.
J. Dickinson, M. Díaz, C. A. L. Dantec, and S. Erete, “The cavalry ain’t coming in to save us”: Supporting capacities and relationships through civic tech, Proceedings of the ACM on Human-Computer Interaction, vol. 3, no. CSCW, pp. 1–21, 2019.
M. Asad, Prefigurative design as a method for research justice, Proceedings of the ACM on Human-Computer Interaction, vol. 3, no. CSCW, pp. 1–18, 2019.
M. M. Maharawal and E. McElroy, The anti-eviction mapping project: Counter mapping and oral history toward bay area housing justice, Annals of the American Association of Geographers, vol. 108, no. 2, pp. 380–389, 2018.
S. Viljoen, A relational theory of data governance, Yale Law Journal, vol. 131, no. 2, pp. 573–654, 2021.
B. Green is grateful to the Berkman Klein Center Ethical Tech Working Group for fostering his thinking on matters of technology, ethics, and politics. B. Green also thanks Catherine D’Ignazio, Anna Lauren Hoffmann, Lily Hu, Momin Malik, Dan McQuillan, Luke Stark, Salomé Viljoen, and the reviewers for providing helpful discussions and suggestions.
The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).