Please join us for a talk being given by Barbara Kiviat from Harvard University.
The Moral Limits of Predictive Practices: The Case of Credit-Based Insurance Scores
Corporations increasingly gather massive amounts of consumer data to predict how individuals will behave, so that they can more profitably price goods and allocate resources like insurance, credit, and jobs. In this talk, I investigate the moral foundations of such market practices. I leverage the case of credit scores in car insurance pricing—an early and controversial use of algorithms in the U.S. consumer economy—to understand how mathematical prediction functions as a framework of market fairness and the ways people push back against it. Drawing on more than 6,000 pages of documents produced during public policy debates since the 1990s, I show that the mathematical mechanics of prediction complicate efforts to morally reason in nuanced ways; in this case, to determine if it really is fair to charge people with low credit scores more for car insurance. Policymakers respond by searching for causal theories, the thing algorithmic prediction is supposed to eclipse, and re-sorting consumers from mathematical categories into categories of moral deservingness. This process, which I call de-commensuration, shapes the law and regulation that result. This research points to an important new direction for the study of markets and their impact on stratification in the era of “big data.”