Ethics of quantification


Ethics of quantification is the study of the ethical issues associated to different forms of visible or invisible forms of quantification. These could include algorithms, metrics/ indicators, statistical and mathematical modelling, as noted in a review of various aspects of sociology of quantification.
According to Espeland and Stevens an ethics of quantification would naturally descend from a sociology of quantification, especially at an age where democracy, merit, participation, accountability and even ‘‘fairness’’ are assumed to be best discovered and appreciated via numbers. In his classic work Theodore M. Porter notes how numbers meet a demand for quantified objectivity, and may for this be by used by bureaucracies or institutions to gain legitimacy and epistemic authority.
For Sareen et al., ethical issues arise when social actors may abuse quantification by strategically illuminating those aspects that can be socially legitimated, while obfuscating those that cannot. As an example, an AI-assisted census in India may purportedly increase the legitimacy of government, while at the same rendering minority citizens invisible.
For Andy Stirling of the STEPS Centre at Sussex University there is a rhetoric element around concepts such as ‘expected utility’, ‘decision theory’, ‘life cycle assessment’, ‘ecosystem services’ ‘sound scientific decisions’ and ‘evidence-based policy’. The instrumental application of these techniques and their use of quantification to deliver an impression of accuracy may raise ethical concerns.
For Sheila Jasanoff these technologies of quantification can be labeled as 'Technologies of hubris', whose function is to reassure the public while keeping the wheels of science and industry turning. The downside of the technologies of hubris is that they may generate overconfidence thanks to the appearance of exhaustivity; they can preempt a political discussion by transforming a political problem into a technical one; and remain fundamentally limited in processing what takes place outside their restricted range of assumptions.
Jasanoff contrasts technologies of hubris with 'technologies of humility' which admit the existence of ambiguity, indeterminacy and complexity, and strive to bring to the surface the ethical nature of problems. Technologies of humility are also sensitive to the need to alleviate known causes of people’s vulnerability, to pay attention to the distribution of benefits and risks, and to identify those factors and strategies which may promote or inhibit social learning.
For Sally Engle Merry, studying indicators of human rights, gender violence and sex trafficking, quantification is a technology of control, but whether it is reformist or authoritarian depends on who has harnessed its power and for what purpose. She notes in order to make indicators less misleading and distorting some principles should be followed:
Moving from indicators to mathematical models a group of 22 authors in propose five principles for making models serve society, moving from the premise that modelling is a social activity. The principles, which resonate with those above for indicators, are:
The principle are addressed to modellers, to model users, and ultimately to society.
The field of algorithms is the regime of quantification where the discussion about ethics is more advanced. An important work in this respect is Weapons of Math Destruction of Cathy O'Neil. While objectivity and efficiency are some positive properties associated with the use of algorithms, ethical issues are posed by these tools coming in the form of black boxes. Thus algorithms have the power to act upon data and make decisions, but they are to a large extend beyond query .