Explainability for experts: A design framework for making algorithms supporting expert decisions more explainable

Algorithmic decision support systems are widely applied in domains ranging from healthcare to journalism. To ensure that these systems are fair and accountable, it is essential that humans can maintain meaningful agency, understand and oversee algorithmic processes. Explainability is often seen as a promising mechanism for enabling human-in-the-loop, however, current approaches are ineffective and can lead to various biases. We argue that explainability should be tailored to support naturalistic decision-making and sensemaking strategies employed by domain experts and novices. Based on cognitive psychology and human factors literature review we map potential decision-making strategies dependant on expertise, risk and time dynamics and propose the conceptual Expertise, Risk and Time Explainability framework, intended to be used as explainability design guidelines. Finally, we present a worked example in journalism to illustrate the applicability of our framework in practice.

Abstract licence: CC BY-NC-ND

1. 33.

   “Many miles to go …”: a systematic review of the implementation of patient decision support interventions into routine clinical practice · 2013

2. 66.

   Interactive machine learning for health informatics: when do we need the human-in-the-loop? · 2016

3. 93.

   Reasons For Physicians Not Adopting Clinical Decision Support Systems: Critical Analysis · 2018

4. 140.

   Machine intelligence in healthcare—perspectives on trustworthiness, explainability, usability, and transparency · 2020

5. 142.

   Sex and gender differences and biases in artificial intelligence for biomedicine and healthcare · 2020

183 more references, whose wording the paper’s licence keeps private.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.