A Two-Dimensional Explanation Framework to Classify AI as Incomprehensible, Interpretable, or Understandable

摘要

Because of recent and rapid developments in Artificial Intelligence (AI), humans and Al-systems increasingly work together in human-agent teams. However, in order to effectively leverage the capabilities of both, Al-systems need to be understandable to their human teammates. The branch of explainable AI (XAI) aspires to make Al-systems more understandable to humans, potentially improving human-agent teamwork. Unfortunately, XAI literature suffers from a lack of agreement regarding the definitions of and relations between the four key XAI-concepts: transparency, interpretability, explainability, and understand-ability. Inspired by both XAI and social sciences literature, we present a two-dimensional framework that defines and relates these concepts in a concise and coherent way, yielding a classification of three types of Al-systems: incomprehensible, interpretable, and understandable. We also discuss how the established relationships can be used to guide future research into XAI, and how the framework could be used during the development of Al-systems as part of human-AI teams.