IUI2025_ConvXAI

This is our repository for the paper:

Gaole He, Nilay Aishwarya, and Ujwal Gadiraju. Is Conversational XAI All You Need? Human-AI Decision Making With a Conversational XAI Assistant. In IUI'2025.

Introduction

Explainable artificial intelligence (XAI) methods are being proposed to help interpret and understand how AI systems reach specific predictions. Inspired by prior work on conversational user interfaces, we argue that augmenting existing XAI methods with conversational user interfaces can increase user engagement and boost user understanding of the AI system. In this paper, we explored the impact of a conversational XAI interface on users’ understanding of the AI system, their trust, and reliance on the AI system. In comparison to an XAI dashboard, we found that the conversational XAI interface can bring about a better understanding of the AI system among users and higher user trust. However, users of both the XAI dashboard and conversational XAI interfaces showed clear overreliance on the AI system. Enhanced conversations powered by large language model (LLM) agents amplified over-reliance.

Requirements:

• Python 3.8
• pandas
• numpy
• scipy
• pingouin

Acknowledgement

Any scientific publications that use our codes and datasets should cite the following paper as the reference:

@inproceedings{He-IUI-2025,
  title={Is Conversational XAI All You Need? Human-AI Decision Making With a Conversational XAI Assistant},
  author={He, Gaole and Aishwarya, Nilay and Gadiraju, Ujwal},
  booktitle={Proceedings of the 30th International Conference on Intelligent User Interfaces},
  year={2025}
}