Building Appropriate Trust in AI: The Significance of Integrity-Centered Explanations 🏆

Conference paper

Siddharth Mehrotra, Carolina Centeio Jorge, Catholijn M. Jonker, Myrthe L. Tielman
Frontiers in Artificial Intelligence and Applications, , HHAI 2023: Augmenting Human Intellect, vol. 368, IOS Press Ebooks, 2023 Jun, pp. 436 - 439

DOI: 10.3233/FAIA230121

Full-text

Cite

APA Click to copy
Mehrotra, S., Jorge, C. C., Jonker, C. M., & Tielman, M. L. (2023). Building Appropriate Trust in AI: The Significance of Integrity-Centered Explanations 🏆. In HHAI 2023: Augmenting Human Intellect (Vol. 368, pp. 436–439). IOS Press Ebooks. https://doi.org/10.3233/FAIA230121

Chicago/Turabian Click to copy
Mehrotra, Siddharth, Carolina Centeio Jorge, Catholijn M. Jonker, and Myrthe L. Tielman. “Building Appropriate Trust in AI: The Significance of Integrity-Centered Explanations 🏆.” In HHAI 2023: Augmenting Human Intellect, 368:436–439. Frontiers in Artificial Intelligence and Applications. IOS Press Ebooks, 2023.

MLA Click to copy
Mehrotra, Siddharth, et al. “Building Appropriate Trust in AI: The Significance of Integrity-Centered Explanations 🏆.” HHAI 2023: Augmenting Human Intellect, vol. 368, IOS Press Ebooks, 2023, pp. 436–39, doi:10.3233/FAIA230121.

BibTeX Click to copy

@inproceedings{siddharth2023a,
  title = {Building Appropriate Trust in AI: The Significance of Integrity-Centered Explanations 🏆},
  year = {2023},
  month = jun,
  pages = {436 - 439},
  publisher = {IOS Press Ebooks},
  series = {Frontiers in Artificial Intelligence and Applications},
  volume = {368},
  doi = {10.3233/FAIA230121},
  author = {Mehrotra, Siddharth and Jorge, Carolina Centeio and Jonker, Catholijn M. and Tielman, Myrthe L.},
  editor = {},
  booktitle = {HHAI 2023: Augmenting Human Intellect},
  month_numeric = {6}
}

🏆: Best Poster Award

Abstract:

Establishing an appropriate level of trust between people and AI systems is crucial to avoid the misuse, disuse, or abuse of AI. Understanding how AI systems can generate appropriate levels of trust among users is necessary to achieve this goal. This study focuses on the impact of displaying integrity, which is one of the factors that influence trust. The study analyzes how different integrity-based explanations provided by an AI agent affect a human’s appropriate level of trust in the agent. To explore this, we conducted a between-subject user study involving 160 participants who collaborated with an AI agent to estimate calories on a food plate, with the AI agent expressing its integrity in different ways through explanations. The preliminary results demonstrate that an AI agent that explicitly acknowledges honesty in its decision making process elicit higher subjective trust than those that are transparent about their decision-making process or fair about biases. These findings can aid in designing agent-based AI systems that foster appropriate trust from humans.