Abstract
As artificial intelligence advances, it can increasingly be applied in collaboration with humans in decision-making contexts. However, questions on the design of different collaborative environments remain open. In the context of AI-advised human decision-making processes, we analyze the influence of AI advice on human confidence in the final decision. In a laboratory experiment, 458 subjects performed an image classification task. We compare their confidence over three treatments: i) a baseline case where subjects do not receive any AI advice; ii) where subjects receive AI advice; and iii) in addition to AI advice subjects also see the certainty of AI for its choice. Our results suggest that while AI advice can increase human overconfidence, this effect can be mitigated by augmenting the AI advice with its certainty. Our results not only contribute to the growing literature of human-AI collaboration, but also bear important practical implications for the design of collaborative systems.
Original language | English (US) |
---|---|
Title of host publication | Proceedings of the 55th Annual Hawaii International Conference on System Sciences, HICSS 2022 |
Editors | Tung X. Bui |
Publisher | IEEE Computer Society |
Pages | 245-253 |
Number of pages | 9 |
ISBN (Electronic) | 9780998133157 |
State | Published - 2022 |
Event | 55th Annual Hawaii International Conference on System Sciences, HICSS 2022 - Virtual, Online, United States Duration: Jan 3 2022 → Jan 7 2022 |
Publication series
Name | Proceedings of the Annual Hawaii International Conference on System Sciences |
---|---|
Volume | 2022-January |
ISSN (Print) | 1530-1605 |
Conference
Conference | 55th Annual Hawaii International Conference on System Sciences, HICSS 2022 |
---|---|
Country/Territory | United States |
City | Virtual, Online |
Period | 1/3/22 → 1/7/22 |
Bibliographical note
Publisher Copyright:© 2022 IEEE Computer Society. All rights reserved.