Engineering Commons^™

Human-Ai Teaming During An Ongoing Disaster: How Scripts Around Training And Feedback Reveal This Is A Form Of Human-Machine Communication, Keri K. Stephens, Anastazja G. Harris, Amanda L. Hughes, Carolyn E. Montagnolo, Karim Nader, S. Ashley Stevens, Tara Tasuji, Yifan Xu, Hemant Purohit, Christopher W. Zobel

Human-Machine Communication

Humans play an integral role in identifying important information from social media during disasters. While human annotation of social media data to train machine learning models is often viewed as human-computer interaction, this study interrogates the ontological boundary between such interaction and human-machine communication. We conducted multiple interviews with participants who both labeled data to train machine learning models and corrected machine-inferred data labels. Findings reveal three themes: scripts invoked to manage decision-making, contextual scripts, and scripts around perceptions of machines. Humans use scripts around training the machine—a form of behavioral anthropomorphism—to develop social relationships with them. Correcting machine-inferred data …