Social and Behavioral Sciences Commons^™

Algorithmic Accountability, Ai, Transparency, & Text Analysis Assessment Panel, Susan [Gardner] Archambault, Alexander Justice

Susan Gardner Archambault

Shall We Chat? A Statistical Case Study Of Chat Reference Utilization, Jiebei Luo

Jiebei Luo

PurposeThis paper aims to evaluate the performance of a chat reference service implemented at an academic library in a private liberal arts college by gauging its impact on other forms of reference service in terms of usage volume, with a focus on research-related face-to-face reference questions. Design/methodology/approach Two statistical methods are used, namely, the difference-in-differences method and a simple moving average time series analysis, to analyze both the short-term and long-term impact brought by chat reference. Findings This study finds that the usage volume of the traditional face-to-face reference is significantly affected by chat reference in its first service year. …

Let’S Chat: Assessing Virtual Reference Service For Optimal User Experience, Heidi Gauder, Margaret Barkley

Heidi Gauder

Both librarians and student employees staff our virtual reference service, so ensuring consistent and quality chat transactions is important. Sample transcripts from fall 2014 were evaluated, and a fall 2015 follow-up analysis reviewed service improvement efforts. This poster will highlight how a simple scale can be used to assess virtual reference service.

Should Chat Reference Be Staffed By Librarians? An Assessment Of Chat Reference At An Academic Library Using Libstats, Patricia Bravender, Colleen Lyon, Anthony Molaro

Patricia Bravender

This study analyzes 1,557 chat reference questions received at Grand Valley State University Libraries over four semesters to determine the quantity and nature of the questions. Results indicated that use of chat reference was low and that less than a quarter of chat questions required a librarian to answer. The cost of a librarian answering a chat question ranged from $37 to $439 per question. The findings suggest that assigning chat reference to trained reference assistants will not affect patron service and that it is not cost effective to use reference librarians to answer chat questions.