Using Qualtrics XM to Create a Point-of-Use Survey to Assess the Usability of a Local Implementation of Primo

Authors

  • Matthew Black University of Calgary
  • Heather Ganshorn University of Calgary
  • Justine Wheeler University of Calgary

DOI:

https://doi.org/10.5860/ital.v42i4.16475

Keywords:

Usability, Primo, User feedback, web-scale discovery service, surveys

Abstract

In 2020, Libraries and Cultural Resources (LCR) at the University of Calgary used Qualtrics XM to design and pilot a point-of-use survey to collect user feedback on the usability of our implementation of Primo, Ex Libris's web-scale discovery service. Over a two-week period, users were presented with the pop-up survey while searching and asked to provide feedback. This article summarizes how we designed and implemented this point-of-use survey and the lessons learned from this project.

References

Aaron Nichols et al., “Kicking the Tires: A Usability Study of the Primo Discovery Tool,” Journal of Web Librarianship 8, no. 2 (April 3, 2014): 172–95, https://doi.org/10.1080/19322909.2014.903133

Annis Lee Adams and Margot Hanson, “Primo on the Go: A Usability Study of the Primo Mobile Interface,” Journal of Web Librarianship 14, no. 1–2 (April 2, 2020): 1–27, https://doi.org/10.1080/19322909.2020.1784820

Athena Hoeppner, “The Ins and Outs of Evaluating Web-Scale Discovery Services,” Computers in Libraries, no. 3 (April 2012), https://www.infotoday.com/cilmag/apr12/Hoeppner-Web-Scale-Discovery-Services.shtml.

Barbara Valentine and Beth West, “Improving Primo Usability and Teachability with Help from the Users,” Journal of Web Librarianship 10, no. 3 (July 2, 2016): 176–96, https://doi.org/10.1080/19322909.2016.1190678.

Blake Lee Galbreath, Corey Johnson, and Erin Hvizdak, “Primo New User Interface: Usability Testing and Local Customizations Implemented in Response,” Information Technology and Libraries 37, no. 2 (June 18, 2018): 10–33, https://doi.org/10.6017/ital.v37i2.10191

Christian Rohrer, “When to Use Which User-Experience Research Methods,” Nielsen Norman Group, July 17, 2022, https://www.nngroup.com/articles/which-ux-research-methods/.

David J. Comeaux, “Usability Testing of a Web-Scale Discovery System at an Academic Library,” College & Undergraduate Libraries 19, no. 2–4 (April 2012): 189–206, https://doi.org/10.1080/10691316.2012.695671

Greta Kliewer et al., “Using Primo for Undergraduate Research: A Usability Study,” Library Hi Tech 34, no. 4 (January 1, 2016): 566–84, https://doi.org/10.1108/LHT-05-2016-0052

Jane Nichols, Richard Stoddart, and Terry Reese, “Nuanced and Timely: Capturing Collections Feedback at Point of Use,” in Too Much Is Not Enough! (Charleston Conference, Against the Grain, 2014), 299, https://doi.org/10.5703/1288284315275.

Joy Marie Perrin et al., “Usability Testing for Greater Impact: A Primo Case Study,” Information Technology and Libraries 33, no. 4 (December 18, 2014): 57–66, https://doi.org/10.6017/ital.v33i4.5174

Kelsey Renee Brett, Ashley Lierman, and Cherie Turner, “Lessons Learned: A Primo Usability Study,” Information Technology and Libraries 35, no. 1 (April 1, 2016): 7–25, https://doi.org/10.6017/ital.v35i1.8965

Kylie Jarrett, “Findit@Flinders: User Experiences of the Primo Discovery Search Solution,” Australian Academic & Research Libraries 43, no. 4 (December 2012): 278–99

Lynne Porat and Nir Zinger, “Primo New User Interface—Not Just for Undergrads: A Usability Study,” Weave: Journal of Library User Experience 1, no. 9 (2018), https://doi.org/10.3998/weave.12535642.0001.904

Martha Kyrillidou, Terry Plum, and Bruce Thompson, “Evaluating Usage and Impact of Networked Electronic Resources through Point-of-Use Surveys: A MINES for LibrariesTM Study,” The Serials Librarian 59, no. 2 (July 30, 2010): 485, https://doi.org/10.1080/03615261003674057.

Sarah Dahlen, Kenny Garcia, and Kathlene Hanson, “Comparing Apples and Bananas? A/B Testing for Discovery System Optimization,” Library Faculty Publications and Presentations, January 1, 2018, https://digitalcommons.csumb.edu/lib_fac/9

Scott Hanrath and Miloche Kottman, “Use and Usability of a Discovery Tool in an Academic Library,” Journal of Web Librarianship 9, no. 1 (January 2, 2015): 1–21, https://doi.org/10.1080/19322909.2014.983259

Tamar Sadeh, “User Experience in the Library: A Case Study,” New Library World 109, no. 1/2 (January 11, 2008): 7–24, https://doi.org/10.1108/03074800810845976.

W. Jacobs, Mike DeMars, and J. M. Kimmitt, “A Multi-Campus Usability Testing Study of the New Primo Interface,” College & Undergraduate Libraries 27, no. 1 (January 2, 2020): 1–16, https://doi.org/10.1080/10691316.2019.1695161

Xi Niu, Tao Zhang, and Hsin-liang Chen, “Study of User Search Activities with Two Discovery Tools at an Academic Library,” International Journal of Human-Computer Interaction 30, no. 5 (May 4, 2014): 422–33, https://doi.org/10.1080/10447318.2013.873281

Downloads

Published

2023-12-18

How to Cite

Black, M., Ganshorn, H., & Wheeler, J. (2023). Using Qualtrics XM to Create a Point-of-Use Survey to Assess the Usability of a Local Implementation of Primo. Information Technology and Libraries, 42(4). https://doi.org/10.5860/ital.v42i4.16475

Issue

Section

Communications