Using Qualtrics XM to Create a Point-of-Use Survey to Assess the Usability of a Local Implementation of Primo


  • Matthew Black University of Calgary
  • Heather Ganshorn University of Calgary
  • Justine Wheeler University of Calgary



Usability, Primo, User feedback, web-scale discovery service, surveys


In 2020, Libraries and Cultural Resources (LCR) at the University of Calgary used Qualtrics XM to design and pilot a point-of-use survey to collect user feedback on the usability of our implementation of Primo, Ex Libris's web-scale discovery service. Over a two-week period, users were presented with the pop-up survey while searching and asked to provide feedback. This article summarizes how we designed and implemented this point-of-use survey and the lessons learned from this project.


Aaron Nichols et al., “Kicking the Tires: A Usability Study of the Primo Discovery Tool,” Journal of Web Librarianship 8, no. 2 (April 3, 2014): 172–95,

Annis Lee Adams and Margot Hanson, “Primo on the Go: A Usability Study of the Primo Mobile Interface,” Journal of Web Librarianship 14, no. 1–2 (April 2, 2020): 1–27,

Athena Hoeppner, “The Ins and Outs of Evaluating Web-Scale Discovery Services,” Computers in Libraries, no. 3 (April 2012),

Barbara Valentine and Beth West, “Improving Primo Usability and Teachability with Help from the Users,” Journal of Web Librarianship 10, no. 3 (July 2, 2016): 176–96,

Blake Lee Galbreath, Corey Johnson, and Erin Hvizdak, “Primo New User Interface: Usability Testing and Local Customizations Implemented in Response,” Information Technology and Libraries 37, no. 2 (June 18, 2018): 10–33,

Christian Rohrer, “When to Use Which User-Experience Research Methods,” Nielsen Norman Group, July 17, 2022,

David J. Comeaux, “Usability Testing of a Web-Scale Discovery System at an Academic Library,” College & Undergraduate Libraries 19, no. 2–4 (April 2012): 189–206,

Greta Kliewer et al., “Using Primo for Undergraduate Research: A Usability Study,” Library Hi Tech 34, no. 4 (January 1, 2016): 566–84,

Jane Nichols, Richard Stoddart, and Terry Reese, “Nuanced and Timely: Capturing Collections Feedback at Point of Use,” in Too Much Is Not Enough! (Charleston Conference, Against the Grain, 2014), 299,

Joy Marie Perrin et al., “Usability Testing for Greater Impact: A Primo Case Study,” Information Technology and Libraries 33, no. 4 (December 18, 2014): 57–66,

Kelsey Renee Brett, Ashley Lierman, and Cherie Turner, “Lessons Learned: A Primo Usability Study,” Information Technology and Libraries 35, no. 1 (April 1, 2016): 7–25,

Kylie Jarrett, “Findit@Flinders: User Experiences of the Primo Discovery Search Solution,” Australian Academic & Research Libraries 43, no. 4 (December 2012): 278–99

Lynne Porat and Nir Zinger, “Primo New User Interface—Not Just for Undergrads: A Usability Study,” Weave: Journal of Library User Experience 1, no. 9 (2018),

Martha Kyrillidou, Terry Plum, and Bruce Thompson, “Evaluating Usage and Impact of Networked Electronic Resources through Point-of-Use Surveys: A MINES for LibrariesTM Study,” The Serials Librarian 59, no. 2 (July 30, 2010): 485,

Sarah Dahlen, Kenny Garcia, and Kathlene Hanson, “Comparing Apples and Bananas? A/B Testing for Discovery System Optimization,” Library Faculty Publications and Presentations, January 1, 2018,

Scott Hanrath and Miloche Kottman, “Use and Usability of a Discovery Tool in an Academic Library,” Journal of Web Librarianship 9, no. 1 (January 2, 2015): 1–21,

Tamar Sadeh, “User Experience in the Library: A Case Study,” New Library World 109, no. 1/2 (January 11, 2008): 7–24,

W. Jacobs, Mike DeMars, and J. M. Kimmitt, “A Multi-Campus Usability Testing Study of the New Primo Interface,” College & Undergraduate Libraries 27, no. 1 (January 2, 2020): 1–16,

Xi Niu, Tao Zhang, and Hsin-liang Chen, “Study of User Search Activities with Two Discovery Tools at an Academic Library,” International Journal of Human-Computer Interaction 30, no. 5 (May 4, 2014): 422–33,




How to Cite

Black, M., Ganshorn, H., & Wheeler, J. (2023). Using Qualtrics XM to Create a Point-of-Use Survey to Assess the Usability of a Local Implementation of Primo. Information Technology and Libraries, 42(4).