Library Discovery Products: Discovering User Expectations through Failure Analysis
DOI:
https://doi.org/10.6017/ital.v35i3.9190Abstract
As the new generation of discovery systems evolve and gain maturity, it is important to continually focus on how users interact with these tools and what areas they find problematic. This study looks at user interactions within SearchWorks, a discovery system developed by Stanford University Libraries, with an emphasis on identifying and analyzing problematic and failed searches. Our findings indicate that users still experience difficulties conducting author and subject searches, could benefit from enhanced support for browsing, and expect their overall search experience to be more closely aligned with that on popular Web destinations. The article also offers practical recommendations pertaining to metadata, functionality, and scope of the search system that could help address some of the most common problems encountered by the users.
References
Marshall Breeding, “Library Resource Discovery Products: Context, Library Perspectives, and Vendor Positions,” Library Technology Reports 50, no. 1 (2014): 5-58.
Craig Silverstein, Hannes Marais, Monika Henzinger and Michael Moricz, “Analysis of a Very Large Web Search Engine Query Log,” SIGIR Forum 33, no. 1 (1999): 6-12; Bernard J. Jansen, Amanda Spink and Tefko Saracevic, “Real Life, Real Users, and Real Needs: A Study and Analysis of User Queries on the Web,” Information Processing and Management 36, no. 2 (2000), 207-27, doi:10.1016/S0306-4573(99)00056-4; Amanda Spink, Bernard J. Jansen and H. Cenk Ozmultu. “Use of Query Reformulation and Relevance Feedback by Excite Users,” Internet Research 10, no. 4 (2000): 317-28; Amanda Spink, Dietmar Wolfram, Bernard J. Jansen and Tefko Saracevic, “Searching the Web: The Public and Their Queries,” Journal of the American Society for Information Science and Technology 52, no. 3 (2001): 226-34; Bernard J. Jansen and Amanda Spink, “An Analysis of Web Searching by European AllteWeb.com Users,” Information Processing and Management 41, no. 2 (2005): 361-81, doi:10.1016/S0306-4573(03)00067-0.
Cory Lown and Bradley Hemminger, “Extracting User Interaction Information from the Transaction Logs of a Faceted Navigation OPAC,” code4lib 4 (2009), accessed January 1, 2016, http://journal.code4lib.org/articles/1633; Eng Pwey Lau and Dion Ho-Lian Goh, “In Search of Query Patterns: A Case Study of a University OPAC,” Information Processing and Management 42, no. 5 (2006): 1316-29, doi:10.1016/j.ipm.2006.02.003; Heather Moulaison, “OPAC Queries at a Medium-Sized Academic Library: A Transaction Log Analysis,” Library Resources and Technical Services 52, no. 4 (2008): 230-37.
William H. Mischo, Mary C. Schlembach, Joshua Bishoff and Elizabeth M. German, “User Search Activities within an Academic Library Gateway: Implications for Web-Scale Discovery Systems”, in Planning and Implementing Resource Discovery Tools in Academic Libraries, eds. Mary Pagliero Popp and Diane Dallis (Hershey: Information Science Reference, 2012), 153-73; Xi Niu, Tao Zhang and Hsin-liang Chen, “Study of User Search Activities with Two Discovery Tools at an Academic Library,” International Journal of Human-Computer Interaction 30, no. 5 (2014): 422-33, doi: 10.1080/10447318.2013.873281.
Eng Pwey Lau and Dion Ho-Lian Goh, “In Search of Query Patterns: A Case Study of a University OPAC,” Information Processing and Management 42, no. 5 (2006): 1316-29, doi: doi:10.1016/j.ipm.2006.02.003; Xi Niu, Tao Zhang and Hsin-liang Chen, “Study of User Search Activities with Two Discovery Tools at an Academic Library,” International Journal of Human-Computer Interaction 30, no. 5 (2014): 422-33, doi: 10.1080/10447318.2013.873281.
Cory Lown and Bradley Hemminger, “Extracting User Interaction Information from the Transaction Logs of a Faceted Navigation OPAC,” code4lib 4 (2009), accessed January 1, 2016, http://journal.code4lib.org/articles/1633; Kristin Antelman, Emily Lynema and Andrew K. Pace, “Toward a Twenty-First Century Library Catalog,” Information Technology and Libraries 25, no. 3 (2006): 128-39; Xi Niu, Tao Zhang and Hsin-liang Chen, “Study of User Search Activities with Two Discovery Tools at an Academic Library,” International Journal of Human-Computer Interaction 30, no. 5 (2014): 422-33, doi:10.1080/10447318.2013.873281.
Xi Niu and Bradely Hemminger, “Analyzing the Interaction Patterns in a Faceted Search Interface”, Journal of the Association for Information Science and Technology 66, no. 5 (2015): 1030-47, doi: 10.1002/asi.23227.
Steven D. Zink, “Monitoring User Search Success through Transaction Log Analysis: the WolfPAC Example,” Reference Services Review 19, no. 1 (1991): 49-56; Deborah D. Blecic, Nirmala S. Bangalore, Josephine L. Dorsch, Cynthia L. Henderson, Melissa H. Koenig and Ann C. Weller, “Using Transaction Log Analysis to Improve OPAC Retrieval Results,” College and Research Libraries 59, no. 1 (1998): 39-50; Holly Yu and Margo Young, “The Impact of Web Search Engines on Subject Searching in OPAC,” Information Technology and Libraries 23, no. 4 (2004): 168-80; Heather Moulaison, “OPAC Queries at a Medium-Sized Academic Library: A Transaction Log Analysis,” Library Resources and Technical Services 52, no. 4 (2008): 230-37;
Thomas Peters, “When Smart People Fail,” Journal of Academic Librarianship 15, no. 5 (1989): 267-73; Steven D. Zink, “Monitoring User Search Success through Transaction Log Analysis: the WolfPAC Example,” Reference Services Review 19, no. 1 (1991): 49-56; Rhonda H. Hunter, “Successes and Failures of Patrons Searching the Online Catalog at a Large Academic Library: a Transaction Log Analysis”, Reference Quarterly, Spring 1991: 395-402.
Karen Antell and Jie Huang, “Subject Searching Success: Transaction Logs, Patron Perceptions, and Implications for Library Instruction”, Reference and User Services Quarterly 48, no. 1 (2008): 68-76; Rhonda H. Hunter, “Successes and Failures of Patrons Searching the Online Catalog at a Large Academic Library: a Transaction Log Analysis”, Reference Quarterly, Spring 1991: 395-402; Thomas Peters, “When Smart People Fail,” Journal of Academic Librarianship 15, no. 5 (1989): 267-73.
Thomas Peters, “When Smart People Fail,” Journal of Academic Librarianship 15, no. 5 (1989): 267-73; Heather Moulaison, “OPAC Queries at a Medium-Sized Academic Library: A Transaction Log Analysis,” Library Resources and Technical Services 52, no. 4 (2008): 230-37; Deborah D. Blecic, Nirmala S. Bangalore, Josephine L. Dorsch, Cynthia L. Henderson, Melissa H. Koenig and Ann C. Weller, “Using Transaction Log Analysis to Improve OPAC Retrieval Results,” College and Research Libraries 59, no. 1 (1998): 39-50.
Lynn Silipigni Connaway, Debra Wilcox Johnson, and Susan E. Searing, “Online Catalogs from the Users’ Perspective: The Use of Focus Group Interviews,” College and Research Libraries 58, no. 5 (1997): 403-20, doi:10.5860/crl.58.5.403.
Karl V. Fast and D. Grant Campbell, “‘I Still Like Google’: University Student Perceptions of Searching OPACs and the Web”, ASIST Proceedings 41 (2004): 138-46; Eric Novotny, “I Don’t Think I Click: A Protocol Analysis Study of Use of a Library Online Catalog in the Internet Age”, College and Research Libraries 65, no. 6 (2004): 525-37, doi: 10.5860/crl.65.6.525.
Xi Niu, Bradley M. Hemminger, Cory Lown, Stephanie Adams, Cecelia Brown, Allison Level, Merinda McLure, Audrey Powers, Michele R. Tennant and Tara Cataldo, “National Study of Information Seeking Behavior of Academic Researchers in the United States”, Journal of the American Society for Information Science and Technology 61, no. 5 (2010): 869-90, doi: 10.1002/asi.21307; Lynn Sillipigni Connaway, Timothy J. Dikey and Marie L. Radford, “If It Is Too Inconvenient I’m Not Going after it: Convenience as a Critical Factor in Information-Seeking Behaviors,” Library and Information Science Research 33, no. 3 (2011): 179-90; Karen Calhoun, Joanne Cantrell, Peggy Gallagher and Janet Hawk, Online Catalogs: What Users and Librarians Want: An OCLC report. Dublin, OH: OCLC Online Computer Library Center, 2009.
F. William Chickering and Sharon Q. Young, “Evaluation and Comparison of
Discovery Tools: An Update,” Information Technology and Libraries 33, no.2 (2014): 5-30, doi: http://dx.doi.org/10.6017/ital.v33i2.3471.
William Denton and Sarah J, Coysh, “Usability Testing of VuFind at an Academic Library”, Library Hi Tech 29, no. 2 (2011): 301-19, doi:10.1108/07378831111138189; Jennifer Emanuel, “Usability of the VuFind Next-Generation Online Catalog,” Information Technology and Libraries 30, no. 1 (2011): 44-52; Erin Dorris Cassidy , Glenda Jones, Lynn McMain, Lisa Shen and Scott Vieira, “Student Searching with EBSCO Discovery: A Usability Study,” Journal of Electronic Resources Librarianship 26, no. 1 (2014): 17-35, doi:10.1080/1941126X.2014.877331.
Sarah C. Williams and Anita K. Foster, “Promise Fulfilled? An EBSCO Discovery Service Usability Study,” Journal of Web Librarianship 5, no. 3 (2011): 179-98, doi: 10.1080/19322909.2011.597590; Rice Majors “Comparative User Experiences of Next-Generation Catalogue Interfaces”, Library Trends 61, no. 1 (2012): 186-207; Andrew D. Asher, Lynda M. Duke and Suzanne Wilson, “Paths of Discovery: Comparing the Search Effectiveness of EBSCO Discovery Service, Summon, Google Scholar, and Conventional Library Resources,” College and Research Libraries 74, no. 5 (2013): 464-88.
Jody Condit Fagan, Meris A. Mandernach, Carl S. Nelson, Jonathan R. Paulo and Grover Saunders, “Usability Test Results for a Discovery Tool in an Academic Library”, Information Technology and Libraries 31, no. 1 (2012): 83-112; Megan Johnson, “Usability Test Results for Encore in an Academic Library”, Information Technology and Libraries 32, no. 3 (2013): 59-85.
Andrew D. Asher, Lynda M. Duke and Suzanne Wilson, “Paths of Discovery: Comparing the Search Effectiveness of EBSCO Discovery Service, Summon, Google Scholar, and Conventional Library Resources,” College and Research Libraries 74, no. 5 (2013): 464-88; Kelly Meadow and James Meadow, “Search Query Quality and Web-Scale Discovery: a Qualitative and Quantitative Analysis,” College and Undergraduate Libraries 19, no. 2-4 (2012): 163-75, doi: 10.1080/10691316.2012.693434.
Sarah C. Williams and Anita K. Foster, “Promise Fulfilled? An EBSCO Discovery Service Usability Study,” Journal of Web Librarianship 5, no. 3 (2011): 179-98, doi: 10.1080/19322909.2011.597590; Kathleen Bauer and Alice Peterson-Hart, “Does Faceted Display in a Library Catalog Increase Use of Subject Headings?” Library Hi Tech 30, no. 2 (2012), pp. 347-58, doi:10.1108/07378831211240003
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2016 Information Technology and Libraries
This work is licensed under a Creative Commons Attribution 3.0 Unported License.
Authors that submit to Information Technology and Libraries agree to the Copyright Notice.
