Evaluating Web-Scale Discovery Services: A Step-by-Step Guide
DOI:
https://doi.org/10.6017/ital.v34i2.5745Abstract
Selecting a web-scale discovery service is a large and important undertaking that involves a significant investment of time, staff, and resources. Finding the right match begins with a thorough and carefully planned evaluation process. In order to be successful, this process should be inclusive, goal-oriented, data-driven, user-centered, and transparent. The following article offers a step-by-step guide for developing a web-scale discovery evaluation plan rooted in these five key principles based on best practices synthesized from the literature as well as the author’s own experiences coordinating the evaluation process at Rutgers University. The goal is to offer academic libraries that are considering acquiring a web-scale discovery service a blueprint for planning a structured and comprehensive evaluation process.
References
Bietila, David and Tod Olson. “Designing an Evaluation Process for Resource Discovery Tools.” In Planning and Implementing Resource Discovery Tools in Academic Libraries, edited by Mary P. Popp and Diane Dallis, 122-136. Hershey, PA: Information Science Reference, 2012. doi:10.4018/978-1-4666-1821-3.ch008.
Breeding, Marshall. “Major Discovery Products.” Library Technology Guides. Accessed August 5, 2014. http://librarytechnology.org/discovery.
Breitbach, William. “Web-Scale Discovery: A Library of Babel?” In Planning and Implementing Resource Discovery Tools in Academic Libraries, edited by Mary P. Popp and Diane Dallis, 637-645. Hershey, PA: Information Science Reference, 2012. doi:10.4018/978-1-4666-1821-3.ch038.
Brennan, David P. “Details, Details, Details: Issues in Planning for, Implementing, and Using Resource Discovery Tools.” In Planning and Implementing Resource Discovery Tools in Academic Libraries, edited by Mary P. Popp and Diane Dallis, 44-56. Hershey, PA: Information Science Reference, 2012. doi:10.4018/978-1-4666-1821-3.ch003
Brubaker, Noah, Susan Leach-Murray, and Sherri Parker. “Shapes in the Cloud: Finding the Right Discovery Layer.” Online 35, no. 2: 20-26.
Chapman, Suzanne, Scott Dennis, Kathleen Folger, and Ken Varnum. “Developing a User-Centered Article Discovery Environment.” In Planning and Implementing Resource Discovery Tools in Academic Libraries, edited by Mary P. Popp and Diane Dallis, 194-224. Hershey, PA: Information Science Reference, 2012. doi:10.4018/978-1-4666-1821-3.ch012.
Chickering, F. William and Sharon Q. Yang. “Evaluation and Comparison of Discovery Tools: An Update.” Information Technology & Libraries 33, no. 2 (2014): 5-30. doi:10.6017/ital.v33i2.3471.
Ellero, Nadine P. “An Unexpected Discovery: One Library’s Experience with Web-Scale Discovery Service (WSDS) Evaluation and Assessment.” Journal of Library Administration 53, no. 5-6 (2014): 323–343. doi:10.1080/01930826.2013.876824.
Freivalds, David and Binky Lush. “Thinking Inside the Grid: Selecting a Discovery System Through the RFP Process.” In Planning and Implementing Resource Discovery Tools in Academic Libraries, edited by Mary P. Popp and Diane Dallis, 104-121. Hershey, PA: Information Science Reference, 2012. doi:10.4018/978-1-4666-1821-3.ch007.
Hoeppner, Athena. “The Ins and Outs of Evaluating Web-Scale Discovery Services.” Computers in Libraries 32, no. 3 (2012): 6-10, 38-40.
Hoseth, Amy. “Criteria To Consider When Evaluating Web-Based Discovery Tools.” In Planning and Implementing Resource Discovery Tools in Academic Libraries, edited by Mary P. Popp and Diane Dallis, 90-103. Hershey, PA: Information Science Reference, 2012. doi:10.4018/978-1-4666-1821-3.ch006.
Hoy, Matthew B. “An Introduction to Web Scale Discovery Systems.” Medical Reference Services Quarterly 31, no. 3 (2012), 323-329. doi:10.1080/02763869.2012.698186.
Lampert, Lynn D. and Katherine S. Dabbour. “Librarian Perspectives on Teaching Metasearch and Federated Search Technologies.” Internet Reference Services Quarterly 12, no.3/4 (2007): 253-278. doi:10.1300/J136v12n03_02
Luther, Judy and Maureen C. Kelly. “The Next Generation of Discovery.” Library Journal 136, no. 5 (2011): 66.
Mandernach, Meris A. and Jody Condit Fagan. “Creating Organizational Buy-In: Overcoming Challenges to a Library-Wide Discovery Tool Implementation.” In Planning and Implementing Resource Discovery Tools in Academic Libraries, edited Mary P. Popp and Diane Dallis, 419-437. Hershey, PA: Information Science Reference, 2012. doi:10.4018/978-1-4666-1821-3.ch024.
Metz-Wiseman, Monica, Melanie Griffin, Carol Ann Borchert, and Deborah Henry. “Best Practices for Selecting the Best Fit.” In Planning and Implementing Resource Discovery Tools in Academic Libraries, edited by Mary P. Popp and Diane Dallis, 77-89. Hershey, PA: Information Science Reference, 2012. doi:10.4018/978-1-4666-1821-3.ch005.
Moore, Kate B. and Courtney Greene. “Choosing Discovery: A Literature Review on the Selection and Evaluation of Discovery Layers.” Journal of Web Librarianship 6, no. 3 (2012): 145-163. doi:10.1080/19322909.2012.689602.
Nielsen, Jakob. “First Rule of Usability? Don't Listen to Users.” Nielsen Norman Group. Last modified August 5, 2001. Accessed, August 5 2014. http://www.nngroup.com/articles/first-rule-of-usability-dont-listen-to-users.
Popp, Mary P. and Diane Dallis. Planning and Implementing Resource Discovery Tools in Academic Libraries. Hershey, PA: Information Science Reference, 2012. doi:10.4018/978-1-4666-1821-3.
Rowe, Ronda. “Web-Scale Discovery: A Review of Summon, EBSCO Discovery Service, and WorldCat Local.” Charleston Advisor 12, no. 1 (2010): 5-10. doi:10.5260/chara.12.1.5.
Rowe, Ronda. “Encore Synergy, Primo Central,” Charleston Advisor 12, no. 4 (2011): 11-15. doi:10.5260/chara.12.4.11.
Vaughan, Jason. “Web Scale Discovery Services.” Library Technology Reports 47, no. 1. (2011): 5-61.
Vaughan, Jason. “Investigations into Library Web-Scale Discovery Services.” Information Technology & Libraries 31, no. 1 (2012): 32-82. doi:10.6017/ital.v31i1.1916.
Vaughan, Jason. “Evaluating and Selecting a Library Web-Scale Discovery Service.” In Planning and Implementing Resource Discovery Tools in Academic Libraries, edited by Mary P. Popp and Diane Dallis, 59-76. Hershey, PA: Information Science Reference, 2012. doi:10.4018/978-1-4666-1821-3.ch004.
Yang, Sharon Q. and Kurt Wagner. “Evaluating and Comparing Discovery Tools: How Close Are We Towards the Next Generation Catalog?” Library Hi Tech 28, no. 4 (2010): 690-709. doi:10.1108/07378831011096312.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2015 Information Technology and Libraries
This work is licensed under a Creative Commons Attribution 3.0 Unported License.
Authors that submit to Information Technology and Libraries agree to the Copyright Notice.
