From Card Catalogs to Semantic Search: Building a Human-Centered Discovery Platform Powered by AI Technologies

Carolyn Caizzi; Amy Deschenes

doi:10.5860/ital.v45i1.17511

Authors

Carolyn Caizzi University of California, Berkeley Library https://orcid.org/0000-0002-2625-7854
Amy Deschenes Harvard University Library https://orcid.org/0009-0008-5902-875X

DOI:

https://doi.org/10.5860/ital.v45i1.17511

Keywords:

Artificial Intelligence (AI), Discovery Systems, User Experience, Academic Libraries, Product Development, Usability, Prototyping, Special Collections

Abstract

The first phase of the Reimagining Discovery project at Harvard Library sought to address the challenge of fragmented search experiences of special collections materials using artificial intelligence (AI) technologies, such as embedding models and large language models (LLMs). The resulting platform, Collections Explorer, simplifies and enhances the search experience for more effective special collections discovery. The project team took a user-centered and trustworthy approach to implementing AI, grounding the choices of the platform in user empowerment and librarian expertise. The development process included extensive user research, including interviews, usability testing, and prototype evaluations, to understand and address user needs.

Collections Explorer was developed using a multi-component architecture that integrates multiple types of AI. The team evaluated more than 12 models to select ones that were the best fit for the need, as well as being ethical and sustainable. Detailed system prompts were developed to guide LLM outputs and ensure the reliability of information. The methodical and iterative approach helped to create a flexible and scalable platform that could evolve to support other material types in the future. Initial research showed that potential users are enthused at the prospect of AI-powered features to enhance discovery, especially the item-level summaries and related search suggestions. The project demonstrated the potential of integrating AI technologies into library discovery systems while maintaining a commitment to trustworthiness and user-centered design.

Author Biographies

Carolyn Caizzi, University of California, Berkeley Library

Carolyn Caizzi is the Associate University Librarian for Digital Initiatives and Information Technology at University of California, Berkeley Library. She is responsible for the Digital Lifecycle Program, Library Information Technology, Data Services, Resource Sharing Services, and the Assessment Program, a portfolio which collectively includes digitization, discovery, and delivery; computing, data, and digital scholarship; and technology spaces, interface design, and infrastructure services. Carolyn previously led a strategic multi-year project at Harvard Library to reimagine discovery of millions of resources using AI-driven technologies, overseeing product development, stakeholder engagement, and Agile team management. Prior to Harvard, Carolyn served as the Head of Repository, Digital Products & Digital Curation at Northwestern University Libraries, where she directed a 16-person team while spearheading innovative digital initiatives, for 12 years.

Carolyn holds advanced degrees in Library and Information Science (University of Illinois at Urbana-Champaign) and Studio Arts (University of Illinois at Chicago), and a BA in Art Semiotics (Brown).

Amy Deschenes, Harvard University Library

Amy Deschenes is the Interim Director of UX & Discovery at Harvard Library, where she leads initiatives to create inclusive and user-centered digital experiences across the organization. She oversees user experience strategy, research, and digital projects to ensure that the libraries meet the needs of its diverse community of students, faculty, and researchers.

Amy has established best practices for the user experience program at Harvard Library. She champions inclusive design principles and collaborates closely with stakeholders across the organization to ensure services are user-centered. She is an active leader on campus-wide efforts related to digital accessibility. She publishes and presents frequently on the topics of user experience and digital initiatives in libraries.

She holds an M.S. from Simmons College in Boston and teaches in the User-Centered Design program at Brandeis University.

References

Aaron Tay, “Boolean vs Keyword/Lexical Search vs Semantic—Keeping Things Straight,” Medium (blog), November 26, 2023, https://aarontay.medium.com/boolean-vs-keyword-lexical-search-vs-semantic-keeping-tings-straight-95eb503b48f5.

Amy Deschenes and Meg McMahon, “A Survey on Student Use of Generative AI Chatbots for Academic Research,” Evidence Based Library and Information Practice 19, no. 2 (2024): 2–22, https://doi.org/10.18438/eblip30512.

Amy Hannah Deschenes, Meg McMahon, and Claire DeMarco, “Designing Content for Impact: A Content Strategy Approach for Libraries & Beyond,” Weave: Journal of Library User Experience 8, no. 2 (2025), https://doi.org/10.3998/weaveux.6954.

Ben Shneiderman, Human-Centered AI (Oxford, UK: Oxford University Press, 2022), https://academic.oup.com/book/41126.

Betsy Van Der Veer Martens, “Discovery, Retrieval,” in Keywords In and Out of Context, 111–26 (Cham, Switzerland: Springer, 2023), https://doi.org/10.1007/978-3-031-32530-4_8.

Carolyn Caizzi, Amy Deschenes, and Stu Snydman, “Reimagining Discovery: Transforming Access to Collections with Artificial Intelligence-Driven Exploration,” presented at the Coalition for Networked Information Spring 2024 Membership Meeting, https://www.cni.org/topics/special-collections/reimagining-discovery-transforming-access-to-collections-with-artificial-intelligence-driven-exploration.

Charles Hildreth, “The Use and Understanding of Keyword Searching in a University Online Catalog,” Information Technology and Libraries 16, no. 2 (1997): 52–62.

Chauncey Wilson, Interview Techniques for UX Practitioners: A User-Centered Design Method (San Francisco, CA: Morgan Kaufmann, 2013).

Daniel Jurafsky and James H. Martin, Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, third edition (Upper Saddle River, NJ: Prentice Hall, 2025), https://web.stanford.edu/~jurafsky/slp3/ed3book.pdf.

Donald A. Norman, The Design of Everyday Things, revised and expanded edition (Cambridge, MA: MIT Press, 2013).

Donald Norman and Stephen Draper, User Centered System Design: New Perspectives on Human-Computer Interaction (Hillsdale, NJ: Lawrence Erlbaum Associates, 1986).

Erika Hall, Just Enough Research (New York, NY: A Book Apart, 2013).

Hannah Bast et al., “Semantic Search on Text and Knowledge Bases,” Foundations and Trends® in Information Retrieval 10, nos. 2–3 (2016): 119–271, https://doi.org/10.1561/1500000032.

J. J. Chen, “Reimagining Harvard Collections: AI-Enhanced Discovery,” presentation at the Code4Lib conference, Princeton, New Jersey, March 12, 2025, https://2025.code4lib.org/talks/reimagining-harvard-collections-ai-enhanced-discovery.

Jesse James Garrett, The Elements of User Experience: User-Centered Design for the Web (Westlake Village, CA: New Riders, 2002).

John D. Lee and Neville Moray, “Trust, Self-Confidence, and Operators’ Adaptation to Automation,” International Journal of Human-Computer Studies 40, no. 1 (1994): 153–84, https://doi.org/10.1006/ijhc.1994.1007.

Karen Calhoun, The Changing Nature of the Catalog and Its Integration with Other Discovery Tools (Washington, DC: Library of Congress, 2006), https://hdl.handle.net/1813/2670.

Karen Coyle, “The Evolving Catalog,” American Libraries Magazine, January 4, 2016, https://americanlibrariesmagazine.org/2016/01/04/cataloging-evolves/.

Karen Markey, “The Online Library Catalog: Paradise Lost and Paradise Regained?,” D-Lib Magazine 13, nos. 1–2 (2007), https://doi.org/10.1045/january2007-markey.

Kristen Antelman et al., “Toward a Twenty-First Century Catalog,” Information Technology and Libraries 25, no. 3 (2006): 128–39, https://doi.org/10.6017/ital.v25i3.3342.

Laura Klein, Build Better Products: A Modern Approach to Building Successful User-Centered Products (New York, NY: Rosenfeld Media, 2016).

Lo, “The Transition from the Library OPAC to the Library Resources Portal”.

Lorcan Dempsey, “Library Discovery Directions,” foreword to Resource Discovery for the Twenty-First Century Library: Case Studies and Perspectives on the Role of IT in User Engagement and Empowerment, edited by Simon McLeish (London, UK: Facet Publishing, 2020), https://doi.org/10.25333/P8J4-1411.

Marshall Breeding, “Chapter 1: Discovery Product Functionality,” Library Technology Reports 50, no. 1 (n.d.): 5–32.

Matt Enis, “AI on the Horizon: Several Major Companies—Including Clarivate, EBSCO, OCLC, and OverDrive—Are Introducing New AI Tools and Features That Will Impact Researchers, Patrons, and Library Work Directly,” Library Journal News, August 5, 2024, https://www.libraryjournal.com/story/ai-on-the-horizon/.

Michael Gorman, Our Enduring Values Revisited: Librarianship in an Ever-Changing World (Chicago, IL: ALA Editions, 2015).

Michael Stuart Freeman, “Pen, Ink, Keys, and Cards: Some Reflections on Library Technology,” College & Research Libraries 52, no. 4 (1991): 328–35, https://doi.org/10.5860/crl_52_04_328.

Mike Kuniavsky et al., Observing the User Experience: A Practitioner’s Guide to User Research (San Francisco, CA: Morgan Kaufmann, 2012).

Mohammad Amir Khusru Akhtar et al., “Challenges in Developing Ethical and Socially Responsible Explainable AI,” in Towards Ethical and Socially Responsible Explainable AI, vol. 551 (Cham, Switzerland: Springer, 2024), https://doi.org/10.1007/978-3-031-66489-2_3.

Patrick Lo, “The Transition from the Library OPAC to the Library Resources Portal: Difficulties and New Approaches in User Education for the Academic Librarians and Their Changing Roles,” International Journal of Technology, Knowledge, and Society 4, no. 2 (2008): 39–50, https://doi.org/10.18848/1832-3669/CGP/v04i02/55848.

Richard Lemarchand, A Playful Production Process: For Game Designers (and Everyone) (Cambridge, MA: MIT Press, 2021).

Richard Wisneski, “I Can’t Get No Satis-Searching: Reassessing Discovery Layers in Academic Libraries Journal of Web Librarianship,” Journal of Web Librarianship 18, no. 1 (2024): 1–14, https://doi.org/10.1080/19322909.2024.2326687.

Steven Portigal, Interviewing Users: How to Uncover Compelling Insights (New York, NY: Rosenfeld Media, 2013).

Stu Snydman, “Launch of Collections Explorer (MVP),” The Circ Blog, Harvard Library, September 19, 2025, https://circblog.library.harvard.edu/2025/09/19/launch-of-collections-explorer-mvp/.

Stuart Snydman and Martha Whitehead, “From Building a First-Generation Digital Library Infrastructure to Reimagining Discovery,” International Journal of Digital Curation 19, no. 1 (2025): 13, https://doi.org/10.2218/ijdc.v19i1.1068.

Susan Kathleen Lippert, “An Exploratory Study into the Relevance of Trust in the Context of Information Systems Technology,” ProQuest Dissertations and Theses (2001).

Tita Alissa Bach et al., “A Systematic Literature Review of User Trust in AI-Enabled Systems: An HCI Perspective,” International Journal of Human–Computer Interaction 40, no. 5 (2024): 1251–66, https://doi.org/10.1080/10447318.2022.2138826.

Trey Grainger et al., AI-Powered Search (New York, NY: Simon and Schuster, 2025).

William Albert and Thomas Tullis, Measuring the User Experience (San Francisco, CA: Morgan Kaufmann, 2022), https://doi.org/10.1016/C2018-0-00693-3.

From Card Catalogs to Semantic Search

Building a Human-Centered Discovery Platform Powered by AI Technologies

Authors

DOI:

Keywords:

Abstract

Author Biographies

Carolyn Caizzi, University of California, Berkeley Library

Amy Deschenes, Harvard University Library

References

Downloads

Published

How to Cite

Issue

Section

License

Developed By

Information