Measuring Query Complexity in Web-Scale Discovery: A Comparison between Two Academic Libraries
Abstract
This study reports on the examination of search transaction logs from web-scale discovery tools at two Indiana University campuses. The authors discuss how they gathered search queries from transaction logs, categorized queries according to the Library of Congress Classification schedule, and then examined queries using text analysis tools in order to identify which subjects were being searched and whether users were using advanced search options. The results of this investigation demonstrate how transaction logs may be used to communicate user interactions within discovery services. The findings offer detailed insight into the subjects and skills that teaching faculty and librarians should communicate to improve information literacy instruction. The search queries also uncover information needs that provide direction for collection managers.
References
Marshall Breeding, “Looking Forward to the Next Generation of Discovery Services,” Computers in Libraries 32, no. 2 (2012): 28–31, https://librarytechnology.org/document/16731.
Marshall Breeding, “Relationship with Discovery,” Library Technology Reports 51, no. 4 (2015): 22–25, https://journals.ala.org/index.php/ltr/article/view/5688/7067.
Noah Brubaker, Susan Leach-Murray, and Sherri Parker, “Shapes in the Cloud: Finding the Right Discovery Layer,” Online 35, no. 2 (2011): 20–26.
María M. Pinkas et al., “Selecting and Implementing a Discovery Tool: The University of Maryland Health Sciences and Human Services Library Experience,” Journal of Electronic Resources in Medical Libraries 11, no. 1 (2014): 1–12, https://doi.org/10.1080/15424065.2013.876574.
Anita K. Foster and Jean B. MacDonald, “A Tale of Two Discoveries: Comparing the Usability of Summon and EBSCO Discovery Service,” Journal of Web Librarianship 7, no. 1 (2013): 1–19, https://doi.org/10.1080/19322909.2013.757936.
Dianne Cmor and Xin Li, “Beyond Boolean, Towards Thinking: Discovery Systems and Information Literacy,” Library Management 33, no. 8/9 (2012): 450–57, https://doi.org/10.1108/01435121211279812.
Rocco Debonis, Edward O’Donnell, and Cynthia Thomes, “(Self-)Discovery Service: Helping Students Help Themselves,” Journal of Library & Information Services in Distance Learning 6, no. 3–4 (2012): 235–50, https://doi.org/10.1080/1533290X.2012.705648.
Thomas A. Peters, “The History and Development of Transaction Log Analysis,” Library Hi Tech 11, no. 2 (1993): 41–66, https://doi.org/10.1108/eb047884.
Bernard J. Jansen, “Search Log Analysis: What It Is, What’s Been Done, How to Do It,” Library and Information Science Research 28, no. 3 (2006): 407–32, https://doi.org/10.1016/j.lisr.2006.06.005.
Amanda Spink and Bernard J. Jansen, Web Search: Public Searching of the Web (Dordrecht, Netherlands: Kluwer Academic, 2004).
Bernard J. Jansen, Amanda Spink, and Tefko Saracevic, “Real Life, Real Users, and Real Needs: A Study and Analysis of User Queries on the Web,” Information Processing & Management 36, no. 2 (2000): 207–27, https://doi.org/10.1016/s0306-4573(99)00056-4.
Eng Pwey Lau and Dion Hoe-Lian Goh, “In Search of Query Patterns: A Case Study of a University OPAC,” Information Processing & Management 42, no. 5 (2006): 1316–29, https://doi.org/10.1016/j.ipm.2006.02.003.
Thomas A. Peters, “When Smart People Fail: An Analysis of the Transaction Log of an Online Public Access Catalog,” Journal of Academic Librarianship 15, no. 5 (1989): 267–73.
Lau and Goh, “In Search of Query Patterns”; Helen Georgas, “Google vs. the Library (Part II): Student Search Patterns and Behaviors When Using Google and a Federated Search Tool,” portal: Libraries and the Academy 14, no. 4 (2014): 503–32.
Megan Dempsey and Alyssa M. Valenti, “Student Use of Keywords and Limiters in Web-Scale Discovery Searching,” Journal of Academic Librarianship 42, no. 3 (2016): 200–206, https://doi.org/10.1016/j.acalib.2016.03.002.
Hao-Ren Ke et al., “Exploring Behavior of E-journal Users in Science and Technology: Transaction Log Analysis of Elsevier’s ScienceDirect OnSite in Taiwan,” Library & Information Science Research 24, no. 3 (2002): 265–91, https://doi.org/10.1016/S0740-8188(02)00126-3.
Luis Villén-Rueda, Jose A. Senso, and Félix de Moya-Anegón, “The Use of OPAC in a Large Academic Library: A Transactional Log Analysis Study of Subject Searching,” Journal of Academic Librarianship 33, no. 3 (2007): 327–37, https://doi.org/10.1016/j.acalib.2007.01.018.
Steve Jones et al., “A Transaction Log Analysis of a Digital Library,” International Journal on Digital Libraries 3, no. 2 (2000): 152–69, https://doi.org/10.1007/s007999900022.
Susan Avery and Daniel G. Tracy, “Using Transaction Log Analysis to Assess Student Search Behavior in the Library Instruction Classroom,” Reference Services Review 42, no. 2 (2014): 320–35, https://doi.org/10.1108/RSR-08-2013-0044.
Stephen Asunka et al., “Understanding Academic Information Seeking Habits through Analysis of Web Server Log Files: The Case of the Teachers College Library Website,” Journal of Academic Librarianship 35, no. 1 (2009): 33–45, https://doi.org/10.1016/j.acalib.2008.10.019.
Kelly Meadow and James Meadow, “Search Query Quality and Web-Scale Discovery: A Qualitative and Quantitative Analysis,” College & Undergraduate Libraries 19, no. 2–4 (2012): 163–75, https://doi.org/10.1080/10691316.2012.693434.
Kelsey Brett, Elizabeth German, and Frederick Young, “Tabs and Tabulations: Results of a Transaction Log Analysis of a Tabbed-Search Interface,” Journal of Web Librarianship 9, no. 1 (2015): 22–41, https://doi.org/10.1080/19322909.2015.1004502.
Jan Kemp, “Does Web-Scale Discovery Make a Difference? Changes in Collection Use after Implementing Summon,” in Planning and Implementing Resource Discovery Tools in Academic Libraries, edited by Mary Pagliero Popp and Diane Dallis, (Hershey, PA: Information Science Reference, 2012), 456–68, https://doi.org/ 10.4018/978-1-4666-1821-3.ch026.
Kristin Calvert, “Maximizing Academic Library Collections: Measuring Changes in Use Patterns Owing to EBSCO Discovery Service,” College & Research Libraries 76, no. 1 (2015): 81–99, https://doi.org/10.5860/crl.76.1.81.
Timothy Siegel, “Utilizing Discovery Service Queries for Collection Development Purposes,” Current Studies in Librarianship 32, no. 2 (2016): 91–118.
Indiana University, “Historical Enrollment, Hour and FTE: Bloomington: Fall 2006 through Fall 2015,” Indiana University Fact Book, University Institutional Research and Reporting, Indiana University, 2015, https://wwwiu.edu/~uirr/reports/standard/factbook/2015-16/Bloomington/Student_Data/Enrollment/Historical_Enrollment.
Indiana University, “Indiana University-Bloomington,” The Carnegie Classification of Institutions of Higher Education, 2014, http://carnegieclassifications.iu.edu/lookup/view_institution.php?unit_id=151351&start_page=lookup.php&clq=%7B%22first_letter%22%3A%22I%22%7D.
Rachael A. Cohen and Angie Thorpe, “Discovering User Behavior: Applying Usage Statistics to Shape Frontline Services,” The Serials Librarian 69, no. 1 (2015): 29–46, https://doi.org/10.1080/0361526x.2015.1040194.
Indiana University, “Indiana University-Kokomo,” The Carnegie Classification of Institutions of Higher Education, 2014, http://carnegieclassifications.iu.edu/lookup/view_institution.php?unit_id=151333&start_page=lookup.php&clq=%7B%22first_letter%22%3A%22I%22%7D.
Indiana University, “Historical Enrollment, Hour and FTE: Kokomo: Fall 2006 through Fall 2015,” Indiana University Fact Book, University Institutional Research and Reporting, Indiana University, 2015, https://www.iu.edu/~uirr/reports/standard/factbook/2015-16/Kokomo/Student_Data/Enrollment/Historical_Enrollment.
EBSCO Information Services, “What Field Codes Are Available When Searching EBSCO Discovery Service (EDS)?” Support—EBSCO Help, accessed January 17, 2017, http://support.epnet.com/knowledge_base/detail.php?id=3198.
Rhonda N. Hunter, “Successes and Failures of Patrons Searching the Online Catalog at a Large Academic Library: A Transaction Log Analysis,” Research Quarterly 30, no. 3 (1991): 395–402, http://www.jstor.org/stable/25828813.
Adam Brown, “A Singaporean Corpus of Misspellings: Analysis and Implications,” Journal of the Simplified Spelling Society 3 (1988).
Graeme Hirst and Alexander Budanitsky, “Correcting Real-Word Spelling Errors by Restoring Lexical Cohesion,” Journal of Natural Language Engineering 11, no. 1 (2005): 87–111, https://doi.org/10.1017/S1351324904003560.
Andre-Roch Lecours, “Serial Order in Writing—A Study of Misspelled Words in ‘Developmental Dysgraphia,’” Neuropsychologia 4, no. 3 (1966): 221–41, https://doi.org/10.1016/0028-3932(66)90029-7.
Seda Ozmutlu, Huseyin C. Ozmutlu, and Amanda Spink, “Are People Asking Questions of General Web Search Engines?” Online Information Review 27, no. 6 (2003): 396–406, https://doi.org/10.1108/14684520310510037.
Johannes Leveling, “A Comparative Analysis: QA Evaluation Questions versus Real-World Queries,” paper presented at 2010 Workshop on Web Logs and Question Answering (WLQA 2010), May 22, 2010, Valletta, Malta, http://doras.dcu.ie/16035/.
Stefanie Buck and Margaret Mellinger, “The Impact of Serials Solutions’ Summon on Information Literacy Instruction: Librarian Perceptions,” Internet Reference Services Quarterly 16, no. 4 (2011): 159–81, https://doi.org/10.1080/10875301.2011.621864.
Nancy Fawley and Nikki Krysak, “Learning to Love Your Discovery Tool: Strategies for Integrating a Discovery Tool in Face-to-Face, Synchronous, and Asynchronous Instruction,” Public Services Quarterly 10, no. 4 (2014): 283–301, https://doi.org/10.1080/15228959.2014.961110.
Yin-Leng Theng et al., “Scaffolding in Information Search: Effects on Less Experienced Searchers,” Journal of Librarianship and Information Science 48, no. 2 (2016): 177–90, https://doi.org/10.1177/0961000615595455.
Dempsey and Valenti, “Student Use of Keywords and Limiters,” 205; Meadow and Meadow, “Search Query Quality and Web-Scale Discovery,” 172.
DOI: https://doi.org/10.5860/rusq.57.4.6705
Refbacks
- There are currently no refbacks.
© 2023 RUSA