Search Engines and Beyond

Joanna RomansicLSC 742

What’s Your View?

How does a search engine work?

• Webcrawlers or bots are used by most search engines– For example, Google’s GoogleBot jumps from

each newly created web page through hyperlinks• The bot guides the indexing of the pages and the

indexing of the words that appear on each pag• There is also a second bot that updates the index

• Scores are also assigned to page These measure how many times a word appears on a

page (density), the popularity of the link and other qualities that determines how high up on the search a page will appear

Federated Search

• This is a large part of library automation.– Libraries are trying to be like Google

• “The simple but powerful ‘Google search box’ is a model for what we need in libraries—beyond federated search, this means one-step immediate access to the full text of library resources. We can claim success when people use the library search as readily, easily, and often as they do Google.”—Eisenberg, Mike (May 2008)

It’s a very quick, organized and accurate way of finding information in databases—keeps information clean, ranked and free of duplicates

Federated Search

• Used in libraries as a way to access information– Has to do with electronic resource management

(ERM systems)• Ex Libris produces SFX, a link server

– Provides links for patrons to library resources, full-text articles, OPAC holdings, other “document delivery suppliers”

• WebFeat, MetaLib, Index Data, MuseGlobal• Ranking is also a large part of federated searching

•Before ranking, results were just long lists of findings

Enterprise Search Tools

• Exist within businesses themselves• Search engines and the concept of “findability”

– Important for "competitive intelligence, business intelligence, e-commerce, finance, knowledge management, legal issues, marketing and research and development"--AIIM Market IQ Intelligence Quarterly

– Improve ranking system

Chart: Andreas Blumauer (2/19/2009). “Enterprise Search Goes Open Source.” URL: http://www.semantic-web.at/1.36.resource.274.enterprise-search-goes-open-source.htm. Accessed 3/9/09.

My view

• There should be an effort to make a more powerful search engine within libraries– For example, students at academic libraries

should have the ability to search in journals outside of their major

– Use metasearch capabilities to do this

My view• Library should open up their search engine to the

public, commercial web• Like the idea of having a kid’s search engine as used

by Ask.com—AJKids.Expand faceted search

– Would work to create communities interest, just as corporations use it—more open source movement

• Incorporate personalized searches within libraries. Such as the Genius software on iTunes. (Endeca—NCSU Library Catalog)—the “long tail” of info

References• Beal, Vangie (October 2007). "Web Search Engines and Directories," Webopedia.

URL: http://www.webopedia.com/quick_ref/Internet_Search_Engines.asp (accessed 12/23/2008).

• Breeding, Marshall (April 2008). "Automation System Marketplace 2008: Opportunity Out of Turmoil," LibraryJournal.com. URL: http://www.libraryjournal.com/article/CA6542440.html (accessed 4/3/2008)

• Frappaolo, Carl and Keldsen, Dan (February 2008). Presentation on Findability (PPT) from AIIM's Market IQ Intelligence Quarterly.

• Eisenberg, Mike (May 2008). "The Parallel Information Universe: What's Out There and What It Means for Libraries," LibraryJournal.com. URL: http://www.libraryjournal.com/article/CA6551184.html (accessed 1/4/2009).

• Lossau, Norbert (Spring 2004). “Search Engine Technology and Digital Libraries.” Presented at the American Digital Library Federation Spring Forum Meeting in New Orleans. URL: http://bieson.ub.uni-bielefeld.de/volltexte/2004/531/html/06lossau.html (accessed 3/8/09)

• Warnick, Walter (March 4, 2009). “Growing Up With Federated Search,” Federated

• Wray, Richard (May 23, 2006). “Google users promised artificial intelligence,” Guardian.co.uk. URL: http://www.guardian.co.uk/technology/2006/may/23/searchengines.news (accessed 3/8/09).