SlideShare a Scribd company logo

2010 01 Vvbad Brussel Nieuwenhuysen

Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD), profile picture
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)

The document provides an overview of federated search engines, highlighting their purpose in integrating disparate information sources for more efficient searching. It discusses the advantages and limitations of federated search systems, including their ability to save users time and simplify the search process, while also pointing out difficulties such as varied user interfaces and data formats across platforms. Additionally, it addresses potential issues with user assumptions about comprehensiveness and database access limitations.

1 of 106
Downloaded 18 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
1 Federated search engines: an introduction Paul.Nieuwenhuysen @ vub.ac.be Prepared to support the opening lecture at the 1-day conference about “Federated search engines” organized by VVBAD, section School Libraries, in Brussels, Belgium, on January 22, 2010.
2 These slides should be available from the WWW site http://www.vub.ac.be/BIBLIO/nieuwenhuysen/presentations/ (note: BIBLIO and not biblio) and also from the WWW site of the organisers of the conference = VVBAD
3 1. Introduction and definition 2. Problem statement - contents 3. Federated search engines as - summary a partial solution 4. Meaning and confusion - structure 5. Advantages / benefits ☺ - overview 6. Difficulties / limitations 7. Implementation of this 8. Putting federated searching presentation in a wider context 9. Some information sources about federated searching
4 Federated searching Introduction and definition
5 Introduction: scattering of sources • Users want to exploit information sources fast and effectively. • This is hindered by the fact that digital, electronic information sources that may contain relevant information are created and scattered, distributed on numerous computers all over the intranet of the user’s organization AND over the Internet and the WWW.
6 Introduction: scattering of sources • In other words: integration / aggregation is still far from perfect.
7 Introduction: scattering of sources difficulties • Using many information retrieval systems costs time: 1. They must be used one after the other which requires many decisions and actions.
8 Introduction: scattering of sources difficulties • Using many information retrieval systems costs time: 2. They offer different user interfaces in the retrieval phase, which is confusing.
9 Introduction: scattering of sources difficulties • Using many information retrieval systems costs time: 3. They offer found information items in various data formats. They display found items in different ways on a computer screen
10 Introduction: scattering of sources difficulties Small = BEAUTIFUL
11 Introduction: scattering of sources difficulties Small = BEAUTIFUL ?
12 Introduction: scattering of sources difficulties Small = BEAUTIFUL ?
13 Federated searching Problem statement
14 Problem statements Which methods have been developed and applied to cope with this reality?
15 Federated searching Federated search engines as a partial solution
16 Method 1: Merging = aggregating into a searchable database User User User User Search engine Aggregated database Database Database Database or web site or web site or web site o or… or… or…
17 Method 2: Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
18 Both methods offer benefits to the users + Saves the users time that would be needed to execute queries towards various servers or to browse through various systems. ☺
19 Both methods offer benefits to the users + The users have to learn only 1 user interface for searching and only 1 search syntax, instead of a user interface and a search syntax for each database! ☺
20 Both methods offer benefits to the users + The system offers a uniform / consistent display of results in the output phase. ☺
21 Method 1: Merging = aggregating into a searchable database User User User User Search engine Aggregated database Database Database Database or web site or web site or web site o or… or… or…
22 Method 1: Merging = aggregating into a searchable database User User User User Search engine Aggregated database Database Database Database or web site or web site or web site o or… or… or…
23 Method 2: Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
24 Federated searching: definition An ideal federated search system 1. allows a user to formulate a query, 2. it adapts/transforms this query, so that it can be sent with a proper syntax to each search engine of a chosen set/group of disparate databases, 3. it broadcasts this query to those databases, 4. it collects results from each database, 5. (perhaps: consolidates these results into 1 result set) 6. (perhaps: detects and removes duplicate items) 7. shows the final results to the user, in a unified format 8. allows the user to sort the results by various criteria ☺
25 Federated searching: approach • This type of computer systems helps to integrate access to distributed databases in one search action, as far as possible. • The catalogue of local library holdings can be one of the target databases.
26 Federated searching: scheme End user End user ☺ ☺ portal for portal for information sources meta-searching meta-searching = federated searching = federated searching End user = cross-database searching = cross-database searching End user ☺ ☺
27 Federated searching through scattered databases: why? The perfect trip: The perfect trip: 1. A cheap and nice flight 1. A cheap and nice flight ☺
Example 28 Federated searching: application: finding a suitable flight Example: • http://CheapTickets.com/ for the USA
29 Federated searching through scattered databases: why? ☺ The perfect trip: The perfect trip: 1. A cheap and nice flight 1. A cheap and nice flight 2. A cheap and nice hotel 2. A cheap and nice hotel
Example 30 Federated searching: application: finding a hotel room in some city
31 Federated searching through scattered databases: why? ☺ The perfect trip: The perfect trip: 1. A cheap and nice flight 1. A cheap and nice flight 2. A cheap and nice hotel 2. A cheap and nice hotel 3. A visit to a nice museum 3. A visit to a nice museum
Example 32 Federated searching: searching in a museum
33 Federated searching through scattered databases: why? The perfect trip: The perfect trip: ☺ 1. A cheap and nice flight 1. A cheap and nice flight 2. A cheap and nice hotel 2. A cheap and nice hotel 3. A visit to a nice museum 3. A visit to a nice museum 4. Something nice to read (free via your library) 4. Something nice to read (free via your library)
Example 34 Federated searching: searching in a library
35 Federated searching: integrating access Intranet Intranet Articles Articles WWW WWW search engines search engines Journals Journals Catalog Catalog Publishers Publishers database(s) database(s) of other libraries of other libraries Databases Databases (full-text or bibliographic) (full-text or bibliographic) Local library catalog Local library catalog database(s) database(s) Meta-searching system Meta-searching system
36 Federated searching: produce - distribute - implement Producers ==developers ==creators Producers developers creators Intermediate sellers ==distributors Intermediate sellers distributors Implementers ==users (for instance aalibrary Implementers users (for instance library
37 Federated searching: examples of commercial software Producing company Distributing / selling company Product name Ex Libris MetaLib Infor (was GEAC) V-Spaces MuseGlobal CSA and others MuseSearch Serials Solutions 360 Search Serials Solutions WebFeat Deep Web Technologies Swets and others Vivissimo Groxis Infotrieve …
38 Federated searching Meaning and confusion
39 Federated searching: terminology / vocabulary / synonyms federated searching = meta-searching = metasearching = cross-database searching = multi-database searching = multi-threaded searching = one-stop searching = poly-searching = polysearching = broadcast searching = searching through a portal (but the term “portal” is used also with other meanings)
40 “Federated searching” meaning and confusion Here and in many other contexts, the term “federated searching” is used as a synonym for “meta-searching”.
41 “Federated searching” meaning and confusion However, some use the terms “federated searching” and “meta-searching” with DIFFERENT meanings. »“Federated searching” as searching through a database that results from merging several databases. So this is certainly NOT equal to “meta-searching”. »“Federated searching” as meta-searching that is followed by merging (federating) the items retrieved from various databases into only 1 set, ordered in one way or another. This language problem creates confusion.
42 “Federated searching” meaning and confusion • Furthermore: A federated search engine as software product is NOT the same as a federated searching system implemented as a service that can be available for all on the WWW, to search »public WWW search engines »bookshop databases »library catalogs / holdings »flight databases »hotel databases
43 Federated searching Advantages / benefits ☺
44 Federated searching: benefits for the users + The need to know which particular database is suitable for a particular search is reduced, because several ones can be searched in one action. ☺
45 Federated searching: benefits for the users + The system can help the user to select appropriate sources. ☺
46 Federated searching: benefits for the users + Can make users search and exploit databases that they would never use otherwise, that is without federated search system! ☺
47 Federated searching: benefits for the users + Useful, relevant, interesting items/references can be found/uncovered from unexpected, unknown, unfamiliar databases! This is mainly beneficial in the case of interdisciplinary subjects/topics. ☺
48 Federated searching: benefits for the users + The system can help in the process of authentication and authorization when this involves not only a simple recognition of IP-address of the user’s client computer, but when it involves user-id’s and passwords. ☺
49 Federated searching: benefits for the users + The users have to learn only 1 user interface for searching and only 1 search syntax, instead of a user interface and a search syntax for each database! ☺
50 Federated searching: benefits for the users + Can make users search and exploit databases that they would never use otherwise, that is without federated search system! ☺
51 Federated searching: benefits for the users + Useful, relevant, interesting items/references can be found/uncovered from unexpected, unknown, unfamiliar databases! This is mainly beneficial in the case of interdisciplinary subjects/topics. ☺
52 Federated searching: benefits for the users + Some systems offer tools to refine display of the results; for instance »to dedupe very similar items in the result set, »to sort the results, »to rank the results, »to search within the result set, »… ☺
53 Federated searching: benefits for the users + Some systems offer interesting links from a retrieval result to various related sources or services (such as the full text or a document delivery service), using a link generator based on the OpenURL standard. ☺
54 Federated searching: benefits for the users + Some systems check for each retrieved bibliographic description if the corresponding full text is immediately available online and indicate this immediately to the user, on the fly. ☺
55 Federated searching: benefits for the users + Some systems further process the retrieved results and display them in an interesting way that is not always offered by the searched original systems. For instance: ☺ » Clustering of results according to — subject — age — availability of full text » Displaying the results in a graphical way
56 Federated searching: benefits for the users So far so good ! ☺
57 Federated searching Difficulties / challenges / problems / limitations
58 Federated searching: difficulties / challenges / problems - Portal software tries to cope with several difficulties/challenges/problems/pitfalls that hinder the application of the “good idea”: The user does not notice most of these problems and shortcomings, because results from various databases are merged by the federated search system.
59 Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
60 Federated searching: difficulties / challenges / problems - Searching in a target database may be restricted by the federated search engine to a particular field (for example: a restriction to words occurring in the title, because this is the default way of searching of that system) while this restriction is not present in other target databases. Furthermore, this is perhaps not explained in the user interface. This may lead to a lower recall, which is of course NOT desirable. Even worse, the user is perhaps not aware of this.
61 Federated searching: difficulties / challenges / problems - How to deduplicate/dedupe/cluster very similar entries/results/items = near-duplicates, from various target sources? When is similar similar enough? Which entry/result/item to choose/select as the representative of a cluster of similar entries?
62 Federated searching: difficulties / challenges / problems - How to provide some useful relevance ranking of search results/entries, even when the target databases can be quite different in type and quality, and even when no index is created in advance, just-in-case, well before the search action, like Google and other Internet search engines do.
63 Federated searching: difficulties / challenges / problems - Powerful / sophisticated / refined forms of searching may not be applicable in a federated search. Example: limiting to a particular type of document, such as a therapy in medicine. This may cause a LOSS of time, instead of winning time.
64 Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
65 Federated searching: difficulties / challenges / problems - Differences among target sources in the Internet application protocols that are applied normally, by default, for connection/communication and retrieval, such as »(telnet) HTTP »proprietary, non-standard protocols »Z39.50, ISO239.50, SRU, and related protocols that are developed for federated-searching!
66 Federated searching: difficulties / challenges / problems - Even when the target is compatible with a suitable set of protocols for standardised retrieval Z39.50, ISO239.50, SRU…, then difficulties can arise due to incomplete implementations (the target may lack features supported by the protocol and by the software for federated searching)
67 Federated searching: difficulties / challenges / problems - When a suitable protocol can NOT be used and simple HTTP must be used for connection to the target source, and when simple HTML is used by the target source to present results, then the capture and analysis of the results by the federating search system is complicated and difficult and can be hindered by changes with time in the method of the presentation of results.
68 Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
69 Federated searching: difficulties / challenges / problems - Various search engines may act in different ways! For instance: Is truncation of a word in a search query possible? Is limitation to a particular field possible? How can a federated search engine take these differences into account?
70 Federated searching: difficulties / challenges / problems - A query with several words and without explicit Boolean operators can be interpreted in various ways by the various database retrieval systems. For instance, the retrieval software may apply the Boolean operator AND to combine all the query words, but it may also use OR. In the case that the federated search system does not take care of this well, then this may lead to lower recall and precision.
71 Federated searching: difficulties / challenges / problems - When some special, non-standard, dedicated retrieval software is made available by a specific target source databases to offer special features to the user to exploit the database better than with a standard retrieval interface, then the source can probably not be exploited as well by the federated search system. Searches are reduced to the lowest common denominator.
72 Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
73 Federated searching: difficulties / challenges / problems - Differences among target sources in the formatting/structuring of their database records in fields hinders - searching limited to a field (for instance the author field) - displaying selected fields only (such as the retrieved titles) - sorting of the displayed records on the contents of a particular selected field (such as author or publication date)
74 Federated searching or merging: difficulties / challenges / problems - In many cases there are differences among sources in the metadata schemes that are applied in the databases to improve retrieval, such as »classifications »taxonomies »thesaurus systems »ontologies - This hinders the exploitation of the added value of such metadata.
75 Federated searching: difficulties / challenges / problems - A user of a federated search system may perhaps incorrectly assume that ALL relevant databases are covered simply in 1 action, or that if a database is not included, then it must not be relevant/important. However, even a federated search system can only search a limited number of databases, so that perhaps some relevant databases are NOT covered.
76 Federated searching: difficulties / challenges / problems - Students who rely on a federated search system may perhaps not learn about the important subject-specific databases in their field, so that when they have no access anymore to the same federated search system, they still do not know which database may help them in their research and how to use it well.
77 Federated searching: difficulties / challenges / problems - Some databases are accessible only by a limited number of concurrent/simultaneous users from one organisation, as agreed in the licence and controlled by the authorization software of the database. When such a database would be included automatically in all or in many federated searches, then some users who really require access to that particular database may perhaps not be able to use that database.
78 Federated searching: difficulties / challenges / problems - When a database is accessible by an unlimited number of concurrent/simultaneous users from one organisation, and when such a database would be included automatically in all or in many federated searches, from many organisations (even when the searcher does not have any particular interest in that database), then the retrieval system of that database may be overburdened. This is mainly a concern for information vendors, who must maintain servers with sufficient capacity.
79 Federated searching: difficulties / challenges / problems - Some databases can NOT be included as a target database in a federated searching engine, because their owners/producers do not allow this. This is a difficulty, because in this way interesting / valuable databases are perhaps not exploited by users who rely on federated searching.
80 Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
81 Federated searching: difficulties / challenges / problems - Users may be less impressed by a federated searching system than by the simple, common, familiar, famous Internet / WWW search engines, as response time is in most cases less impressive, due to differences as follows: - The computer hardware used by the systems - Slower distributed searching through several computer systems, versus faster searching through a more centralised computer database of a priori compiled records
82 Federated searching: difficulties / challenges / problems - The evaluation of the quality of each search result from a federated search action may be more difficult than when each database is searched separately, because the user may be less aware of the limitations, strengths, selection criteria and aims of the individual, separate databases that offer each result. For instance, peer-reviewed articles from reputable scientific journals may be mixed with more popular and more biased, unscientific texts from trade literature.
83 Federated searching Implementation
84 Federated searching: local or remote hosting • The federated searching system can be developed and maintained »on a local computer in-house, or »hosted on a more distant, external, remote computer; this service is offered by some vendors of software for federated searching; partly outsourcing
85 Federated searching: local hosting: scheme End user End user ☺ ☺ In-house portal for In-house portal for information meta-searching meta-searching sources = federated searching = federated searching = cross-database searching = cross-database searching End user End user ☺ ☺
86 Federated searching: remote hosting: scheme End user End user ☺ ☺ Externally hosted portal for Externally hosted portal for information meta-searching meta-searching sources = federated searching = federated searching = cross-database searching = cross-database searching End user End user ☺ ☺
87 Federated searching: local versus remote hosting • Remote hosting requires perhaps »a smaller initial investment in computer hardware and skilled personnel »less time investment in installation and maintenance of equipment and software
88 Federated searching: tasks for the library • Of course providing a computer system for meta- searching
89 Federated searching: tasks for the library • Maintaining a list of target information sources that are appropriate in the framework of the particular library: »subjects covered by the target databases should be relevant »subscriptions must have been made by the library for access to the targets
90 Federated searching: tasks for the library • Grouping databases in groups that correspond to subject fields and offer these as pre-selections in the user interface of the federated search system
91 Federated searching: tasks for the library • Showing the system and its features to potential users
92 Federated searching in a library WWW site? - Searching for books - Opening hours - Searching for articles - Library services - Rules and regulations - Organisation of the library
93 Federated searching in a library WWW site? - Searching for books - Opening hours - Catalog of this library - Library services - Other catalogs - Rules and regulations - Other book databases - Organisation of the - Electronic books library - Federated searching for books - Searching for articles
94 Federated searching in a library WWW site? - Searching for books - Opening hours - Searching for articles - Library services - Databases to find articles - Rules and regulations - Electronic journals - Organisation of the - Collective catalog of library periodicals - Repositories of articles on the Internet and WWW - Federated searching for articles
95 Federated searching in a library WWW site! - Find the information that you need - The catalog - Databases - Opening hours - Library services To a federated search engine To a federated search engine - Rules and regulations - Organisation of the library
96 Federated searching: conclusion Federated searching - is a continuous challenge for developers of the sophisticated software and for the implementers in libraries and information centers - offers benefits for those end-users who are not enthusiastic to work with separate target source databases - does not eliminate the need for access to individual databases
97 Libraries and information centres Putting federating searching in a wider context
98 Federated searching + link generator user user ☺ ☺ full-text document !! full-text document menu menu reference reference federated searching federated searching context-sensitive context-sensitive hyperlink generator hyperlink generator appropriate appropriate target target information information source source database database information information about local situation about local situation sources sources “knowledgebase” “knowledgebase”
99 Federated search system and link resolver compared Problem to be solved Federated Link resolver search system How to bring a user ! - to many information sources in 1 action? How to bring a user from some - ! information to related information?
100 Putting the digital tools together in a library system user user ☺ ☺ library WWW site library WWW site context-sensitive context-sensitive hyperlink generator hyperlink generator catalogue(s) catalogue(s) federated searching federated searching of local holdings of local holdings database database about local situation about local situation “knowledgebase” “knowledgebase”
101 Access to information sources: tools / methods / systems In sequence of priority: 1. Online library catalogue (for hard copy and digital documents) 2. Library web site 3. Link generator + “knowledgebase” 4. Federated search system 5. …
102 Methods for efficient information retrieval: conclusions • The examples given show at least that progress in this field is impressive. ☺
103 Libraries and information centres Good information sources about federated searching
104 Some good information sources about federated searching Baer, William Federated searching: friend or foe? College & Research Libraries News, October 2004, pp. 518-519. Hofstede, Marten Portals op de pijnbank. Informatie Professional, 2002, No. 10, pp. 34-39. Jacso, Peter Thoughts about federated searching. Information Today, October 2004, pp. 17, 20. Joint, Nicholas Managing the implementation of a federated search tool in an academic library. Library Review, Vol. 58, No. 1, 2009, pp. 11-16. Linoski, Alexis and Walczyk, Tine Federated search 101. Library Journal Netconnect Summer 2008, pp. 2-5. Lockwood, Charles and Mac Donald, Patricia Implementation of a federated search system in the academic library: lessons learned. Co-published simultaneously in Internet Reference Service Quarterly, Vol. 12, No. ½, 2007, pp. 73-91 and in Federated search: solution or setback for online library services (edited by Christopher N. Cox) The Haworth Information Press, 2007, pp. 73-91. Available online from: http://irsq.haworthpress.com McHale, Nina Accidental federated searching: implementing federated searching in the smaller academic library. Co-published simultaneously in Internet Reference Service Quarterly, Vol. 12, No. 1-2, 2007, pp. 93-110 and in Federated search: solution or setback for online library services (edited by Christopher N. Cox) The Haworth Information Press, 2007, pp. 93-110. Available online from: http://irsq.haworthpress.com Noerr, Peter Scaling the digital divide: how interoperable systems are making information more accessible. In proceedings of the International Conference on Digital Libraries 2004: knowledge creation, preservation, access, and management, ICDL 2004, in Habitat Centre, New Delhi, India, 24-27 February 2004, Volume 1, 517 pp. New Delhi : TERI, The Energy and Resources Institute, 2004, ISBN 81-7993-029-7, pp. 66-68. Reiss, Kevin SRU, Open Data and the future of metasearch Co-published simultaneously in Internet Reference Service Quarterly, Vol. 12, No. ½, 2007, pp. 369-386 and in Federated search: solution or setback for online library services (edited by Christopher N. Cox) The Haworth Information Press, 2007, pp. 369-386. Available online from: http://irsq.haworthpress.com Sadeh, Tamar To Google or not to Google: metasearch design in the quest for the ideal user experience. [online] In: Proceedings of the ELAG 2004 Conference, May 2004. Available from: http://www.elag.org/ [cited 2004] Sadeh, Tamar Transforming the metasearch concept into a friendly user experience. Co-published simultaneously in Internet Reference Service Quarterly, Vol. 12, No. ½, 2007, pp. 1-25 and in Federated search: solution or setback for online library services (edited by Christopher N. Cox) The Haworth Information Press, 2007, pp. 1-25. Available online from: http://irsq.haworthpress.com Tennant, Roy The right solution: federated search tools. Library Journal, June 15, 2003, p. 28. Webster, Peter M. Challenges for federated searching. Co-published simultaneously in Internet Reference Service Quarterly, Vol. 12, No. ½, 2007, pp. 357-368 and in Federated search: solution or setback for online library services (edited by Christopher N. Cox) The Haworth Information Press, 2007, pp. 357-368. Available online from: http://irsq.haworthpress.com
105 Questions? Suggestions? Remarks?
106 • You are free to copy, distribute, display this work under the following conditions: »Attribution: You must mention the author. »Noncommercial: You may not use this work for commercial purposes. »No Derivative Works: You may not change, modify, alter, transform, or build upon this work. • For any reuse or distribution, you must make clear to others the license terms of this work.

More Related Content

PDF
Zoveel informatie, zo weinig tijd
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PDF
2009 05 Vvbad Brussel Nieuwenhuysen
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PDF
DMPTool: a community tool
Andrew Sallans
 
PDF
trial+pdf
theextraaedge
 
PPTX
Archivering en ontsluiting van digitale bestanden
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPT
Willy Vanderpijpen
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPT
Dave Pattern
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPT
Web2.0 Een Kritische Analyse
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Zoveel informatie, zo weinig tijd
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
2009 05 Vvbad Brussel Nieuwenhuysen
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
DMPTool: a community tool
Andrew Sallans
 
trial+pdf
theextraaedge
 
Archivering en ontsluiting van digitale bestanden
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Willy Vanderpijpen
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Dave Pattern
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Web2.0 Een Kritische Analyse
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 

Similar to 2010 01 Vvbad Brussel Nieuwenhuysen (20)

PDF
Federated Search Webinar for SLA (Special Libraries Assoc.)
Helen Mitchell
 
PDF
Aiim Webinar Helen Mitchell Unified Search Final 7 21 2010
Helen Mitchell
 
PPT
Information searching & retrieving techniques khalid
Khalid Mahmood
 
DOC
1 01 Notes Internet Search Tools T
wmassie
 
PPT
Inteligent Catalogue Final
guestcaef1d
 
PDF
Discovery platforms: Technology, tools and issues
saiful76
 
PPTX
Federated Search in a Disparate Environment
Helen Mitchell
 
PDF
Enhanced Performance of Search Engine with Multitype Feature Co-Selection of ...
IJASCSE
 
PPTX
Search engines
Anshuman Tyagi
 
PPTX
랭킹 최적화를 넘어 인간적인 검색으로 - 서울대 융합기술원 발표
Jin Young Kim
 
PPTX
Exploratory Search upon Semantically Described Web Data Sources: Service regi...
Marco Brambilla
 
PDF
Information retrieval-systems notes
BAIRAVI T
 
PPT
Business Research Methods Chap010
Mazhar Masood
 
PPTX
Semantic Search tutorial at SemTech 2012
Peter Mika
 
PPTX
#SEASPC: Information Architecture and Enterprise Search - Better Together
Agnes Molnar
 
PDF
Search&Filter Interface Round Up by Amy Cueva, Mad Pow
UIDesign Group
 
PPTX
SPConnections - Search Administration in SharePoint 2013
Agnes Molnar
 
PDF
ReSearch - Searching for Researchers
Davide Eynard
 
PPTX
Federate search
Tumkur University
 
PPT
From federated to aggregated search
Mounia Lalmas-Roelleke
 
Federated Search Webinar for SLA (Special Libraries Assoc.)
Helen Mitchell
 
Aiim Webinar Helen Mitchell Unified Search Final 7 21 2010
Helen Mitchell
 
Information searching & retrieving techniques khalid
Khalid Mahmood
 
1 01 Notes Internet Search Tools T
wmassie
 
Inteligent Catalogue Final
guestcaef1d
 
Discovery platforms: Technology, tools and issues
saiful76
 
Federated Search in a Disparate Environment
Helen Mitchell
 
Enhanced Performance of Search Engine with Multitype Feature Co-Selection of ...
IJASCSE
 
Search engines
Anshuman Tyagi
 
랭킹 최적화를 넘어 인간적인 검색으로 - 서울대 융합기술원 발표
Jin Young Kim
 
Exploratory Search upon Semantically Described Web Data Sources: Service regi...
Marco Brambilla
 
Information retrieval-systems notes
BAIRAVI T
 
Business Research Methods Chap010
Mazhar Masood
 
Semantic Search tutorial at SemTech 2012
Peter Mika
 
#SEASPC: Information Architecture and Enterprise Search - Better Together
Agnes Molnar
 
Search&Filter Interface Round Up by Amy Cueva, Mad Pow
UIDesign Group
 
SPConnections - Search Administration in SharePoint 2013
Agnes Molnar
 
ReSearch - Searching for Researchers
Davide Eynard
 
Federate search
Tumkur University
 
From federated to aggregated search
Mounia Lalmas-Roelleke
 
Ad

More from Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD) (20)

PDF
Presentatie AHD studiedag Leeszaalmedewerkers -
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PDF
ChatGPT, chatboxes en het einde van de databases
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
Connecting libraries to EU resources
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PDF
Ben je klaar voor innovatie?
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PDF
Hoe maak ik mijn project impactvol?
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PDF
Connecteren faciliteren in hoger onderwijs, welke rol heeft de bibliotheek?
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PDF
Netwerken bij Informatie aan Zee
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
Islamtisch (religieus) erfgoed. Waar liggen de uitdagingen en kansen?
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
Waarderen van archieven
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
Okapi2-Vlaanderen een hulp richting data driven management
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
Van experiment naar structurele oplossing: gezichtsherkenning in functie van ...
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
Het gebruik van AI bij het catalogiseren van boeken in KBR
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
Data-interoperabiliteit in de praktijk
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
Droomhuis of luchtkasteel: De verbouwing van de Nederlandse informatiehuishou...
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
Participative Registration of Intangible Cultural Heritage on immaterieelerfg...
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
Een MaakBib voor iedereen in elke bib
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
De bib als derde plek? Ja, selvølgelig
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
ZB Bibliotheek van Zeeland maakt het verschil
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PPTX
Hybriditeit als uitgangspunt: de vernieuwde leeszaal van het ModeMuseum Antwe...
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
PDF
De bib is mens- en buurtversterkend
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Presentatie AHD studiedag Leeszaalmedewerkers -
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
ChatGPT, chatboxes en het einde van de databases
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Connecting libraries to EU resources
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Ben je klaar voor innovatie?
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Hoe maak ik mijn project impactvol?
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Connecteren faciliteren in hoger onderwijs, welke rol heeft de bibliotheek?
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Netwerken bij Informatie aan Zee
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Islamtisch (religieus) erfgoed. Waar liggen de uitdagingen en kansen?
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Waarderen van archieven
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Okapi2-Vlaanderen een hulp richting data driven management
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Van experiment naar structurele oplossing: gezichtsherkenning in functie van ...
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Het gebruik van AI bij het catalogiseren van boeken in KBR
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Data-interoperabiliteit in de praktijk
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Droomhuis of luchtkasteel: De verbouwing van de Nederlandse informatiehuishou...
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Participative Registration of Intangible Cultural Heritage on immaterieelerfg...
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Een MaakBib voor iedereen in elke bib
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
De bib als derde plek? Ja, selvølgelig
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
ZB Bibliotheek van Zeeland maakt het verschil
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Hybriditeit als uitgangspunt: de vernieuwde leeszaal van het ModeMuseum Antwe...
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
De bib is mens- en buurtversterkend
Vlaamse Vereniging voor Bibliotheek, Archief & Documentatie vzw (VVBAD)
 
Ad

2010 01 Vvbad Brussel Nieuwenhuysen

  • 1. 1 Federated search engines: an introduction Paul.Nieuwenhuysen @ vub.ac.be Prepared to support the opening lecture at the 1-day conference about “Federated search engines” organized by VVBAD, section School Libraries, in Brussels, Belgium, on January 22, 2010.
  • 2. 2 These slides should be available from the WWW site http://www.vub.ac.be/BIBLIO/nieuwenhuysen/presentations/ (note: BIBLIO and not biblio) and also from the WWW site of the organisers of the conference = VVBAD
  • 3. 3 1. Introduction and definition 2. Problem statement - contents 3. Federated search engines as - summary a partial solution 4. Meaning and confusion - structure 5. Advantages / benefits ☺ - overview 6. Difficulties / limitations 7. Implementation of this 8. Putting federated searching presentation in a wider context 9. Some information sources about federated searching
  • 5. 5 Introduction: scattering of sources • Users want to exploit information sources fast and effectively. • This is hindered by the fact that digital, electronic information sources that may contain relevant information are created and scattered, distributed on numerous computers all over the intranet of the user’s organization AND over the Internet and the WWW.
  • 6. 6 Introduction: scattering of sources • In other words: integration / aggregation is still far from perfect.
  • 7. 7 Introduction: scattering of sources difficulties • Using many information retrieval systems costs time: 1. They must be used one after the other which requires many decisions and actions.
  • 8. 8 Introduction: scattering of sources difficulties • Using many information retrieval systems costs time: 2. They offer different user interfaces in the retrieval phase, which is confusing.
  • 9. 9 Introduction: scattering of sources difficulties • Using many information retrieval systems costs time: 3. They offer found information items in various data formats. They display found items in different ways on a computer screen
  • 10. 10 Introduction: scattering of sources difficulties Small = BEAUTIFUL
  • 11. 11 Introduction: scattering of sources difficulties Small = BEAUTIFUL ?
  • 12. 12 Introduction: scattering of sources difficulties Small = BEAUTIFUL ?
  • 13. 13 Federated searching Problem statement
  • 14. 14 Problem statements Which methods have been developed and applied to cope with this reality?
  • 15. 15 Federated searching Federated search engines as a partial solution
  • 16. 16 Method 1: Merging = aggregating into a searchable database User User User User Search engine Aggregated database Database Database Database or web site or web site or web site o or… or… or…
  • 17. 17 Method 2: Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
  • 18. 18 Both methods offer benefits to the users + Saves the users time that would be needed to execute queries towards various servers or to browse through various systems. ☺
  • 19. 19 Both methods offer benefits to the users + The users have to learn only 1 user interface for searching and only 1 search syntax, instead of a user interface and a search syntax for each database! ☺
  • 20. 20 Both methods offer benefits to the users + The system offers a uniform / consistent display of results in the output phase. ☺
  • 21. 21 Method 1: Merging = aggregating into a searchable database User User User User Search engine Aggregated database Database Database Database or web site or web site or web site o or… or… or…
  • 22. 22 Method 1: Merging = aggregating into a searchable database User User User User Search engine Aggregated database Database Database Database or web site or web site or web site o or… or… or…
  • 23. 23 Method 2: Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
  • 24. 24 Federated searching: definition An ideal federated search system 1. allows a user to formulate a query, 2. it adapts/transforms this query, so that it can be sent with a proper syntax to each search engine of a chosen set/group of disparate databases, 3. it broadcasts this query to those databases, 4. it collects results from each database, 5. (perhaps: consolidates these results into 1 result set) 6. (perhaps: detects and removes duplicate items) 7. shows the final results to the user, in a unified format 8. allows the user to sort the results by various criteria ☺
  • 25. 25 Federated searching: approach • This type of computer systems helps to integrate access to distributed databases in one search action, as far as possible. • The catalogue of local library holdings can be one of the target databases.
  • 26. 26 Federated searching: scheme End user End user ☺ ☺ portal for portal for information sources meta-searching meta-searching = federated searching = federated searching End user = cross-database searching = cross-database searching End user ☺ ☺
  • 27. 27 Federated searching through scattered databases: why? The perfect trip: The perfect trip: 1. A cheap and nice flight 1. A cheap and nice flight ☺
  • 28. Example 28 Federated searching: application: finding a suitable flight Example: • http://CheapTickets.com/ for the USA
  • 29. 29 Federated searching through scattered databases: why? ☺ The perfect trip: The perfect trip: 1. A cheap and nice flight 1. A cheap and nice flight 2. A cheap and nice hotel 2. A cheap and nice hotel
  • 30. Example 30 Federated searching: application: finding a hotel room in some city
  • 31. 31 Federated searching through scattered databases: why? ☺ The perfect trip: The perfect trip: 1. A cheap and nice flight 1. A cheap and nice flight 2. A cheap and nice hotel 2. A cheap and nice hotel 3. A visit to a nice museum 3. A visit to a nice museum
  • 32. Example 32 Federated searching: searching in a museum
  • 33. 33 Federated searching through scattered databases: why? The perfect trip: The perfect trip: ☺ 1. A cheap and nice flight 1. A cheap and nice flight 2. A cheap and nice hotel 2. A cheap and nice hotel 3. A visit to a nice museum 3. A visit to a nice museum 4. Something nice to read (free via your library) 4. Something nice to read (free via your library)
  • 34. Example 34 Federated searching: searching in a library
  • 35. 35 Federated searching: integrating access Intranet Intranet Articles Articles WWW WWW search engines search engines Journals Journals Catalog Catalog Publishers Publishers database(s) database(s) of other libraries of other libraries Databases Databases (full-text or bibliographic) (full-text or bibliographic) Local library catalog Local library catalog database(s) database(s) Meta-searching system Meta-searching system
  • 36. 36 Federated searching: produce - distribute - implement Producers ==developers ==creators Producers developers creators Intermediate sellers ==distributors Intermediate sellers distributors Implementers ==users (for instance aalibrary Implementers users (for instance library
  • 37. 37 Federated searching: examples of commercial software Producing company Distributing / selling company Product name Ex Libris MetaLib Infor (was GEAC) V-Spaces MuseGlobal CSA and others MuseSearch Serials Solutions 360 Search Serials Solutions WebFeat Deep Web Technologies Swets and others Vivissimo Groxis Infotrieve …
  • 38. 38 Federated searching Meaning and confusion
  • 39. 39 Federated searching: terminology / vocabulary / synonyms federated searching = meta-searching = metasearching = cross-database searching = multi-database searching = multi-threaded searching = one-stop searching = poly-searching = polysearching = broadcast searching = searching through a portal (but the term “portal” is used also with other meanings)
  • 40. 40 “Federated searching” meaning and confusion Here and in many other contexts, the term “federated searching” is used as a synonym for “meta-searching”.
  • 41. 41 “Federated searching” meaning and confusion However, some use the terms “federated searching” and “meta-searching” with DIFFERENT meanings. »“Federated searching” as searching through a database that results from merging several databases. So this is certainly NOT equal to “meta-searching”. »“Federated searching” as meta-searching that is followed by merging (federating) the items retrieved from various databases into only 1 set, ordered in one way or another. This language problem creates confusion.
  • 42. 42 “Federated searching” meaning and confusion • Furthermore: A federated search engine as software product is NOT the same as a federated searching system implemented as a service that can be available for all on the WWW, to search »public WWW search engines »bookshop databases »library catalogs / holdings »flight databases »hotel databases
  • 43. 43 Federated searching Advantages / benefits ☺
  • 44. 44 Federated searching: benefits for the users + The need to know which particular database is suitable for a particular search is reduced, because several ones can be searched in one action. ☺
  • 45. 45 Federated searching: benefits for the users + The system can help the user to select appropriate sources. ☺
  • 46. 46 Federated searching: benefits for the users + Can make users search and exploit databases that they would never use otherwise, that is without federated search system! ☺
  • 47. 47 Federated searching: benefits for the users + Useful, relevant, interesting items/references can be found/uncovered from unexpected, unknown, unfamiliar databases! This is mainly beneficial in the case of interdisciplinary subjects/topics. ☺
  • 48. 48 Federated searching: benefits for the users + The system can help in the process of authentication and authorization when this involves not only a simple recognition of IP-address of the user’s client computer, but when it involves user-id’s and passwords. ☺
  • 49. 49 Federated searching: benefits for the users + The users have to learn only 1 user interface for searching and only 1 search syntax, instead of a user interface and a search syntax for each database! ☺
  • 50. 50 Federated searching: benefits for the users + Can make users search and exploit databases that they would never use otherwise, that is without federated search system! ☺
  • 51. 51 Federated searching: benefits for the users + Useful, relevant, interesting items/references can be found/uncovered from unexpected, unknown, unfamiliar databases! This is mainly beneficial in the case of interdisciplinary subjects/topics. ☺
  • 52. 52 Federated searching: benefits for the users + Some systems offer tools to refine display of the results; for instance »to dedupe very similar items in the result set, »to sort the results, »to rank the results, »to search within the result set, »… ☺
  • 53. 53 Federated searching: benefits for the users + Some systems offer interesting links from a retrieval result to various related sources or services (such as the full text or a document delivery service), using a link generator based on the OpenURL standard. ☺
  • 54. 54 Federated searching: benefits for the users + Some systems check for each retrieved bibliographic description if the corresponding full text is immediately available online and indicate this immediately to the user, on the fly. ☺
  • 55. 55 Federated searching: benefits for the users + Some systems further process the retrieved results and display them in an interesting way that is not always offered by the searched original systems. For instance: ☺ » Clustering of results according to — subject — age — availability of full text » Displaying the results in a graphical way
  • 56. 56 Federated searching: benefits for the users So far so good ! ☺
  • 57. 57 Federated searching Difficulties / challenges / problems / limitations
  • 58. 58 Federated searching: difficulties / challenges / problems - Portal software tries to cope with several difficulties/challenges/problems/pitfalls that hinder the application of the “good idea”: The user does not notice most of these problems and shortcomings, because results from various databases are merged by the federated search system.
  • 59. 59 Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
  • 60. 60 Federated searching: difficulties / challenges / problems - Searching in a target database may be restricted by the federated search engine to a particular field (for example: a restriction to words occurring in the title, because this is the default way of searching of that system) while this restriction is not present in other target databases. Furthermore, this is perhaps not explained in the user interface. This may lead to a lower recall, which is of course NOT desirable. Even worse, the user is perhaps not aware of this.
  • 61. 61 Federated searching: difficulties / challenges / problems - How to deduplicate/dedupe/cluster very similar entries/results/items = near-duplicates, from various target sources? When is similar similar enough? Which entry/result/item to choose/select as the representative of a cluster of similar entries?
  • 62. 62 Federated searching: difficulties / challenges / problems - How to provide some useful relevance ranking of search results/entries, even when the target databases can be quite different in type and quality, and even when no index is created in advance, just-in-case, well before the search action, like Google and other Internet search engines do.
  • 63. 63 Federated searching: difficulties / challenges / problems - Powerful / sophisticated / refined forms of searching may not be applicable in a federated search. Example: limiting to a particular type of document, such as a therapy in medicine. This may cause a LOSS of time, instead of winning time.
  • 64. 64 Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
  • 65. 65 Federated searching: difficulties / challenges / problems - Differences among target sources in the Internet application protocols that are applied normally, by default, for connection/communication and retrieval, such as »(telnet) HTTP »proprietary, non-standard protocols »Z39.50, ISO239.50, SRU, and related protocols that are developed for federated-searching!
  • 66. 66 Federated searching: difficulties / challenges / problems - Even when the target is compatible with a suitable set of protocols for standardised retrieval Z39.50, ISO239.50, SRU…, then difficulties can arise due to incomplete implementations (the target may lack features supported by the protocol and by the software for federated searching)
  • 67. 67 Federated searching: difficulties / challenges / problems - When a suitable protocol can NOT be used and simple HTTP must be used for connection to the target source, and when simple HTML is used by the target source to present results, then the capture and analysis of the results by the federating search system is complicated and difficult and can be hindered by changes with time in the method of the presentation of results.
  • 68. 68 Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
  • 69. 69 Federated searching: difficulties / challenges / problems - Various search engines may act in different ways! For instance: Is truncation of a word in a search query possible? Is limitation to a particular field possible? How can a federated search engine take these differences into account?
  • 70. 70 Federated searching: difficulties / challenges / problems - A query with several words and without explicit Boolean operators can be interpreted in various ways by the various database retrieval systems. For instance, the retrieval software may apply the Boolean operator AND to combine all the query words, but it may also use OR. In the case that the federated search system does not take care of this well, then this may lead to lower recall and precision.
  • 71. 71 Federated searching: difficulties / challenges / problems - When some special, non-standard, dedicated retrieval software is made available by a specific target source databases to offer special features to the user to exploit the database better than with a standard retrieval interface, then the source can probably not be exploited as well by the federated search system. Searches are reduced to the lowest common denominator.
  • 72. 72 Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
  • 73. 73 Federated searching: difficulties / challenges / problems - Differences among target sources in the formatting/structuring of their database records in fields hinders - searching limited to a field (for instance the author field) - displaying selected fields only (such as the retrieved titles) - sorting of the displayed records on the contents of a particular selected field (such as author or publication date)
  • 74. 74 Federated searching or merging: difficulties / challenges / problems - In many cases there are differences among sources in the metadata schemes that are applied in the databases to improve retrieval, such as »classifications »taxonomies »thesaurus systems »ontologies - This hinders the exploitation of the added value of such metadata.
  • 75. 75 Federated searching: difficulties / challenges / problems - A user of a federated search system may perhaps incorrectly assume that ALL relevant databases are covered simply in 1 action, or that if a database is not included, then it must not be relevant/important. However, even a federated search system can only search a limited number of databases, so that perhaps some relevant databases are NOT covered.
  • 76. 76 Federated searching: difficulties / challenges / problems - Students who rely on a federated search system may perhaps not learn about the important subject-specific databases in their field, so that when they have no access anymore to the same federated search system, they still do not know which database may help them in their research and how to use it well.
  • 77. 77 Federated searching: difficulties / challenges / problems - Some databases are accessible only by a limited number of concurrent/simultaneous users from one organisation, as agreed in the licence and controlled by the authorization software of the database. When such a database would be included automatically in all or in many federated searches, then some users who really require access to that particular database may perhaps not be able to use that database.
  • 78. 78 Federated searching: difficulties / challenges / problems - When a database is accessible by an unlimited number of concurrent/simultaneous users from one organisation, and when such a database would be included automatically in all or in many federated searches, from many organisations (even when the searcher does not have any particular interest in that database), then the retrieval system of that database may be overburdened. This is mainly a concern for information vendors, who must maintain servers with sufficient capacity.
  • 79. 79 Federated searching: difficulties / challenges / problems - Some databases can NOT be included as a target database in a federated searching engine, because their owners/producers do not allow this. This is a difficulty, because in this way interesting / valuable databases are perhaps not exploited by users who rely on federated searching.
  • 80. 80 Federated searching through scattered databases User User User User Federated search engine Search engine Search engine Search engine Database Database Database
  • 81. 81 Federated searching: difficulties / challenges / problems - Users may be less impressed by a federated searching system than by the simple, common, familiar, famous Internet / WWW search engines, as response time is in most cases less impressive, due to differences as follows: - The computer hardware used by the systems - Slower distributed searching through several computer systems, versus faster searching through a more centralised computer database of a priori compiled records
  • 82. 82 Federated searching: difficulties / challenges / problems - The evaluation of the quality of each search result from a federated search action may be more difficult than when each database is searched separately, because the user may be less aware of the limitations, strengths, selection criteria and aims of the individual, separate databases that offer each result. For instance, peer-reviewed articles from reputable scientific journals may be mixed with more popular and more biased, unscientific texts from trade literature.
  • 83. 83 Federated searching Implementation
  • 84. 84 Federated searching: local or remote hosting • The federated searching system can be developed and maintained »on a local computer in-house, or »hosted on a more distant, external, remote computer; this service is offered by some vendors of software for federated searching; partly outsourcing
  • 85. 85 Federated searching: local hosting: scheme End user End user ☺ ☺ In-house portal for In-house portal for information meta-searching meta-searching sources = federated searching = federated searching = cross-database searching = cross-database searching End user End user ☺ ☺
  • 86. 86 Federated searching: remote hosting: scheme End user End user ☺ ☺ Externally hosted portal for Externally hosted portal for information meta-searching meta-searching sources = federated searching = federated searching = cross-database searching = cross-database searching End user End user ☺ ☺
  • 87. 87 Federated searching: local versus remote hosting • Remote hosting requires perhaps »a smaller initial investment in computer hardware and skilled personnel »less time investment in installation and maintenance of equipment and software
  • 88. 88 Federated searching: tasks for the library • Of course providing a computer system for meta- searching
  • 89. 89 Federated searching: tasks for the library • Maintaining a list of target information sources that are appropriate in the framework of the particular library: »subjects covered by the target databases should be relevant »subscriptions must have been made by the library for access to the targets
  • 90. 90 Federated searching: tasks for the library • Grouping databases in groups that correspond to subject fields and offer these as pre-selections in the user interface of the federated search system
  • 91. 91 Federated searching: tasks for the library • Showing the system and its features to potential users
  • 92. 92 Federated searching in a library WWW site? - Searching for books - Opening hours - Searching for articles - Library services - Rules and regulations - Organisation of the library
  • 93. 93 Federated searching in a library WWW site? - Searching for books - Opening hours - Catalog of this library - Library services - Other catalogs - Rules and regulations - Other book databases - Organisation of the - Electronic books library - Federated searching for books - Searching for articles
  • 94. 94 Federated searching in a library WWW site? - Searching for books - Opening hours - Searching for articles - Library services - Databases to find articles - Rules and regulations - Electronic journals - Organisation of the - Collective catalog of library periodicals - Repositories of articles on the Internet and WWW - Federated searching for articles
  • 95. 95 Federated searching in a library WWW site! - Find the information that you need - The catalog - Databases - Opening hours - Library services To a federated search engine To a federated search engine - Rules and regulations - Organisation of the library
  • 96. 96 Federated searching: conclusion Federated searching - is a continuous challenge for developers of the sophisticated software and for the implementers in libraries and information centers - offers benefits for those end-users who are not enthusiastic to work with separate target source databases - does not eliminate the need for access to individual databases
  • 97. 97 Libraries and information centres Putting federating searching in a wider context
  • 98. 98 Federated searching + link generator user user ☺ ☺ full-text document !! full-text document menu menu reference reference federated searching federated searching context-sensitive context-sensitive hyperlink generator hyperlink generator appropriate appropriate target target information information source source database database information information about local situation about local situation sources sources “knowledgebase” “knowledgebase”
  • 99. 99 Federated search system and link resolver compared Problem to be solved Federated Link resolver search system How to bring a user ! - to many information sources in 1 action? How to bring a user from some - ! information to related information?
  • 100. 100 Putting the digital tools together in a library system user user ☺ ☺ library WWW site library WWW site context-sensitive context-sensitive hyperlink generator hyperlink generator catalogue(s) catalogue(s) federated searching federated searching of local holdings of local holdings database database about local situation about local situation “knowledgebase” “knowledgebase”
  • 101. 101 Access to information sources: tools / methods / systems In sequence of priority: 1. Online library catalogue (for hard copy and digital documents) 2. Library web site 3. Link generator + “knowledgebase” 4. Federated search system 5. …
  • 102. 102 Methods for efficient information retrieval: conclusions • The examples given show at least that progress in this field is impressive. ☺
  • 103. 103 Libraries and information centres Good information sources about federated searching
  • 104. 104 Some good information sources about federated searching Baer, William Federated searching: friend or foe? College & Research Libraries News, October 2004, pp. 518-519. Hofstede, Marten Portals op de pijnbank. Informatie Professional, 2002, No. 10, pp. 34-39. Jacso, Peter Thoughts about federated searching. Information Today, October 2004, pp. 17, 20. Joint, Nicholas Managing the implementation of a federated search tool in an academic library. Library Review, Vol. 58, No. 1, 2009, pp. 11-16. Linoski, Alexis and Walczyk, Tine Federated search 101. Library Journal Netconnect Summer 2008, pp. 2-5. Lockwood, Charles and Mac Donald, Patricia Implementation of a federated search system in the academic library: lessons learned. Co-published simultaneously in Internet Reference Service Quarterly, Vol. 12, No. ½, 2007, pp. 73-91 and in Federated search: solution or setback for online library services (edited by Christopher N. Cox) The Haworth Information Press, 2007, pp. 73-91. Available online from: http://irsq.haworthpress.com McHale, Nina Accidental federated searching: implementing federated searching in the smaller academic library. Co-published simultaneously in Internet Reference Service Quarterly, Vol. 12, No. 1-2, 2007, pp. 93-110 and in Federated search: solution or setback for online library services (edited by Christopher N. Cox) The Haworth Information Press, 2007, pp. 93-110. Available online from: http://irsq.haworthpress.com Noerr, Peter Scaling the digital divide: how interoperable systems are making information more accessible. In proceedings of the International Conference on Digital Libraries 2004: knowledge creation, preservation, access, and management, ICDL 2004, in Habitat Centre, New Delhi, India, 24-27 February 2004, Volume 1, 517 pp. New Delhi : TERI, The Energy and Resources Institute, 2004, ISBN 81-7993-029-7, pp. 66-68. Reiss, Kevin SRU, Open Data and the future of metasearch Co-published simultaneously in Internet Reference Service Quarterly, Vol. 12, No. ½, 2007, pp. 369-386 and in Federated search: solution or setback for online library services (edited by Christopher N. Cox) The Haworth Information Press, 2007, pp. 369-386. Available online from: http://irsq.haworthpress.com Sadeh, Tamar To Google or not to Google: metasearch design in the quest for the ideal user experience. [online] In: Proceedings of the ELAG 2004 Conference, May 2004. Available from: http://www.elag.org/ [cited 2004] Sadeh, Tamar Transforming the metasearch concept into a friendly user experience. Co-published simultaneously in Internet Reference Service Quarterly, Vol. 12, No. ½, 2007, pp. 1-25 and in Federated search: solution or setback for online library services (edited by Christopher N. Cox) The Haworth Information Press, 2007, pp. 1-25. Available online from: http://irsq.haworthpress.com Tennant, Roy The right solution: federated search tools. Library Journal, June 15, 2003, p. 28. Webster, Peter M. Challenges for federated searching. Co-published simultaneously in Internet Reference Service Quarterly, Vol. 12, No. ½, 2007, pp. 357-368 and in Federated search: solution or setback for online library services (edited by Christopher N. Cox) The Haworth Information Press, 2007, pp. 357-368. Available online from: http://irsq.haworthpress.com
  • 106. 106 • You are free to copy, distribute, display this work under the following conditions: »Attribution: You must mention the author. »Noncommercial: You may not use this work for commercial purposes. »No Derivative Works: You may not change, modify, alter, transform, or build upon this work. • For any reuse or distribution, you must make clear to others the license terms of this work.