Is one stop shopping all we dreamed it
would be?
Usability and the Single Search
Interface
Gillian Byrne & Louise McGillis
Memorial University Libraries
CLA 2006
Ottawa, Ontario
Introduction
 What is SingleSearch?
 The methodology
 The results
 What’s next?
Federated Searching at Memorial
 SingleSearch (one interface…many resources)
 Resolver (links to our full-text & holdings)
 RELAIS (document delivery)
One interface…
…for many sources…
…leading to full text…
…or to a check of our holdings…
…Resolver links to online holdings…
…or to Relais (document delivery system)
Test Audience
 12 participants from three MUN Libraries
 5 males & 7 females
 7 undergradutes, 3 graduate & 2 faculty
 Ages ranged from under 20 to 49
Survey Tasks
 Select categories & resources
 Find & check holdings for a book
 Find & check holdings for an article
 Navigate the Resolver
Sample Questionnaire
Test Materials & Analysis
 Test Materials
 Pre-test: demographic and library use data
 Survey: completed as participants completed the tasks
 Post-test: participant impressions of SingleSearch
 Analysis
 Quantitative data analyzed by SPSS
 Screen captures analyzed with a variety of tools (click
path analysis)
Results!
 The expected...
 The unexpected...
 The bonus material
Difficulty understanding layout of search
screen
 Participants had difficulty understanding
the differentiation of resources and
categories on the search screen
 Participant Comments:
 “I would also chose the library catalogue and
GoogleScholar if it were here”
 “In the beginning when you have to choose
groups and individual resources, there are so
many categories that it is difficult to decide
which topics to select.”
 Several did not even scan down to the
resources section
Resource/Category Selection
 For the question, “Find information on the
evolution of the human skeleton” participants
selected an average of 2.5 categories and 3.25
resources.
 Equals approximately 25 databases being
searched
Categories
Selected
Resources
Selected
M 2.0 3.25
Mdn 2.0 1
σ 1.348 4.845
Lots of clicking...
 Participants were asked to select “Get
It@Memorial” and navigate to Library
holdings.
 Took participants an average of 9 clicks to
reach an article/holdings or to give up.
 Participants who were successful took an
average of 6 clicks.
...And lots of hovering
 Participants were asked to choose an
article citation and determine if it were
available online or whether MUN owned it.
 Took participants an average of 5 min. & 10
sec. to complete
Basic search strategies
 None of the participants used
sophisticated search techniques like
Boolean and/or truncation. I.e.,
 “Find information on pollution and asthma”
 pollution asthma (2)
 asthma pollution
 “Find information on elder abuse”
 information on elder abuse
 elder abuse (2)
Users identified format with ease
 100% of participants were correctly able
to identify whether there was a book and
an article on their search results.
 Majority (75%, n=12) selected an article
where document type was in the Single
Search display
Route to holdings
 2 options in each citation
 More Information: Links to native interface
 Get it@Memorial: Links to Resolver
 Majority select “more information” first
 Question asked: “Is the article available
online (full text)? If not…does any MUN
Library have this article?”
Expected Click Path
Question: Is the article available online?
Actual Click Paths
Question: Is the article available online?
N = 8 (successful attempts)
N =10 (unsuccessful attempts)
Bonus Material
 Fascinating insight into how people deal
with error messages (which abounded)
and other browsing behaviours.
 Example
Conclusions...thus far.
1. Need to simplify resource selection
2. Need to include format identifiers
3. Need to clean up display
4. Need to promote “most efficient” path
through the SingleSearch to the article
What next?
 Use the data to develop mocks of different
layouts for focus group this summer
 Re-do study when Rooms Portal is
implemented?
Users get the last word…
“It displayed a wide range of results with
very little effort. Usually I would use
google for research for an essay, but after
seeing how easily and accurately this
system finds and displays information I
would rather use it.”

More Related Content

PPT
Digital Library Poster
PPTX
Data availability Study
PPTX
Data availability and feasibility of validation – A genomics case study
PPTX
EDS across the pond
PPT
Owning the Discovery Experience for Your Patrons
PDF
The student search experience
PPTX
Discovering discovery
PPTX
In Search of Patterns at the Desk
Digital Library Poster
Data availability Study
Data availability and feasibility of validation – A genomics case study
EDS across the pond
Owning the Discovery Experience for Your Patrons
The student search experience
Discovering discovery
In Search of Patterns at the Desk

What's hot (20)

PDF
How search results became 'the new black'
PPT
A Living Archive
PPTX
How discovery impacts of users' experiences
PPTX
CMT3342 (Jan start) Feb 2014
PPT
Interactive Information Seeking via Selective Application of Contextual Knowl...
PPTX
AAUP 2016: UPScope (S. Doerr)
PPTX
AAUP 2016: The Charlotte Initiative for Permanent Acquisitions of eBooks for ...
PDF
Doing research better: The role of meta‐data
PPTX
Library Department Group Discussions - Website Prototype
PPTX
Ewu pp
PDF
Why altmetrics?
PPTX
Assessing Digital Output in New Ways
PPTX
Edu532 db srch_mod2_sp2018update2
PPTX
E-Metrics: Assessing Electronic Resources
PPTX
Is what's 'trending' what¹s worth purchasing?
PPT
Statistics for Librarians: How to Use and Evaluate Statistical Evidence
PPT
Enhancing the Usability of Libraries
PPT
Evaluating Libraries
PPTX
CSD2600 Nov 2018
PPT
Coquitlam Ltt March3
How search results became 'the new black'
A Living Archive
How discovery impacts of users' experiences
CMT3342 (Jan start) Feb 2014
Interactive Information Seeking via Selective Application of Contextual Knowl...
AAUP 2016: UPScope (S. Doerr)
AAUP 2016: The Charlotte Initiative for Permanent Acquisitions of eBooks for ...
Doing research better: The role of meta‐data
Library Department Group Discussions - Website Prototype
Ewu pp
Why altmetrics?
Assessing Digital Output in New Ways
Edu532 db srch_mod2_sp2018update2
E-Metrics: Assessing Electronic Resources
Is what's 'trending' what¹s worth purchasing?
Statistics for Librarians: How to Use and Evaluate Statistical Evidence
Enhancing the Usability of Libraries
Evaluating Libraries
CSD2600 Nov 2018
Coquitlam Ltt March3
Ad

Similar to "Is one Stop Shopping all we Dreamed it Would be? Usability and the Single Search Interface" (20)

PPTX
A Decade of Discovery: What We Know and Where We Will Go
PPTX
Uksg 2013 breakout r kennedy mcrump
PPTX
Barber Library Website Usability Results, Fall 2012
PPTX
Primo Central Trial, Usability Testing, and Implementation Options (2012)
PPTX
Testing and Tweaking Your Way to a Better Library Website: Improved User Expe...
PPTX
Discovery on a budget
PPTX
Discovery on a budget: Improved searching without a Web-scale discovery product
PPT
Building a User-Centric Web-Based Library Service
PDF
What do students want from library discovery tools?
PPT
Inteligent Catalogue Final
PPTX
How search engines work Anand Saini
PPTX
NCSU Libraries Usability Testing
PPTX
“From Discovery to Fulfillment: Improving the User Experience at Every Stage.”
PPTX
Chaos&Order: Using visualization as a means to
 explore large heritage collec...
PDF
Re examining the- location_ of_ web objects-vasantharaju_and_harinarayana_201...
PDF
Search, Report, Wherever You Are: A Novel Approach to Assessing User Satisfac...
PPTX
Web-scale Discovery Implementation with the End User in Mind (SLA 2012)
PDF
Search Solutions 2011: Successful Enterprise Search By Design
PDF
Redesigning the Open Access Institutional Repository
PDF
Kammerer How The Interface Design Influences Users Spontaneous Trustworthines...
A Decade of Discovery: What We Know and Where We Will Go
Uksg 2013 breakout r kennedy mcrump
Barber Library Website Usability Results, Fall 2012
Primo Central Trial, Usability Testing, and Implementation Options (2012)
Testing and Tweaking Your Way to a Better Library Website: Improved User Expe...
Discovery on a budget
Discovery on a budget: Improved searching without a Web-scale discovery product
Building a User-Centric Web-Based Library Service
What do students want from library discovery tools?
Inteligent Catalogue Final
How search engines work Anand Saini
NCSU Libraries Usability Testing
“From Discovery to Fulfillment: Improving the User Experience at Every Stage.”
Chaos&Order: Using visualization as a means to
 explore large heritage collec...
Re examining the- location_ of_ web objects-vasantharaju_and_harinarayana_201...
Search, Report, Wherever You Are: A Novel Approach to Assessing User Satisfac...
Web-scale Discovery Implementation with the End User in Mind (SLA 2012)
Search Solutions 2011: Successful Enterprise Search By Design
Redesigning the Open Access Institutional Repository
Kammerer How The Interface Design Influences Users Spontaneous Trustworthines...
Ad

More from Gillian Byrne (6)

PPTX
Forging New Links: Libraries in the Semantic Web
PDF
SWOT vs. SOAR: Engaging Staff in Institutional Planning
PPT
“Just the Facts, Ma’am”: RSS and your library
PPT
Is our two way communication a one way street? Informal Surveys & Polls in Li...
PPTX
De-Mystifying Stats: A primer on basic statistics
PPT
Give ‘em a playground and they’ll learn: Challenge-based technology training ...
Forging New Links: Libraries in the Semantic Web
SWOT vs. SOAR: Engaging Staff in Institutional Planning
“Just the Facts, Ma’am”: RSS and your library
Is our two way communication a one way street? Informal Surveys & Polls in Li...
De-Mystifying Stats: A primer on basic statistics
Give ‘em a playground and they’ll learn: Challenge-based technology training ...

Recently uploaded (20)

PDF
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
PDF
Complications of Minimal Access-Surgery.pdf
PDF
Paper A Mock Exam 9_ Attempt review.pdf.
PDF
What if we spent less time fighting change, and more time building what’s rig...
PDF
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
PPTX
Share_Module_2_Power_conflict_and_negotiation.pptx
PDF
HVAC Specification 2024 according to central public works department
PDF
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
PDF
Hazard Identification & Risk Assessment .pdf
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PPTX
ELIAS-SEZIURE AND EPilepsy semmioan session.pptx
PPTX
History, Philosophy and sociology of education (1).pptx
PPTX
TNA_Presentation-1-Final(SAVE)) (1).pptx
PDF
Empowerment Technology for Senior High School Guide
PDF
CISA (Certified Information Systems Auditor) Domain-Wise Summary.pdf
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
PDF
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PPTX
Unit 4 Computer Architecture Multicore Processor.pptx
PDF
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
Complications of Minimal Access-Surgery.pdf
Paper A Mock Exam 9_ Attempt review.pdf.
What if we spent less time fighting change, and more time building what’s rig...
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
Share_Module_2_Power_conflict_and_negotiation.pptx
HVAC Specification 2024 according to central public works department
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
Hazard Identification & Risk Assessment .pdf
202450812 BayCHI UCSC-SV 20250812 v17.pptx
ELIAS-SEZIURE AND EPilepsy semmioan session.pptx
History, Philosophy and sociology of education (1).pptx
TNA_Presentation-1-Final(SAVE)) (1).pptx
Empowerment Technology for Senior High School Guide
CISA (Certified Information Systems Auditor) Domain-Wise Summary.pdf
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
Unit 4 Computer Architecture Multicore Processor.pptx
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf

"Is one Stop Shopping all we Dreamed it Would be? Usability and the Single Search Interface"

  • 1. Is one stop shopping all we dreamed it would be? Usability and the Single Search Interface Gillian Byrne & Louise McGillis Memorial University Libraries CLA 2006 Ottawa, Ontario
  • 2. Introduction  What is SingleSearch?  The methodology  The results  What’s next?
  • 3. Federated Searching at Memorial  SingleSearch (one interface…many resources)  Resolver (links to our full-text & holdings)  RELAIS (document delivery)
  • 7. …or to a check of our holdings…
  • 8. …Resolver links to online holdings…
  • 9. …or to Relais (document delivery system)
  • 10. Test Audience  12 participants from three MUN Libraries  5 males & 7 females  7 undergradutes, 3 graduate & 2 faculty  Ages ranged from under 20 to 49
  • 11. Survey Tasks  Select categories & resources  Find & check holdings for a book  Find & check holdings for an article  Navigate the Resolver
  • 13. Test Materials & Analysis  Test Materials  Pre-test: demographic and library use data  Survey: completed as participants completed the tasks  Post-test: participant impressions of SingleSearch  Analysis  Quantitative data analyzed by SPSS  Screen captures analyzed with a variety of tools (click path analysis)
  • 14. Results!  The expected...  The unexpected...  The bonus material
  • 15. Difficulty understanding layout of search screen  Participants had difficulty understanding the differentiation of resources and categories on the search screen  Participant Comments:  “I would also chose the library catalogue and GoogleScholar if it were here”  “In the beginning when you have to choose groups and individual resources, there are so many categories that it is difficult to decide which topics to select.”  Several did not even scan down to the resources section
  • 16. Resource/Category Selection  For the question, “Find information on the evolution of the human skeleton” participants selected an average of 2.5 categories and 3.25 resources.  Equals approximately 25 databases being searched Categories Selected Resources Selected M 2.0 3.25 Mdn 2.0 1 σ 1.348 4.845
  • 17. Lots of clicking...  Participants were asked to select “Get It@Memorial” and navigate to Library holdings.  Took participants an average of 9 clicks to reach an article/holdings or to give up.  Participants who were successful took an average of 6 clicks.
  • 18. ...And lots of hovering  Participants were asked to choose an article citation and determine if it were available online or whether MUN owned it.  Took participants an average of 5 min. & 10 sec. to complete
  • 19. Basic search strategies  None of the participants used sophisticated search techniques like Boolean and/or truncation. I.e.,  “Find information on pollution and asthma”  pollution asthma (2)  asthma pollution  “Find information on elder abuse”  information on elder abuse  elder abuse (2)
  • 20. Users identified format with ease  100% of participants were correctly able to identify whether there was a book and an article on their search results.  Majority (75%, n=12) selected an article where document type was in the Single Search display
  • 21. Route to holdings  2 options in each citation  More Information: Links to native interface  Get it@Memorial: Links to Resolver  Majority select “more information” first  Question asked: “Is the article available online (full text)? If not…does any MUN Library have this article?”
  • 22. Expected Click Path Question: Is the article available online?
  • 23. Actual Click Paths Question: Is the article available online? N = 8 (successful attempts) N =10 (unsuccessful attempts)
  • 24. Bonus Material  Fascinating insight into how people deal with error messages (which abounded) and other browsing behaviours.  Example
  • 25. Conclusions...thus far. 1. Need to simplify resource selection 2. Need to include format identifiers 3. Need to clean up display 4. Need to promote “most efficient” path through the SingleSearch to the article
  • 26. What next?  Use the data to develop mocks of different layouts for focus group this summer  Re-do study when Rooms Portal is implemented?
  • 27. Users get the last word… “It displayed a wide range of results with very little effort. Usually I would use google for research for an essay, but after seeing how easily and accurately this system finds and displays information I would rather use it.”