User Requirements in Audiovisual Search: a Quantitative Approach
Download as PPTX, PDF1 like689 views
This document discusses using a quantitative approach to understand user requirements for audiovisual search. Researchers conducted interviews and sorting/rating exercises with professionals, researchers, and home users to generate statements about desired search features. These statements were categorized and rated for desirability. The results showed clear interest from users in advanced search options using multiple metadata sources. Users also wanted segment-level access to audiovisual content through annotations and a system that is clear, transparent, and smoothly functioning. The quantitative concept mapping approach provided insights into differences between user groups to help guide development of specialized audiovisual search tools.
User Requirements in Audiovisual Search: a Quantitative Approach
- 1. User Requirements in Audiovisual Search A Quantitative Approach Danish Nadeem Roeland Ordelman Robin Aly Erwin Verbruggen
- 3. BUSINESS ARCHIVE DUTCH PUBLIC BROADCASTERS
- 4. DIGITIZATION
- 5. CLARIAH PRESENTATIE 11 September 2013 5 800.000 hrs
- 6. ?METADATA
- 8. CLARIAH PRESENTATIE 11 September 2013 8 TOOLS
- 10. CLARIAH PRESENTATIE 11 September 2013 10 FEEDBACK
- 19. Research & Education Broadcast Professionals Hergebruik Media Archivists (documentalisten) Beschrijven Journalists Research Academic researchers Investigate Education Illustrate
- 21. 21 Use Scenarios & System Requirements Interview & elicitation sessions Mock-up creation & evaluation Prototype evaluation System evaluation Surveys & log analysis Qualitative Qualitative QualitativeQuantitative Quantitative/ Qualitative
- 22. Quantitative approach • Categorization of user requirements • According to different user groups • Prioritize implementation of system features 1. 2. 3.
- 23. Concept Mapping • Data collection • Multidimensional Scaling • Hierarchical Cluster Analysis
- 24. Method • Phase 1: “Idea generation” –Caveat: unfamiliarity with A/V search –Interviews, requirements elicitation experiments using system mock-ups –professionals, researchers, home user –71 “statements”
- 25. Method (2) • Phase 2: “Sorting & Rating” –47 participants, evenly spread over 3 groups –Categorize according to perceived similarity • Create categories and label with description –Rate according to desirability • 1-5: undesirable – highly desirable
- 27. Categories
- 28. User-defined search functions Translates into: 1. having options for search manipulation and result representation: – change sort order of results (date, relevance) – Use filters and activate them at any point during search – Use boolean operators 2. the system should be clear and guide users in a rather complex search process
- 29. Advanced search • Users are eager to make use of advanced search options: – Search using example image – Events, persons, speakers, visual objects – Using multiple metadata sources, e.g., • Archival metadata • Speech transcripts • Visual labels • Less interest in “technical” metadata – Shot types, camera movement, b/w-color
- 30. Help functions • Slight miss-alignment with what developers understand as “help functions” • Next to “access to help manuals”: – System should be fast – Clear, user-friendly, intuitive UI – Access to video – Clear message when no results are found – Consistent results
- 37. Conclusions • Quantitative approach using concept mapping – Useful approach to get some more grip on user requirements and differences between user groups – Helps to steer development process of advanced user type specific A/V search tools – User defined labels may not always be in-line with formal definitions used by developers which may cause confusions, e.g., • Help functions vs. clear, smooth and consistent system
- 38. Conclusions (2) • Clear interest of users in 1. advanced search options 2. segment-level access points to AV by means of rich multi-modal annotations (speech, speakers, events, objects) 3. Clear, transparent, smoothly working system
- 40. http://www.axes-project.eu Information Retrieval for Information Services http://www.project-infiniti.nl/
Editor's Notes
- #15: Automatic annotations