SlideShare a Scribd company logo
1
IIPC, London Web Archiving Week
16 June 2017
Best Practices for Descriptive
Metadata
Recommendations of the OCLC Research Library Partnership
Web Archiving Metadata Working Group
Alexis Antracoli, Karen Stoll Farrell, Jackie Dooley
oc.lc/wam
2
THE PROBLEM
3
3
• Archived websites often are not easily discoverable via
search engines or library and archives catalogs and finding
aid systems, which inhibits use.
• Absence of community best practices for descriptive
metadata was the most widely-shared web archiving
challenge identified in two surveys:
– OCLC Research Library Partnership (2015)
– Weber/Chapman study of users of archived website (2016)
4
4
5
5
6
OCLC RESEARCH LIBRARY PARTNERSHIP
WEB ARCHIVING METADATA
WORKING GROUP
7
7
Objective
• Recommend best practices for web archiving descriptive
metadata that are community-neutral and standards-
neutral
• A set of defined data elements (i.e., a data dictionary)
8
8
Outputs (July 2017)
• Literature review to inform our understanding of
documented user needs and behaviors
• Best practices for descriptive metadata address both
single-site and collection approaches
• Analysis of descriptive metadata functionalities of eleven
harvesting tools [not covered in today’s session]
LITERATURE REVIEWS
Bailey et al. Ben-David & Huurdeman Bernstein Bragg & Hanna Costa
Costa & Gomes Costa & Silva Cruz & Gomes Dougherty & Meyer Galligan
Gatenby Gibbons Goel Goethals Guenther Hartman et al. Hockx-Yu
Jackson Jones & Shankar Lavoie & Gartner Leetaru Mannheimer Masanès
Milligan Murray & Hsieh Neubert Niu O’Dell Peterson Phillips & Koerbin
Pregill Prom & Swain Ras & van Bussel Reynolds Riley & Crookston
Stirling et al. Sweetser Taylor Thomas et al. Thurman & O’Hanlon
Tillinghast Truman Weber&Graham Webster Wuet al. Zhang et al.
Who are the end users of web archives?
Digital humanists
Web scientists
Computer scientists
Data analysts
Journalists
Lawyers
Website owners
Website designers
Government employees
Genealogists
Patent applicants
Instructors
Students
Linguists
Sociologists
Political scientists
Historians
Anthropologists
How are they using web archives?
• Read specific web pages/sites
• Data and text mining
• Technology development
What behaviors do they use?
Costa and Silva (2010) classify needs into three behavioral
groups; much cited by others.
• Navigational
• Informational
• Transactional
Takeaways for end-user needs
• Flexible Formats
• Engagement
• Access and re-use/rights statements
• Archived vs. live
• Subject access
“Provenance” metadata
• “The critical missing piece”
• Provides context
• Why was the content archived?
• Selection criteria
• Scope
Takeaways for metadata practitioners
• Archival and bibliographic approaches
• RDA, MARC, Dublin Core, MODS, finding aids, DACS
• Data elements vary widely
• Same element name, different meanings
• Level of description
– Single site, collection of sites, seed URLs
• Scalability and limited resources
16
DEVELOPING DESCRIPTIVE METADATA
BEST PRACTICES
17
17
Methodology
• Analyze metadata standards & institutional guidelines
– RDA (libraries), DACS (archives), Dublin Core (simplified)
• Evaluate existing metadata records “in the wild”
– WorldCat, ArchiveGrid, Archive-It
• Identify dilemmas specific to web archiving
• Incorporate findings from literature reviews
• Prepare data dictionary and report narrative
18
WEB-SPECIFIC DILEMMAS
19
19
• Is the website creator/owner the … publisher? author? subject?
• Should the title be … transcribed verbatim from the head of the
site? Edited to clarify the nature/scope of the site? Append e.g. "web
archive”?
• Which dates are important/feasible other than capture
dates? Beginning/end of the site's existence? Date of the content?
Copyright?
• How should extent/size be expressed? 1 archived website?
1 online resource? 6.25 Gb? approximately 300 websites?
• Is the host institution that harvests and manages the
archived content the repository? creator? publisher? selector?
20
20
• Is it important to clearly state that the resource is a website?
If so, where? In the title? description? extent statement? all of these?
• Does provenance refer to …the site owner? the repository that
harvests and hosts the site? ways in which the site evolved?
• Does appraisal mean …the reason the site warrants being
archived? a collection of sites named by the repository? the parts of the
site that were harvested?
• Which URLs should be included? Seed? access? landing page?
21
RECOMMENDED BEST PRACTICES
22
22
Setting the context
• Use cases: library, archives, researcher
• Comparisons between …
– Bibliographic and archival approaches to description
– Description of archived and live sites
– Collection, site, and document-level descriptions
23
23
Data dictionary characteristics
• Lean (14 elements); use on its own or with granular library and archives
standards
• Element names and definitions adopted or adapted from standards
• Usage notes explain how to formulate the content of each element
• The same element is used for a concept at all levels of description as per
multilevel principles expressed in archival standards (DACS and EAD).
24
24
Data dictionary inclusion criteria
• Includes common elements used for identification and discovery of all
types of resource (e.g., Creator, Date, Subject, Title)
• Other elements must have clear applicability to archived websites (e.g.
Access Conditions, Description, URL)
• Elements excluded that rarely (if ever) appear in guidelines and/or extant
metadata records and have no web-specific meaning (e.g. audience,
publisher, statement of responsibility)
25
25
WAM data elements
Access/Rights * Extent Title *
Collector Genre/Form URL
Contributor * Language *
Creator * Relation *
Date * Source of Description
Description * Subject *
* = 9 of 14 element names/meanings match Dublin Core
26
26
Access Conditions [to be renamed Rights]
Definition: Circumstances that affect the availability [and/or re-use] of an archived
website or collection.
Use Access Conditions to record whether or not conditions exist that restrict user access to
the archived content. These might include the need to make an appointment for onsite
use or a specified period of time during which the content is embargoed. Such conditions
may be imposed by an archival repository, donor, other agency, or legal statute.
This content is embargoed from public access until 2025.
Due to Twitter's Terms of Service, this data archive is accessible only to the University
of Miami community …
Maps to “Rights” in Dublin Core.
27
27
Access Conditions: Crosswalks
Crosswalks
Dublin Core Rights
EAD <accessrestrict>
<userestrict>
MARC 506
MODS <accessCondition>
schema.org schema:license
schema:isAccessiblrForFree
28
28
Collector
Definition: The organization responsible for curation and stewardship of an
archived website or collection.
Use Collector for the organization that selects the web content for archiving, creates
metadata and performs other activities associated with “ownership” of a resource.
Stated another way, this is the organization that has taken responsibility for the archived
content, although the digital files are not necessarily stored and maintained by this
organization (collections harvested using Archive-It are a prominent example).
No equivalent in Dublin Core.
29
29
Collector: Lifecycle activities
Institutions involved in web archiving engage in a variety of activities during the lifecycle
of archiving web content. We identified four activities performed by the institution that
assumes responsibility for archiving web content:
• Selecting websites for archiving
• Harvesting the content of the designated seed URLs
• Creating and maintaining metadata to describe the content
• Making decisions about other aspects of collections management, including how
the harvested files will be preserved and how will access be provided.
30
30
Collector: Examples
Creator: Seattle (Wash.)
Title: City of Seattle Harvested Websites
Collector: Seattle Municipal Archives
-============
Title: Globalchange.gov
Contributor: U.S. Global Change Research Program
Collector: Federal Depository Library Program
============
Creator: Association for Research into Crimes against Art
Title: ARCAblog : promoting the study and research of art crime and cultural
heritage protection
Collector: New York Art Resources Consortium
31
31
Collector: Crosswalks
Crosswalks
Dublin Core Contributor
EAD <repository>
MARC 524
852 subfield a
852 subfield b
MODS <location>
schema.org schema:OwnershipInfo
32
32
Source of description
Definition: Information about the gathering or creation of the metadata
itself, such as sources of data or the date on which source data was
obtained.
Source of Information is used to identify the source of all or some of the
metadata, particularly for descriptions of single sites. Basic aspects of a
website (creator name, title, etc.) may change significantly, but the
responsible institution is unlikely to have the resources to become aware of
changes, let alone update the metadata. Include the date on which the site
was examined and the location from which the information was taken.
No equivalent in Dublin Core.
33
33
Source of description: Examples
Description based on archived web page captured Sept. 22, 2016; title from
title screen (viewed Oct. 27, 2016)
Title from home page last updated June 21, 2012 (viewed June 22, 2012)
Title from home page (viewed on Oct. 11, 2007)
Title from HTML header (viewed Feb. 16, 2006)
34
34
Source of description: Crosswalks
35
35
WAM data elements (14)
Access/Rights * Extent Title *
Collector Genre/Form URL
Contributor * Language *
Creator * Relation *
Date * Source of Description
Description * Subject *
* = 9 of 14 element names/meanings match Dublin Core
36
PUBLICATION IN LATE JULY
37
37
Three simultaneous reports
● Best practices for descriptive metadata
○ With data dictionary
● User needs
○ With annotated bibliography
● Tools
○ With evaluation grids
38
Q&A
39
SM
Jackie Dooley
Program Officer, OCLC Research
dooleyj@oclc.org
@minniedw
IIPC, Web Archiving Week
16 June 2017
©2016 OCLC. This work is licensed under a Creative Commons Attribution 4.0 International License. Suggested attribution:
“This work uses content from Developing Best Practices for Web Archiving Metadata to Meet User Needs
© OCLC, used under a Creative Commons Attribution 4.0 International License:
http://creativecommons.org/licenses/by/4.0/.”
For more information, please contact:
oc.lc/wam

More Related Content

PPTX
Describing Theses and Dissertations Using Schema.org
PPTX
The network reshapes the research library collection
PPTX
Data Designed for Discovery
PPTX
Best Practices for Descriptive Metadata for Web Archiving
PPTX
Libraries, collections, technology: presented at Pennylvania State University...
PPTX
Collection Directions - Research collections in the network environment
PPTX
OA in the Library Collection: The Challenge of Identifying and Managing Open ...
PPTX
Multilingual presentation ifla 2013 08-19
Describing Theses and Dissertations Using Schema.org
The network reshapes the research library collection
Data Designed for Discovery
Best Practices for Descriptive Metadata for Web Archiving
Libraries, collections, technology: presented at Pennylvania State University...
Collection Directions - Research collections in the network environment
OA in the Library Collection: The Challenge of Identifying and Managing Open ...
Multilingual presentation ifla 2013 08-19

What's hot (20)

PPTX
Collection Directions: Some Reflections on Libraries and Stewardship of the ...
PPTX
The library in the life of the user
PPT
Social metadata for libraries, archives and museums: Research findings from t...
PPT
Cloud Library: Precipitating change in library infrastructure
PPTX
The OCLC Research Library Partnership
PPTX
Exploring a world of networked information built from free-text metadata
PPTX
The Evolving Scholarly Record Framing the Landscape
PPTX
The facilitated collection: collections and collecting in a network environment
PPTX
Full Spectrum Stewardship of the Scholarly Record by Brian E. C. Schottlaende...
PPTX
Working collaboratively: scaling infrastructure, services, learning and innov...
PPTX
Linked Data Implementations—Who, What and Why?
PPTX
Library collections and the emerging scholarly record
PPTX
2015 NISO Forum: The Future of Library Resource Discovery
PDF
Library Assessment Toolkit & Dashboard Scoping Research Final Report and Path...
PPTX
NISO Webinar: The Future of Integrated Library Systems PART 2: User Interaction
PPTX
Library discovery: past, present and some futures
PPTX
The SHARES Partnership, Plus Tracking Trends in ILL Cost and Transaction Data
PPTX
NISO Standards Update @ ALA Midwinter, January 27, 2013 in Seattle, WA
PPTX
BIBFRAME and OCLC Works: Defining Models and Discovering Evidence
PPTX
Towards collaboration at scale: Libraries, the social and the technical
Collection Directions: Some Reflections on Libraries and Stewardship of the ...
The library in the life of the user
Social metadata for libraries, archives and museums: Research findings from t...
Cloud Library: Precipitating change in library infrastructure
The OCLC Research Library Partnership
Exploring a world of networked information built from free-text metadata
The Evolving Scholarly Record Framing the Landscape
The facilitated collection: collections and collecting in a network environment
Full Spectrum Stewardship of the Scholarly Record by Brian E. C. Schottlaende...
Working collaboratively: scaling infrastructure, services, learning and innov...
Linked Data Implementations—Who, What and Why?
Library collections and the emerging scholarly record
2015 NISO Forum: The Future of Library Resource Discovery
Library Assessment Toolkit & Dashboard Scoping Research Final Report and Path...
NISO Webinar: The Future of Integrated Library Systems PART 2: User Interaction
Library discovery: past, present and some futures
The SHARES Partnership, Plus Tracking Trends in ILL Cost and Transaction Data
NISO Standards Update @ ALA Midwinter, January 27, 2013 in Seattle, WA
BIBFRAME and OCLC Works: Defining Models and Discovering Evidence
Towards collaboration at scale: Libraries, the social and the technical
Ad

Similar to Best Practices for Descriptive Metadata (20)

PPT
UAEU_MDL_Slides_rev1.ppt
PPTX
Digital Repositories: Essential Information for Academic Librarians
PPTX
NISO access related projects (presented at the Charleston conference 2016)
PPT
Summary of Trends in Cataloging
PPTX
Linked Data, Library Users, and the Discovery Tools of the Future
PPTX
Lodlam.slideshare
PPTX
Next Generation Repositories
PPT
Resource discovery and information sharing: reaching the 2.0 turn
PPTX
UKSG webinar: Making Connections - Creating Linked Open Library Data with Nei...
PDF
A brief overview of metadata for datasets
PDF
The commitment of arabic sites in the field of libraries and information that...
PPTX
Edina cigs-21-september-2012
PPTX
Uc3 pasig-asis&t-2013-08-20-support-of-data-intensive-research
PDF
Finding Data Sets
PPTX
Alphabet soup: CDM, VRA, CCO, METS, MODS, RDF - Why Metadata Matters
PPTX
Aggregation of cultural heritage datasets through the Web of Data
PDF
Improving library services with semantic web technology in the realm of repos...
PPTX
An Ecosystem for Digital Costume Collections
PDF
Handout for Metadata for your Digital Collections
UAEU_MDL_Slides_rev1.ppt
Digital Repositories: Essential Information for Academic Librarians
NISO access related projects (presented at the Charleston conference 2016)
Summary of Trends in Cataloging
Linked Data, Library Users, and the Discovery Tools of the Future
Lodlam.slideshare
Next Generation Repositories
Resource discovery and information sharing: reaching the 2.0 turn
UKSG webinar: Making Connections - Creating Linked Open Library Data with Nei...
A brief overview of metadata for datasets
The commitment of arabic sites in the field of libraries and information that...
Edina cigs-21-september-2012
Uc3 pasig-asis&t-2013-08-20-support-of-data-intensive-research
Finding Data Sets
Alphabet soup: CDM, VRA, CCO, METS, MODS, RDF - Why Metadata Matters
Aggregation of cultural heritage datasets through the Web of Data
Improving library services with semantic web technology in the realm of repos...
An Ecosystem for Digital Costume Collections
Handout for Metadata for your Digital Collections
Ad

More from OCLC (20)

PPTX
Communicating library impact beyond library walls: Findings from an action-or...
PPTX
"You can just tell whether a website looks reliable or not." People's modes o...
PPTX
Factors influencing research data management programs.
PPTX
Teaching research methods in LIS programs: Approaches, formats, and innovativ...
PPTX
OCLC ALISE Library & Information Science Research Grant Program
PPTX
Investing in library users and potential users: The Many Faces of Digital Vi...
PPTX
Academic library impact: Improving practice and essential areas to research
PPTX
Studying information behavior: The Many Faces of Digital Visitors and Residents
PPTX
Online engagement and information literacy: The Many Face of Digital Visitors...
PPTX
People's mode of online engagement: The Many Faces of Digital Visitors and R...
PPTX
Applying research methods: Investigating the Many Faces of Digital Visitors &...
PDF
OCLC RLP @ RLUK
PPTX
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
PPTX
Visitors and Residents: The Hows and Whys of Engagement with Technology
PPTX
Action-Oriented Research Agenda on Library Contributions to Student Learning ...
PPTX
Visitors and Residents: Interactive Mapping Exercise Workshop
PPTX
The Library in the Life of the User
PPTX
Where are We Going and What Do We Do Next? Demonstrating the Value of Academi...
PPTX
Changing Tack: A Future-Focused ACRL Research Agenda
PPTX
Qualitative Research Methods in LIS
Communicating library impact beyond library walls: Findings from an action-or...
"You can just tell whether a website looks reliable or not." People's modes o...
Factors influencing research data management programs.
Teaching research methods in LIS programs: Approaches, formats, and innovativ...
OCLC ALISE Library & Information Science Research Grant Program
Investing in library users and potential users: The Many Faces of Digital Vi...
Academic library impact: Improving practice and essential areas to research
Studying information behavior: The Many Faces of Digital Visitors and Residents
Online engagement and information literacy: The Many Face of Digital Visitors...
People's mode of online engagement: The Many Faces of Digital Visitors and R...
Applying research methods: Investigating the Many Faces of Digital Visitors &...
OCLC RLP @ RLUK
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
Visitors and Residents: The Hows and Whys of Engagement with Technology
Action-Oriented Research Agenda on Library Contributions to Student Learning ...
Visitors and Residents: Interactive Mapping Exercise Workshop
The Library in the Life of the User
Where are We Going and What Do We Do Next? Demonstrating the Value of Academi...
Changing Tack: A Future-Focused ACRL Research Agenda
Qualitative Research Methods in LIS

Recently uploaded (20)

PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
102 student loan defaulters named and shamed – Is someone you know on the list?
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PPTX
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
PDF
01-Introduction-to-Information-Management.pdf
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PPTX
Renaissance Architecture: A Journey from Faith to Humanism
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PDF
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
PPTX
GDM (1) (1).pptx small presentation for students
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PDF
Complications of Minimal Access Surgery at WLH
PPTX
master seminar digital applications in india
PDF
Anesthesia in Laparoscopic Surgery in India
PDF
Basic Mud Logging Guide for educational purpose
PDF
Computing-Curriculum for Schools in Ghana
PPTX
PPH.pptx obstetrics and gynecology in nursing
PPTX
Cell Types and Its function , kingdom of life
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Final Presentation General Medicine 03-08-2024.pptx
102 student loan defaulters named and shamed – Is someone you know on the list?
FourierSeries-QuestionsWithAnswers(Part-A).pdf
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
01-Introduction-to-Information-Management.pdf
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Renaissance Architecture: A Journey from Faith to Humanism
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
GDM (1) (1).pptx small presentation for students
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
Complications of Minimal Access Surgery at WLH
master seminar digital applications in india
Anesthesia in Laparoscopic Surgery in India
Basic Mud Logging Guide for educational purpose
Computing-Curriculum for Schools in Ghana
PPH.pptx obstetrics and gynecology in nursing
Cell Types and Its function , kingdom of life
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape

Best Practices for Descriptive Metadata

  • 1. 1 IIPC, London Web Archiving Week 16 June 2017 Best Practices for Descriptive Metadata Recommendations of the OCLC Research Library Partnership Web Archiving Metadata Working Group Alexis Antracoli, Karen Stoll Farrell, Jackie Dooley oc.lc/wam
  • 3. 3 3 • Archived websites often are not easily discoverable via search engines or library and archives catalogs and finding aid systems, which inhibits use. • Absence of community best practices for descriptive metadata was the most widely-shared web archiving challenge identified in two surveys: – OCLC Research Library Partnership (2015) – Weber/Chapman study of users of archived website (2016)
  • 4. 4 4
  • 5. 5 5
  • 6. 6 OCLC RESEARCH LIBRARY PARTNERSHIP WEB ARCHIVING METADATA WORKING GROUP
  • 7. 7 7 Objective • Recommend best practices for web archiving descriptive metadata that are community-neutral and standards- neutral • A set of defined data elements (i.e., a data dictionary)
  • 8. 8 8 Outputs (July 2017) • Literature review to inform our understanding of documented user needs and behaviors • Best practices for descriptive metadata address both single-site and collection approaches • Analysis of descriptive metadata functionalities of eleven harvesting tools [not covered in today’s session]
  • 9. LITERATURE REVIEWS Bailey et al. Ben-David & Huurdeman Bernstein Bragg & Hanna Costa Costa & Gomes Costa & Silva Cruz & Gomes Dougherty & Meyer Galligan Gatenby Gibbons Goel Goethals Guenther Hartman et al. Hockx-Yu Jackson Jones & Shankar Lavoie & Gartner Leetaru Mannheimer Masanès Milligan Murray & Hsieh Neubert Niu O’Dell Peterson Phillips & Koerbin Pregill Prom & Swain Ras & van Bussel Reynolds Riley & Crookston Stirling et al. Sweetser Taylor Thomas et al. Thurman & O’Hanlon Tillinghast Truman Weber&Graham Webster Wuet al. Zhang et al.
  • 10. Who are the end users of web archives? Digital humanists Web scientists Computer scientists Data analysts Journalists Lawyers Website owners Website designers Government employees Genealogists Patent applicants Instructors Students Linguists Sociologists Political scientists Historians Anthropologists
  • 11. How are they using web archives? • Read specific web pages/sites • Data and text mining • Technology development
  • 12. What behaviors do they use? Costa and Silva (2010) classify needs into three behavioral groups; much cited by others. • Navigational • Informational • Transactional
  • 13. Takeaways for end-user needs • Flexible Formats • Engagement • Access and re-use/rights statements • Archived vs. live • Subject access
  • 14. “Provenance” metadata • “The critical missing piece” • Provides context • Why was the content archived? • Selection criteria • Scope
  • 15. Takeaways for metadata practitioners • Archival and bibliographic approaches • RDA, MARC, Dublin Core, MODS, finding aids, DACS • Data elements vary widely • Same element name, different meanings • Level of description – Single site, collection of sites, seed URLs • Scalability and limited resources
  • 17. 17 17 Methodology • Analyze metadata standards & institutional guidelines – RDA (libraries), DACS (archives), Dublin Core (simplified) • Evaluate existing metadata records “in the wild” – WorldCat, ArchiveGrid, Archive-It • Identify dilemmas specific to web archiving • Incorporate findings from literature reviews • Prepare data dictionary and report narrative
  • 19. 19 19 • Is the website creator/owner the … publisher? author? subject? • Should the title be … transcribed verbatim from the head of the site? Edited to clarify the nature/scope of the site? Append e.g. "web archive”? • Which dates are important/feasible other than capture dates? Beginning/end of the site's existence? Date of the content? Copyright? • How should extent/size be expressed? 1 archived website? 1 online resource? 6.25 Gb? approximately 300 websites? • Is the host institution that harvests and manages the archived content the repository? creator? publisher? selector?
  • 20. 20 20 • Is it important to clearly state that the resource is a website? If so, where? In the title? description? extent statement? all of these? • Does provenance refer to …the site owner? the repository that harvests and hosts the site? ways in which the site evolved? • Does appraisal mean …the reason the site warrants being archived? a collection of sites named by the repository? the parts of the site that were harvested? • Which URLs should be included? Seed? access? landing page?
  • 22. 22 22 Setting the context • Use cases: library, archives, researcher • Comparisons between … – Bibliographic and archival approaches to description – Description of archived and live sites – Collection, site, and document-level descriptions
  • 23. 23 23 Data dictionary characteristics • Lean (14 elements); use on its own or with granular library and archives standards • Element names and definitions adopted or adapted from standards • Usage notes explain how to formulate the content of each element • The same element is used for a concept at all levels of description as per multilevel principles expressed in archival standards (DACS and EAD).
  • 24. 24 24 Data dictionary inclusion criteria • Includes common elements used for identification and discovery of all types of resource (e.g., Creator, Date, Subject, Title) • Other elements must have clear applicability to archived websites (e.g. Access Conditions, Description, URL) • Elements excluded that rarely (if ever) appear in guidelines and/or extant metadata records and have no web-specific meaning (e.g. audience, publisher, statement of responsibility)
  • 25. 25 25 WAM data elements Access/Rights * Extent Title * Collector Genre/Form URL Contributor * Language * Creator * Relation * Date * Source of Description Description * Subject * * = 9 of 14 element names/meanings match Dublin Core
  • 26. 26 26 Access Conditions [to be renamed Rights] Definition: Circumstances that affect the availability [and/or re-use] of an archived website or collection. Use Access Conditions to record whether or not conditions exist that restrict user access to the archived content. These might include the need to make an appointment for onsite use or a specified period of time during which the content is embargoed. Such conditions may be imposed by an archival repository, donor, other agency, or legal statute. This content is embargoed from public access until 2025. Due to Twitter's Terms of Service, this data archive is accessible only to the University of Miami community … Maps to “Rights” in Dublin Core.
  • 27. 27 27 Access Conditions: Crosswalks Crosswalks Dublin Core Rights EAD <accessrestrict> <userestrict> MARC 506 MODS <accessCondition> schema.org schema:license schema:isAccessiblrForFree
  • 28. 28 28 Collector Definition: The organization responsible for curation and stewardship of an archived website or collection. Use Collector for the organization that selects the web content for archiving, creates metadata and performs other activities associated with “ownership” of a resource. Stated another way, this is the organization that has taken responsibility for the archived content, although the digital files are not necessarily stored and maintained by this organization (collections harvested using Archive-It are a prominent example). No equivalent in Dublin Core.
  • 29. 29 29 Collector: Lifecycle activities Institutions involved in web archiving engage in a variety of activities during the lifecycle of archiving web content. We identified four activities performed by the institution that assumes responsibility for archiving web content: • Selecting websites for archiving • Harvesting the content of the designated seed URLs • Creating and maintaining metadata to describe the content • Making decisions about other aspects of collections management, including how the harvested files will be preserved and how will access be provided.
  • 30. 30 30 Collector: Examples Creator: Seattle (Wash.) Title: City of Seattle Harvested Websites Collector: Seattle Municipal Archives -============ Title: Globalchange.gov Contributor: U.S. Global Change Research Program Collector: Federal Depository Library Program ============ Creator: Association for Research into Crimes against Art Title: ARCAblog : promoting the study and research of art crime and cultural heritage protection Collector: New York Art Resources Consortium
  • 31. 31 31 Collector: Crosswalks Crosswalks Dublin Core Contributor EAD <repository> MARC 524 852 subfield a 852 subfield b MODS <location> schema.org schema:OwnershipInfo
  • 32. 32 32 Source of description Definition: Information about the gathering or creation of the metadata itself, such as sources of data or the date on which source data was obtained. Source of Information is used to identify the source of all or some of the metadata, particularly for descriptions of single sites. Basic aspects of a website (creator name, title, etc.) may change significantly, but the responsible institution is unlikely to have the resources to become aware of changes, let alone update the metadata. Include the date on which the site was examined and the location from which the information was taken. No equivalent in Dublin Core.
  • 33. 33 33 Source of description: Examples Description based on archived web page captured Sept. 22, 2016; title from title screen (viewed Oct. 27, 2016) Title from home page last updated June 21, 2012 (viewed June 22, 2012) Title from home page (viewed on Oct. 11, 2007) Title from HTML header (viewed Feb. 16, 2006)
  • 35. 35 35 WAM data elements (14) Access/Rights * Extent Title * Collector Genre/Form URL Contributor * Language * Creator * Relation * Date * Source of Description Description * Subject * * = 9 of 14 element names/meanings match Dublin Core
  • 37. 37 37 Three simultaneous reports ● Best practices for descriptive metadata ○ With data dictionary ● User needs ○ With annotated bibliography ● Tools ○ With evaluation grids
  • 39. 39 SM Jackie Dooley Program Officer, OCLC Research dooleyj@oclc.org @minniedw IIPC, Web Archiving Week 16 June 2017 ©2016 OCLC. This work is licensed under a Creative Commons Attribution 4.0 International License. Suggested attribution: “This work uses content from Developing Best Practices for Web Archiving Metadata to Meet User Needs © OCLC, used under a Creative Commons Attribution 4.0 International License: http://creativecommons.org/licenses/by/4.0/.” For more information, please contact: oc.lc/wam