SlideShare a Scribd company logo
The workflows for the ingest of
digital objects into a repository/digital library
Jenny Jing
New York City
July 14, 2016
•Versions
•Privacy
•Rights
•Licensing
•Access
•Archiving
http://www.dcc.ac.uk/resources/curation-lifecycle-model
Data
or DB
Digital Curation Lifecycle
& born digital
The Big Picture:
sample systems: Summon
http://www.slideshare.net/ubclibrary/ubc-librarys-digital
Archivematica
Islandora ArchiveSpace
• Receive Submission
• Quality Assurance
• Generate AIP
• Generate Descriptive Information
• Coordinate Updates
DSpace
Omeka
DataVerse
• Review current procedures
• Review collections:
- Analog :Type of carrier, Condition of the media, etc.
- Born digital: File format, software,
• Define use cases
• Analyze existing functionality, tools and workflow
• Identify development needs, functional requirements
• Identify, recommend the tools/software to use
1. Needs & requirements – Ingest
2. Standards: Preservation & metadata
Trusted Digital Repositories: (TDR) Attributes and Responsibilities
1. Administrative Responsibility
2. Organization Viability
3. Financial Sustainability
4. Technological & Procedural Suitability
5. System Security
6. Procedural Accountability
Open Archival
Information
System (OAIS):
Reference Tool
Archivematica ,
Archivest’s Toolkit
DAM/Islandora,
OAIS: Ingest process
Working With OAIS- Digital Preservation Management Workshop
1
2
3
4
5
6 7
4
3. Batch processing: things to consider
Analog files: standards, processes, equipment, and storage for media records.
Image: File format, size, large datasets
Technology: Software (BitCurator, Archivematcia, ArchiveSpace), Storage hardware
Staffing: who
Metadata: PREMIS, METS (born-digital, copyrights)
• SIP Creation and PREMIS Rights
• Metadata is service driven
• Generated/extracted (automated) vs. human
• Where in workflows create metadata
• What form(s)
4. Quality Control:
• Staff/Who is doing what
• Sampling the content
• Standards, check list
• Assurance Activities
• Tool/software
Ingest Workflow : IR - Dspace @ Queen’s University
Rosarie Coughlan, Scholarly Publishing Librarian, Queen’s University Library
Ingest Workflow - Sample using Archivematica
http://www.slideshare.net/mikeum/shallcross-mmdp-a220150327final
Ingest Workflow : RDM-DataVerse
Acknowledges
• Rachel Wise, Archivist, Knowledge & Library Services, Harvard
Business School
• Kelli Babcock, Digital Initiatives Librarian, Information Technology
Services, University of Toronto Libraries
• Bronwen Sprout, Head, Digital Programs and Services Digital
Initiatives, Irving K. Barber Learning Centre, University of British
Columbia
Resources/References
• ArchivesSpace-Archivematica-Dspace Workflow Integration
• http://www.slideshare.net/mikeum/shallcross-mmdp-a220150327final
• UBC Library's Digital Preservation Strategy
• http://www.slideshare.net/ubclibrary/ubc-librarys-digital
• Digital POWRR
• http://digitalpowrr.niu.edu/tool-grid/
• UBC's Implementation of IR/DAM
• http://www.unesco.org/new/fileadmin/MULTIMEDIA/HQ/CI/CI/pdf/mow/VC_Sprout_Romkey_2
6_B_1540.pdf
• Review of Available Open Source DAM Software
• http://www.opensourcedigitalassetmanagement.org/reviews/available-open-source-dam/
• Curating the Analog, Curating the Digital - Archive Journal

More Related Content

PPTX
Everything you need to know about Azure Virtual Machines
PDF
Efficient Cloud Resource Management - Unleashing FinOps for Azure Cost Optimi...
PPTX
Azure key vault
PPT
Cloud computing ppt
PDF
Azure Data Factory V2; The Data Flows
PDF
Advanced Load Balancer/Traffic Manager and App Gateway for Microsoft Azure
PPTX
The Elastic Stack as a SIEM
PDF
20190424 只要會SQL就能做Machine Learning? BigQuery ML簡介
Everything you need to know about Azure Virtual Machines
Efficient Cloud Resource Management - Unleashing FinOps for Azure Cost Optimi...
Azure key vault
Cloud computing ppt
Azure Data Factory V2; The Data Flows
Advanced Load Balancer/Traffic Manager and App Gateway for Microsoft Azure
The Elastic Stack as a SIEM
20190424 只要會SQL就能做Machine Learning? BigQuery ML簡介

What's hot (20)

PPTX
Azure Cloud Governance
PDF
Azure Monitoring Overview
PPTX
PPTX
Introduction to the Microsoft Azure Cloud.pptx
PDF
Alphorm.com Microsoft AZURE
PPTX
Azure subscription management with EA and CSP
PPTX
Azure Synapse Analytics Overview (r1)
PDF
Zero-risk 엔터프라이즈 클라우드 스토리지 - 조순현 부장, Zadara :: AWS Summit Seoul 2019
PDF
Azure 101
PPTX
Open source SOC Tools for Home-Lab
PDF
Investigation of dhcp packets using wireshark
PPTX
jQuery
PPT
A complete guide to azure storage
PPTX
Security Onion
PPTX
Criteria for Effective Modern IAM Strategies (Gartner IAM 2018)
PPTX
Azure data factory
PDF
CIS14: Physical and Logical Access Control Convergence
PDF
Container, Container, Container -유재석 (AWS 솔루션즈 아키텍트)
PPTX
Cloud Computing Security
PDF
[2017 Windows on AWS] AWS 를 활용한 Active Directory 연동 및 이관 방안
Azure Cloud Governance
Azure Monitoring Overview
Introduction to the Microsoft Azure Cloud.pptx
Alphorm.com Microsoft AZURE
Azure subscription management with EA and CSP
Azure Synapse Analytics Overview (r1)
Zero-risk 엔터프라이즈 클라우드 스토리지 - 조순현 부장, Zadara :: AWS Summit Seoul 2019
Azure 101
Open source SOC Tools for Home-Lab
Investigation of dhcp packets using wireshark
jQuery
A complete guide to azure storage
Security Onion
Criteria for Effective Modern IAM Strategies (Gartner IAM 2018)
Azure data factory
CIS14: Physical and Logical Access Control Convergence
Container, Container, Container -유재석 (AWS 솔루션즈 아키텍트)
Cloud Computing Security
[2017 Windows on AWS] AWS 를 활용한 Active Directory 연동 및 이관 방안
Ad

Similar to The workflows for the ingest of digital objects into a repository/digital library (20)

PPTX
The workflows for the ingest of digital objects into a repository/digital li...
PPTX
Paving the way to open and interoperable research data service workflows
PPTX
Paving the way to open and interoperable research data service workflows Prog...
PPTX
NCompass Live: Best Practices for Digital Collections
PPTX
Good Enough: Finding what works for processing born-digital archives at the B...
PPT
Gettingstartedwithdigitalcollectionsweb[1]
PPTX
BPE_keynote_2014_DeRidder
PDF
One Core Preservation System for all your Data. No Exceptions! Marco Klindt a...
PPT
Intro to Digitization Projects
PPTX
Digital Presentation Best Practices: Lessons Learned From Across the Pond
PPTX
Digital Preservation Best Practices: Lessons Learned From Across the Pond
PPTX
Acquiring Born-Digital Material at the Canadian Centre for Architecture
PPTX
Mapping the Digital Preservation Wilderness: What you need to know
PDF
Preservation and institutional repositories for the digital arts and humanities
PPTX
Software Management Plans and Software as Data
PPTX
Best practices for Archival Processing of Research Objects (a librarian view)
PPTX
Electronic Records
PPTX
Emerging technologies in academic libraries
PDF
Intro to Digital Preservation
The workflows for the ingest of digital objects into a repository/digital li...
Paving the way to open and interoperable research data service workflows
Paving the way to open and interoperable research data service workflows Prog...
NCompass Live: Best Practices for Digital Collections
Good Enough: Finding what works for processing born-digital archives at the B...
Gettingstartedwithdigitalcollectionsweb[1]
BPE_keynote_2014_DeRidder
One Core Preservation System for all your Data. No Exceptions! Marco Klindt a...
Intro to Digitization Projects
Digital Presentation Best Practices: Lessons Learned From Across the Pond
Digital Preservation Best Practices: Lessons Learned From Across the Pond
Acquiring Born-Digital Material at the Canadian Centre for Architecture
Mapping the Digital Preservation Wilderness: What you need to know
Preservation and institutional repositories for the digital arts and humanities
Software Management Plans and Software as Data
Best practices for Archival Processing of Research Objects (a librarian view)
Electronic Records
Emerging technologies in academic libraries
Intro to Digital Preservation
Ad

More from Hong (Jenny) Jing (10)

PPTX
Discovery Systems Used in Academic Libraries Projects & Case Study
PPTX
The  Selection Between An Open Source And Vended Software in Libraries: Oppor...
PPTX
Institutional Repository (IR) and Open Access in Academic Libraries
PPTX
The Impact of Linked Data in Digital Curation and Application to the Catalogu...
PPTX
Strategic Developments in Digital Initiatives at Academic Libraries
PPTX
Digital asset management (dam) systems used in Libraries
PPTX
Implementing an Open Source IT Ticketing System at Queen's University Library
PPTX
Linked Open Data and Digital Curation (Islandora)
PPTX
Transparent Licenses: Making user rights clear (OLA Super Conference 2015)
PPTX
ALA 2014--Adding copyright/license information to different library systems
Discovery Systems Used in Academic Libraries Projects & Case Study
The  Selection Between An Open Source And Vended Software in Libraries: Oppor...
Institutional Repository (IR) and Open Access in Academic Libraries
The Impact of Linked Data in Digital Curation and Application to the Catalogu...
Strategic Developments in Digital Initiatives at Academic Libraries
Digital asset management (dam) systems used in Libraries
Implementing an Open Source IT Ticketing System at Queen's University Library
Linked Open Data and Digital Curation (Islandora)
Transparent Licenses: Making user rights clear (OLA Super Conference 2015)
ALA 2014--Adding copyright/license information to different library systems

Recently uploaded (20)

PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PPTX
Microbial diseases, their pathogenesis and prophylaxis
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PDF
Pre independence Education in Inndia.pdf
PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PPTX
Institutional Correction lecture only . . .
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PDF
Basic Mud Logging Guide for educational purpose
PDF
Anesthesia in Laparoscopic Surgery in India
PPTX
Pharma ospi slides which help in ospi learning
PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PPTX
Cell Structure & Organelles in detailed.
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
Sports Quiz easy sports quiz sports quiz
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
PDF
VCE English Exam - Section C Student Revision Booklet
PDF
O7-L3 Supply Chain Operations - ICLT Program
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Microbial diseases, their pathogenesis and prophylaxis
STATICS OF THE RIGID BODIES Hibbelers.pdf
Pre independence Education in Inndia.pdf
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
Institutional Correction lecture only . . .
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
Basic Mud Logging Guide for educational purpose
Anesthesia in Laparoscopic Surgery in India
Pharma ospi slides which help in ospi learning
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
2.FourierTransform-ShortQuestionswithAnswers.pdf
Cell Structure & Organelles in detailed.
Final Presentation General Medicine 03-08-2024.pptx
Sports Quiz easy sports quiz sports quiz
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
VCE English Exam - Section C Student Revision Booklet
O7-L3 Supply Chain Operations - ICLT Program
school management -TNTEU- B.Ed., Semester II Unit 1.pptx

The workflows for the ingest of digital objects into a repository/digital library

  • 1. The workflows for the ingest of digital objects into a repository/digital library Jenny Jing New York City July 14, 2016
  • 4. sample systems: Summon http://www.slideshare.net/ubclibrary/ubc-librarys-digital Archivematica Islandora ArchiveSpace • Receive Submission • Quality Assurance • Generate AIP • Generate Descriptive Information • Coordinate Updates DSpace Omeka DataVerse
  • 5. • Review current procedures • Review collections: - Analog :Type of carrier, Condition of the media, etc. - Born digital: File format, software, • Define use cases • Analyze existing functionality, tools and workflow • Identify development needs, functional requirements • Identify, recommend the tools/software to use 1. Needs & requirements – Ingest
  • 6. 2. Standards: Preservation & metadata Trusted Digital Repositories: (TDR) Attributes and Responsibilities 1. Administrative Responsibility 2. Organization Viability 3. Financial Sustainability 4. Technological & Procedural Suitability 5. System Security 6. Procedural Accountability Open Archival Information System (OAIS): Reference Tool Archivematica , Archivest’s Toolkit DAM/Islandora,
  • 7. OAIS: Ingest process Working With OAIS- Digital Preservation Management Workshop 1 2 3 4 5 6 7 4
  • 8. 3. Batch processing: things to consider Analog files: standards, processes, equipment, and storage for media records. Image: File format, size, large datasets Technology: Software (BitCurator, Archivematcia, ArchiveSpace), Storage hardware Staffing: who Metadata: PREMIS, METS (born-digital, copyrights) • SIP Creation and PREMIS Rights • Metadata is service driven • Generated/extracted (automated) vs. human • Where in workflows create metadata • What form(s)
  • 9. 4. Quality Control: • Staff/Who is doing what • Sampling the content • Standards, check list • Assurance Activities • Tool/software
  • 10. Ingest Workflow : IR - Dspace @ Queen’s University Rosarie Coughlan, Scholarly Publishing Librarian, Queen’s University Library
  • 11. Ingest Workflow - Sample using Archivematica http://www.slideshare.net/mikeum/shallcross-mmdp-a220150327final
  • 12. Ingest Workflow : RDM-DataVerse
  • 13. Acknowledges • Rachel Wise, Archivist, Knowledge & Library Services, Harvard Business School • Kelli Babcock, Digital Initiatives Librarian, Information Technology Services, University of Toronto Libraries • Bronwen Sprout, Head, Digital Programs and Services Digital Initiatives, Irving K. Barber Learning Centre, University of British Columbia
  • 14. Resources/References • ArchivesSpace-Archivematica-Dspace Workflow Integration • http://www.slideshare.net/mikeum/shallcross-mmdp-a220150327final • UBC Library's Digital Preservation Strategy • http://www.slideshare.net/ubclibrary/ubc-librarys-digital • Digital POWRR • http://digitalpowrr.niu.edu/tool-grid/ • UBC's Implementation of IR/DAM • http://www.unesco.org/new/fileadmin/MULTIMEDIA/HQ/CI/CI/pdf/mow/VC_Sprout_Romkey_2 6_B_1540.pdf • Review of Available Open Source DAM Software • http://www.opensourcedigitalassetmanagement.org/reviews/available-open-source-dam/ • Curating the Analog, Curating the Digital - Archive Journal

Editor's Notes

  • #3: Digital curation establishes, maintains and adds value to repositories of digital data for present and future use. It enhances the long-term value of existing data by making it available for further research. Born digital : resources are items created and managed in digital form. considerations take on added dimensions: • Versions: should unintentionally retained drafts be kept? • Privacy: should deleted files be recovered? • Rights Licensing: does the original license transfer when software is “inherited”? • Access
  • #5: Scope: to create a project workflow for the ingest of a combination of analog and born digital archival collection into a digital library The ingest process for born digital is new at libraries. A lot of it has to do with departmental priorities and there is a lack of sufficient storage for such materials. Ingest functions: 1
  • #6: In our case: Collections: analog and born digital archival collection Use case and development Needs: batch processing of digital images and metadata, and apply standards, identify staffing, and apply quality control. Collect Requirements: Tools/Techniques: Interviews, focus groups, observations, etc. Based on the functional requirements, review the tools/software and identify the ones meets our requirements.
  • #7: Ingest: Archivematica Archival Storage (short term, long term): DAM, OCUL Cloud (Dark Archive) Data Management: Archivematica/DAM Administration: oversee the systems Access: AtoM Preservation Planning: Set up policies for the above processes Common Services: services required by IT system, such as application of security patches. Purpose of OAIS raise understanding, awareness, consensus • enable effective participation • describe and compare – architectures and operations – preservation strategies and techniques • understand digital info data models • guide growth of OAIS-related standards
  • #8: 1. We got this thing 2. Quality checking, is it good enough? Check list: metadata, shape, etc. You can do sampling if you are familiar with the content. 3. what the info we need to know about this object 4. go to data management. batch processing of digital images and metadata Collections: Analog and born digital archival collection
  • #9: When transferring analog sound file collections, a workflow should be established to outline the standards, processes, equipment, and storage for media records. When selecting the tools, we need to make sure The interface support batch processing. For example, PREMIS in METS Toolbox does not support it. PREMIS: Common data model for organizing/thinking about preservation metadata  Checklist for core metadata in a repository  Guidance for local implementations  Standard for exchanging IPs between repositories
  • #10: This process helps us determine if deliverables are being produced to an acceptable quality level and if the project processes used to manage and create the deliverables are effective and properly applied.   For both analog & born digital: Preserving metadata—managerial, technical, descriptive, structural, and administrative information embedded in the file and/or in a database that corresponds to the digital file. Evaluate current quality of your metadata • Weigh significance of metadata elements • Evaluate metadata form needs • Set priorities/steps for filling metadata gaps Implement a program to run checksums and other authentication methods to check the integrity of the file over time.(analog & born digital) archivematica provides a list of Micro-services Archivematica implements a micro-service approach to digital preservation.
  • #12: Archivematica: During ingest, digital objects are packaged into SIPs and run through several micro-services, including normalization, packaging into an AIP and generation of a DIP. If you would like to skip some of the default decision points or make preconfigured choices for your desired workflow, you can configure Archivematica to do so.