Developing Goobi: An Open-Source Workflow Tracking Tool for Digitization Projects
2 likes2,220 views
The document outlines an open-source workflow tracking tool for digitization projects, highlighting the current challenges in project management and data handling. It presents a structured approach to improve efficiency through automation, transparency, and user coordination by breaking down workflows into manageable steps and utilizing templates. Future development aims to broaden the tool's features and extend its application to more institutions while maintaining a user-centric design.
![Free. Open Source. Production proven.
4
Steffen Hankiewicz, intranda GmbH21.04.2016
‣ Based on 17 years
experience in
digi8za8on
‣ Coordina8on of users,
projects, import,
exports
‣ Overview, metadata,
valida8on, management
‣ Easy to use
‣ Enforce quality
‣ Avoid errors
Workflow so]ware for digitisa8on projects as central
produc8on environment](https://image.slidesharecdn.com/goobiinwashington-160422141351/85/Developing-Goobi-An-Open-Source-Workflow-Tracking-Tool-for-Digitization-Projects-8-320.jpg){kind=tracking}
![Part 2 - Use workflow templates
8
Steffen Hankiewicz, intranda GmbH21.04.2016
Input / Import
Scanning
Output / Export
QA
Image processing
Metadata indexing
OCR
Update catalogue
Decide one workflow for a whole project:
‣ Involved user groups
‣ Involved workflow steps
‣ Automa8c steps & manual tasks
‣ Import, export, order
Input / Import
Scanning
Output / Export
QA
Image processing
Metadata indexing
OCR
Update catalogue
Input / Import
Scanning
Output / Export
QA
Image processing
Metadata indexing
OCR
Update catalogue
Input / Import
Scanning
Output / Export
QA
Image processing
Metadata indexing
OCR
Update catalogue
Input / Import
Scanning
Output / Export
QA
Image processing
Metadata indexing
OCR
Update catalogue
Input / Import
Scanning
Output / Export
QA
Image processing
Metadata indexing
OCR
Update catalogue
Input / Import
Scanning
Output / Export
QA
Image processing
Metadata indexing
OCR
Update catalogue
Input / Import
Scanning
Output / Export
QA
Image processing
Metadata indexing
OCR
Update catalogue
Input / Import
Scanning
Output / Export
QA
Image processing
Metadata indexing
OCR
Update catalogue
Duplicate workflow template for each object:
‣ as o]en as needed
‣ Each object has it own progress
‣ All objects of that workflow
are handled iden8cal](https://image.slidesharecdn.com/goobiinwashington-160422141351/85/Developing-Goobi-An-Open-Source-Workflow-Tracking-Tool-for-Digitization-Projects-14-320.jpg){kind=tracking}
![Lessons learned
Write Documenta8on for the users
Implement as much plugins as possible
Never remove exis8ng func8onality
Use the so]ware for yourself
Bring the users together
Much more …
16
Steffen Hankiewicz, intranda GmbH21.04.2016](https://image.slidesharecdn.com/goobiinwashington-160422141351/85/Developing-Goobi-An-Open-Source-Workflow-Tracking-Tool-for-Digitization-Projects-24-320.jpg){kind=tracking}
Developing Goobi: An Open-Source Workflow Tracking Tool for Digitization Projects
- 2. Ever heard about these problems? ‣ Known objec8ves ‣ Exis8ng experience ‣ Current way not perfect 2 Steffen Hankiewicz, intranda GmbH21.04.2016 Projects & Workflows Staff members and places Data sources and objec8ves Materials and data formats Scan hardware Errors and correc8ons Situa8on
- 3. Ever heard about these problems? ‣ Known objec8ves ‣ Exis8ng experience ‣ Current way not perfect 2 Steffen Hankiewicz, intranda GmbH21.04.2016 Projects & Workflows Staff members and places Data sources and objec8ves Materials and data formats Scan hardware Errors and correc8ons Efficient work Automa8on Progress overview Transparent responsibili8es QA Sta8s8cs and repor8ng Situa8on Wishlist
- 4. Ever heard about these problems? ‣ Known objec8ves ‣ Exis8ng experience ‣ Current way not perfect 2 Steffen Hankiewicz, intranda GmbH21.04.2016 Projects & Workflows Staff members and places Data sources and objec8ves Materials and data formats Scan hardware Errors and correc8ons Efficient work Automa8on Progress overview Transparent responsibili8es QA Sta8s8cs and repor8ng Data management Integrate exis8ng tools Integrate into infrastructure Scalability Flexible and configurable Intui8veness and usability Situa8on Wishlist Addi8onals
- 5. Ever heard about these problems? ‣ Known objec8ves ‣ Exis8ng experience ‣ Current way not perfect 2 Steffen Hankiewicz, intranda GmbH21.04.2016 Projects & Workflows Staff members and places Data sources and objec8ves Materials and data formats Scan hardware Errors and correc8ons Efficient work Automa8on Progress overview Transparent responsibili8es QA Sta8s8cs and repor8ng Data management Integrate exis8ng tools Integrate into infrastructure Scalability Flexible and configurable Intui8veness and usability Situa8on Wishlist Addi8onals ∞
- 8. Free. Open Source. Production proven. 4 Steffen Hankiewicz, intranda GmbH21.04.2016 ‣ Based on 17 years experience in digi8za8on ‣ Coordina8on of users, projects, import, exports ‣ Overview, metadata, valida8on, management ‣ Easy to use ‣ Enforce quality ‣ Avoid errors Workflow so]ware for digitisa8on projects as central produc8on environment
- 9. Part 1 - Split workflow into steps 5 Steffen Hankiewicz, intranda GmbH21.04.2016 Input / Import Output / Export Data coming in from somewhere else Workflow The data is changed: ‣ create digital version ‣ manipulate digital version ‣ enrich metadata ‣ do manual work ‣ let automa8c tools do the work ‣ specific work depends on previous work Data delivered out to other system
- 10. Part 1 - Split workflow into steps 6 Steffen Hankiewicz, intranda GmbH21.04.2016 Input / Import Output / Export Data coming in from somewhere else Data delivered out to other system Workflow steps: ‣ steps have a specific order ‣ steps can be manual or automa8c ‣ steps can call other tools, scripts etc. ‣ dependent on workflow and project steps can be different ‣ valida8on avoid errors ‣ workflow steps are executed as tasks ‣ persons have a personal task list (a.k.a. ToDo) Scanning Workflow step 1 QA Workflow step 2 Image processing Workflow step 3 Metadata indexing Workflow step 4 OCR Workflow step 5 Update catalogue Workflow step 6
- 13. Part 2 - Use workflow templates 8 Steffen Hankiewicz, intranda GmbH21.04.2016 Input / Import Scanning Output / Export QA Image processing Metadata indexing OCR Update catalogue Decide one workflow for a whole project: ‣ Involved user groups ‣ Involved workflow steps ‣ Automa8c steps & manual tasks ‣ Import, export, order
- 14. Part 2 - Use workflow templates 8 Steffen Hankiewicz, intranda GmbH21.04.2016 Input / Import Scanning Output / Export QA Image processing Metadata indexing OCR Update catalogue Decide one workflow for a whole project: ‣ Involved user groups ‣ Involved workflow steps ‣ Automa8c steps & manual tasks ‣ Import, export, order Input / Import Scanning Output / Export QA Image processing Metadata indexing OCR Update catalogue Input / Import Scanning Output / Export QA Image processing Metadata indexing OCR Update catalogue Input / Import Scanning Output / Export QA Image processing Metadata indexing OCR Update catalogue Input / Import Scanning Output / Export QA Image processing Metadata indexing OCR Update catalogue Input / Import Scanning Output / Export QA Image processing Metadata indexing OCR Update catalogue Input / Import Scanning Output / Export QA Image processing Metadata indexing OCR Update catalogue Input / Import Scanning Output / Export QA Image processing Metadata indexing OCR Update catalogue Input / Import Scanning Output / Export QA Image processing Metadata indexing OCR Update catalogue Duplicate workflow template for each object: ‣ as o]en as needed ‣ Each object has it own progress ‣ All objects of that workflow are handled iden8cal
- 17. Steffen Hankiewicz, intranda GmbH Result of this development work ‣ Easy and efficient func8oning for the user ‣ Enforced homogeneity ‣ Overview and quality assurance for project management ‣ Central data management with ligle maintenance 11 21.04.2016
- 21. Individual workflow require plugins 13 Steffen Hankiewicz, intranda GmbH21.04.2016 Input / Import Output / Export Scanning QA Image processing Metadata indexing OCR Update catalogue Import Plugin Shell-Scripts Step-Plugin with GUI Export-Plugin Validation-Plugin Web-API Step-Plugin without GUI
- 25. What’s next? 17 Steffen Hankiewicz, intranda GmbH21.04.2016 ‣ Move on the development ‣ Extend focus to more ins8tu8ons ‣ Extend OLR, NER and seman8c analysis ‣ A lot more …
- 26. ‣ Download Goobi to go & run auto installer hgp://www.intranda.com/goobi-to-go/ ‣ Read the manual hgp://www.intranda.com/digiverso/documenta8on/ ‣ Checkout the plugins hgp://www.goobi-marketplace.com What’s next? 17 Steffen Hankiewicz, intranda GmbH21.04.2016 ‣ Move on the development ‣ Extend focus to more ins8tu8ons ‣ Extend OLR, NER and seman8c analysis ‣ A lot more …