Cbsdl 2015 koch_wg_v01
0 likes185 views
The document outlines the Locloud project, a cloud-based initiative funded by the European Commission to assist small and medium-sized institutions in making their content accessible to Europeana. It details the implementation of core infrastructure components, micro-services, and the development of a collaborative cloud-based test lab to enhance metadata and content discoverability. Key elements include the use of established vocabularies, business intelligence tools, and digital curation practices to improve data management and analysis.
![2015‐09‐17 Gerda & Walter Koch (AIT) 9
Microservice
Wikipedia: https://en.wikipedia.org/wiki/Microservices (2015‐09‐15)
[...] microservices is a
• software architecture style in which
• complex applications are composed
of small, independent processes
• communicating with each other using language‐
agnostic APIs.
• These services are small, highly decoupled and
focus on doing a small task,facilitating a modular
approach to system‐building.](https://image.slidesharecdn.com/cbsdl2015kochwgv01-160208220256/85/Cbsdl-2015-koch_wg_v01-9-320.jpg)
Cbsdl 2015 koch_wg_v01
- 2. 2015‐09‐17 Gerda & Walter Koch (AIT) 2 locoud.eu About: – LoCloud is a Best Practice Network co‐funded under the CIP ICT‐PSP programme of the European Commission. – LoCloud is supporting small and medium‐sized institutions in making their content and metadata available to Europeana. – A cloud‐based technology infrastructure will enable the aggregation of local content, and – a number of micro‐services will help to reduce technical, semantic and skills barriers and to render the content more discoverable and interoperable.
- 3. 2015‐09‐17 Gerda & Walter Koch (AIT) 3 Relevant Work Packages Specify, modify, test, implement core infrastructure components: MINT, MoRe, Lightweight digital library – all build on existing work Specify, modify, test, implement core infrastructure components: MINT, MoRe, Lightweight digital library – all build on existing work WP 2WP 2 Design and implementation of aggregation Design and implementation of aggregation infrastructure Collaborative cloud‐based testlab, involving partners and users; develop and implement a suite of SaaS: geolocation enrichment; metadata enrichment; multilingual vocabularies; historic place‐names; Wikimedia and crowdsourcing Collaborative cloud‐based testlab, involving partners and users; develop and implement a suite of SaaS: geolocation enrichment; metadata enrichment; multilingual vocabularies; historic place‐names; Wikimedia and crowdsourcing WP 3WP 3 Micro servicesMicro services for small and medium institutions
- 5. 2015‐09‐17 Gerda & Walter Koch (AIT) 5 Reference Model Micro-services (Vocabulary,...) Operating Environment (Linux, Windows, MAC) Virtual Engines (KVM, XEN, VMDK, ...) Micro-services (Vocabulary,...) Outcome / Value Process / Procedure
- 6. 2015‐09‐17 Gerda & Walter Koch (AIT) 6 Testlab Implementation (opennebula.org) Private Cloud Private Cloud Public Cloud
- 7. 2015‐09‐17 Gerda & Walter Koch (AIT) 7 OpenNebula ‐ Frontend http://test186.ait.co.at Vocabulary WebServices
- 9. 2015‐09‐17 Gerda & Walter Koch (AIT) 9 Microservice Wikipedia: https://en.wikipedia.org/wiki/Microservices (2015‐09‐15) [...] microservices is a • software architecture style in which • complex applications are composed of small, independent processes • communicating with each other using language‐ agnostic APIs. • These services are small, highly decoupled and focus on doing a small task,facilitating a modular approach to system‐building.
- 10. 2015‐09‐17 Gerda & Walter Koch (AIT) 10 http://vocabulary.locloud.eu/ • Vocabulary Microservices • This is the entry page for the LoCloud vocabulary application. • LoCloud uses a variety of standard vocabularies during the metadata enrichment process. These vocabularies have been established with the TemaTres tool and are available in the LoCloud cloud testlab. • In addition, it is possible to feed the tool with your own vocabularies, establish new vocabularies or add languages to existing vocabularies.
- 11. 2015‐09‐17 Gerda & Walter Koch (AIT) 11 Vocabulary WebService 20+ Functions, API Parameters Example
- 13. 2015‐09‐17 Gerda & Walter Koch (AIT) 13 SPARQL‐Example DISMARC‐Genres • Query: "Find all Broader Term for 'Acid Jazz‘“ • SPARQL End Point: http://test113.ait.co.at/tematres/vocab/sparql.php Query Result Thesaurus Entry
- 14. 2015‐09‐17 Gerda & Walter Koch (AIT) 14 Service Call („fetchTopTerms“) embedded in a test application Micro- Service Vocabulary Web Service
- 15. 2015‐09‐17 Gerda & Walter Koch (AIT) 15 Test Application Development Designer View Development of a Drop Down List Development of a Drop Down List
- 16. 2015‐09‐17 Gerda & Walter Koch (AIT) 16 The Test Application: Part of Data Entry Path to the Thesaurus Item „Candidate Term“ Crowdsourcing activity Next Slide (Vocabulary Management)
- 17. 2015‐09‐17 Gerda & Walter Koch (AIT) 17 Vocabulary Management BPMN ‐ Diagramme „Candidate Term“ Crowdsrc. Activity Candidate New Item
- 19. 2015‐09‐17 Gerda & Walter Koch (AIT) 19 Business Intelligence Wikipedia: https://en.wikipedia.org/wiki/Business_intelligence (2015‐09‐15) • Business intelligence (BI) is the set of techniques and tools for the transformation of raw data into meaningful and useful information for business analysis purposes. • From Business Analysis to Cultural Analytics https://en.wikipedia.org/wiki/Cultural_analytics (2015‐09‐15) • One Tool: ETL – „Extract Transform – Load“ https://en.wikipedia.org/wiki/Extract,_transform,_load (2015‐09‐15) • Example: Pentaho – Data Integration („Kettle“) http://www.pentaho.com/product/data‐integration
- 20. 2015‐09‐17 Gerda & Walter Koch (AIT) 20 OpenUp! ‐ Natural History Aggregator for Europeana Micro Service: Common Name Service Micro Service: Common Name Service
- 22. 2015‐09‐17 Gerda & Walter Koch (AIT) 22 OpenUp! Transformation Workflow Invoke Micro Service: Common Name Service
- 23. 2015‐09‐17 Gerda & Walter Koch (AIT) 23 OpenUp! Transformation Parameters Micro Service: Common Name Service Service End Point (Cache)
- 24. 2015‐09‐17 Gerda & Walter Koch (AIT) 24 Result: OpenUp! Enriched Meta Data Set Latin Name Common Names
- 25. 2015‐09‐17 Gerda & Walter Koch (AIT) 25 Pentaho‐PDI Selected Tools ... and many more !
- 27. 2015‐09‐17 Gerda & Walter Koch (AIT) 27 Digital Curation State‐of‐the‐Art Examples (2010) • Archivematica – Linux VM based toolset allows producers and archivists to implement a small scale workflow • UC3 / CDL Merritt – Micro‐Services specifications – implement building blocks for the Digital Curation Lifecycle
- 29. 2015‐09‐17 Gerda & Walter Koch (AIT) 29 California Digital Library UC3 Merritt • California Digital Library UC Curation Center • Independant, Interoperable Micro‐Services • Complex curation function through combination of atomistic services Knowledge Enhancement Annotation
- 30. 2015‐09‐17 Gerda & Walter Koch (AIT) 30 Micro‐Services (Merritt vs. Archivematica) CDL/UC3-MERRITT ARCHIVEMATICA
- 31. 2015‐09‐17 Gerda & Walter Koch (AIT) 31 High‐Level Workflow • OAIS activities provide a sound basis • Archivematica Use Cases • Merritt specifications • Micro‐Services are the building blocks
- 32. 2015‐09‐17 Gerda & Walter Koch (AIT) 32 CDL Curation Micro Services 1) „An Emergent Micro‐Services Approach to Digital Curation Infrastructure“, IPRES 2009 https://escholarship.org/uc/item/5313h6k9 2) UC Curation Center / California Digital Library, merritt: An Emergent Micro‐services Approach to Digital Curation Infrastructure; Rev. 0.6, 2010‐03‐25 1) Annotation service 2) The Annotation service provides a mechanism by which the consumers of managed digital content can enrich that content through additional description, association, or related content. The service supports the following methods: • Annotate • Submit.