Introduction to LoCloud
Download as PPTX, PDF0 likes207 views
The International TAG CLOUD Project workshop introduced services and infrastructure developed by the LoCloud project to help smaller cultural heritage institutions publish their content online and share it with Europeana. Key developments included MINT and MORe for metadata mapping and aggregation, microservices for enrichment like geocoding and linking, and LoCloud Collections for online publishing. Training and support resources were also provided to help institutions participate. The goal of the project was to create technical solutions using cloud computing suitable for smaller organizations to make their content more accessible.
Introduction to LoCloud
- 1. International TAG CLOUD Project Workshop Digital Heritage, 29 September, 2015 Granada, Spain Intro to Holly Wright Archaeology Data Service University of York, UK LoCloud Video
- 2. • Best practice network funded by the EU under the CIP ICT PSP programme • 1st March 2013 to 29th February 2016 • 33 partners in 26 countries • Scientific coordinator: National Archives, Norway • Project management: 2Culture Associates, UK • Strong group of technical partners • National and regional aggregation services, and individual content providers http://www.locloud.eu International TAG CLOUD Project
- 3. Main goals • Was developed based on the findings of EuropeanaLocal and CARARE • Supporting small and medium-sized institutions in making their content available to Europeana • Creating technical solutions suitable for smaller institutions • Exploring the potential of cloud-computing technologies • Creating a variety of metadata enrichment services • Providing support, guidance and training International TAG CLOUD Project
- 4. Innovating the aggregation infrastructure and exploring the potential of the cloud: • MINT o Mapping tool with support for multiple metadata schemas • MORe aggregator framework o Storage layer with decentralized and scaleable components o Pluggable services for metadata validation and enrichment o User-friendly interface for data providers • Crawler ready tagging tools Core Infrastructure International TAG CLOUD Project
- 5. MINT Mapping Tool • Allows users to map native XML or CSV metadata to one of the Intermediate schemas supported by LoCloud: LIDO, CARARE, EDM. • Enables content providers to prepare their metadata for publication • Integrated with MORe International TAG CLOUD Project
- 6. • Aggregation framework – Based on Fedora Commons and Apache Cassandra – Storage layer with decentralized and scaleable components – Pluggable components – Developers area provides REST API and virtual enrichment drivers • Cloud-based IaaS MORe http://store.locloud.eu International TAG CLOUD Project
- 7. MORe • User-friendly interface allows data providers to select data sources, manage ingestion, validation, enrichment and publication of their metadata • Automatic creation of data sources in MINT and LoCloud Collections
- 8. http://support.locloud.eu/ Cloud-based micro-services for metadata enrichment and capture: • Geo-location API • Vocabulary service • Historic Place Names service • Geo-coding application • Vocabulary matching service • Background linking service • Wikimedia application Microservices International TAG CLOUD Project
- 9. Microservices • Six development teams: AIT, Athena RC, AVINET, IPCHS, UPV/EHU, VUKFC • All the services are implemented on virtual machines in a cloud testlab (using the OpenNebula cloud computing platform) • API documentation is available for each service • End-user interfaces are provided for three microservices • Each service has been integrated in MORe International TAG CLOUD Project
- 10. LoGeo API • Uses NER-Name Entity Recognition • Recognizes and returns one or more place names candidates accompanied by geographical coordinates. International TAG CLOUD Project
- 11. Geo-coding microservice • End-user oriented application • allows institutions to add geographical locations to existing content in a controlled crowd-sourcing environment and then • load the augmented data back into their original production databases. International TAG CLOUD Project
- 12. • A semi-automatic historical geo- information management function and web service. • Enables local cultural institutions to collaborate in developing the Thesaurus of HPN and enriching ingested metadata. • Enables export of selected LoCloud HPN Thesaurus data sets. Historic Place Names Service International TAG CLOUD Project
- 13. Vocabulary services • Based in TemaTres • Incorporates 29 standard thesauri • allows users to add and create vocabularies, and add terms or translations • add thesauri terms to all items of a metadata package • Integrated in MORE • Exploited by the LoCloud vocabulary matching microservice via its API International TAG CLOUD Project
- 14. Vocabulary matching • Builds on work in the PATHS project (FP7) • Automatically assigns relevant concepts and terms to item records • Retrieves terms from the Vocabulary service International TAG CLOUD Project
- 15. Background linking microservice • Based on work in PATHS • Follows the Named Entity Disambiguation approach • Enriches items with links to external contextual information in DBpedia and Wikipedia International TAG CLOUD Project
- 16. • A web service that uses a REST interface to communicate with Wikimedia commons • The main functionalities are harvesting content form Wikimedia, parsing the harvested content, and identifying useful entities that can be mapped to the ESE or EDM metadata schemas. • The mapped ESE / EDM records are then sent to MORe to be delivered to Europeana. Wikimedia Application International TAG CLOUD Project
- 17. Integration International TAG CLOUD Project
- 18. • Developed by PSNC • Based on the open source Omeka system • Allows users to publish digital objects on-line in a few minutes • Developed and tested in 2014, now available in production • Scalable, user friendly, with OAI-PMH interface • Storage of metadata and content • Incorporates web traffic analytics • Cloud-based SaaS LoCloud Collections https://locloudhosting.net/ International TAG CLOUD Project
- 19. Example
- 20. • LoCloud support portal incorporates – user and technical documentation – eLearning materials – Question-and-Answer service – Access to a ticket desk system http://support.locloud.eu International TAG CLOUD Project
- 21. Summary • LoCloud has developed services and aggregation infrastructure in the cloud • These new services are being used to publish content online from smaller data providers and to supply it to Europeana • Support, guidance and training has been put in place • Current focus is on operational and strategic planning International TAG CLOUD Project
- 22. Thank you! holly.wright@york.ac.uk International TAG CLOUD Project Please join us for Sharing Cultural Heritage Online with LoCloud Thursday, 1 October 10.00-13.30