EUDAT Collaborative Data Infrastructure: Data Access and Re-use Service Area
Download as PPT, PDF1 like364 views
The document summarizes services provided by EUDAT, a collaborative data infrastructure funded by the European Union. It describes EUDAT's B2ACCESS identity and access management service, which allows users to access EUDAT and other services using their existing credentials. It also summarizes EUDAT's B2FIND data discovery service, B2SHARE data sharing and preservation service, and B2DROP file sharing service. It outlines their key features and integration with each other. Future plans include further deployments, improved interoperability, and enhanced user experiences across EUDAT services.
EUDAT Collaborative Data Infrastructure: Data Access and Re-use Service Area
- 1. www.eudat.euEUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No. 654065 EUDAT Collaborative Data Infrastructure: Data Access and Re-use Service Area Chris Ariyo Service Area Manager, Data Access & Re-use, EUDAT CSC - IT Center for Science, Finland EUDAT Conference - Putting the EOSC vision into practice January 22nd - 25th, 2018, Porto, Portugal
- 2. Data Access & Re-use Services http://www.eudat.eu/services
- 3. Who Anyone wanting to use the B2 Services What Complies with community ownerships and access rights, basis of trust Credential conversion approach (e.g. SAML, OpenID, X.509, Username/password) Identity provider for citizen scientists Why Use your own ID in federated environment Stable/Production release of B2ACCESS, current version 1.9.6 Add support for personal certificates to support eduGAIN, Social Identities (Facebook, Google, Microsoft, Gitlab), ORCID and local accounts IdP support for SAML, OpenID, OAuth2, X.509 SP support for SAML, OIDC, OAuth2, X.509 Integrated services: B2SHARE, B2SAFE, B2STAGE, B2DROP, B2NOTE, GEF, SPMT, DPMT, Confluence wiki, Gitlab, Pilot IdP integration with ELIXIR, PRACE, EGI Pilot integration with RCAuth CA EOSCpilot joint proposal for the Life Sciences with EGI and GEANT AARC pilot integration with GEANT eduTEAMS EUDAT2020
- 4. Identity and service provider integrations Now integrated with all B2 services (B2DROP, B2NOTE, B2STAGE HTTP API, GEF) requiring authentication as well with various internal systems (Data Project Management Tool (DPMT), Service Portfolio Management Tool (SPMT), Confluence wiki, Gitlab) Integrated with the ORCID identity provider in addition to the existing identity providers
- 5. Infrastructure interoperability PRACE Synchronization of user's in the PRACE LDAP to B2ACCESS Provisioning of user accounts in B2SAFE upon first authentication Current approach with daily synchronization of user accounts no longer needed Demonstrated at this conference
- 6. Infrastructure interoperability Qualified generic Identity Sources Ls specific hostel LS service providers EGI services EUDAT services B2ACCESSCheckin SAML OIDC LSAAIproxygateway TTS UserRegistration Attribute Authority EGI Both infrastructures have configured each others Identity Provider B2ACCESS integrated with RCAuth CA Working together with EGI and Gé ant, to offer a LifeScience AAI solution
- 7. Future Developments Further deployment and operation of LifeScience AAI solution, in collaboration with EGI and GEANT Distributed authorization solution Harmonization of user and community information across AAI infrastructures This includes continuing the work on a fine grained level of assurance approach1 1 https://b2share.eudat.eu/records/20c1c0c8ba254e768fbcb67724918936
- 8. 3 Major releases, ownCloud v9 and Nextcloud v11, v12 Integration with B2SHARE via B2SHARE bridge app 2 Releases of the B2SHARE bridge app To publish data stored in B2DROP to B2SHARE multi file upload and selection of community domain Integration with B2ACCESS Who Citizens Scientists and small teams What Store and exchange data Synchronize multiple versions Ensure automatic desktop synchronization Why Ease of Use Trusted European Service EUDAT2020
- 9. Change of the core technology from OwnCloud to NextCloud B2ACCESS Integration B2DROP uses B2ACCESS for user management Sign in with B2ACCESS button B2SHARE bridge Select deposit title Upload multiple files to one deposit Select your community for metadata schema Major Development and Improvement
- 10. User Interface - File List
- 11. User Interface – Community Selection
- 12. Store the API token from B2SHARE at personal page List all deposits View their status Go to deposit by ”Deposit URL“ User Interface – Deposit & Personal Settings
- 13. Future Developments Further development of B2SHARE bridge Account movement from local B2DROP accounts to B2ACCESS accounts Extension of features and usability
- 14. Total 12 releases, 1 major release, current release 2.3.2 Release B2FIND metadata schema, based on DataCite v3.0 and OpenAIRE guidelines Filter by Time (CKAN extension) Optimized workflow for harvesting and metadata ingest Extend harvesting methods to JSON-API and CSW 19 (+6) Repositories harvested + 6 enabling + 12 planned Pilot integration with B2NOTE Who Anyone What Find collections of scientific data quickly and easily, irrespective of their origin, discipline or community Get quick overviews of available data Browse through collections using standardized facets Why Unique collection Ease of Searching EUDAT2020
- 15. A FAIR and interdisciplinary data catalogue B2FIND is the discovery service of EUDAT, based on an interdisciplinary metadata catalogue of research data collections stored in EUDAT data centres and other repositories and covering a wide range of research domains FAIR principles derived the development of B2FIND : Findability Discovery Portal with powerful facetted search over a common and unified search space Accessibility Persistent Identifiers for unique resolvability of data objects Interoperability Interdisciplinary and cross-domain catalogue based on Common Standards, Vocabs and Schema Reuseability Provenance and Domain relevant Information, as access Rights and Disciplines , is provided
- 16. Metadata publishing in B2FIND follows a low barrier approach and only a few preconditions are required on data provider site : MD provider API (e.g. OAI-PMH) Specification of MD using standardised formats and schemas (e.g. DataCite and OpenAIRE) And is implemented by a modular workflow : Harvesting of MD from EUDAT and external sources Semantic Mapping onto common and unified B2FIND schema Uploading and indexing in the discovery portal B2FIND Ingestion Workflow Data Provider : Community and Domain Specific Schema B2FIND: Unified and Common Schema 1.MD Generation 2.b MD Harvesting 3. MD Mapping and Validation 4. MD Uploading and Indexer 2.a MD Repository and Provider
- 17. Ingestion status
- 18. Faceted Search and Data Access B2FIND provides ‘faceted’ search for • Free text • Geo spatial • Temporal coverage • Publication year • Textual facets as • Tags • Creator • Discipline etc.
- 19. Faceted Search and Data Access Dataset view provides display of metadata : • Spatial extent • Table of field-value pairs • Links to data resources
- 20. established an operative service based on agreed standards and guidelines as the FAIR principles, provides a discovery portal with powerful search functionalities and is based on a unique catalogue of research data , combining many heterogeneous and cross- discipline sources achieved improved interoperability by homogenisation to a common metadata schema follows a low barrier approach for data providers to expose metadata to B2FIND Main achievements
- 21. B2FIND is intended to be the central discovery service of the EOSC-hub Adding additional harvest and search channels Extend coverage by integration of further scientific domains Advanced support of data providers and further automation of the ingestion Improve user experience, performance and scalability Enhance search functionalities and semantic mapping Use the potential of the semantic web, for example by integration of B2NOTE and using Linked Data Future Developments
- 22. Total 27 releases, 1 Major release B2SHARE v2, 13 RC for B2SHARE v2 Current release v2.1.0 B2SHARE v2 based on Invenio v3 Support for DOI’s and PIDs on object level Support for object checksums and verification Support for object statistics Support for Handle v8 HTTP API and B2HANDLE library Improved installation and upgrade procedures via Docker Flexible metadata model via JSON schema’s for community domains Authorization to community domains Record lifecycle and versioning Integration with B2ACCESS, B2DROP and B2NOTE Who Small to Medium Teams What Store data (incl. software) and add domain meta data Share registered research data worldwide Preserve (small-scale) research data for long-term Why Register Data for Publications Make known to wider community EUDAT2020
- 23. Users, communities, and records Supports user communities, with specific metadata fields Users can be community members, administrators, or unaffiliated Records containing data files and associated metadata can be published for each community
- 24. Interfaces and integrations Interfaces: web user interface for common users HTTP API for programmatic access, OAI-PMH for search engines Integrated with B2FIND, B2ACCESS, B2DROP, B2NOTE, B2HANDLE, … and B2SAFE(prototype)
- 25. History and achievements Redesigned the deployment procedure to facilitate and simplify local site installations based on Docker, integrating postgres, elasticsearch, rabbitmq, redis and nginx Moved from an unstable prototype, based on Invenio v2, to a clean and tested product based on Invenio v3 Production site upgrade in Dec 2016 (v2-RC13) v2.0.0 in Feb’17; v2.0.1 in Apr’17; v2.1.0 in Dec’17
- 26. Last major release: 2.1.0 Record versioning: new versions of records can be created, with updated data objects Automatic database migration allowing a trivial upgrade procedure File download statistics Automatic data integrity verification Good uptake from community sites on running B2SHARE instances
- 27. B2SAFE integration Release candidate available now Stable version to land in v2.1.1: Feb 2017 One of the services in EOSC-hub More enhancements, features and bug fixes! Future Developments
- 28. Co-ordinator Willem Elbers (CLARIN) Members Sander Apweiler(FZJ) Michal Jankowski (PSNC) Nicolas Liampotis (GRNET) Jens Jensen (STFC) Shiraz Memon (FZJ) Uros Stevanovic (KIT) Markus Hardt (KIT) Arsen Hayrapetyan (former) Co-ordinator Sander Apweiler (Juelich) Benedikt von St. Vieth (former) Members Thijs Cobben (SurfSara) Mikael Karlsson (CSC) Co-ordinator Emanuel Dima (EKUT) Members Sarah Berenji Ardestani (KTH) Thijs Cobben (SurfSara) Nicolas Harraudeau (CERN) Dinos Kousidis (CERN) Kristian Niininen (CSC) Hans van Piggelen (SurfSara) Co-ordinator Heinrich Widmann (DKRZ) Hannes Thiemann (former) Members Claudia Martens (DKRZ) Mikael Karlsson (CSC) Juha Hakalan (NFL) Michael Kurtz (DKRZ) Yann Le Franc (e-SDF) Juho Lehtonen (CSC) Co-ordinator Toni Cortes (BSC) Members Alberto Miranda (BSC) Carl Johan Hå kansson (former
- 29. Contact information: Chris Ariyo Chris.Ariyo@csc.fi Service Area Manager, Data Access & Re-use CSC - IT Center for Science, Finland https://b2(service).eudat.eu/ http://www.eudat.eu/support-request