CORE APIv3
- 1. CORE APIv3: Seamless machine access to open access metadata and full texts from across the global repositories and publishers network Matteo Cancellieri, Valerii Budko, Samuel Pearce, Petr Knoth Knowledge Media institute, The Open University CORE - https://core.ac.uk API - https://core.ac.uk/services/api Twitter - @oacore
- 2. • What can you do with the CORE API? • Lessons learned from v2 and new features in v3 Outline
- 3. In doing so, we: ● enrich scholarly data using state-of-the-art text and data mining technologies to aid discoverability, ● enable others to develop new tools and use cases on top of the CORE platform, ● support the network of open access repositories and journals with innovative technical, solutions and, ● facilitate a scalable, cost-effective route for the delivery of open scholarship. CORE’s mission CORE’s mission is to aggregate all open access research worldwide and deliver unrestricted access for all.
- 4. CORE services Content discovery Raw data services Managing content Discovery Recommender API Dataset FastSync Repository Dashboard Repository Edition Search
- 5. Free to read links to full text papers ~97 million Data providers 10,372 Full texts hosted directly by CORE 28,468,748 Languages > 90 Countries 190 Metadata records 218,808,331 > 30M monthly active users
- 6. Recent success stories using the CORE API - Plagiarism detection - Open Access papers discovery - Fact checking - New approaches to research evaluation - Innovation engineering - Content translation - Trends detection - Rapid systematic reviews - Open Access Compliance Monitoring Find more success stories at: https://core.ac.uk/about/endorsements AND https://blog.core.ac.uk
- 7. ● New model abstraction to represent the scholarly world ● More coherent search queries ● Easier to access large datasets ● Improved analytical tools ● User management made easy ● Better documentation ● A gallery to kick start your journey with the API What's new
- 8. 🖋 Documentation in Swagger 🖋 PHP + Symfony implementation 🚀 Elasticsearch API clients •Java https://github.com/oacore/oacore4j •Python https://github.com/oacore/pyoacore •R https://github.com/ropensci/rcoreoa CORE API: where are we? > 3,000 registered users > 300 active API users (in the last two months )
- 9. Works A deduplicated and polished item, it is made with the best metadata we can use from multiple articles from different sources, it includes enrichments. Article (old name) /Output (new name) It is data coming directly from the data providers. It mostly comes from OAI-PMH but there also other different data providers. The data is uniform so all the different data providers lead to a single metadata format. Data provider It contains repositories (institutional and disciplinary), preprint servers, journals and publishers. Journal This dataset contains all journal titles included in the CORE collection. How CORE sees the world 1...n versions contains contains
- 10. Improved search queries + better sorting + better filtering
- 11. Large dataset access ▪ The API now support querying for medium size datasets (1,000-100,000 records) through the scroll parameter. ▪ For large datasets (>100,000), consider the CORE dataset
- 12. Better analytical tools Meaningful statistics for all the entities in CORE Search aggregations to help you explore the data
- 14. Great docs Easy to start with Examples Gallery Free to use Free to register
- 15. Easy to start with Documentation (https://api.core.ac.uk/docs/v3) Example from the quick start gallery
- 16. Examples Collaboration network for publications using the term covid in 2021
- 17. Most records using the terms “unprecedented times” 2018-2021 2018 2019 2020 2021 Examples
- 18. Roadmap APIv3 is in production Sunset period for APIv2 (in Q2 2022) Questions? https://bit.ly/core-apiv3
- 19. Feedback If you are using the API for research, please cite one of our research outputs https://core.ac.uk/about/research- outputs Show us how you are using the API Get in touch if you have questions. Questions? https://bit.ly/core-apiv3
- 20. Thank you!