Towards a network of usage statistic hubs on a global level
2 likes120 views
This document discusses OpenAIRE's role in developing a global network of usage statistics hubs. It describes OpenAIRE's infrastructure for collecting, linking, and reporting usage statistics from various sources. OpenAIRE uses the Matomo analytics platform to track usage and collects COUNTER-compliant reports through its SUSHI interface. Challenges include ensuring comparability of statistics across platforms and contexts. Next steps involve expanding plugin support, promoting the service, and linking publication and data usage statistics as part of developing responsible, contextualized metrics.
Towards a network of usage statistic hubs on a global level
- 1. @openaire_eu Towards a Network of Usage Statistics Hubs on a Global Level AndreasCzerniak,BielefeldUniversity DimitrisPierrakos,ATHENAResearchCenter JochenSchirrwagen,BielefeldUniversity AlternativeIndicatorsSummerSchool September2018
- 2. OpenAIRE infrastructure andUsageStatistics Service UsageStatssketch,Howitworks,TrackingWorkflow,ServiceFeatures. Metrics intheOpenAIRE Content ProviderDashboard OpenAIRE: ausage statistics HubforResponsible Metrics WhenandHowtoparticipate MainChallengesandLimitations,Nextsteps TOPICS
- 4. • A pan-European Research Information platform to monitor OA research outcomes from EC and other national funders. • Research analytics tools to promote new scientific metrics & support evidence-based decision-making. • Implementation of an OpenAIRE usage statistics service for usage data collected from data providers. OpenAIRE 2020
- 5. • Continues the mission of OpenAIRE aiming to be a trusted e- Infrastructure within the realms of the European Open Science Cloud. • Empowers National Open Access Desks (NOADs) so they become a pivotal part within their own national data infrastructures, positioning OA and open science onto national agendas. • Improves the OpenAIRE services: • optimizing their performance and scalability. • refining their functionality based on end-user feedback. • repackaging them into products, taking a professional marketing approach with well-defined KPIs. • consolidating the range of services/products into a common e-Infra catalogue to enable a wider uptake. • Consolidates OpenAIRE’s global role extending its collaborations with Latin America, US, Japan, Canada, and Africa. OpenAIRE-Advance
- 6. • Task covers: • aligning policies and standards for gathering and sharing of usage data -> guidelines • considering legal aspects (GDPR compliance) • relating usage statistics to other kinds of metrics • collecting and processing of usage data and producing consolidated, standards-based usage statistics • Task team: Athena Research Center, University of Bielefeld, University of Minho, Jisc IRUS-UK, Couperin + NOADs Usage Statistics in OpenAIRE-Advance
- 8. OpenAIRE’s e-infrastructure Commons & Usage Stats sketch Publications repositories Research Data repositories CRIS systems Registries (e.g. projects) OA Journals Software Repositories Validation Cleaning De-duplication Enrichment By inference CONTENT PROVIDERS INFO SPACE SERVICES Project initiative FunderFunding Result Publication Data Software Organization OpenAIRE USAGE STATISTICS SERVICE Linking Usage Event – Research Result Tracking / (Logging) Exposing / Reporting
- 9. UsageStatisticsServiceFeatures Tracking ofviewsand downloads /collecting COUNTERreports PushorPullcollectionworkflows. Anonymisation ofIP- addresses. Metadata de-duplication enables accumulation of viewsanddownloads for samedocuments COUNTERCodeofPractice compatibility. standardsbasedusagestatistics. enablescomparabilitywithstatistics fromotherdatasources. This is where you type in the event
- 10. • World's leading open-source analytics platform (formerly Piwik). • Valuable insights into website traffic and visitors activity. • Matomo collects and stores PII (personally identifiable information). • Keeps full data ownership and can control who has access. • Robot filtering plugin. • Compliant with EU regulations. • Recommended by privacy organizations such as ULD (Germany) and CNIL (France). Matomo Analytics platform
- 11. Matomo Facts Matomo Google Analytics Number of Hits per Month Unlimited 10 million Number of user accounts per login Unlimited 10 Data storage time Unlimited 25 months Number of properties (websites, apps etc.) tracked per account Unlimited 50 Custom Variables 5 5 Data Export Unlimited 5000 rows Real time Analytics Matomo offers real-time web analytics in all of its reports. GA monitors user activity right after it happens, although period of delay is not explicitly stated.
- 12. Parameter Description idSite the ID of the repository idVisit a visitor/session ID (an 8 byte binary string) visitIP (optionally anonymized) the IP address of the visitor action the action performed (view, download, outlink, etc) url the url of the requested item timestamp the date & time of the request OAI-PMH Identifier the Open Access Initiative identifier of the item being viewed/downloaded agent the Web Browser and the operating system of the visitor referrer The url linked to the item requested Matomo Tracking Parameters
- 13. Metadata-Index UsageStatistics-DB ● Repository ● CRIS ● eJournal ● National Statistics Node ● Publisher PULL COUNTER Report PUSH tracked event IP-Anonym. processing script processing script Tiers Collection Workflows for Usage Statistics
- 14. Aninstitutional repository isregistered inMatomo. Serversidetracking: Plugins(Dspace)orpatches(Eprints) usingMatomo’sHTTPAPI. Usage Activityistracked andloggedatMatomoplatformin realtime. Ιnformationistransferredoffline, usingMatomo’s API,to OpenAIRE’s DBsforstatistical analysis. Statistics aredeployed forhuman(OpenAIRE’s Portal)and machine(Sushi-LiteAPI)consumption. Push Usage Statistics Tracking Workflow
- 15. Gathering of consolidated statistics reports from aggregation services, such as IRUS-UK, using protocols such as SUSHI-Lite. Statistics are stored to OpenAIRE’s DB for statistical analysis. Statistics are deployed via OpenAIRE’s Portal or Sushi- Lite API. Collecting (Pull) Consolidated Usage Statistics Reports
- 16. entityId/orid entityId/orid entityId/orid entityId/orid source source OpenAIRE Usage Statistics DB
- 17. ● OpenAIRE collects from > 1000 compatible data providers ~24 Mio documents ● currently 99 active data providers participating in Usage statistics + IRUS-UK ● Usage statistics deployment under CC-0 license. ○ in OpenAIRE dashboard, portal and API. Usage Statistics in the OpenAIRE Infrastructure
- 18. Usage Activity in Real Time
- 19. Real Time Visitor Map
- 25. onestopshop for OpenAIRE content providers forfriends… “therepositorymanagers dashboard” Dashboardforcontentproviders
- 27. ● Four steps to join OpenAIRE Usage Statistics 1. Download. 2. Configure. 3. Deploy. 4. Validate (by OpenAIRE). ● Or enter SUSHI endpoint to let OpenAIRE collect COUNTER reports Metrics in the OpenAIRE Dashboard for content providers
- 28. Enable Metrics for selected Datasource
- 29. Configure Metrics for selected Datasource 000 01233456
- 30. Usage Metrics by example of the UMinho Repository
- 31. Usage Metrics on the Article Level
- 32. ● Available as beta with the help of IRUS-UK ○ http://beta.services.openaire.eu/usagestats/sushilite/ ● Supports COUNTER R4 compatible reports: ○ ArticleReports(AR)andBookReports(BR)using identifierslikeopenaire,doi,oai-record-id ○ ItemReports(IR) ○ RepositoryReports(RR)usingidentifiersissuedby OpenAIREorOpenDOAR ○ JournalReports(JR)usingidentifierslikeISSN SUSHI-Lite Interface COUNTERUSAGEREPORTS RELEVANTFOROPENAIRE RepositoryPlatformReport–RR1 JournalReport–JR1 ItemReport–IR1 ArticleReport–AR1 BookReport–BR1 BookChapterReport–BR2 ResearchDatasetReporttbc. ResearchSoftwareUsageReporttbc.
- 33. Repository Report Item Report SUSHI response example (JSON)
- 35. • Comparability ofUsage Statistics acrossplatforms • Mustbecollectedandprocessedbyagreedcommonstandards,e.g.COUNTERCoP • Mustbeopenlyaccessiblebydefault(e.g.CC-0license) • Comparability ofUsage Statistics ofdifferentversions ofanitem • E.g.UsageStatisticsofOpenAccessvs.non-OpenAccessitemversions • UsageStatisticsmustbeenrichedbyitemidentifiers • Itemsmusthavecomprehensivemetadatadescriptions • Contextualized UsageStatistics • COUNTERReportsareabasicfirststepbutlimitedonstatisticsperplatform(items) • Aggregatedusagestatisticsofdeduplicateditems • LinkedresearchresultsandtheirUsageStatisticsinthecontextof (e.g. a project or topic) Main Challenges and Limitations
- 36. ● Develop Matomo plugins for other Repository platforms (eg. Fedora, Samvera) ● Promote the service to content provider managers ● Support national usage statistics initiatives to become a node in OpenAIRE Usage Statistics ● E.g. LA Referencia to set up a regional usage statistics network ● Contribute to the Open Metrics concept and vision ● Update to COUNTER R5 standard and support of COUNTER CoP for Research Data Next Steps
- 37. • We already link publications and datasets • Let‘s link their usage statistics too, make usage statistics more valuable and meaningful The Usage Statistics Hub Concept Hub of Publ.-Level Metrics Hub of Data-Level Metrics Data Repositories Inst. / Thematic Repositories Regional / National Statistics Services, e.g. IRUS, OpenAIRE, EOSC-Infrastructures track track track trackprovide provide provide provide link e.g. Making DataCount, IRUSdata, OpenAIRE, EOSC-Infrastructures