SlideShare a Scribd company logo
@openaire_eu
A user journey in
OpenAIRE services
through the lens of repository managers
PedroPrΓ­ncipe,UniversityofMinho,AndrΓ©Vieira,UniversityofMinho,
AlessiaBardi,CNR-ISTI,JochenSchirrwagen,BielefeldUniversity,'DimitrisPierrakos,ATHENARC
OR2019 Workshop – 2nd part
13:30 – Welcome and introduction, Pedro PrΓ­ncipe
13:40 – OpenAIRE catch-all Broker Service for literature and data repositories
13:55 – Dashboard for Content Providers: Open Science as-a-Service for repositories
14:10 – Dashboard demo and test drive (breakout groups)
15:00-15:30 – Coffee break
15:30 – OpenAIRE usage statistics service - overview of the service
15:50 – Service demo base on real case
16:10 – Collection workflows
16:30 – How to join OpenAIRE usage statistics, Tracking usage events
16:45 – Discussion
17:00 – Closing
AGENDA
14th International Open Repositories Conference, June 10th, Hamburg, Germany
WorkshopsTopics–2ndpart
1)OpenAIREcatch-allBrokerServiceforliteratureanddata
repositories
2)DashboardforContentProviders:OpenScienceas-a-Servicefor
repositories
>>>14:10–Dashboarddemoandtestdrive(breakoutgroups)
3)OpenAIREusagestatisticsservice-overviewoftheservice
4)Servicedemobaseonrealcase&Collectionworkflows
5)HowtojoinOpenAIREusagestatistics, Tracking usageevents
>>> Discussion
SLIDES HERE:
bit.ly/openaire_or2019
http://box.openaire.eu/index.php/s/V9xSCykE5oklxMC
Broker Service
Catch-all broker for content
providers
1
OpenAIRE’s e-infrastructure Commons – BROKER CONCEPT
Publications
repositories
Research Data
repositories
CRIS
systems
Registries
(e.g. projects)
OA
Journals
Software
Repositories
Validation
Cleaning De-duplication
Enrichment
By inference
CONTENT PROVIDERS
INFO SPACE SERVICES
Project initiative
FunderFunding
Result
Publication Data Software
Organization
GUIDE
LINES
TERMS
OF USE
Repositories in OpenAIRE may
be interested to acquire
metadata information about
publications that are
β€œpotentially of interest
to them”
i.e. be part of their collection:
add new records, enrich the
records with extra metadata
information.
OpenAIRE Broker sketch
OpenAIRE
Notification Broker
OpenAIRE Information Space
Graph
(deduplication,
Inference,
Aggregation)
…
Subscriptions
Potential
Notifications
subscribe
notifyrepository
admin
OpenAIRE Data
Sources
Identifying β€œevents”
relevant to repositories
(enrichments & additions)
Sending
events
Delivered
Notifications
Event (potential notification):
β€’ Message
β€’ Topic
β€’ TargetRepository
β€’ Trust
οƒΌ ENRICH/MISSING/PROJECT - OpenAIRE discovered references to research projects that can be
associated to your publications
οƒΌ ENRICH/MISSING/OPENACCESS_VERSION - OpenAIRE discovered Open Access versions of your
publications
οƒΌ ENRICH/MISSING/PID - OpenAIRE discovered missing persistent identifiers associated to your
publications
οƒΌ ENRICH/MISSING/ABSTRACT - OpenAIRE discovered missing abstracts among your publications
οƒΌ ENRICH/MISSING/DATE - OpenAIRE discovered missing date values to your publications
οƒΌ ENRICH/MISSING/SUBJECT/MESHEUROPMC - OpenAIRE discovered classification terms from the Medical Subject Headings that can be
associated to your publications
οƒΌ ENRICH/MISSING/SUBJECT/JEL - OpenAIRE discovered Journal of Economic Literature (JEL) classification terms that can be associated to your
publications
οƒΌ ENRICH/MISSING/SUBJECT/DDC - OpenAIRE discovered Dewey Decimal classification terms (DDC) that can be associated to your
publications
οƒΌ ENRICH/MISSING/SUBJECT/ACM - OpenAIRE discovered ACM classification terms that can be associated to your publications
οƒΌ ENRICH/MISSING/SUBJECT/ARXIV - OpenAIRE discovered ARXIV classification terms that can be associated to your publications
Enrichments events from the broker service
8
9
Enrichments:
β€’ MOREmetadata
or
β€’ MISSINGmetadata
2
Dashboard for
Content Providers
Servicedemoandtestdrive:
contentenrichmentevents.
OpenAIREContentProviderDashboard–whatitis
11
One-stop-shop web service where content providers (repositories, data
archives, journals, aggregators, CRIS systems) interact with OpenAIRE.
It provides the front-end access to many of OpenAIRE's backend services.
provide.openaire.eu
…
onestopshopforall
OpenAIREcontentproviders
Services for repository managers,
Data Archive managers,
OA publishers…
SUPPORT, PROMOTE, ENRICH
Dashboard usage
TARGET USERS
Repositorymanagers(literature,
data),libraries,contentproviders,
publishers,nationalaggregators.
USER BASE
800contentprovidershaveused
theregistrationandvalidation
service(V1focusedonliterature
repositories,1200alltypesforV2).
USER VALUE
Improverepositorycollectionsandcontentforenhancedvisibility
andaccess.Improved institution memory. Betterinstitution
researchassessment. Compliancetofunderrules.Improved
repositoryinteroperability.
OpenAIRE Content Provider Dashboard
what it does
Content Provider Dashboard
Interoperable metadata is key for
effective content sharing
Use our validation service and see how you can apply the
OpenAIRE Guidelines to expose your contents using
global standards.
VALIDATE
Reach a wider audience around the world
Register your datasource in OpenAIRE and be part of a
global interlinked network.
REGISTER
Improve your metadata.
Get more connections
OA Broker service offers a wealth of information on
scholarly communication data.ENRICH
Find out what interests you and subscribe to enrich your records.
More & Missing events that may enrich your Repository:
β€’ Persistent identifiers
β€’ Open Access Versions
β€’ Projects
β€’ Subjects
β€’ Abstracts
… datasets, software
Open research impact empowers
Open Science
Open Metrics service by sharing your usage data.
Get the benefit of an aggregated environment to
broaden the mechanisms for impact assessment.
MEASURE
Get usage statistics reports for your datasource
Novelties
A user journey in OpenAIRE services through the lens of repository managers - #OpenREPO2019 workshop 2nd part
A user journey in OpenAIRE services through the lens of repository managers - #OpenREPO2019 workshop 2nd part
A user journey in OpenAIRE services through the lens of repository managers - #OpenREPO2019 workshop 2nd part
provide.openaire.eu
In production since October!
Content Provider Dashboard: testing phase
1 Webinar, 59 Attendees
21 Repositories represented
Portugal Spain
Real users of the
Dashboard
β€’ Repository Managers from
Portugal & Spain
2 Webinars (Demo)
β€’ Main OpenAIRE services for
content providers
(Dashboard and Broker),
RCAAP and RECOLECTA.
Test drive
β€’ Grant the access to the
Dashboard
β€’ Guidance on the
functionalities usage
Collect feedback
β€’ Questionnaire & Helpdesk
1 Webinar, 49 Attendees
28 Repositories represented
May/June 2018
provide.openaire.eu
Breakout groups – demo
Pass: openaire1!
Login: repositorium
Pass: Rcaapsdum2008
Login: comum
Support materials for Content Providers Dashboard uptake
β€’ Provide - How to validate and register your
repository
β€’ Provide - How to enrich research artifacts
β€’ Usage Statistics – How to track the usage
activity of your repository
β€’ ScholExplorer - Literature & Data
interlinking
β€’ Making your repository Open
Support – guides
β€’ Make your content count - OpenAIRE
Content providers Dashboard: service for
repository managers
β€’ OpenAIRE metrics service: usage statistics
β€’ OpenAIRE Guidelines for data providers:
new Metadata Application Profile for
Literature Repositories
Training – webinars
OpenAIRE Content Provider Dashboard
what comes next
β€’ ORCID > Publications/Datsets/software
β€’ Datasets > Projects
β€’ Publications <-> Software
β€’ Publications <-> Datasets
New broker events
OpenAIRE-Connect EAB meeting, 8th of March, 2019 - Pisa
www.openaire.eu
@openaire_eu
facebook.com/groups/openaire
pedroprincipe@sdum.uminho.pt
OpenAIRE USER FEEDBACK
FORM: bit.ly/brokerevaluation
https://forms.gle/uQZQ8954q47az7Vn8
3
OpenAIRE usage
statistics service
Overview,demoandcollection
workflows
OpenAIRE
Usage Statistics Service
Jochen Schirrwagen
Dimitris Pierrakos
Andreas Czerniak
Workshop A User Journey in OpenAIRE Services | Hamburg | 10 Jun 2019
Why Usage Statistics
● Authors / readers: to assess
impact and to compare with
scholarly works of peers
● Repository managers: how
often / how well is the repository
service used
● Research funders /
administrators: usage metrics
as part of a variety of metrics to
assess impact of research
funded or supported
Open research impact empowers Open Science
● (1) Tracking of usage events or (2) retrieving
COUNTER reports on scholarly work items in
repositories
● Applying rules based on COUNTER CoP
● Aggregating metrics on usage for scholarly
works
● Repository plugins to track usage events
How it works
Metadata-Index
UsageStatistics-DB
● Repository
● CRIS
● eJournal
● National
Statistics Node
● Publisher
PULL
COUNTER Report
PUSH
tracked event
IP-Anonym.
processing script
processing script
TIERS Collection Workflows for Usage Statistics
Parameter Description
idSite the ID of the repository
idVisit a visitor/session ID (an 8 byte binary string)
visitIP (optionally anonymized) the IP address of the visitor
action the action performed (view, download, outlink, etc)
url the url of the requested item
timestamp the date & time of the request
OAI-PMH Identifier the Open Access Initiative identifier of the item being viewed/downloaded
agent the Web Browser and the operating system of the visitor
referrer The url linked to the item requested
Matomo Tracking Parameters
Usage Statistics on Datasource and
Item Level
OpenAIRE Exposes Usage Statistics
COUNTER compliant usage statistics reports for Repositories
http://services.openaire.eu/usagestats/sushilite/
Repository Report Item Report
SUSHI response example (JSON)
Main Challenges and Limitations
β€’ Comparability of Usage Statistics across platforms
β€’ Must be collected and processed by agreed common standards, e.g. COUNTER CoP
β€’ Must be openly accessible by default (e.g. CC-0 license)
β€’ Comparability of Usage Statistics of different versions of an item
β€’ e.g. Usage Statistics of Open Access vs. non-Open Access item versions
β€’ Usage Statistics must be enriched by item identifiers
β€’ Items must have comprehensive metadata descriptions
β€’ Contextualized Usage Statistics
β€’ COUNTER Reports are a basic first step but limited on statistics per platform (items)
β€’ Aggregated usage statistics of deduplicated items
β€’ Linked research results and their Usage Statistics in the context of
(e.g. a project or topic)
● Promote the service to content provider managers
● Update to COUNTER CoP R5
● Support of COUNTER CoP for Research Data
(work with MakeDataCount)
● Improve visualizations of Usage Statistics in portal and
dashboard
● Aligning tracking protocols and generic tracking
solutions
● Support national usage statistics initiatives to become a
node in OpenAIRE Usage Statistics
● collaboration already with LA Referencia, IRUS-UK
Next Steps
OpenAIRE-Advance TM | Pisa / Italy | 5-7 MAR 2019
● Item in the EOSC Service catalogue:
https://catalogue.eosc-
portal.eu/service/openaire.openaire_usage_statistics
● OpenAIRE Usage Statistics Guidelines:
https://openaire.github.io/usage-statistics-guidelines/
● OpenAIRE2020 - Usage Statistics Services - D8.5:
https://doi.org/10.5281/zenodo.1034164
More Information
OpenAIRE-Advance TM | Pisa / Italy | 5-7 MAR 2019
Metadata-Index
UsageStatistics-DB
● Repository
● CRIS
● eJournal
● National
Statistics Node
● Publisher
PULL
COUNTER Report
PUSH
tracked event
IP-Anonym.
processing script
processing script
Architecture and Workflows for Usage Statistics
● Four steps to join OpenAIRE Usage Statistics
1. Download.
2. Configure.
3. Deploy.
4. Validate (by OpenAIRE).
● Or enter SUSHI endpoint to let OpenAIRE collect
COUNTER reports
Metrics in the OpenAIRE Dashboard for content providers
Enable Metrics for selected Datasource
Configure Metrics for selected Datasource
000
01233456
Matomo Live tracking (Pull)
● Demo Site:
http://demo.librecat.org/
● Real time tracking:
https://analytics.openaire.eu/index.php?module=CoreHome&action=index&idSite=1&period=day&date=yesterday&updated=1#
?idSite=1&period=day&date=yesterday&category=Dashboard_Dashboard&subcategory=1&popover=
Matomo offline collection of
COUNTER Reports (Push)
● Irus-UK (aggregator) endpoint via SUSHI-Lite:
https://irus.jisc.ac.uk/api/sushilite/v1_7/Client/IR1/
● Aberdeen University Research Archive (irusuk:28)
https://irus.jisc.ac.uk/api/sushilite/v1_7/GetReport/?Report=IR1&Release=4&RequestorID=Jisc&BeginDate=2019-
01&EndDate=2019-
03&RepositoryIdentifier=irusuk%3A28&ItemIdentifier=&ItemDataType=&hasDOI=&Granularity=Monthly&Callback=&Pretty=
Pretty
Usage Statistics Reports
● Repository Statistics from the Content Providers
Dashboard
provide.openaire.eu
● COUNTER reports using the SushiLite API
http://services.openaire.eu/usagestats/sushilite/
http://services.openaire.eu/usagestats/sushilite/GetReport/?Report=IR1&Release=4&RequestorID=anonymous&BeginDate=20
19-01&EndDate=2019-
02&RepositoryIdentifier=opendoar%3A1714&ItemIdentifier=&ItemDataType=&Granularity=Monthly&Pretty=Pretty
Questions
● How important the Metrics service is for your
repository?
● Do you consider Usage statistics as a β€œtrustworthy”
evaluator for scholarly impact?
www.menti.com
192517
Thank you!PedroPrΓ­ncipe,UniversityofMinho,pedroprincipe@sdum.uminho.pt;
AlessiaBardi,CNR-ISTI,alessia.bardi@isti.cnr.it
AndrΓ©Vieira,UniversityofMinho,andrevieira@sdum.uminho.pt;
JochenSchirrwagen,BielefeldUniversity,jochen.schirrwagen@uni-
bielefeld.deinfo@openaire.eu
info@openaire.eu

More Related Content

PDF
4th Content Providers Community Call
PDF
6th Content Providers Community Call
PDF
2nd Content Providers Community Call
PDF
1st Content Providers Community Call
PDF
3rd Content Providers Community Call
PPTX
OpenAIRE services & tools: Zenodo and what's next (Danish OpenAIRE workshop)
PPT
Smart opendata results of pilots & user groups final
PPT
LoCloud Micro Services and the Digitisation Workflow
4th Content Providers Community Call
6th Content Providers Community Call
2nd Content Providers Community Call
1st Content Providers Community Call
3rd Content Providers Community Call
OpenAIRE services & tools: Zenodo and what's next (Danish OpenAIRE workshop)
Smart opendata results of pilots & user groups final
LoCloud Micro Services and the Digitisation Workflow

Similar to A user journey in OpenAIRE services through the lens of repository managers - #OpenREPO2019 workshop 2nd part (20)

PPTX
OpenAIRE Metrics Service: Usage Statistics (24x7 presentation at #OR2018)
PDF
10th OpenAIRE Content Providers Community Call
PDF
Towards a network of usage statistic hubs on a global level
PPTX
OpenAIRE services and tools - presentation at #DI4R2016
PPTX
A user journey in OpenAIRE services through the lens of repository managers -...
PPTX
Infraestructuras, recursos y servicios de OpenAIRE. OpenAIRE Workshop Spain, ...
PPTX
OpenAIRE Provide Dashboard - a one-stop-shop web service where content provid...
PPTX
OpenAIRE - Implementing Open Science (presentation by Natalia Manola at Food ...
PPTX
OpenAIRE services and tools - 6th National Open Access Conference and OpenAIR...
PPTX
OpenAIRE services and tools - 6th National Open Access Conference and OpenAIR...
PPTX
Make your content count - OpenAIRE Content providers Dashboard: service for r...
PDF
7th Content Providers Community Call
PDF
Interoperability is the key: repositories networks promoting the quality and ...
PPTX
OpenAIRE Dashboard for Content Providers: Open Science as-a-Service for liter...
PPTX
OpenAIRE provide dashboard #OpenAIREweek2020
PPTX
OpenAIRE: Implementing Open Science in EOSC - crosscutting with RDA (Presenta...
PDF
OpenAIRE: Science. Set Free, Iryna Kuchma, EIFL
PPTX
Facilitate Research Communities Adoption of Open Science Publishing Principle...
PPTX
Supporting infrastructures for Open Access
PPTX
Emilie hermans supporting_infrastructures
OpenAIRE Metrics Service: Usage Statistics (24x7 presentation at #OR2018)
10th OpenAIRE Content Providers Community Call
Towards a network of usage statistic hubs on a global level
OpenAIRE services and tools - presentation at #DI4R2016
A user journey in OpenAIRE services through the lens of repository managers -...
Infraestructuras, recursos y servicios de OpenAIRE. OpenAIRE Workshop Spain, ...
OpenAIRE Provide Dashboard - a one-stop-shop web service where content provid...
OpenAIRE - Implementing Open Science (presentation by Natalia Manola at Food ...
OpenAIRE services and tools - 6th National Open Access Conference and OpenAIR...
OpenAIRE services and tools - 6th National Open Access Conference and OpenAIR...
Make your content count - OpenAIRE Content providers Dashboard: service for r...
7th Content Providers Community Call
Interoperability is the key: repositories networks promoting the quality and ...
OpenAIRE Dashboard for Content Providers: Open Science as-a-Service for liter...
OpenAIRE provide dashboard #OpenAIREweek2020
OpenAIRE: Implementing Open Science in EOSC - crosscutting with RDA (Presenta...
OpenAIRE: Science. Set Free, Iryna Kuchma, EIFL
Facilitate Research Communities Adoption of Open Science Publishing Principle...
Supporting infrastructures for Open Access
Emilie hermans supporting_infrastructures
Ad

More from OpenAIRE (20)

PDF
9th Content Providers Community Call\
PPTX
OpenAIRE in the European Open Science Cloud (EOSC)
PDF
8th Content Providers Community Call
PDF
OpenAIRE PROVIDE Dashboard for Turkish repository managers
PDF
What will it cost to manage and share my data?
PDF
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 3)
PDF
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 2)
PDF
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 1)
PPTX
20200504_OpenAIRE Legal Policy Webinar: GDPR and Sharing Data
PPTX
20200504_Research Data & the GDPR: How Open is Open?
PDF
20200504_Data, Data Ownership and Open Science
PPTX
20200429_Research Data & the GDPR: How Open is Open? (updated version)
PDF
20200429_Data, Data Ownership and Open Science
PPTX
20200429_OpenAIRE Legal Policy Webinar: GDPR and Sharing Data
PDF
COVID-19: Activities, tools, best practice and contact points in Greece
PDF
5th Content Providers Community Call
PPTX
20200130_Mannocci_OpenAIRE_ResearchGraph
PDF
IPR and Exploitation
PPTX
Eosc_OpenAIRE_onboarding_v2
PPTX
Open Science infrastructure in the EU
9th Content Providers Community Call\
OpenAIRE in the European Open Science Cloud (EOSC)
8th Content Providers Community Call
OpenAIRE PROVIDE Dashboard for Turkish repository managers
What will it cost to manage and share my data?
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 3)
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 2)
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 1)
20200504_OpenAIRE Legal Policy Webinar: GDPR and Sharing Data
20200504_Research Data & the GDPR: How Open is Open?
20200504_Data, Data Ownership and Open Science
20200429_Research Data & the GDPR: How Open is Open? (updated version)
20200429_Data, Data Ownership and Open Science
20200429_OpenAIRE Legal Policy Webinar: GDPR and Sharing Data
COVID-19: Activities, tools, best practice and contact points in Greece
5th Content Providers Community Call
20200130_Mannocci_OpenAIRE_ResearchGraph
IPR and Exploitation
Eosc_OpenAIRE_onboarding_v2
Open Science infrastructure in the EU
Ad

Recently uploaded (20)

PDF
WebRTC in SignalWire - troubleshooting media negotiation
PDF
Slides PDF The World Game (s) Eco Economic Epochs.pdf
PDF
Unit-1 introduction to cyber security discuss about how to secure a system
PDF
An introduction to the IFRS (ISSB) Stndards.pdf
PPTX
CHE NAA, , b,mn,mblblblbljb jb jlb ,j , ,C PPT.pptx
PPT
Design_with_Watersergyerge45hrbgre4top (1).ppt
PPTX
Introduction about ICD -10 and ICD11 on 5.8.25.pptx
PDF
Cloud-Scale Log Monitoring _ Datadog.pdf
PDF
Best Practices for Testing and Debugging Shopify Third-Party API Integrations...
PDF
Testing WebRTC applications at scale.pdf
PDF
APNIC Update, presented at PHNOG 2025 by Shane Hermoso
Β 
PDF
Sims 4 Historia para lo sims 4 para jugar
PPTX
international classification of diseases ICD-10 review PPT.pptx
PPTX
introduction about ICD -10 & ICD-11 ppt.pptx
PDF
πŸ’° π”πŠπ“πˆ πŠπ„πŒπ„ππ€ππ†π€π πŠπˆππ„π‘πŸ’πƒ π‡π€π‘πˆ 𝐈𝐍𝐈 πŸπŸŽπŸπŸ“ πŸ’°
Β 
PDF
Automated vs Manual WooCommerce to Shopify Migration_ Pros & Cons.pdf
PPTX
June-4-Sermon-Powerpoint.pptx USE THIS FOR YOUR MOTIVATION
PPTX
Introduction to Information and Communication Technology
PDF
Tenda Login Guide: Access Your Router in 5 Easy Steps
PDF
Paper PDF World Game (s) Great Redesign.pdf
WebRTC in SignalWire - troubleshooting media negotiation
Slides PDF The World Game (s) Eco Economic Epochs.pdf
Unit-1 introduction to cyber security discuss about how to secure a system
An introduction to the IFRS (ISSB) Stndards.pdf
CHE NAA, , b,mn,mblblblbljb jb jlb ,j , ,C PPT.pptx
Design_with_Watersergyerge45hrbgre4top (1).ppt
Introduction about ICD -10 and ICD11 on 5.8.25.pptx
Cloud-Scale Log Monitoring _ Datadog.pdf
Best Practices for Testing and Debugging Shopify Third-Party API Integrations...
Testing WebRTC applications at scale.pdf
APNIC Update, presented at PHNOG 2025 by Shane Hermoso
Β 
Sims 4 Historia para lo sims 4 para jugar
international classification of diseases ICD-10 review PPT.pptx
introduction about ICD -10 & ICD-11 ppt.pptx
πŸ’° π”πŠπ“πˆ πŠπ„πŒπ„ππ€ππ†π€π πŠπˆππ„π‘πŸ’πƒ π‡π€π‘πˆ 𝐈𝐍𝐈 πŸπŸŽπŸπŸ“ πŸ’°
Β 
Automated vs Manual WooCommerce to Shopify Migration_ Pros & Cons.pdf
June-4-Sermon-Powerpoint.pptx USE THIS FOR YOUR MOTIVATION
Introduction to Information and Communication Technology
Tenda Login Guide: Access Your Router in 5 Easy Steps
Paper PDF World Game (s) Great Redesign.pdf

A user journey in OpenAIRE services through the lens of repository managers - #OpenREPO2019 workshop 2nd part

  • 1. @openaire_eu A user journey in OpenAIRE services through the lens of repository managers PedroPrΓ­ncipe,UniversityofMinho,AndrΓ©Vieira,UniversityofMinho, AlessiaBardi,CNR-ISTI,JochenSchirrwagen,BielefeldUniversity,'DimitrisPierrakos,ATHENARC OR2019 Workshop – 2nd part
  • 2. 13:30 – Welcome and introduction, Pedro PrΓ­ncipe 13:40 – OpenAIRE catch-all Broker Service for literature and data repositories 13:55 – Dashboard for Content Providers: Open Science as-a-Service for repositories 14:10 – Dashboard demo and test drive (breakout groups) 15:00-15:30 – Coffee break 15:30 – OpenAIRE usage statistics service - overview of the service 15:50 – Service demo base on real case 16:10 – Collection workflows 16:30 – How to join OpenAIRE usage statistics, Tracking usage events 16:45 – Discussion 17:00 – Closing AGENDA 14th International Open Repositories Conference, June 10th, Hamburg, Germany
  • 5. Broker Service Catch-all broker for content providers 1
  • 6. OpenAIRE’s e-infrastructure Commons – BROKER CONCEPT Publications repositories Research Data repositories CRIS systems Registries (e.g. projects) OA Journals Software Repositories Validation Cleaning De-duplication Enrichment By inference CONTENT PROVIDERS INFO SPACE SERVICES Project initiative FunderFunding Result Publication Data Software Organization GUIDE LINES TERMS OF USE Repositories in OpenAIRE may be interested to acquire metadata information about publications that are β€œpotentially of interest to them” i.e. be part of their collection: add new records, enrich the records with extra metadata information.
  • 7. OpenAIRE Broker sketch OpenAIRE Notification Broker OpenAIRE Information Space Graph (deduplication, Inference, Aggregation) … Subscriptions Potential Notifications subscribe notifyrepository admin OpenAIRE Data Sources Identifying β€œevents” relevant to repositories (enrichments & additions) Sending events Delivered Notifications Event (potential notification): β€’ Message β€’ Topic β€’ TargetRepository β€’ Trust
  • 8. οƒΌ ENRICH/MISSING/PROJECT - OpenAIRE discovered references to research projects that can be associated to your publications οƒΌ ENRICH/MISSING/OPENACCESS_VERSION - OpenAIRE discovered Open Access versions of your publications οƒΌ ENRICH/MISSING/PID - OpenAIRE discovered missing persistent identifiers associated to your publications οƒΌ ENRICH/MISSING/ABSTRACT - OpenAIRE discovered missing abstracts among your publications οƒΌ ENRICH/MISSING/DATE - OpenAIRE discovered missing date values to your publications οƒΌ ENRICH/MISSING/SUBJECT/MESHEUROPMC - OpenAIRE discovered classification terms from the Medical Subject Headings that can be associated to your publications οƒΌ ENRICH/MISSING/SUBJECT/JEL - OpenAIRE discovered Journal of Economic Literature (JEL) classification terms that can be associated to your publications οƒΌ ENRICH/MISSING/SUBJECT/DDC - OpenAIRE discovered Dewey Decimal classification terms (DDC) that can be associated to your publications οƒΌ ENRICH/MISSING/SUBJECT/ACM - OpenAIRE discovered ACM classification terms that can be associated to your publications οƒΌ ENRICH/MISSING/SUBJECT/ARXIV - OpenAIRE discovered ARXIV classification terms that can be associated to your publications Enrichments events from the broker service 8
  • 11. OpenAIREContentProviderDashboard–whatitis 11 One-stop-shop web service where content providers (repositories, data archives, journals, aggregators, CRIS systems) interact with OpenAIRE. It provides the front-end access to many of OpenAIRE's backend services.
  • 13. onestopshopforall OpenAIREcontentproviders Services for repository managers, Data Archive managers, OA publishers… SUPPORT, PROMOTE, ENRICH
  • 14. Dashboard usage TARGET USERS Repositorymanagers(literature, data),libraries,contentproviders, publishers,nationalaggregators. USER BASE 800contentprovidershaveused theregistrationandvalidation service(V1focusedonliterature repositories,1200alltypesforV2). USER VALUE Improverepositorycollectionsandcontentforenhancedvisibility andaccess.Improved institution memory. Betterinstitution researchassessment. Compliancetofunderrules.Improved repositoryinteroperability.
  • 15. OpenAIRE Content Provider Dashboard what it does
  • 17. Interoperable metadata is key for effective content sharing Use our validation service and see how you can apply the OpenAIRE Guidelines to expose your contents using global standards. VALIDATE
  • 18. Reach a wider audience around the world Register your datasource in OpenAIRE and be part of a global interlinked network. REGISTER
  • 19. Improve your metadata. Get more connections OA Broker service offers a wealth of information on scholarly communication data.ENRICH Find out what interests you and subscribe to enrich your records. More & Missing events that may enrich your Repository: β€’ Persistent identifiers β€’ Open Access Versions β€’ Projects β€’ Subjects β€’ Abstracts … datasets, software
  • 20. Open research impact empowers Open Science Open Metrics service by sharing your usage data. Get the benefit of an aggregated environment to broaden the mechanisms for impact assessment. MEASURE Get usage statistics reports for your datasource
  • 26. Content Provider Dashboard: testing phase 1 Webinar, 59 Attendees 21 Repositories represented Portugal Spain Real users of the Dashboard β€’ Repository Managers from Portugal & Spain 2 Webinars (Demo) β€’ Main OpenAIRE services for content providers (Dashboard and Broker), RCAAP and RECOLECTA. Test drive β€’ Grant the access to the Dashboard β€’ Guidance on the functionalities usage Collect feedback β€’ Questionnaire & Helpdesk 1 Webinar, 49 Attendees 28 Repositories represented May/June 2018
  • 29. Pass: openaire1! Login: repositorium Pass: Rcaapsdum2008 Login: comum
  • 30. Support materials for Content Providers Dashboard uptake β€’ Provide - How to validate and register your repository β€’ Provide - How to enrich research artifacts β€’ Usage Statistics – How to track the usage activity of your repository β€’ ScholExplorer - Literature & Data interlinking β€’ Making your repository Open Support – guides β€’ Make your content count - OpenAIRE Content providers Dashboard: service for repository managers β€’ OpenAIRE metrics service: usage statistics β€’ OpenAIRE Guidelines for data providers: new Metadata Application Profile for Literature Repositories Training – webinars
  • 31. OpenAIRE Content Provider Dashboard what comes next
  • 32. β€’ ORCID > Publications/Datsets/software β€’ Datasets > Projects β€’ Publications <-> Software β€’ Publications <-> Datasets New broker events OpenAIRE-Connect EAB meeting, 8th of March, 2019 - Pisa
  • 34. OpenAIRE USER FEEDBACK FORM: bit.ly/brokerevaluation https://forms.gle/uQZQ8954q47az7Vn8
  • 36. OpenAIRE Usage Statistics Service Jochen Schirrwagen Dimitris Pierrakos Andreas Czerniak Workshop A User Journey in OpenAIRE Services | Hamburg | 10 Jun 2019
  • 37. Why Usage Statistics ● Authors / readers: to assess impact and to compare with scholarly works of peers ● Repository managers: how often / how well is the repository service used ● Research funders / administrators: usage metrics as part of a variety of metrics to assess impact of research funded or supported Open research impact empowers Open Science
  • 38. ● (1) Tracking of usage events or (2) retrieving COUNTER reports on scholarly work items in repositories ● Applying rules based on COUNTER CoP ● Aggregating metrics on usage for scholarly works ● Repository plugins to track usage events How it works
  • 39. Metadata-Index UsageStatistics-DB ● Repository ● CRIS ● eJournal ● National Statistics Node ● Publisher PULL COUNTER Report PUSH tracked event IP-Anonym. processing script processing script TIERS Collection Workflows for Usage Statistics
  • 40. Parameter Description idSite the ID of the repository idVisit a visitor/session ID (an 8 byte binary string) visitIP (optionally anonymized) the IP address of the visitor action the action performed (view, download, outlink, etc) url the url of the requested item timestamp the date & time of the request OAI-PMH Identifier the Open Access Initiative identifier of the item being viewed/downloaded agent the Web Browser and the operating system of the visitor referrer The url linked to the item requested Matomo Tracking Parameters
  • 41. Usage Statistics on Datasource and Item Level
  • 42. OpenAIRE Exposes Usage Statistics COUNTER compliant usage statistics reports for Repositories http://services.openaire.eu/usagestats/sushilite/
  • 43. Repository Report Item Report SUSHI response example (JSON)
  • 44. Main Challenges and Limitations β€’ Comparability of Usage Statistics across platforms β€’ Must be collected and processed by agreed common standards, e.g. COUNTER CoP β€’ Must be openly accessible by default (e.g. CC-0 license) β€’ Comparability of Usage Statistics of different versions of an item β€’ e.g. Usage Statistics of Open Access vs. non-Open Access item versions β€’ Usage Statistics must be enriched by item identifiers β€’ Items must have comprehensive metadata descriptions β€’ Contextualized Usage Statistics β€’ COUNTER Reports are a basic first step but limited on statistics per platform (items) β€’ Aggregated usage statistics of deduplicated items β€’ Linked research results and their Usage Statistics in the context of (e.g. a project or topic)
  • 45. ● Promote the service to content provider managers ● Update to COUNTER CoP R5 ● Support of COUNTER CoP for Research Data (work with MakeDataCount) ● Improve visualizations of Usage Statistics in portal and dashboard ● Aligning tracking protocols and generic tracking solutions ● Support national usage statistics initiatives to become a node in OpenAIRE Usage Statistics ● collaboration already with LA Referencia, IRUS-UK Next Steps OpenAIRE-Advance TM | Pisa / Italy | 5-7 MAR 2019
  • 46. ● Item in the EOSC Service catalogue: https://catalogue.eosc- portal.eu/service/openaire.openaire_usage_statistics ● OpenAIRE Usage Statistics Guidelines: https://openaire.github.io/usage-statistics-guidelines/ ● OpenAIRE2020 - Usage Statistics Services - D8.5: https://doi.org/10.5281/zenodo.1034164 More Information OpenAIRE-Advance TM | Pisa / Italy | 5-7 MAR 2019
  • 47. Metadata-Index UsageStatistics-DB ● Repository ● CRIS ● eJournal ● National Statistics Node ● Publisher PULL COUNTER Report PUSH tracked event IP-Anonym. processing script processing script Architecture and Workflows for Usage Statistics
  • 48. ● Four steps to join OpenAIRE Usage Statistics 1. Download. 2. Configure. 3. Deploy. 4. Validate (by OpenAIRE). ● Or enter SUSHI endpoint to let OpenAIRE collect COUNTER reports Metrics in the OpenAIRE Dashboard for content providers
  • 49. Enable Metrics for selected Datasource
  • 50. Configure Metrics for selected Datasource 000 01233456
  • 51. Matomo Live tracking (Pull) ● Demo Site: http://demo.librecat.org/ ● Real time tracking: https://analytics.openaire.eu/index.php?module=CoreHome&action=index&idSite=1&period=day&date=yesterday&updated=1# ?idSite=1&period=day&date=yesterday&category=Dashboard_Dashboard&subcategory=1&popover=
  • 52. Matomo offline collection of COUNTER Reports (Push) ● Irus-UK (aggregator) endpoint via SUSHI-Lite: https://irus.jisc.ac.uk/api/sushilite/v1_7/Client/IR1/ ● Aberdeen University Research Archive (irusuk:28) https://irus.jisc.ac.uk/api/sushilite/v1_7/GetReport/?Report=IR1&Release=4&RequestorID=Jisc&BeginDate=2019- 01&EndDate=2019- 03&RepositoryIdentifier=irusuk%3A28&ItemIdentifier=&ItemDataType=&hasDOI=&Granularity=Monthly&Callback=&Pretty= Pretty
  • 53. Usage Statistics Reports ● Repository Statistics from the Content Providers Dashboard provide.openaire.eu ● COUNTER reports using the SushiLite API http://services.openaire.eu/usagestats/sushilite/ http://services.openaire.eu/usagestats/sushilite/GetReport/?Report=IR1&Release=4&RequestorID=anonymous&BeginDate=20 19-01&EndDate=2019- 02&RepositoryIdentifier=opendoar%3A1714&ItemIdentifier=&ItemDataType=&Granularity=Monthly&Pretty=Pretty
  • 54. Questions ● How important the Metrics service is for your repository? ● Do you consider Usage statistics as a β€œtrustworthy” evaluator for scholarly impact?