Full Erdmann Ruttenberg Community Approaches to Open Data at Scale
1 like700 views
The document discusses the Metadata 2020 initiative, which aims to enhance the quality and usability of metadata in research by fostering collaboration among various stakeholders such as researchers, librarians, and data publishers. It outlines specific projects focusing on improving communication, best practices, and incentives for better metadata quality. Additionally, the document highlights the evolution of metadata practices at data repositories like Dryad and emphasizes the importance of consistent, accurate metadata for supporting scholarly research.
Full Erdmann Ruttenberg Community Approaches to Open Data at Scale
- 1. Chris Erdmann Judy Ruttenberg Todd Vision NISO Virtual Conference: Open Data Projects June 13, 2018 Community approaches to open data at scale
- 2. Chris Erdmann The Carpentries/California Digital Library Metadata 2020 Participant @libcce / chris@carpentries.org Metadata 2020: Who, what, when, where, why?
- 3. As a researcher…I’m a bit bloody fed up with Data Management - Cameron Neylon
- 4. What is Metadata 2020? Metadata 2020 is a collaboration that advocates richer, connected, and reusable, open metadata for all research outputs, which will advance scholarly pursuits for the benefit of society.
- 5. COMMUNITY GROUPS RESEARCHERS Cameron Neylon, Curtin (Chair), Bethany Drehman, FASEB, Ernesto Priego, University of London, Eva Mendez, UC3M/OSPP, Juan Pablo Alperin, Public Knowledge Project, L.K. Williams, Interfolio... SERVICE PROVIDER/PLATFORMS AND TOOLS Marianne Calilhanna, Cenveo Publisher Services (Chair), Adrian-Tudor Pănescu, Figshare, Bob Kasenchak, Access Innovations, Dan Nigloschy, XML workflow solutions architect... FUNDERS Ross Mounce, Arcadia Fund PUBLISHERS Daniel Shanahan, F1000 (Chair), Fiona Counsell, Taylor & Francis, Christina Gifford, Elsevier, Christina Hoppermann, Springer Nature, Concetta La Spada, Cambridge University Press… LIBRARIANS Juliane Schneider, Harvard Catalyst (Chair), Christopher Erdmann, North Carolina State University, Ebe Kartus, University of New England, Eva Mendez, UC3M/OSPP... DATA PUBLISHERS AND REPOSITORIES John Chodacki, CDL and DataCite (Chair), Barbara Chen, Modern Language Association, Jennifer Lin, Crossref, Scott Plutchak, University of Alabama at Birmingham (retired)...
- 6. ● Each group has met 5 times ● They have defined their community problem statements, outlining challenges and opportunities ● Ideas that arose from multiple meetings are now resulting in specific cross-community projects Group Work
- 7. Problem Statements, Challenges & Opportunities Example: Researchers have a major issue with time. Metadata entry upon submission of research takes time, and this metadata is often required to be entered multiple times. Streamlining is needed. Researchers in different fields have different metadata needs and ways of talking about metadata. There is also a lack of knowledge surrounding the importance of complete and accurate metadata, and the value and uses of that metadata upstream in the research product life cycle.
- 8. Projects 1-3 1. Researcher Communications: Increase the impact and consistency of communication with researchers about metadata 2. Metadata Recommendations and Element Mappings: Shared set of recommended metadata concepts/related mappings 3. Defining the Terms We Use About Metadata: Develop a glossary of words associated with metadata, for core concepts and disciplinary areas
- 9. Projects 4-6 4. Incentives for Improving Metadata Quality: Stories to demonstrate how better metadata will meet researcher goals 5. Shared Best Practices and Principles: High level best practices for using metadata across the scholarly communication cycle, to facilitate interoperability, exchange 6. Metadata Evaluation and Guidance: Identify and compare existing metadata evaluation tools and mechanisms to inform clear community guidance
- 11. Talks: SHARE & Dryad Improving the metadata curation pipeline to SHARE Judy Ruttenberg, Program Director for Strategic Initiatives, ARL SHARE is a community open-source initiative developing tools and services to connected related, yet distributed, research outputs, enabling new kinds of scholarly discovery. This talk will provide an overview of SHARE's current development priorities to move to distributed, institutionally-based infrastructure supporting local priorities, as well as critical improvements to SHARE's harvesting framework and metadata curation pipeline. Dryad and the evolution of metadata curation at a generalist data repository Todd Vision, PI, Dryad Dryad is a generalist data repository underlying the scientific and medical literature, with data underlying articles from hundreds of journals and authors at hundreds of institutions. In this talk, I will describe how Dryad's workflow for metadata curation has evolved over time and contemplate how institutions and data repositories might better interface with one another and with the world of STM publishing.
- 12. Some feedback from NASIG so far... Focus on identifiers: they keep coming up as the source of many problems, specifically when they’re used either inconsistently or incorrectly. Don’t start with single volume monographs and assume serials will fit in eventually. Many existing data models start there and get too far along before they realize that it doesn’t quite work with serials and then the serials community is left trying to figure out how to work around the model/system. Realize that the volume/proliferation of materials means that a lot of libraries, large and small, rely (to varying degrees) on vendor-provided data. We need them to take ownership of that data and work on ways to ensure at least accuracy (identifiers, spelling, website urls, etc.). *Thanks to Juliane Schneider & NASIG Metadata 2020 contributors
- 13. Can you help? ● Contribute to Metadata 2020 projects! Email Clare Dean at cdean@metadata2020.org for details, or sign up here. ● Help promote our efforts to the wider community through your organizations, word of mouth, and social media ● Find us on @Metadata2020 Twitter, Facebook, LinkedIn, and at metadata2020.org
- 16. SHARE is a community open-source initiative developing tools and services to connect related, yet distributed, research outputs, enabling new kinds of scholarly discovery. @SHARE_research www.share-research.org
- 18. Metadata is data Rich metadata ... ● Facilitates discovery ● Exposes research assets ● Contributes to meta-scholarship and meta-analysis Links and relationships can be analyzed from this data
- 19. Dataset Harvesting Framework Aggregator: OSF Preprints Institutional focus: Dashboard Lessons learned Digital Humanities exploration
- 20. Dataset Harvesting Framework Aggregator: OSF Preprints Institutional focus: Dashboard Lessons learned Digital Humanities exploration
- 21. Dataset Harvesting Framework Aggregator: OSF Preprints Institutional focus: Dashboard Lessons learned Digital Humanities exploration
- 22. Dataset & Harvesting Framework 168+ data sources ● Registries (e.g. CrossRef, DataCite) ● Disciplinary repositories and preprint services ● Data repositories ● Institutional repositories ● Agency repositories (e.g. DOE SciTech Connect) 55+ million metadata records https://share.osf.io/discover
- 23. SHARE metadata priorities ● Institutional identifier ● Person identifier ● Source of funding ● Exchange across systems & borders: CC0 ● Reference lists ● URI values - mapping to common values making them transferrable
- 24. Rich metadata, new discovery
- 25. Rich metadata, rich storytelling
- 26. Lessons learned ● Move to distributed infrastructure ● Invest more in relationship mapping among objects in the dataset ● Build on work at the institution level ● Shared service AND reusable solutions
- 27. Decentralization of SHARE Under development: ● Template to make writing harvester code easy, using Node-RED ● Distributed framework for harvesting data ● Editor to clean, remediate, link harvested data Community, open-source software development to solve local problems
- 28. Use case: Research Intelligence “Aggregation, curation, and utilization of metadata about research activities. [RIMs} … help reliably connect a complex scholarly communications landscape of researchers, affiliations, publications, datasets, grants, projects, and their persistent identifiers.” OCLC Research Library Partnerships: https://www.oclc.org/research/themes/research-collections/rim.html
- 30. VIVO - June 2018 - Durham, NC The evolution of metadata at a generalist data repository Todd Vision Associate Prof, Department of Biology Adjunct, School of Information & Library Science University of North Carolina at Chapel Hill With thanks to Dryad staff Jane Greenberg, and the UNC/Drexel Metadata Research Center
- 31. The long tail of orphan dataVolume Rank frequency of datatype Specialized repositories (e.g. GenBank) Orphan data After Heidorn (2008) http://hdl.handle.net/2142/9127 Bumpus HC (1898) The Elimination of the Unfit as Illustrated by the Introduced Sparrow, Passer domesticus. A Fourth Contribution to the Study of Variation. pp. 209-226 in Biological Lectures from the Marine Biological Laboratory, Woods Hole, Mass. VIVO - June 2018 - Durham, NC
- 32. InformationContent Time Time of publication Specific details General details Accident Retirement or career change Death Michener, W. K., J. W. Brunt, J. Helly, T. B. Kirchner, and S. G. Stafford. 1997. Non-geospatial metadata for the ecological sciences. Ecological Applications 7:330-342. Data and metadata entropy VIVO - June 2018 - Durham, NC
- 33. Joint Data Archiving Policy Data are important products of the scientific enterprise, and they should be preserved and usable for decades in the future. As a condition for publication, data supporting the results in the article should be deposited in an appropriate public archive. Authors may elect to embargo access to the data for a period up to a year after publication. Exceptions may be granted at the discretion of the editor, especially for sensitive information. http://datadryad.org/pages/jdap VIVO - June 2018 - Durham, NC
- 34. VIVO - June 2018 - Durham, NC
- 35. Integration of manuscript and data submission VIVO - June 2018 - Durham, NC
- 36. A data “package” VIVO - June 2018 - Durham, NC
- 37. Supplementary documentation VIVO - June 2018 - Durham, NC
- 38. Interoperability VIVO - June 2018 - Durham,
- 39. Interoperability VIVO - June 2018 - Durham, NC
- 40. Interoperability VIVO - June 2018 - Durham, NC
- 41. Data citation VIVO - June 2018 - Durham, NC
- 42. Data Curation Network Uncurated Data Presenting scale and expertise challenges to individual institutions Curated Data at scale through shared Data Curation Network Appraise and Select Ingest Preserve Long-Term Facilitate Access DCN Review Assign CURATE Mediate Approve Check files and metadata Understand and run files Request missing information Augment metadata Transform file formats Evaluate for FAIRness C U R A T E The Data Curation Network VIVO - June 2018 - Durham, NC
- 43. DCN – planning phase (2016-2017) • Collaboration of six academic libraries • Can data curation staff be shared among institutions? • Questions – How to address policy differences? – What do researchers actually need help with? – Will researchers care if curation is distributed? – Can issues of trust and quality control be solved? – What skills and workflows are needed? Lisa Johnston et al. (2017) Data Curation Network: A Cross-Institutional Staffing Model for Curating Research Data http://hdl.handle.net/11299/188654 VIVO - June 2018 - Durham, NC
- 44. DCN - pilot phase (2018-2020) VIVO - June 2018 - Durham, NC
- 45. Partnership with VIVO - June 2018 - Durham, NC Make Data Count
- 46. VIVO - June 2018 - Durham, NC datadryad.org / @datadryad datacurationnetwork.org