SlideShare a Scribd company logo
Using
Bibliometrics
to Keep Up with
the Joneses
Christina K. Pikas, BS, MLS, PhD
Johns Hopkins University Applied Physics Laboratory
Nebulous Connections, April 4, 2017
How do you
know what’s
going on in
the world?
How do you
understand a
technology
landscape outside
your own?
You could interview
lots of people, make
site visits, and/or …
use bibliometrics!wocintechchat.com
Agenda
◎Questions to answer
◎General approach
◎Tips and techniques
◎Verification & validation
1.
Questions to Answer
Given a topic
What is the volume of work and how is it
trending?
What are the top venues?
Where is the work being done?
Countries?
Organizations?
Who funds this work?
What methods, models, etc. are used?
How is this field related to other
fields?
Who are the top researchers/ groups?
How well connected are they?
Given an organization
Over what distribution of topics
do they publish?
With whom do they collaborate?
Who funds their work?
How well cited is their work?
Is it taught in schools?
Does it have clinical applications?
Are there clinical or practical
implications/spin-offs/products?
Are there regulatory or policy implications?
Is the work discussed in the news? By
Congress?
2.
General Approach
Define topic
Search
CleanAnalyze
Report
Define Topic
◎Not too big, not too small
◎Best to do this with the end user of the
report
◎Work iteratively with a subject matter
expert if possible
◎Reference interview!
Search
◎Citation databases
BUT ALSO
◎Domain databases with high quality metadata
◎Technical report servers
◎Google Scholar, Microsoft Academic
◎Funding databases (NSF, Reporter,
URED if you are DoD)
Document
your searches
as you go!
Clean
Validity & Reliability
◎Count all the things
◎Associate correct
terms
◎Show accurate
trends
Tool Selection
◎Correct input for the tool
◎Be able to answer the
desired question with the
tool
◎Merge multiple sources
Note: This slide is from Monday’s talk about data preparation
Analyze
Relevant to the questions you are answering,
not what your favorite tool can do 
Report
◎Sometimes tables are better than
visualizations
◎Include narrative with results
◎Take time to include a backup section with a
clear description of what methods you used and
searches you performed
3.
Tips & Techniques
Geography
Geocoding correspondence address is
actually doable!
Sci2 and R are two paths.
Done with R
VantagePoint ($)
Text
◎VOS viewer does co-word graphing using
the abstract – free!
◎Can do in Gephi, but need to do pre-
processing elsewhere
◎R
Remember to
remove copyright
statements from
abstracts first to
avoid publisher
names being your
top result!
PNNL In-Spire (free to US Government & contractors)
PNNL In-Spire (free to US Government & contractors)
Networks
Co-authorship
Nodes as: authors, groups, organizations, countries
Citation
Citing/Cited, co-citation, bibliographic coupling
Funder – Researcher
Supplier – Builder
Co-word, semantic, topic, etc.
Gephi, Pajek, VOS viewer, Sci2, CitNetExplorer
And more…
A.Q. Rogers et al. (2015) You get what you pay for: examining the true cost of
delivering utility with small satellites. 31st Space Symposium. Colorado Springs,
CO
Done in R
Patent network with 1528 patents. Colored by clusters. Sized by degree. Labeled by clusters.
Done in Quid ($$$)
Data Cleaning
Enterprise Resource Planning
Data Acquisition
Data Integration & Transmission
Image & Visual Data
Vehicle Data
Signal Processing
Printing Applications
Data Cleansing (records)
Power Grid Applications
Multi-Dimensional Data
Multi-Media Data
Data Production & Metadata
Equipment Control
Mobile Devices
Test Data Integration
Data Enrichment
Sensor Networks
Electronic Payments
Sewing and Embroidery
Data Integration Management
Data Preparation Assistance
Medical Applications
Data Integration (business processes)
Mask Data Preparation (electronics manufacturing)
VantagePoint ($$)
4.
Verification &
Validation
Sounds more official than it probably is!
◎ Check with subject matter experts:
○ What is missing?
○ Does anything look amiss?
◎ For results, check for competing
hypotheses
◎ Put it in to Google
◎ Re-check for citing articles (recent or other)
◎ Carefully review all visualizations for
weirdness
Conclusions
◎Bibliometrics can provide a useful tool for
looking at a research landscape
◎Best done iteratively with subject matter
experts
◎Librarians can provide this service best
because of the searching and analyses
required
◎Be sure to not overstate results!
Questions?
You can find me at:
@cpikas
Christina.Pikas@jhuapl.edu
https://www.slideshare.net/cpikas
http://christinaslisrant.scientopia.org/
Credits
Special thanks to all the people who made and released
these awesome resources for free:
◎ Presentation template by SlidesCarnival
◎ Photographs by Unsplash & Death to the Stock Photo
(license)

More Related Content

PDF
Pikas using bibliometrics to make sense of research proposals
PPTX
Library support for metrics: What can and should we do?
PPTX
The role of new information and communication technologies in information and...
PDF
Warren-Jones "Using text-mining and summarisation technology to manage the gr...
PPTX
Cassidy "Case Study: Supporting Researcher Impact and Efficiency"
PPTX
Cooper "Simplicity is the Ultimate Sophistication: Accessible, Ubiquitous Tec...
PPTX
Case studies for open science
PPTX
Research information management: making sense of it all
Pikas using bibliometrics to make sense of research proposals
Library support for metrics: What can and should we do?
The role of new information and communication technologies in information and...
Warren-Jones "Using text-mining and summarisation technology to manage the gr...
Cassidy "Case Study: Supporting Researcher Impact and Efficiency"
Cooper "Simplicity is the Ultimate Sophistication: Accessible, Ubiquitous Tec...
Case studies for open science
Research information management: making sense of it all

What's hot (20)

PDF
Roth "Tools to support systematic review research"
PPTX
Navigating the data management ecosystem - John Kratz
PPTX
Carelli "Promoting Content Discovery Within the Reader/Researcher Workflow"
PPTX
So you want to do a meta analysis
PPTX
Gathering Evidence to Demonstrate Impact
PPTX
Mining Virtual Reference Data for an Iterative Assessment Cycle
PPTX
Choosing the right journal
PPTX
Harper Analytics Beyond Usage Numbers
PPTX
Midwest Medical Library Association 2015 Big Data Panel
PPT
Big Data (SOCIOMETRIC METHODS FOR RELEVANCY ANALYSIS OF LONG TAIL SCIENCE D...
PPTX
Evaluating information
PPTX
STS altmetrics webinar October 2015
PDF
Altmetrics - Measuring the Buzz
PPTX
Payton Eliminating Conflicts in Ebook Metadata
PPTX
The Kaleidoscope of Impact: same data, different perspectives, constantly cha...
PPTX
Your Systematic Review: Getting Started
PDF
Systematic Reviews Session 2: Searching
PPTX
Scholarly Metrics in Specialized Settings
PDF
Academy Owned Peer Review
Roth "Tools to support systematic review research"
Navigating the data management ecosystem - John Kratz
Carelli "Promoting Content Discovery Within the Reader/Researcher Workflow"
So you want to do a meta analysis
Gathering Evidence to Demonstrate Impact
Mining Virtual Reference Data for an Iterative Assessment Cycle
Choosing the right journal
Harper Analytics Beyond Usage Numbers
Midwest Medical Library Association 2015 Big Data Panel
Big Data (SOCIOMETRIC METHODS FOR RELEVANCY ANALYSIS OF LONG TAIL SCIENCE D...
Evaluating information
STS altmetrics webinar October 2015
Altmetrics - Measuring the Buzz
Payton Eliminating Conflicts in Ebook Metadata
The Kaleidoscope of Impact: same data, different perspectives, constantly cha...
Your Systematic Review: Getting Started
Systematic Reviews Session 2: Searching
Scholarly Metrics in Specialized Settings
Academy Owned Peer Review
Ad

Similar to Using Bibliometrics to Keep Up with the Joneses (20)

PPT
Ask Not What the NIH Can Do For You; Ask What You Can Do For the NIH
PPT
Biomedical Research as an Open Digital Enterprise
PPTX
Nasa at i_co_p_aug2011 2
PPTX
Nasa at i_co_p_aug2011 2
PPTX
Sparc-Japan-Slow-revolution-in-scholarly-communication
PDF
The OpenCon Intro to Open Data
PPT
How Semantic Technology Helps Researchers
PDF
Full Erdmann Ruttenberg Community Approaches to Open Data at Scale
PPTX
Social media cafe ResearchGate
PPT
Data management plans (dmp) for nsf
PPT
Data management plans (dmp) for nsf
PPTX
Seven questions about ResearchGate
PDF
PPT
Data management plans
DOC
Transcript - DOIs to support citation of grey literature
PDF
AFEL: Imbalance of Tag Recommendations
PDF
Holmes "Institutional Infrastructure for Data Sharing"
PPT
Evaluating Electronic Resources
PPT
Human Genome and Big Data Challenges
PDF
Nordic health data metadata
Ask Not What the NIH Can Do For You; Ask What You Can Do For the NIH
Biomedical Research as an Open Digital Enterprise
Nasa at i_co_p_aug2011 2
Nasa at i_co_p_aug2011 2
Sparc-Japan-Slow-revolution-in-scholarly-communication
The OpenCon Intro to Open Data
How Semantic Technology Helps Researchers
Full Erdmann Ruttenberg Community Approaches to Open Data at Scale
Social media cafe ResearchGate
Data management plans (dmp) for nsf
Data management plans (dmp) for nsf
Seven questions about ResearchGate
Data management plans
Transcript - DOIs to support citation of grey literature
AFEL: Imbalance of Tag Recommendations
Holmes "Institutional Infrastructure for Data Sharing"
Evaluating Electronic Resources
Human Genome and Big Data Challenges
Nordic health data metadata
Ad

More from Christina Pikas (18)

PDF
Pikas blogs for personal knowledge management (pkm) final for asist 04
PPTX
Pikas bibliometricsfor21may2015
PPT
Pikas research day 2014 poster
PPTX
Pikas casci talk 11262013 final
PPT
Pikas 2013 research day poster 03022013
PPTX
Pikas research day 2011
PPTX
Pikas research day 2011 presentation
PPTX
Pikas xtreme reference 2010 final
PPTX
Pikas Psp Presentation February 2010
PPTX
DRAFT PSP Presentation February 2010
PPT
Updating The Standard Model
PPT
Detecting Communities in Science Blogs
PPT
Pikas Developments In Sci Tech Search Web Search U 08
PPT
Pikas Asist2007 PIM Senior Engineers Final
PPT
Pikas Maryland Tech Day 2007
PPT
Pikas Sla07 Physicists Uses Of Blogs
PDF
Innovative Libraries: Tales from the Stacks
PPT
Blogs for Information Management
Pikas blogs for personal knowledge management (pkm) final for asist 04
Pikas bibliometricsfor21may2015
Pikas research day 2014 poster
Pikas casci talk 11262013 final
Pikas 2013 research day poster 03022013
Pikas research day 2011
Pikas research day 2011 presentation
Pikas xtreme reference 2010 final
Pikas Psp Presentation February 2010
DRAFT PSP Presentation February 2010
Updating The Standard Model
Detecting Communities in Science Blogs
Pikas Developments In Sci Tech Search Web Search U 08
Pikas Asist2007 PIM Senior Engineers Final
Pikas Maryland Tech Day 2007
Pikas Sla07 Physicists Uses Of Blogs
Innovative Libraries: Tales from the Stacks
Blogs for Information Management

Recently uploaded (20)

PPTX
7. General Toxicologyfor clinical phrmacy.pptx
PDF
An interstellar mission to test astrophysical black holes
PPTX
microscope-Lecturecjchchchchcuvuvhc.pptx
PPTX
Comparative Structure of Integument in Vertebrates.pptx
PPTX
Cell Membrane: Structure, Composition & Functions
PPT
POSITIONING IN OPERATION THEATRE ROOM.ppt
PPTX
Derivatives of integument scales, beaks, horns,.pptx
PDF
. Radiology Case Scenariosssssssssssssss
PDF
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
PDF
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
PPTX
ognitive-behavioral therapy, mindfulness-based approaches, coping skills trai...
PPTX
2. Earth - The Living Planet earth and life
PPTX
2Systematics of Living Organisms t-.pptx
PDF
HPLC-PPT.docx high performance liquid chromatography
PDF
Placing the Near-Earth Object Impact Probability in Context
PDF
Phytochemical Investigation of Miliusa longipes.pdf
PDF
bbec55_b34400a7914c42429908233dbd381773.pdf
PDF
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
PPTX
The KM-GBF monitoring framework – status & key messages.pptx
PPTX
Taita Taveta Laboratory Technician Workshop Presentation.pptx
7. General Toxicologyfor clinical phrmacy.pptx
An interstellar mission to test astrophysical black holes
microscope-Lecturecjchchchchcuvuvhc.pptx
Comparative Structure of Integument in Vertebrates.pptx
Cell Membrane: Structure, Composition & Functions
POSITIONING IN OPERATION THEATRE ROOM.ppt
Derivatives of integument scales, beaks, horns,.pptx
. Radiology Case Scenariosssssssssssssss
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
ognitive-behavioral therapy, mindfulness-based approaches, coping skills trai...
2. Earth - The Living Planet earth and life
2Systematics of Living Organisms t-.pptx
HPLC-PPT.docx high performance liquid chromatography
Placing the Near-Earth Object Impact Probability in Context
Phytochemical Investigation of Miliusa longipes.pdf
bbec55_b34400a7914c42429908233dbd381773.pdf
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
The KM-GBF monitoring framework – status & key messages.pptx
Taita Taveta Laboratory Technician Workshop Presentation.pptx

Using Bibliometrics to Keep Up with the Joneses

  • 1. Using Bibliometrics to Keep Up with the Joneses Christina K. Pikas, BS, MLS, PhD Johns Hopkins University Applied Physics Laboratory Nebulous Connections, April 4, 2017
  • 2. How do you know what’s going on in the world?
  • 3. How do you understand a technology landscape outside your own?
  • 4. You could interview lots of people, make site visits, and/or … use bibliometrics!wocintechchat.com
  • 5. Agenda ◎Questions to answer ◎General approach ◎Tips and techniques ◎Verification & validation
  • 7. Given a topic What is the volume of work and how is it trending? What are the top venues? Where is the work being done? Countries? Organizations?
  • 8. Who funds this work? What methods, models, etc. are used? How is this field related to other fields? Who are the top researchers/ groups? How well connected are they?
  • 9. Given an organization Over what distribution of topics do they publish? With whom do they collaborate? Who funds their work? How well cited is their work? Is it taught in schools? Does it have clinical applications?
  • 10. Are there clinical or practical implications/spin-offs/products? Are there regulatory or policy implications? Is the work discussed in the news? By Congress?
  • 13. Define Topic ◎Not too big, not too small ◎Best to do this with the end user of the report ◎Work iteratively with a subject matter expert if possible ◎Reference interview!
  • 14. Search ◎Citation databases BUT ALSO ◎Domain databases with high quality metadata ◎Technical report servers ◎Google Scholar, Microsoft Academic ◎Funding databases (NSF, Reporter, URED if you are DoD) Document your searches as you go!
  • 15. Clean
  • 16. Validity & Reliability ◎Count all the things ◎Associate correct terms ◎Show accurate trends Tool Selection ◎Correct input for the tool ◎Be able to answer the desired question with the tool ◎Merge multiple sources Note: This slide is from Monday’s talk about data preparation
  • 17. Analyze Relevant to the questions you are answering, not what your favorite tool can do 
  • 18. Report ◎Sometimes tables are better than visualizations ◎Include narrative with results ◎Take time to include a backup section with a clear description of what methods you used and searches you performed
  • 20. Geography Geocoding correspondence address is actually doable! Sci2 and R are two paths.
  • 23. Text ◎VOS viewer does co-word graphing using the abstract – free! ◎Can do in Gephi, but need to do pre- processing elsewhere ◎R Remember to remove copyright statements from abstracts first to avoid publisher names being your top result!
  • 24. PNNL In-Spire (free to US Government & contractors)
  • 25. PNNL In-Spire (free to US Government & contractors)
  • 26. Networks Co-authorship Nodes as: authors, groups, organizations, countries Citation Citing/Cited, co-citation, bibliographic coupling Funder – Researcher Supplier – Builder Co-word, semantic, topic, etc. Gephi, Pajek, VOS viewer, Sci2, CitNetExplorer And more…
  • 27. A.Q. Rogers et al. (2015) You get what you pay for: examining the true cost of delivering utility with small satellites. 31st Space Symposium. Colorado Springs, CO Done in R
  • 28. Patent network with 1528 patents. Colored by clusters. Sized by degree. Labeled by clusters. Done in Quid ($$$) Data Cleaning Enterprise Resource Planning Data Acquisition Data Integration & Transmission Image & Visual Data Vehicle Data Signal Processing Printing Applications Data Cleansing (records) Power Grid Applications Multi-Dimensional Data Multi-Media Data Data Production & Metadata Equipment Control Mobile Devices Test Data Integration Data Enrichment Sensor Networks Electronic Payments Sewing and Embroidery Data Integration Management Data Preparation Assistance Medical Applications Data Integration (business processes) Mask Data Preparation (electronics manufacturing)
  • 31. Sounds more official than it probably is! ◎ Check with subject matter experts: ○ What is missing? ○ Does anything look amiss? ◎ For results, check for competing hypotheses ◎ Put it in to Google ◎ Re-check for citing articles (recent or other) ◎ Carefully review all visualizations for weirdness
  • 33. ◎Bibliometrics can provide a useful tool for looking at a research landscape ◎Best done iteratively with subject matter experts ◎Librarians can provide this service best because of the searching and analyses required ◎Be sure to not overstate results!
  • 34. Questions? You can find me at: @cpikas Christina.Pikas@jhuapl.edu https://www.slideshare.net/cpikas http://christinaslisrant.scientopia.org/
  • 35. Credits Special thanks to all the people who made and released these awesome resources for free: ◎ Presentation template by SlidesCarnival ◎ Photographs by Unsplash & Death to the Stock Photo (license)

Editor's Notes

  • #3: NASA via unsplash
  • #4: Rob Morton on unsplash
  • #5: https://www.flickr.com/photos/wocintechchat/21910900553/