Bibliometrics: Now There Are Options
Download as PPTX, PDF5 likes1,776 views
The document discusses bibliometrics, focusing on tools and metrics for evaluating scholarly communication and the influence of articles, journals, and scholars. It reviews various citation metrics, such as impact factor, immediacy index, and citation half-life, as well as newer tools like Google Scholar and Scopus that capture citation data across disciplines. Concerns about the limitations and adequacy of these metrics in assessing the quality and impact of journals are also highlighted.
Bibliometrics: Now There Are Options
- 1. Bibliometrics :Now There are OptionsElaine M. Lasda BergmanBibliographer for Social Welfare and Dewey ReferenceDewey Graduate LibraryApril 28, 2011
- 2. What is bibliometrics?Scholarly communicationInfluence of articles, journals, scholars
- 3. The birth of citation analysisEugene GarfieldCitation indexes and JCRBetter coverage on hard sciences than on social sciences and worse still on humanities
- 4. Garfield’s metricsCitation countImpact FactorImmediacy IndexCitation Half-Life
- 5. Citation countNumber of times cited within a given time periodAuthorJournalDoes not take into accountMaterials not included in citation databaseSelf citations
- 6. Impact factorMeasures “impact” of a journal (not an article) within a given subject Formula is a ratio:Number of citations to a journal in a given year from articles occurring in the past 2 years Divided by the number of scholarly articles published in the journal in the past 2 years
- 7. Concerns with impact factorCannot be used to compare cross disciplinary (per Garfield himself) due to different rates of publication and citationTwo year time frame not adequate for non-scientific disciplinesCoverage of some disciplines not sufficient in the ISI databasesIs a measure of “impact” a measure of “quality”?
- 8. Immediacy indexWhat it’s supposed to measure: how quickly articles in a given journal have an impact on the discipline Formula: the average number of times an article in a journal in a given year was cited in that same year
- 9. Citation Half-Life What it’s supposed to measure: duration of relevance of articles in a given journalFormula: median age of articles cited for a particular journal in a given year
- 10. Twenty first century tools
- 11. Influence of Google Page RankEigenvector analysis:“The probability that a researcher, in documenting his or her research, goes from a journal to another selecting a random reference in a research article of the first journal. Values obtained after the whole process represent a ‘random research walk’ that starts from a random journal to end in another after following an infinite process of selecting random references in research articles. A random jump factor is added to represent the probability that the researcher chooses a journal by means other than following the references of research articles.” (Gonzales-Pereira, et.al., 2010)
- 12. Sources Using ISI Data
- 13. Journalranking.comJournal Ranking.com uses ISI data and eigenvector (PageRank) algorhythm to create one’s own categoriesCan assign different weights to citations from the same journal, the same category and from other categories or only whithin a specific listNot updated since 2005http://libguides.library.albany.edu/content.php?pid=60086&sid=441804
- 14. Eigenfactor.org http://libguides.library.albany.edu/content.php?pid=60086&sid=441804Uses ISI dataSimilar to PageRankListed in JCR as of 2009Eigenfactor Score :Influence of the citing journal divided by the total number of citations appearing in that journalExample: Neurology (2006): score of .204 = an estimated 0.2% of all citation traffic of journals in JCR (Bergstrom & West, 2008).Larger journals will have more citations and therefore will have larger eigenfactors
- 15. Article Influence Score From Eigenfactor: measure of prestige of a journalAverage influence, per article of the papers on a journalComparable to the Impact Factor Corrects for the issues of journal size in the raw Eigenfactor scoreNeurology’s 2006 article influence score = 2.01. Or that an avg. article in Neurology is 2X as influential as an avg. article in all of JCR
- 16. ScienceWatchProvides “quick and dirty” articles on hot researchers, trending research topics, institutions and journalsMuch on this site (in-cites, etc) are now parts of analytical products being sold byThompson; no longer freeThere are still some good articles, but not searchable, hit or miss informationhttp://sciencewatch.com/dr/sci/11/
- 17. New sources for citation informationGoogle ScholarScopus
- 18. Scopus: alternate database of citation dataReview panel, i.e., quality controlBigger field than ISI: covers all the journals in WoS and moreStrongest in “hard”sciences”, ostensibly improved social science coverage, arts and humanities: are “getting there”Algorithmically determined with human editing
- 19. Google Scholaralternate database of citation dataNo rhyme or reason to what is includedBiggest source of citation dataForeign language sourcesSources other than scholarly journalsEntirely algorithmically determined, no human editing
- 21. SNIP (Source Normalized Impact Per Paper)Journal Ranking based on citation analysis with adjustments for the frequency of citations of the other journals within the field (the field is all journals citing this particular journal)SNIP is defined as the ratio of the journal’s citation count per paper and the citation potential in its subject field. (Moed, 2009)http://www.scopus.com/home.url
- 22. SJR:SCImago Journal RankWhat it’s supposed to measure: “current “average prestige per paper”SCImago website uses journal/citation data from Scopus, and is also available from scopus dbFormula: citation time window is 3 years instead of 2 like JIFCorrections for self citationsStrong correlation to JIF
- 23. SCImago Journal Rank Prestige factors include: number of journals in db, number of papers from journal in database, citation numbers and “importance” received from other journals: size dependent: larger journals have greater prestige valuesNormalized by the number of significant works published by the journal: helps correct for size variationsCorrections made for journal self citations
- 24. Scopus Author EvaluatorBreakdown of documents by sourceH-indexCitations per year (graph)
- 25. Google ScholarPublish or PerishCIDS
- 26. Publish or PerishProvides a variety of metrics for measuring scholarly impact and output.More useful for metrics on authors than journals or institutionsUses Google Scholar citation informationUseful for interdisciplinary topics, fields relying heavily on conference papers or reports, non-English language sources, new journals, etc.Continuously updated since 2006
- 27. Publish or Perish MetricsBasic metrics:# papers, #citations, active years, years since first published, average #of citations per paper, average # of citations per year, average # citations per author, etc.Complex metricsH index (and its many variations, mquotient, g-index (corrects h-index for variations in citation patterns), AR index, AW indexDoes not have any corrections for SELF CITATIONS
- 28. CIDSMeasures output of authors for prestige and influenceSimilar to PoPCorrects for Self-CitationsUses Google Scholar data
- 29. CIDS metricsCitations per year, h-index, g-index, total citations, avg cites per paper, self citations included and excluded, etc.http://cids.di.fc.ul.pt/cids_3_0/info.php?acc=25201514041114103161
- 30. MesurMetric based on usage, citation and bibliographic dataUses its own datbases of documents/metadata/reference, users & authors, “usage events” and citationsProject seems to be dead?
- 31. ConsiderationsDon’t measure an individual journal’s impact by the metrics for the entire journalCluster of years of citations Negative citationsA few high impact citations or a lot of low impact ciationsSource of citing documentsForeign, conference proceedings, traditional
- 32. Questions???
Editor's Notes
- #28: G index, contemporary h index, factors in age of articles, individual h index: per author, hm index, corrects for multiple authors by reducing paper counts,