Practice with PoP: How to use Publish or Perish Effectively
4 likes2,480 views
The document discusses the importance of citation metrics in evaluating academic publications, emphasizing the difference between the perceived quality of journals and actual citation impact. It introduces various metrics such as h-index and individual annualised h-index (hia), and compares citation data from different sources like ISI, Scopus, and Google Scholar across multiple disciplines. Additionally, it provides practical applications of the 'Publish or Perish' tool for tracking citations, preparing for academic evaluations, and conducting literature reviews.
![Why citation analysis?:
Proof over promise
¡ Assessment of the quality of a publication might be (subconsciously)
influenced by the “promise” of:
¡ the journal in which it is published,
¡ the reputation of the author's affiliation,
¡ the sub-discipline (theoretical/modeling vs. applied, hard vs. soft)
¡ [Promise] Publication in a “triple-A” journal initially means that 3-4
academics thought your paper was a worthwhile contribution to the
field. But what if this paper is subsequently hardly ever cited?
¡ [Proof] Publication in a “C-journal” with 1,000+ citations means that 1,000
academics considered your paper to be a worthwhile contribution to
the field
¡ For more details and an application see:
¡ Harzing, A.W.; Mijnhardt, W. (2015) Proof over promise: Towards a more
inclusive ranking of Dutch academics in Economics & Business,
Scientometrics, vol. 102, no. 1, pp. 727-749. Available online...
¡ Article’s main conclusion: Using citation metrics leads to more diverse
rankings (in terms of gender, affiliation, age, and discipline)](https://image.slidesharecdn.com/poppractice-150928164517-lva1-app6892/85/Practice-with-PoP-How-to-use-Publish-or-Perish-Effectively-2-320.jpg)
![Publish or Perish for individuals
How to present your case?
¡ It is all about finding your “diamonds” and polishing them to
make them shine!
¡ Find your reference group
¡ Overall record: Average or range for academics at the same level in
your department or field of research (either nationally or worldwide)
¡ Individual papers: Publications in the same journal in the same year
¡ How does your article score within the journal? [Use Journal
Impact]
¡ One of the top-3/5/10(%) scorers in that year? (OS 2003) (see
screenshot)
¡ Play with this for the different data sources: 6th most cited in
Google Scholar, 3rd most cited in Scopus, 2nd most cited in
Thomson Reuters ISI
¡ The most cited paper in the year (JWB 2013) (see screenshot)
¡ Most cited single-authored paper (JWB 2002) (see screenshot)
¡ The first listed paper from your country/outside USA? (IJHRM 1995)
(see screenshot)](https://image.slidesharecdn.com/poppractice-150928164517-lva1-app6892/85/Practice-with-PoP-How-to-use-Publish-or-Perish-Effectively-12-320.jpg)
![Journal submission
¡ Before submitting to a journal ensure you have not
missed any publications on your topic
¡ Use General citations
¡ Enter journal title in publication field
¡ Enter topic key words in “all of the words”, “any of
the words” or “the phrase” [words in that exact
order]
¡ If you get too many results, tick the box “title words
only” which searches only in the title (as opposed to
the entire article)
¡ You can combine searches by using OR (in capitals)](https://image.slidesharecdn.com/poppractice-150928164517-lva1-app6892/85/Practice-with-PoP-How-to-use-Publish-or-Perish-Effectively-15-320.jpg)
Practice with PoP: How to use Publish or Perish Effectively
- 1. Practice with PoP: How to use Publish or Perish effectively? Professor Anne-Wil Harzing Middlesex University www.harzing.com
- 2. Why citation analysis?: Proof over promise ¡ Assessment of the quality of a publication might be (subconsciously) influenced by the “promise” of: ¡ the journal in which it is published, ¡ the reputation of the author's affiliation, ¡ the sub-discipline (theoretical/modeling vs. applied, hard vs. soft) ¡ [Promise] Publication in a “triple-A” journal initially means that 3-4 academics thought your paper was a worthwhile contribution to the field. But what if this paper is subsequently hardly ever cited? ¡ [Proof] Publication in a “C-journal” with 1,000+ citations means that 1,000 academics considered your paper to be a worthwhile contribution to the field ¡ For more details and an application see: ¡ Harzing, A.W.; Mijnhardt, W. (2015) Proof over promise: Towards a more inclusive ranking of Dutch academics in Economics & Business, Scientometrics, vol. 102, no. 1, pp. 727-749. Available online... ¡ Article’s main conclusion: Using citation metrics leads to more diverse rankings (in terms of gender, affiliation, age, and discipline)
- 3. Which citation metrics? What is a h-index, why is hIa better? ¡ H-index increasingly seen as a convenient summary of quantity & impact and is used in many research assessments ¡ H-index of 10 means an academic has published 10 papers with at least 10 citations each ¡ hIa (Individual annualised h-index), i.e. h-index corrected for career length and number of co-authors ¡ measures the average number of single-author equivalent impactful publications an academic publishes a year (usually well below 1.0) ¡ For details see: ¡ Harzing, A.W.; Alakangas, S.; Adams, D. (2014) hIa: An individual annual h-index to accommodate disciplinary and career length differences, Scientometrics, vol. 99, no. 3, pp. 811-821. Available online…
- 4. Which data source? ISI, Scopus or Google Scholar ¡ Sample of 148 Associate and Full Professors at the University of Melbourne ¡ All main disciplines (Humanities, Social Sciences, Engineering, Sciences, Life Sciences) were represented, 37 sub-disciplines ¡ Two professors (1 male, 1 female) and two associate profs (1 male, 1 female) in each sub-discipline (e.g. management, marketing, accounting, economics) ¡ Citation metrics in WoS/ISI, Scopus and Google Scholar ¡ Collected citation data every 3 months for nearly 2 years ¡ Google Scholar data collected with Publish or Perish, WoS/ISI and Scopus collected in the respective databases and imported into Publish or Perish to calculate metrics ¡ The final conclusion: with appropriate metrics and data sources, citation metrics can be applied in the Social Sciences ¡ ISI H-index: Life Sciences average lies 200% above Social Sciences average ¡ Google Scholar hIa index: Life Sciences average lies 8% below Social Sciences average
- 5. Comparing data sources across disciplines: 148 academics (1) 0 20 40 60 80 100 120 140 160 180 200 Humanities Social Sciences Engineering Sciences Life Sciences Web of Science 16 30 81 98 109 Scopus 21 34 103 101 123 Google Scholar 93 115 143 149 189 Averagenumberofpapers
- 6. Comparing data sources across disciplines: 148 academics (2) 0 500 1000 1500 2000 2500 3000 3500 4000 4500 5000 Humanities Social Sciences Engineering Sciences Life Sciences Web of Science 61 591 897 2612 3139 Scopus 100 782 1132 2558 3313 Google Scholar 871 2604 1964 3984 4699 Averagenumberofcitations
- 7. Comparing data sources across disciplines: 148 academics (3) 0.0 5.0 10.0 15.0 20.0 25.0 30.0 35.0 Web of Science Scopus Google Scholar Humanities 3.5 4.3 12.3 Social Sciences 9.6 12.0 21.5 Engineering 13.5 15.6 20.8 Sciences 25.6 25.6 30.1 Life Sciences 27.1 28.3 33.4 Averageh-index
- 8. Comparing data sources across disciplines: 148 academics (4) 0.00 0.10 0.20 0.30 0.40 0.50 0.60 0.70 Web of Science Scopus Google Scholar Humanities 0.14 0.18 0.36 Social Sciences 0.32 0.42 0.66 Engineering 0.33 0.41 0.53 Sciences 0.44 0.45 0.57 Life Sciences 0.43 0.46 0.65 AveragehIaindex
- 9. Practical applications of Publish or Perish ¡ How can I use Publish or Perish to (see links for details in online version of the Publish or Perish Book) ¡ Track my own citations? (http://www.harzing.com/popbook/ch3.htm) ¡ Present my case for confirmation or promotion? (http://www.harzing.com/popbook/ch7.htm) ¡ Ensure I don’t miss key publications in the journal I am submitting to? (http://www.harzing.com/popbook/ch10_3.htm) ¡ Prepare for a meeting with an academic I don’t know? (http://www.harzing.com/popbook/ch8_1.htm) ¡ Systematically store queries so I can run them again? (http://www.harzing.com/popbook/ch6_2_3.htm)
- 10. Track your own citations ¡ Use Author impact Author search, e.g. “A Harzing” ¡ Review various measures of impact ¡ Many well-cited pubs (h-index) vs some highly-cited pubs (g- index) ¡ Young versus older researchers (hc index measures current impact) ¡ Single versus co-authored (hI norm corrects for multiple authors) ¡ Combined corrections for co-authorship and career stage (hIa) ¡ Which of your publications is a star? ¡ Review citations per year for each publication ¡ Shows you which of your research topics have more impact ¡ What type of publication is it?
- 12. Publish or Perish for individuals How to present your case? ¡ It is all about finding your “diamonds” and polishing them to make them shine! ¡ Find your reference group ¡ Overall record: Average or range for academics at the same level in your department or field of research (either nationally or worldwide) ¡ Individual papers: Publications in the same journal in the same year ¡ How does your article score within the journal? [Use Journal Impact] ¡ One of the top-3/5/10(%) scorers in that year? (OS 2003) (see screenshot) ¡ Play with this for the different data sources: 6th most cited in Google Scholar, 3rd most cited in Scopus, 2nd most cited in Thomson Reuters ISI ¡ The most cited paper in the year (JWB 2013) (see screenshot) ¡ Most cited single-authored paper (JWB 2002) (see screenshot) ¡ The first listed paper from your country/outside USA? (IJHRM 1995) (see screenshot)
- 15. Journal submission ¡ Before submitting to a journal ensure you have not missed any publications on your topic ¡ Use General citations ¡ Enter journal title in publication field ¡ Enter topic key words in “all of the words”, “any of the words” or “the phrase” [words in that exact order] ¡ If you get too many results, tick the box “title words only” which searches only in the title (as opposed to the entire article) ¡ You can combine searches by using OR (in capitals)
- 17. Imagine: Meeting your academic hero for dinner? ¡ You want to make a good impression ¡ You need to make sure you know a bit more about them than just the specific paper you have used for your PhD ¡ You have been running late all day and only have 10 minutes left before going to the restaurant, what do you do? ¡ Run a Publish or Perish search and sort the results: ¡ By citations, to learn about their most cited article (was it the one you used in your PhD or not?) ¡ By citations per year to learn about any recent highly cited articles ¡ By year, to learn about their most recent interests (academics might long be bored with their seminal contributions) ¡ By publication, to get an idea of the journals they have published in (any journals you have published in too?; US/ European journals, academic/ practitioner journals, general/specialised journals, books) ¡ By author, to get a feel for whom they have worked with (anyone you know?) ¡ An academic’s publication and citation record is the public reflection of their “research story” and you can learn a lot from it
- 18. How to store your queries? ¡ PoP automatically stores any queries you run in the multi-query center ¡ Queries are stored in the “recent queries” folder ¡ They are moved to the “older queries” folder if they are >30 days old ¡ They are moved to the “trash” folder after 180 days ¡ “Query aging” can be adjusted in the preferences ¡ Functionality is very similar to Windows explorer ¡ You can create new folder and sub-folders to organise your queries ¡ Folders and queries can be renamed, copied, or dragged and dropped ¡ Stored queries can be run again at any time by selecting all the queries you want to rerun and click look-up direct ¡ If you want to KEEP the old result (e.g. to check changes over time), FIRST copy the query and then run the copied query again ¡ In the screenshot, note the strong increase in citations over the last 5 years for highly cited AoM presidents DC Hambrick and DM Rousseau ¡ This is caused partly by expansion of Google Scholar coverage and partly by natural increase of citations ¡ Hence DO NOT compare current day citation metrics to citation metrics gathered years ago
- 20. More information? Part 1: How to use Publish or Perish more effectively Chapter 1: Introduction to citation analysis Chapter 2: Introduction to Publish or Perish Chapter 3: Author searches Chapter 4: Journal searches Chapter 5: General citation search queries Chapter 6: Multi-query centre Part 2: Day-to-day uses of Publish or Perish citation analysis Chapter 7: Making your case for tenure or promotion Chapter 8: How to evaluate other academics Chapter 9: Tips for deans and other academic administrators Chapter 10: Where to submit your paper? Chapter 11: Conducting a literature review Part 3: Advanced topics: Delving deeper into the world of citation analysis Chapter 12: Doing bibliometric research on authors & journals Chapter 13: Evaluating Google Scholar Chapter 14: Evaluating Thomson ISI Web of Science Chapter 15: A Google Scholar h-index for journals Chapter 16: Author citation analysis across disciplines http://www.harzing.com/popbook_pbk.htm