SlideShare a Scribd company logo
Web Tools for Peer Reviewers … and Everyone Richard Akerman ICSTI Public Conference 2007 June 21, 2007
The Motivation for Science If Mr. Cavor made [the gravity-blocking substance], it would go down to posterity as Cavorite or Cavorine, and he would be made an F.R.S., and his portrait given away as a scientific worthy with  Nature , and things like that. And that was all he saw! - H.G. Wells,  The First Men in the Moon  (1901)
Peer Review also remains basically unchanged And has enduring value Some enhancement through automation of review process citation linking plagiarism detection Perhaps increased recognition or openness Publish list of reviewers annually Publish reviewer comments after some embargo period
 
Overview Exploring the problem space New metrics Certification (and reward) challenges Some example web tools
Two Problem Spaces and Two Directions Find existing Articles, experts, clusters, objects (article discovery) Discover new Ideas, concepts, relationships (knowledge discovery) Retrospective The existing body of scientific knowledge, the citation web, known author relationships Prospective (real-time) New and unconnected or weakly-connected work and authors ( Ramanujan )
Retrospective Finding Start with some nucleus idea, keywords, article, author, (collection), your history Find a network of related objects How?  Recommender services. Use metrics/features and find closeness/similarity in some feature space
Features/Quality Metrics Networks of Citations Authors (reputation) Groups and Projects Certification (journal publication) Position in these networks
http://www. flickr .com/photos/ darkmatterpaintball /251552464/
Forensics & Major Miner Problems Examining the corpse / dead trees Fossilized trees -> coal -> mining! We need to recognize this knowledge metaphor We’re mining material that is already refined
http://www. flickr .com/photos/ mekin /399220499/
Thinking about mining Currently most demonstrations are only on abstracts due to limited full-text availability So we are mining a refinement of the refinement Rights are a major problem Lack of mining rights is one factor that is driving open access Also knowledge discovery leads into difficult areas of machine reasoning What does it mean to move beyond mining?
Talking a walk in the the forest How do we find the new Mr. Cavor? Exploring the World Wide Web (including repositories) as opposed to the World Wide Literature Blogs, wikis, videos, datasets And pre-prints The retrospective metrics we could use are either weaker or non-existent
http://www. flickr .com/photos/ jzakariya /191481917/
What New Metrics Can We Use? Derived reputation (e.g.  Nature  blogs) Page rank and similar citation-like connections Bookmarks Intentional rank Comments Page hits /  usage  / viewing time Derived quality (important person or group) favours this object (many many people) favour this object Lots of privacy issues
Challenges: Download/Views The versions challenge – many copies of the article in many places http://www.lse.ac.uk/library/versions/ eprintweb is linking pre-prints to published versions Search engines (spidering)
Challenges for Certification What should be certified? Articles in repositories Blog entries Versioned Wiki entries Data sets Videos Annotated mashups How is certification asserted? Some sort of digital signature What sort of scientific rewards can we provide for the new Mr. Cavor?
Example: Eigenfactor
Example: eprintweb.org astro-ph/0607051  (July 2006) Bulk viscosity of Mixed nucleon-hyperon-quark Matter in Neutron stars Na-Na Pan, Xiao-Ping Zheng and Jia-Rong Li Received. 04 July 2006  Last updated. 04 July 2006 Abstract. We calculate the coefficient of bulk viscosity … Journal-ref. Mon.Not.Roy.Astron.Soc. 371 (2006) 1359 Published Article doi:  10.1111/j.1365-2966.2006.10759.x
Example: ScienceBlogs
Example: Postgenomic
Example: ChemRank
Thank You Richard dot Akerman at NRC dot CA Supplementary bookmarks at http://www.connotea.org/user/scilib/tag/icsti2007akerman © 2007 Government of Canada and licensed  in the Creative Commons http://creativecommons.org/licenses/by-nc-sa/2.5/

More Related Content

PPTX
Keeping up to date
PPT
Copyright crash course 3rd revision ppt 6340.64 sonia aldape
PPTX
Copyright edtc6340.66 april_canales_final
PPT
產業實習
PPT
Mobile Web 2.0, Mobile Widgets, Microlearning and Intertwingularity
PPT
An Open Context for Archaeology
PPT
PPTX
The Rhetoric of Research Objects
Keeping up to date
Copyright crash course 3rd revision ppt 6340.64 sonia aldape
Copyright edtc6340.66 april_canales_final
產業實習
Mobile Web 2.0, Mobile Widgets, Microlearning and Intertwingularity
An Open Context for Archaeology
The Rhetoric of Research Objects

Similar to Web Tools For Peer Reviewers... and Everyone (20)

PPTX
Reproducibility, Research Objects and Reality, Leiden 2016
PPT
How to get Information for Your Geology Assignments
PPT
Earth Sciences 4490: Getting Started on your Literature Review
PPT
Open access for researchers, policy makers and research managers - Short ver...
PPT
Usability Testing a Public ERM: Worth the Effort?
PPT
Next Generation Technical Services May 2009 Calhoun
PPT
Peer Review and Science2.0
PPTX
Introduction to the Library for ERTH10001 The Global Environment/ERTH10002 Un...
PPT
Library OKRA: A Matter of Semantics? Intelligence, Open Data and the Future o...
PPT
E research overview gahegan bioinformatics workshop 2010
PPT
Beyond Open Access: Open Data, Web services, and Semantics (the Open Context ...
PDF
Research Shared: researchobject.org
PPT
Rots RDAP11 Data Archives in Federal Agencies
PDF
HERS SA Academy 8 September 2014: Workshop on Scholarly Journals
PPT
Scholarly Publishing 2.0 Squared
PPT
Earth Sciences 4490: Library Research Tools for your Literature Review
PDF
Probing Galaxy Evolution By Unveiling The Structure Of Massive Galaxies Acros...
PPT
Geology Geophysics 9580 9680 Library Workshop
PPT
PLoS - Why It is a Model to be Emulated
PPTX
Libraries and Linked Data: Looking to the Future (3)
Reproducibility, Research Objects and Reality, Leiden 2016
How to get Information for Your Geology Assignments
Earth Sciences 4490: Getting Started on your Literature Review
Open access for researchers, policy makers and research managers - Short ver...
Usability Testing a Public ERM: Worth the Effort?
Next Generation Technical Services May 2009 Calhoun
Peer Review and Science2.0
Introduction to the Library for ERTH10001 The Global Environment/ERTH10002 Un...
Library OKRA: A Matter of Semantics? Intelligence, Open Data and the Future o...
E research overview gahegan bioinformatics workshop 2010
Beyond Open Access: Open Data, Web services, and Semantics (the Open Context ...
Research Shared: researchobject.org
Rots RDAP11 Data Archives in Federal Agencies
HERS SA Academy 8 September 2014: Workshop on Scholarly Journals
Scholarly Publishing 2.0 Squared
Earth Sciences 4490: Library Research Tools for your Literature Review
Probing Galaxy Evolution By Unveiling The Structure Of Massive Galaxies Acros...
Geology Geophysics 9580 9680 Library Workshop
PLoS - Why It is a Model to be Emulated
Libraries and Linked Data: Looking to the Future (3)
Ad

More from Richard Akerman (19)

PPTX
Open science in the Government of Canada
PPTX
Open Scientific Data
PPTX
Culture Shock: Managing the Change in Publishing
PPTX
When are we going to get to the science factory?
PPTX
Springtime for publishers - 20120711
PPTX
Springtime for Publishers?
PPTX
Google Wave
PDF
Science to the People
PPTX
Will We Command Our Data? From the Petascale to the Personal
ZIP
Web 2.0 timeline and future
PPT
CISTI: Promoting Science Access
PDF
Building SkyNet for Science: Discovering New Frontiers Using Embedded Knowledge
PDF
Service-Oriented Architecture for Libraries
PPT
Trendspotting
PPT
Library service-oriented architecture to enhance access to science
PDF
The Internet - A Scholarly Community?
PPT
Service-Oriented Architecture Methods to Develop Networked Library Services
PPT
Library Web Services for Discovery and Delivery of Scientific Information
PPT
Open science in the Government of Canada
Open Scientific Data
Culture Shock: Managing the Change in Publishing
When are we going to get to the science factory?
Springtime for publishers - 20120711
Springtime for Publishers?
Google Wave
Science to the People
Will We Command Our Data? From the Petascale to the Personal
Web 2.0 timeline and future
CISTI: Promoting Science Access
Building SkyNet for Science: Discovering New Frontiers Using Embedded Knowledge
Service-Oriented Architecture for Libraries
Trendspotting
Library service-oriented architecture to enhance access to science
The Internet - A Scholarly Community?
Service-Oriented Architecture Methods to Develop Networked Library Services
Library Web Services for Discovery and Delivery of Scientific Information
Ad

Recently uploaded (20)

PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PPTX
Tartificialntelligence_presentation.pptx
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
A comparative analysis of optical character recognition models for extracting...
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Encapsulation theory and applications.pdf
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Electronic commerce courselecture one. Pdf
PDF
Accuracy of neural networks in brain wave diagnosis of schizophrenia
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Tartificialntelligence_presentation.pptx
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
A comparative analysis of optical character recognition models for extracting...
20250228 LYD VKU AI Blended-Learning.pptx
Encapsulation theory and applications.pdf
Building Integrated photovoltaic BIPV_UPV.pdf
Programs and apps: productivity, graphics, security and other tools
Diabetes mellitus diagnosis method based random forest with bat algorithm
Electronic commerce courselecture one. Pdf
Accuracy of neural networks in brain wave diagnosis of schizophrenia
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
MIND Revenue Release Quarter 2 2025 Press Release
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
NewMind AI Weekly Chronicles - August'25-Week II
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Dropbox Q2 2025 Financial Results & Investor Presentation

Web Tools For Peer Reviewers... and Everyone

  • 1. Web Tools for Peer Reviewers … and Everyone Richard Akerman ICSTI Public Conference 2007 June 21, 2007
  • 2. The Motivation for Science If Mr. Cavor made [the gravity-blocking substance], it would go down to posterity as Cavorite or Cavorine, and he would be made an F.R.S., and his portrait given away as a scientific worthy with Nature , and things like that. And that was all he saw! - H.G. Wells, The First Men in the Moon (1901)
  • 3. Peer Review also remains basically unchanged And has enduring value Some enhancement through automation of review process citation linking plagiarism detection Perhaps increased recognition or openness Publish list of reviewers annually Publish reviewer comments after some embargo period
  • 4.  
  • 5. Overview Exploring the problem space New metrics Certification (and reward) challenges Some example web tools
  • 6. Two Problem Spaces and Two Directions Find existing Articles, experts, clusters, objects (article discovery) Discover new Ideas, concepts, relationships (knowledge discovery) Retrospective The existing body of scientific knowledge, the citation web, known author relationships Prospective (real-time) New and unconnected or weakly-connected work and authors ( Ramanujan )
  • 7. Retrospective Finding Start with some nucleus idea, keywords, article, author, (collection), your history Find a network of related objects How? Recommender services. Use metrics/features and find closeness/similarity in some feature space
  • 8. Features/Quality Metrics Networks of Citations Authors (reputation) Groups and Projects Certification (journal publication) Position in these networks
  • 9. http://www. flickr .com/photos/ darkmatterpaintball /251552464/
  • 10. Forensics & Major Miner Problems Examining the corpse / dead trees Fossilized trees -> coal -> mining! We need to recognize this knowledge metaphor We’re mining material that is already refined
  • 11. http://www. flickr .com/photos/ mekin /399220499/
  • 12. Thinking about mining Currently most demonstrations are only on abstracts due to limited full-text availability So we are mining a refinement of the refinement Rights are a major problem Lack of mining rights is one factor that is driving open access Also knowledge discovery leads into difficult areas of machine reasoning What does it mean to move beyond mining?
  • 13. Talking a walk in the the forest How do we find the new Mr. Cavor? Exploring the World Wide Web (including repositories) as opposed to the World Wide Literature Blogs, wikis, videos, datasets And pre-prints The retrospective metrics we could use are either weaker or non-existent
  • 14. http://www. flickr .com/photos/ jzakariya /191481917/
  • 15. What New Metrics Can We Use? Derived reputation (e.g. Nature blogs) Page rank and similar citation-like connections Bookmarks Intentional rank Comments Page hits / usage / viewing time Derived quality (important person or group) favours this object (many many people) favour this object Lots of privacy issues
  • 16. Challenges: Download/Views The versions challenge – many copies of the article in many places http://www.lse.ac.uk/library/versions/ eprintweb is linking pre-prints to published versions Search engines (spidering)
  • 17. Challenges for Certification What should be certified? Articles in repositories Blog entries Versioned Wiki entries Data sets Videos Annotated mashups How is certification asserted? Some sort of digital signature What sort of scientific rewards can we provide for the new Mr. Cavor?
  • 19. Example: eprintweb.org astro-ph/0607051 (July 2006) Bulk viscosity of Mixed nucleon-hyperon-quark Matter in Neutron stars Na-Na Pan, Xiao-Ping Zheng and Jia-Rong Li Received. 04 July 2006 Last updated. 04 July 2006 Abstract. We calculate the coefficient of bulk viscosity … Journal-ref. Mon.Not.Roy.Astron.Soc. 371 (2006) 1359 Published Article doi: 10.1111/j.1365-2966.2006.10759.x
  • 23. Thank You Richard dot Akerman at NRC dot CA Supplementary bookmarks at http://www.connotea.org/user/scilib/tag/icsti2007akerman © 2007 Government of Canada and licensed in the Creative Commons http://creativecommons.org/licenses/by-nc-sa/2.5/