Assessing the quality of open access journals suzhou presentation

ASSESSING THE
QUALITY OF OPEN
ACCESS JOURNALS
审核开放获取期刊的质量
SEMINAR AT CHINA OPEN ACCESS WEEK
OCTOBER 24, 2016, SUZHOU
TOM@DOAJ.ORG
EDITOR-IN-CHIEF DOAJ
DOAJ官方微信公众号正式发布
欢迎扫描二维码加入我们

You are free to:
Copy, share, adapt, or re-mix;
Blog, live-blog, or post video of;
This presentation. Provided that:
You attribute the work to its author and respect the rights
and licenses associated with its components.
Slide Concept by Cameron Neylon, who has waived all copyright and related or neighbouring rights. This slide only ccZero.
Social Media Icons adapted with permission from originals by Christopher Ross. Original images are available under GPL at;

• PROOF? 证据
• MISBELIEFS 误解
• THE REALITY OF OPEN ACCESS 真正
的开放获取
Are Open Access Journals of Low
Quality? 开放获取期刊的质量差吗？

S U P P O S E
•S C O P U S A S M E A S U R E F O R T O L L A C C E S S Q U A L I T Y J O U R N A L S
• D O A J A S M E A S U R E F O R O P E N A C C E S S Q U A L I T Y J O U R N A L S
F A C T S
• N O T A L L S U B S C R I P T I O N J O U R N A L S A R E I N S C O P U S O N L Y 1 0 - 2 0 , 0 0 0 O F
1 0 0 . 0 0 0
• N O T A L L O P E N A C C E S S J O U R N A L S A R E I N D O A J O N L Y 8 - 1 0 , 0 0 0 O F
3 5 , 0 0 0
•C O N C L U S I O N
• P E R C E N T A G E Q U A L I T Y J O U R N A L S I S A B O U T T H E S A M E
Open Access versus Toll Access
开放获取 vs. 订购访问

OPEN ACCESS.....
• A R T I C L E S R E C E I V E M O R E C I T A T I O N S
• R E A C H E S A B I G G E R A U D I E N C E
• L E A D S T O B E T T E R E D U C A T I O N
• A V O I D S D U P L I C A T E S T U D I E S
• A R T I C L E S C A N B E M O R E E A S I L Y C H E C K E D
• D A T A L E S S P R O N E T O M A N I P U L A T I O N
• I S B E T T E R F O R A D V A N C I N G S C I E N C E
• L E A D S T O M O R E I N N O V A T I O N
The Reality of Open Access
真正的开放获取

• QUALITY OF PUBLISHING（出版的质量）
• QUALITY OF THE SCIENCE （科学的质量）
Assessing the Quality of a Journal
审核期刊的质量

• CRITERIA FOR PUBLISHING
• Principles of transparency and Best Practice in Scholarly Publishing
• DOAJ criteria for Quality Open Access Publishing
Quality of Publishing
（出版的质量）

• D i r e c t o r y o f O p e n A c c e s s J o u r n a l s
• L a u n c h e d i n M a y 2 0 0 3 , L u n d U n i v e r s i t y , S w e d e n – l i s t o f 3 0 0
t i t l e s
• C e n t r a l l y , p u b l i c l y a n d i n t e r n a t i o n a l l y a v a i l a b l e c o m m u n i t y -
c u r a t e d l i s t o f h i g h q u a l i t y o p e n a c c e s s j o u r n a l t i t l e s a c r o s s a l l
d i s c i p l i n e s
• A i m : t o b e t h e s t a r t i n g p o i n t f o r a l l i n f o r m a t i o n s e a r c h e s f o r
q u a l i t y , p e e r - r e v i e w e d o p e n a c c e s s m a t e r i a l
What is the DOAJ?
DOAJ是什么？

Required information
for inclusion in the
DOAJ
收录DOAJ所需的信息
*Basic requirement
（＊为基本要求）
https://doaj.org/publishers

Journal Web Site (1)* 期刊网站
• Dedicated web site per journal – journal specific web
address*
• All journal content centrally available – not spread
over various pages
• Do not mimic other journal web sites
• Web site clear, concise, easy to navigate, transparent,
up to date and correct content – high ethical and
professional standards
• Language & grammar usage correct, spell check

Journal Web Site (2)* 期刊网站
• Visible links to business information
• Avoid distracting, offensive, irrelevant, moving, blinking
advertisements
• Unique identifier (web address) *:
• Journal level
• Article metadata level (also DOI)
• Full text article level (pdf, html, xml, epub)
• ISSN (International Standard Serial Number) *
• Print ISSN and/or
• Online ISSN

Journal Content 期刊内容
• Clear journal structure for easier navigation, indexing,
discoverability
• Publication date for each article
• Publication year per volume/issue
• Volumes & issues; 5 articles per year
• Start & end page number
• Authors, affiliations, countries, ORCIDs
• Articles arranged in Table of Contents
• Search/Browse option
• Links to Current, Archive/Past Issues

Impact Factors 影响因子
• Thomson Reuters IF against ethics and principles of
OA
• DOAJ is IF agnostic
• Display of IF information on journal web page
discouraged

Ownership & Management 归属权 & 管理
• Journal title unique – not confusing/misleading
• Avoid using misleading information
• Each journal unique, journal specific policies
• All business information about journal available from
central web site for journal* - not generic web site for
publisher

Business Information* 商业信息
• About
• Aims and Scope
• Editorial Board
• Instructions for Authors
• Quality control system
• Open Access system
• Plagiarism policy
• Licensing terms
• Contact info

Assessing the quality of open access journals suzhou presentation

Editorial Office & Editorial Team 编辑部 & 编
辑团队
• Editor*/Editor-in-Chief/Associate Editor/Co-Editor
• Full names, Affiliations, Countries, Emails*
• Postal address of office
• Contact information: email/telephone

Governing Body 主管部门
• Editorial Board*/Editorial Advisory Board
• Arts & Humanities allowed editorial review, 2 editors,
no editorial board
• Members to be experts in field/journal scope
• Full names, Affiliations, Countries, Emails*

Aims & Scope 期刊的内容和范围

Author Fees 作者费用
• Article Processing Charges (APCs)
• Article Submission Charges (APCs)
• Manuscript Handling Fees
• Galley Fees, page charges, colour charges, etc.
• Per article (incl. any taxes if applicable) – not per page
• Waiver policy
• Clearly visible for prospective authors – also if
no charges apply*

Peer Review Process* 同行评议
• Advice on individual manuscripts from reviewers/
experts in the field who are not part of the journal's
editorial staff
• Quality control rigorous
• Process & policies clearly described on journal's web
site
• Editorial/Peer - Blind/Double blind/Open*

Instructions for Authors* 投稿须知
• Detailed style guide
• Description of quality control process (review)
• Copyright information
• Licensing information
• Plagiarism policy
• Instructions on how to submit an article
• Contact email address

Access & Usage 获取 & 使用
• Full text of all content available as Open Access, no
delay/embargo*
• How accessible is journal to the rest of the world,
harvesters
• Open Access or Subscription Access or Pay per view
• Journal specific OA statement/policy*
• Differentiate between OA statement – Copyright -
Licensing

Rights 权利
• Recommend: author retains copyright
• Recommend: no exclusive publishing rights
• Recommend: no transfer of commercial rights
https://doajournals.wordpress.com/2015/06/02/copyright-and-licensing-part-2/

Content Licensing 内容许可
• Clearly described on web site
• Licensing terms on all articles, all versions (html, pdf,
xml etc.)
• Embedded in article level metadata

https://creativecommons.org/licenses/
1
2

3
4

5
6

Depositing Policy 存储政策

http://www.sherpa.ac.uk/romeo/index.php

Ethics & Malpractice 伦理 & 不端行为
• Indicate steps to identify & prevent papers where
research misconduct occurred
• Unethical
• Plagiarism (statement & similarity check tool)
• Citation manipulation
• Data falsification/fabrication
• See COPE Guidelines in dealing with allegations

Conflict of Interest 利益冲突
• Policy on handling potential conflict of interest -
editors, authors, reviewers

Financial Sustainability 财务可持续
• Revenue sources (eg author fees, subscriptions,
advertising, reprints, institutional support,
organizational support)
• Advertising policy, types of ads, decision making on
ads, ads linked to content or reader
behavior/displayed at random
• Marketing: appropriate, well targeted, unobtrusive

Publishing Schedule 刊发计划
• Clearly indicate periodicity
• No interruptions
• Annually, bi-annually, monthly, bi-monthly, continuos,
etc.
• Number of volumes, issues

Accessibility & Availability 可访问性 & 可用性

Digital Archiving & Preservation 电子存储 &
保存
• Electronic backup
• Cloud, disk, server, tapes, etc
• Preservation – Keepers’ Registry & PubMed Central
• Portico
• Open Journal Systems (OJS) – PKP Private LOCKSS network
deposited in CLOCKSS

J O U R N A L L E V E L
•P E E R - R E V I E W , E D I T O R I A L B O A R D , P R O O F - R E A D I N G ( D O A J
C R I T E R I A )
•T H O M S O N R E U T E R S - J I F ( T H O M S O N - R E U T E R )
• J O U R N A L C I T A T I O N D I S T R I B U T I O N S R E P L A C I N G T H E
J I F ( P U B L I S H E R S )
A R T I C L E L E V E L
• A R T I C L E L E V E L M E T R I C S ( A L T M E T R I C , I M P A C T S T O R Y )
• R E L A T I V E C I T A T I O N I N D I C E S ( I C I T E T O O L )
Assessing Quality of the Science
审核科学的质量

oTHE SCIENTIFIC QUALITY OF A JOURNAL CAN NOT
BE ASSESSED BY THE AVERAGE CITATION SCORES
OF ARTICLES
oTHE SCIENTIFIC QUALITY OF ARTICLES CANNOT
BE ASSESSED BY WHERE THEY ARE PUBLISHED
oSCIENTIFIC QUALITY CAN ONLY BE ASSESSED ON
ARTICLE LEVEL
Assessing Quality of the Science
审核科学的质量

H E A D L I N E S I N , S C I E N C E , N A T U R E , T H E S C I E N T I S T , P L O S T H I S Y E A R 2 0 1 6
What is wrong with the JIF?
期刊影响因子有错吗？

• WEAK RELATION WITH JOURNAL QUALITY
•NO RELATION WITH INDIVIDUAL ARTICLE QUALITY IN
A GIVEN JOURNAL
• NO RELATION WITH SCIENTIST QUALITY
• INAPPROPRIATE USE OF JIF FOR ALL THE ABOVE!
•IN ADDITION THE JIF IS HIGHLY BIASED TOWARDS
ENGLISH LANGUAGE STM JOURNALS

THE JIF
I S C A L C U L A T E D I N A P P R O P R I A T E L Y A S T H E A R I T H M E T I C M E A N O F A
H I G H L Y S K E W E D D I S T R I B U T I O N O F C I T A T I O N S
IT CONTAINS NO MEASURE OF THE
SPREAD OF THE DISTRIBUTION; IT
OBSCURES THE HIGH DEGREE OF OVERLAP
BETWEEN THE CITATION DISTRIBUTIONS
OF MOST JOURNALS
IT IS NOT REPRODUCIBLE AND THE DATA
THAT SUPPORT IT ARE NOT PUBLICLY
AVAILABLE
Source :doi:http://dx.doi.org/10.1101/062109.

Table 2: Percentage of papers published
in 2013-2014 with number of citations
below the value of the 2015 JIF.
Larivière et al. (2016)
eLife 8.3 71.2%
EMBO J. 9.6 66.9%
J. Informetrics 2.4 68.4%
Nature 38.1 74.8%
Nature Comm. 11.3 74.1%
PLOS Biol. 8.7 66.8%
PLOS Genet. 6.7 65.3%
PLOS ONE 3.1 72.2%
Proc. R. Soc. B 4.8 65.7%
Science 34.7 75.5%
Sci. Rep. 5.2 73.2%
Journal JIF
% citable items
below JIF
0
10
20
30
40
50
60
70
80
90
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
eLife
0
5
10
15
20
25
30
35
40
45
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
EMBO J.
0
10
20
30
40
50
60
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
J. Informetrics
0
10
20
30
40
50
60
70
80
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
Nature
0
50
100
150
200
250
300
350
400
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
Nature Comm.
0
5
10
15
20
25
30
35
40
45
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
PLOS Biol.
0
20
40
60
80
100
120
140
160
180
200
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
PLOS Genet.
0
2,000
4,000
6,000
8,000
10,000
12,000
14,000
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
PLOS ONE
0
20
40
60
80
100
120
140
160
180
200
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
Proc. R. Soc. B
0
10
20
30
40
50
60
70
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
Science
0
200
400
600
800
1,000
1,200
0 10 20 30 40 50 60 70 80 90 100+
Numberofpapers
Number of citations
Sci. Rep.
highly skewed distribution of citations
高度不平衡的文献引用分布
doi: http://dx.doi.org/10.1101/
062109

FOR PUBLISHERS:
DO NOT USE IF FOR THE PROMOTION OF YOUR
JOURNAL
FOR AUTHORS:
IT IS NOT IMPORTANT WHERE YOU PUBLISH BUT
WHAT YOU PUBLISH
FOR FUNDERS:
DO NOT JUDGE SCIENTISTS ON WHERE THEY
PUBLISH OR HOW MUCH THEY PUBLISH
Too much is wrong with the JIF
期刊影响因子有太多的错误

Replacing the Impact Factor
取代影响因子
this analysis helps to
expose the exaggerated
value attributed to the
JIF and strengthens
the contention that it is
an inappropriate
indicator for the
evaluation of research
or researchers," the
team concludes in a
preprint paper
posted to bioRxiv.
doi: http://dx.doi.org/10.1101/
062109

ALTMETRICS
T A K I N G I N T O A C C O U N T C I T A T I O N S , S O C I A L M E D I A ,
C O N V E N T I A L M E D I A ( N E W S P A P E R S , T V , V I D E O )
RELATIVE CITATION SCORES
C I T A T I O N I N D I C E S A D J U S T E D F O R S C I E N T I F I C F I E L D
Article Level Impact Assessment
基于文献的影响力评估
LEIDEN MANIFESTO
doi:http://dx.doi.org/10.11
01/062109
DORA
The San Francisco Declaration
on Research Assessment
doi: 10.1242/dmm.012955

San Francisco Declaration on Research Impact
关于科研影响力的旧金山声明
http://www.ascb.org/dora/

Leiden Manifesto for Research Metrics
关于科研指标的莱顿宣言
TEN PRINCIPLES
Among which
6. Account for variation by field
in publication and citation
practices
8. the journal impact
factor is published to three
decimal places to avoid ties. it
makes no sense to distinguish
between journals on the basis
of very small impact factor
differences. Avoid false precision

Relative Citation Ratios
相对引用率
https://icite.od.nih.gov/

•
Relative Citation Ratios
相对引用率

The must haves!
 Journals must have: 必须有
• An Open Access statement
• Comply with the BOAI definition
• A peer-review process, and describe the kind of process
• An editor/editorial board with clearly identifiable members
• Licensing and copyright information
• Aims and scope
• Published a least 5 articles per year to qualify (DOAJ criteria)
• Impact Factor (any) IRRELEVANT
Quality Open Access Journals
高质量的开放获取期刊

 Journals are strongly recommended to have
• Unrestricted copyright for the author
• No exclusive publishing rights
• No transfer of commercial rights
• Clear licensing conditions
• Preferably use of Creative commons licensing
• Embedded licensing information with articles
• Link to underlying data
• No mention of IF, instead use journal citation distribution plots
Quality Open Access Journals
高质量的开放获取期刊
Recommendations
推荐

Thank you for your attention!
谢谢你们的关注！
tom@doaj.org
lars
lars@doaj.org

Thanks to
all the Library Consortia, Universities and Publishers and our
Sponsors for the financial support to DOAJ!
感谢我们所有的图书馆联盟，大学，出版商和赞助商对DOAJ
的财政支持！
We have vacancies
here!
tom@doaj.org

Assessing the quality of open access journals suzhou presentation

More Related Content

What's hot (20)

Viewers also liked (20)

Similar to Assessing the quality of open access journals suzhou presentation (20)

More from DOAJ (Directory of Open Access Journals) (20)

Recently uploaded (20)

Assessing the quality of open access journals suzhou presentation