Challenges to Open Science Thoughts from a skeptical supporter
An original quote “If you can not measure it, you can not improve it.” – Lord Kelvin
Need to align incentives Even students are attuned to career incentives If they aren’t, then their mentor should train them Incentive & evaluation change slowly The prime criterion is a technology centuries old
Evaluation Evaluations are most important for the scientifically-young (fellowships; postdocs labs; faculty position; tenure) The short time between publication & evaluation makes citation analysis ineffective Many evaluators will be unfamiliar with detailed field
Wiki Science Been there (not) done that
BCM Sequence Annotation Web Server Randall Smith rsmith at dot.bcm.tmc.edu Wed Aug 24 06:14:20 EST 1994 Announcing a new WWW Server: The BCM Sequence Annotation Server URL:  http://dot.imgen.bcm.tmc.edu:9331/seq-annot/home.html Developed by Kanwal Gill, Brent Wiese, and Randall Smith Human Genome Center, Baylor College of Medicine, Houston TX  USA We have created a "Sequence Annotation" WWW Server that allows researchers to add their own annotations to Entrez (NCBI) DNA and protein sequence reports.  Our Annotation Server is intended as a method for investigators to easily share new information about sequences, e.g., new features, interesting sequence matches, domain identifications, etc. A user who wishes to make an annotation for an Entrez sequence will be given the chance to select an annotation type (eg coding region, variant, etc.). The user is then requested to enter a short annotation that will appear as an embedded link in an Entrez report.  The annotator will then be prompted to enter an extended commentary which gives the further details about the annotation. The annotator may also enter some keywords that can be searched on and URL's that will lead to more information (eg, an entry in another database, a file of data on the annotator's home computer, etc). Only the annotations themselves are stored on our local server. When a user wishes to view an annotated record, our server requests a sequence report from the NCBI Entrez Server. The local annotations are then embedded within the returned report. As an initial entry, we have added several hundred annotations based on data kindly provided by Keith Robison.  The annotations list probable coding regions within bacterial sequences that are not annotated as such in GenBank (see Table 2 of K. Robison, W. Gilbert and G.M. Church, "Large scale bacterial gene discovery by similarity search", Nature Genetics 7:205, 1994). We invite the biological community to use the server to view this data as well as to add data of their own.  Users wishing to view the data need only the URL listed above and a graphical WWW browser such as Mosaic or Chimera.  Users wishing to add data would be well-advised to also prepare the text of their annotation and extended commentary as well as to have their URL's (if any) in mind before beginning. Extensive on-line help is provided for both types of users. Suggestions and comments regarding how the server can best meet the needs of the biological community are welcome.  There is a comments form provided in the server for typing in your comments.  Comments may also be emailed to Randall Smith at rsmith at bcm.tmc.edu. ------------------------------------------------------------------------ Randall F. Smith Human Genome Center Department of Molecular and Human Genetics and W.M. Keck Center for Computational Biology Baylor College of Medicine Houston, TX  77030  USA rsmith at bcm.tmc.edu 713-798-4735; FAX: 713-798-5386 ------------------------------------------------------------------------
Wiki Molecular Biology any successes? BCM annotation server  http://dot.imgen.bcm.tmc.edu:9331/seq-annot/home.html   eProtS http://eprots.pdbj.org/ WikiProteins 10.1186/gb-2008-9-5-r89  Barend Mons  Protopedia www.protopedia.org Gene Wiki: 10.1371/journal.pbio.0060175 TOPSAN  www.topsan.org Rfam-Wikipedia link (Alex Bateman) SNPedia.com OpenWetware Instructional Wiki by Cheryl Kerfeld for undergraduate student education in genomics (a successful example) GeneTests.org – NON-wiki with hundreds of essays about genetic variation

More Related Content

PPTX
Forensic science and criminology
PPTX
Rosenblum "Challenges Citing Preprints and How to Tackle Them"
PDF
Twitter for Journal Clubs and Medical Education
DOC
Hcs 478 Future Our Mission/newtonhelp.com
PPT
Using Web 2.0 Principles to Become Librarian 2.0: RSS
PDF
Charleston 2012: Altmetrics: Analyzing the Value in Scholarly Content
PDF
Funk "Indexing & Discovering a Record of Versions"
PPT
Using Web 2.0 Principles to Become Librarian 2.0: Blogs
Forensic science and criminology
Rosenblum "Challenges Citing Preprints and How to Tackle Them"
Twitter for Journal Clubs and Medical Education
Hcs 478 Future Our Mission/newtonhelp.com
Using Web 2.0 Principles to Become Librarian 2.0: RSS
Charleston 2012: Altmetrics: Analyzing the Value in Scholarly Content
Funk "Indexing & Discovering a Record of Versions"
Using Web 2.0 Principles to Become Librarian 2.0: Blogs

Viewers also liked (8)

PPTX
Real Choices, False Colors
PDF
BFRS Aldershot Event Feedback - 12th March 2015
PPTX
Managing a (different) Data Deluge - SPARC OA conference
PDF
CENDI - Impact
PPTX
Project Credit - Overview and Summary
PDF
From research life cycle to networks: The role of the library
PDF
Talk by J. Eisen for NZ Computational Genomics meeting
PPTX
Oral presentation
Real Choices, False Colors
BFRS Aldershot Event Feedback - 12th March 2015
Managing a (different) Data Deluge - SPARC OA conference
CENDI - Impact
Project Credit - Overview and Summary
From research life cycle to networks: The role of the library
Talk by J. Eisen for NZ Computational Genomics meeting
Oral presentation
Ad

Similar to Challenges to Open Science - Comments from Steven Brenner (20)

PPTX
Cool Informatics Tools and Services for Biomedical Research
PPTX
Bridging Histology and Bioinformatics
PPTX
2016 bioinformatics i_databases_wim_vancriekinge
PPTX
Bioinformatics t2-databases wim-vancriekinge_v2013
PPTX
2015 bioinformatics databases_wim_vancriekinge
PDF
Bioinformatics data mining
PPTX
High-performance web services for gene and variant annotations
DOCX
Bioinformatics Final Report
PDF
PDF
BITS: Overview of important biological databases beyond sequences
PPTX
Web based servers and softwares for genome analysis
PDF
2015_CV_J_SHELTON_linked
PPTX
bioinformatics presentation in the master presentation
PPTX
2014 moore-ddd
ODP
Semantic web technologies applied to bioinformatics and laboratory data manag...
PDF
Bioinformatics مي.pdf
PPTX
Opportunities and challenges presented by Wikidata in the context of biocuration
PDF
Bonnal bosc2010 bio_ruby
PDF
Developing an open source community for cloud bioinformatics
PPTX
20120717 ismb2012
Cool Informatics Tools and Services for Biomedical Research
Bridging Histology and Bioinformatics
2016 bioinformatics i_databases_wim_vancriekinge
Bioinformatics t2-databases wim-vancriekinge_v2013
2015 bioinformatics databases_wim_vancriekinge
Bioinformatics data mining
High-performance web services for gene and variant annotations
Bioinformatics Final Report
BITS: Overview of important biological databases beyond sequences
Web based servers and softwares for genome analysis
2015_CV_J_SHELTON_linked
bioinformatics presentation in the master presentation
2014 moore-ddd
Semantic web technologies applied to bioinformatics and laboratory data manag...
Bioinformatics مي.pdf
Opportunities and challenges presented by Wikidata in the context of biocuration
Bonnal bosc2010 bio_ruby
Developing an open source community for cloud bioinformatics
20120717 ismb2012
Ad

More from Cameron Neylon (20)

PPTX
OA Advocacy Today
PDF
Open Knowledge Institutions: Is there a future for the university in a networ...
PDF
Research Excellence is a Neo-Colonial Agenda
PDF
Network Enabled Research: Connectivity, groups and growth in the production o...
PDF
Open Science Needs Open Indicators
PDF
Excellence is a neo-colonial agenda...and what we can do about
PDF
The Power of Infrastructures and the Infrastructures of Power
PDF
Will we still know ourselves? Identity and Community in a Transforming Knowle...
PDF
Beyond Open: Culture and Scaling in the Making of Knowledge
PDF
Excellence is Bullshit
PPTX
From Cycles to Networks
PDF
Where next for Open Scholarship?
PDF
Openness in Scholarship: A return to core values?
PDF
Interpreting Shadows on the Elephant in the Room
PDF
Sustaining Scholarly Infrastructures through Collective Action: The lessons t...
PDF
Sustainable Futures for Research Communication
PPTX
PPTX
Investing in Scholarly Futures
PDF
Excellence, Innovation, Evaluation: Collaboration x Innovation
PDF
No stories without evidence, no evidence without stories
OA Advocacy Today
Open Knowledge Institutions: Is there a future for the university in a networ...
Research Excellence is a Neo-Colonial Agenda
Network Enabled Research: Connectivity, groups and growth in the production o...
Open Science Needs Open Indicators
Excellence is a neo-colonial agenda...and what we can do about
The Power of Infrastructures and the Infrastructures of Power
Will we still know ourselves? Identity and Community in a Transforming Knowle...
Beyond Open: Culture and Scaling in the Making of Knowledge
Excellence is Bullshit
From Cycles to Networks
Where next for Open Scholarship?
Openness in Scholarship: A return to core values?
Interpreting Shadows on the Elephant in the Room
Sustaining Scholarly Infrastructures through Collective Action: The lessons t...
Sustainable Futures for Research Communication
Investing in Scholarly Futures
Excellence, Innovation, Evaluation: Collaboration x Innovation
No stories without evidence, no evidence without stories

Recently uploaded (20)

PPTX
Final SEM Unit 1 for mit wpu at pune .pptx
PPT
Geologic Time for studying geology for geologist
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PDF
A contest of sentiment analysis: k-nearest neighbor versus neural network
PDF
OpenACC and Open Hackathons Monthly Highlights July 2025
PDF
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
PDF
Credit Without Borders: AI and Financial Inclusion in Bangladesh
PDF
Zenith AI: Advanced Artificial Intelligence
PDF
A proposed approach for plagiarism detection in Myanmar Unicode text
PDF
Enhancing emotion recognition model for a student engagement use case through...
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PDF
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
PDF
Five Habits of High-Impact Board Members
PDF
sbt 2.0: go big (Scala Days 2025 edition)
PPT
Galois Field Theory of Risk: A Perspective, Protocol, and Mathematical Backgr...
PDF
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
PPTX
AI IN MARKETING- PRESENTED BY ANWAR KABIR 1st June 2025.pptx
PDF
Consumable AI The What, Why & How for Small Teams.pdf
PDF
Developing a website for English-speaking practice to English as a foreign la...
PPTX
Microsoft Excel 365/2024 Beginner's training
Final SEM Unit 1 for mit wpu at pune .pptx
Geologic Time for studying geology for geologist
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
A contest of sentiment analysis: k-nearest neighbor versus neural network
OpenACC and Open Hackathons Monthly Highlights July 2025
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
Credit Without Borders: AI and Financial Inclusion in Bangladesh
Zenith AI: Advanced Artificial Intelligence
A proposed approach for plagiarism detection in Myanmar Unicode text
Enhancing emotion recognition model for a student engagement use case through...
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
A Late Bloomer's Guide to GenAI: Ethics, Bias, and Effective Prompting - Boha...
Five Habits of High-Impact Board Members
sbt 2.0: go big (Scala Days 2025 edition)
Galois Field Theory of Risk: A Perspective, Protocol, and Mathematical Backgr...
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
AI IN MARKETING- PRESENTED BY ANWAR KABIR 1st June 2025.pptx
Consumable AI The What, Why & How for Small Teams.pdf
Developing a website for English-speaking practice to English as a foreign la...
Microsoft Excel 365/2024 Beginner's training

Challenges to Open Science - Comments from Steven Brenner

  • 1. Challenges to Open Science Thoughts from a skeptical supporter
  • 2. An original quote “If you can not measure it, you can not improve it.” – Lord Kelvin
  • 3. Need to align incentives Even students are attuned to career incentives If they aren’t, then their mentor should train them Incentive & evaluation change slowly The prime criterion is a technology centuries old
  • 4. Evaluation Evaluations are most important for the scientifically-young (fellowships; postdocs labs; faculty position; tenure) The short time between publication & evaluation makes citation analysis ineffective Many evaluators will be unfamiliar with detailed field
  • 5. Wiki Science Been there (not) done that
  • 6. BCM Sequence Annotation Web Server Randall Smith rsmith at dot.bcm.tmc.edu Wed Aug 24 06:14:20 EST 1994 Announcing a new WWW Server: The BCM Sequence Annotation Server URL: http://dot.imgen.bcm.tmc.edu:9331/seq-annot/home.html Developed by Kanwal Gill, Brent Wiese, and Randall Smith Human Genome Center, Baylor College of Medicine, Houston TX USA We have created a "Sequence Annotation" WWW Server that allows researchers to add their own annotations to Entrez (NCBI) DNA and protein sequence reports. Our Annotation Server is intended as a method for investigators to easily share new information about sequences, e.g., new features, interesting sequence matches, domain identifications, etc. A user who wishes to make an annotation for an Entrez sequence will be given the chance to select an annotation type (eg coding region, variant, etc.). The user is then requested to enter a short annotation that will appear as an embedded link in an Entrez report. The annotator will then be prompted to enter an extended commentary which gives the further details about the annotation. The annotator may also enter some keywords that can be searched on and URL's that will lead to more information (eg, an entry in another database, a file of data on the annotator's home computer, etc). Only the annotations themselves are stored on our local server. When a user wishes to view an annotated record, our server requests a sequence report from the NCBI Entrez Server. The local annotations are then embedded within the returned report. As an initial entry, we have added several hundred annotations based on data kindly provided by Keith Robison. The annotations list probable coding regions within bacterial sequences that are not annotated as such in GenBank (see Table 2 of K. Robison, W. Gilbert and G.M. Church, "Large scale bacterial gene discovery by similarity search", Nature Genetics 7:205, 1994). We invite the biological community to use the server to view this data as well as to add data of their own. Users wishing to view the data need only the URL listed above and a graphical WWW browser such as Mosaic or Chimera. Users wishing to add data would be well-advised to also prepare the text of their annotation and extended commentary as well as to have their URL's (if any) in mind before beginning. Extensive on-line help is provided for both types of users. Suggestions and comments regarding how the server can best meet the needs of the biological community are welcome. There is a comments form provided in the server for typing in your comments. Comments may also be emailed to Randall Smith at rsmith at bcm.tmc.edu. ------------------------------------------------------------------------ Randall F. Smith Human Genome Center Department of Molecular and Human Genetics and W.M. Keck Center for Computational Biology Baylor College of Medicine Houston, TX 77030 USA rsmith at bcm.tmc.edu 713-798-4735; FAX: 713-798-5386 ------------------------------------------------------------------------
  • 7. Wiki Molecular Biology any successes? BCM annotation server http://dot.imgen.bcm.tmc.edu:9331/seq-annot/home.html eProtS http://eprots.pdbj.org/ WikiProteins 10.1186/gb-2008-9-5-r89 Barend Mons Protopedia www.protopedia.org Gene Wiki: 10.1371/journal.pbio.0060175 TOPSAN www.topsan.org Rfam-Wikipedia link (Alex Bateman) SNPedia.com OpenWetware Instructional Wiki by Cheryl Kerfeld for undergraduate student education in genomics (a successful example) GeneTests.org – NON-wiki with hundreds of essays about genetic variation