SlideShare a Scribd company logo
How to Judge the Quality
of a Wikipedia Page
by Tim Farley
whatstheharm.net &
skeptools.com


                Granite State Skeptics in the Pub
                September 13, 2010
Introduction & Agenda

•Why is Wikipedia important?

•Using article ratings

•Features of good articles

•Warning signs of bad articles

•Using the talk & history pages

•Using WikiTrust
Skeptical of Wikipedia?

•Editing is open to anyone

  • Includes anonymous editing

•No significant central editing authority

•Yes, there is much junk

•Quality & editing is uneven due to reliance on volunteers
Some of Wikipedia is high quality

•Nature study in 2005 showed science articles are
 comparable between Wikipedia & Britannica 1

•Other studies also found much to praise 2

•Studies not without their detractors



• 1“Internet encyclopaedias go head to head”, Nature 438 (7070) p900-901;
 http://dx.doi.org/10.1038/438900a
 2Also see: http://en.wikipedia.org/wiki/Reliability_of_Wikipedia
Some articles can be quite bad

•Lots of crap articles (“stubs”)

•Lots of vandalism (often corrected quickly)

•People have been libeled

  • John Siegenthaler incident

  • Wikipedia has been sued on more than one occasion
Why should we care?

•Is very well known

•Content is freely licensable, and thus appears elsewhere
 as well

•Ranks very highly in Google
Search engine results are crucial

•Users rely on search engines 1

   • 88% will start with a search engine when asked to do a
     random online task

•“Google Gullibility” - Users use only the top results2

•Therefore search engine results are important - hence
 the emergence of Search Engine Optimization (SEO)

• 1Jacob Neilsen’s Alertbox, http://www.useit.com/alertbox/20040816.html
  2Jacob Neilsen’s Alertbox, http://www.useit.com/alertbox/user-skills.html
#1 hits in Google
• acupuncture, Adam Savage, AIDS denial, alien abduction,
  Andrew Wakefield, astral projection, attachment therapy, ayurveda, Ben
  Radford, bigfoot, Breatharian, Carl Sagan, Charles Darwin, chiropractic,
  Christian Science, clairvoyance, colloidal silver, craniosacral, creationism,
  critical thinking, cryptid, cupping, debunking, Derek Colanduno,
  detoxification, double blind, dowsing, Edzard Ernst, evolution, EVP,
  exorcism, facilitated communication, faith healer, feng shui, ganzfeld,
  ghosts, Harry Houdini, holistic health, Holocaust denial, homeopathy,
  hypnosis, Illuminati, intelligent design, iridology, Jehovah's Witnesses,
  Jenny McCarthy, Kevin Trudeau, Loch Ness monster, Martin Gardner,
  Matthias Rath, mediums, MMR, moxibustion, naturopathy, new world
  order, numerology, ozone therapy, parapsychology, Paul Kurtz, Peter
  Popoff, poltergeist, pseudoscience, psychic, psychic surgery, quackery,
  Ray Hyman, Rebecca Watson, reiki, reparative therapy, Sai Baba,
  Scientology, skepticism, Steven Novella, thimerosal, Uri Geller, witchcraft
Wikipedia article grades

• FA - Featured Article
  A - Class A
  GA - Good Article
  B - Class B
  C - Class C
  Start - Good start but incomplete
  Stub - Very basic
  Unassessed - Nobody has given it a rating yet
  FL - Featured list
  List - An article that is only a list

• See: http://en.wikipedia.org/wiki/Wikipedia:Version_1.0_Editorial_Team/Assessment
So where are these grades?
An easier way - gadgets
Article assessment with gadget
Other things on Talk Pages

•Discussion pages contain many other things...

  • Further warnings about editing the article

  • Discussions between editors, particularly when edits are
    controversial

  • Whether or not the article was proposed to be deleted in the
    past

  • Other notes & links to related administration pages
No assessment? Look for references

•References should be a variety of reliable sources

•Inline footnotes for each fact in article
Red flag: [citation needed]
Red flag: warning boxes
Who are the volunteers that do this?	

•All content comes from volunteer editors

•This includes assessments, warning boxes, etc.

•Who vets individual editor actions? Other editors.

•That other editor might be you.

•Wikipedia keeps an extensive edit history - use it.
Revision history
Manual history review

•Tools are not very sophisticated - one edit at a time

•Majority of edits on most articles are simple copy
 editing (punctuation and so on)

•Finding when a given piece of text was added can
 involve a very tedious search

•How do you know if the editor involved has any
 credibility?
New Tool: WikiTrust

•Analyzes the edit history of an article for you

•Shows you the result right inside the article

•New, untrusted text is highlighted in orange

•Older, trusted text appears normal
WikiTrust
WikiTrust pros and cons

•Advantages

 • Requires no special knowledge

 • Doesn’t require you to log in to Wikipedia

 • One click takes you to the associated history

•Disadvantages

 • Requires Firefox browser
Thank you!

•Follow me on Twitter, Facebook or FriendFeed:
 twitter.com/krelnik
 facebook.com/krelnik
 friendfeed.com/krelnik
 I post skeptic news & a Skeptic History item every day.

•What’s The Harm is
 http://whatstheharm.net

•Skeptical Software Tools blog is
 http://skeptools.com

More Related Content

PDF
I won't be #BulliedIntoBadScience! - Laurent Gatto - OpenCon 2017
KEY
Promoting Skepticism via Wikipedia
PPTX
Preprints in biomedical sciences
PDF
Buschman, State of the Union: Altmetrics Today
PPTX
Anne Coghill: American Chemical Society Publications and CrossCheck #crossref15
PDF
The Pros and Cons of Wikipedia
PDF
Cmps research school retreat pres by sutton
PPT
The Ontogenesis Kblog: Light-Weight Publishing about Semantics with Light-Wei...
I won't be #BulliedIntoBadScience! - Laurent Gatto - OpenCon 2017
Promoting Skepticism via Wikipedia
Preprints in biomedical sciences
Buschman, State of the Union: Altmetrics Today
Anne Coghill: American Chemical Society Publications and CrossCheck #crossref15
The Pros and Cons of Wikipedia
Cmps research school retreat pres by sutton
The Ontogenesis Kblog: Light-Weight Publishing about Semantics with Light-Wei...

What's hot (17)

PPTX
Adding lipinski to scientists db
PPTX
Women and Wikipedia: Perspectives on the gender gap, harassment, and the Game...
PPTX
IA Wikipedia Edit-a-thon
PPTX
Getting started with Wikipedia editing ppt
PDF
Getting started with Wikipedia editing pdf
PPTX
ISI Research Paper Writing Guidance
PPT
Wiki Wikis For Students
PDF
Open Access: Like free kittens, not free beer
PDF
Cinf flash v2 final
PPT
Building Your Research Team
PPTX
Marentette wiki powerpoint
PPTX
Lecture 24 2012 Wikis & Writing
PPTX
OWASP Wikipedia Training Presentation
PPT
375 cc3 a_lindabeebe
PPTX
2018 SAAM Art and Feminism Wikipedia Edit-a-thon
PPT
Wikipedia’s Quality - Presentation at NIH - July 2009
PPTX
Lecture 23 Wikis & Writing
Adding lipinski to scientists db
Women and Wikipedia: Perspectives on the gender gap, harassment, and the Game...
IA Wikipedia Edit-a-thon
Getting started with Wikipedia editing ppt
Getting started with Wikipedia editing pdf
ISI Research Paper Writing Guidance
Wiki Wikis For Students
Open Access: Like free kittens, not free beer
Cinf flash v2 final
Building Your Research Team
Marentette wiki powerpoint
Lecture 24 2012 Wikis & Writing
OWASP Wikipedia Training Presentation
375 cc3 a_lindabeebe
2018 SAAM Art and Feminism Wikipedia Edit-a-thon
Wikipedia’s Quality - Presentation at NIH - July 2009
Lecture 23 Wikis & Writing
Ad

Viewers also liked (6)

KEY
TAM8 Passages
KEY
Please Don't Start Another Blog or Podcast!
KEY
TAM8 In Memoriam
PPT
TAM9 In Memoriam
PPT
TAM 2012 In Memoriam presentation
PDF
The Ninjitsu of the Internet-Savvy Skeptic
TAM8 Passages
Please Don't Start Another Blog or Podcast!
TAM8 In Memoriam
TAM9 In Memoriam
TAM 2012 In Memoriam presentation
The Ninjitsu of the Internet-Savvy Skeptic
Ad

Similar to How to Judge the Quality of a WIkipedia Page (20)

PPTX
Using Wikipedia for Research
PPTX
Lecture 25: Wikipedia and Reliability
PPT
WikipediaWise
PDF
Wikipedia and Medicine
PDF
Wikipedia in outreach
KEY
Open Innovation
PPTX
Envs100
PDF
Infinithree: Beyond the Wiki Encyclopedia
PPTX
Envs100
PPTX
ALIA Wikipedia and libraries
PPTX
Dr Martin Poulter, Wikipedia and higher education
PDF
Wikipedia -- the missing link in science outreach?
PDF
Pemanfaatan TIK.pdf
PPTX
Information Literacy Lessons in Wikipedia
PPTX
Student to Author: Using Wikipedia to Improve Undergraduate Research & Writing
PPTX
Conventions wiki
PPTX
Conventions wiki
PPTX
Conventions wiki
PPT
Chapter 11 developing library research and information literacy skills
Using Wikipedia for Research
Lecture 25: Wikipedia and Reliability
WikipediaWise
Wikipedia and Medicine
Wikipedia in outreach
Open Innovation
Envs100
Infinithree: Beyond the Wiki Encyclopedia
Envs100
ALIA Wikipedia and libraries
Dr Martin Poulter, Wikipedia and higher education
Wikipedia -- the missing link in science outreach?
Pemanfaatan TIK.pdf
Information Literacy Lessons in Wikipedia
Student to Author: Using Wikipedia to Improve Undergraduate Research & Writing
Conventions wiki
Conventions wiki
Conventions wiki
Chapter 11 developing library research and information literacy skills

Recently uploaded (20)

PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PDF
Weekly quiz Compilation Jan -July 25.pdf
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PPTX
Microbial diseases, their pathogenesis and prophylaxis
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
Yogi Goddess Pres Conference Studio Updates
PPTX
Tissue processing ( HISTOPATHOLOGICAL TECHNIQUE
PDF
RMMM.pdf make it easy to upload and study
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PPTX
GDM (1) (1).pptx small presentation for students
PPTX
Pharma ospi slides which help in ospi learning
PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
PPTX
master seminar digital applications in india
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
O5-L3 Freight Transport Ops (International) V1.pdf
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
Weekly quiz Compilation Jan -July 25.pdf
2.FourierTransform-ShortQuestionswithAnswers.pdf
Supply Chain Operations Speaking Notes -ICLT Program
Microbial diseases, their pathogenesis and prophylaxis
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
Final Presentation General Medicine 03-08-2024.pptx
Yogi Goddess Pres Conference Studio Updates
Tissue processing ( HISTOPATHOLOGICAL TECHNIQUE
RMMM.pdf make it easy to upload and study
Abdominal Access Techniques with Prof. Dr. R K Mishra
FourierSeries-QuestionsWithAnswers(Part-A).pdf
GDM (1) (1).pptx small presentation for students
Pharma ospi slides which help in ospi learning
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
master seminar digital applications in india
Chinmaya Tiranga quiz Grand Finale.pdf
O5-L3 Freight Transport Ops (International) V1.pdf
school management -TNTEU- B.Ed., Semester II Unit 1.pptx

How to Judge the Quality of a WIkipedia Page

  • 1. How to Judge the Quality of a Wikipedia Page by Tim Farley whatstheharm.net & skeptools.com Granite State Skeptics in the Pub September 13, 2010
  • 2. Introduction & Agenda •Why is Wikipedia important? •Using article ratings •Features of good articles •Warning signs of bad articles •Using the talk & history pages •Using WikiTrust
  • 3. Skeptical of Wikipedia? •Editing is open to anyone • Includes anonymous editing •No significant central editing authority •Yes, there is much junk •Quality & editing is uneven due to reliance on volunteers
  • 4. Some of Wikipedia is high quality •Nature study in 2005 showed science articles are comparable between Wikipedia & Britannica 1 •Other studies also found much to praise 2 •Studies not without their detractors • 1“Internet encyclopaedias go head to head”, Nature 438 (7070) p900-901; http://dx.doi.org/10.1038/438900a 2Also see: http://en.wikipedia.org/wiki/Reliability_of_Wikipedia
  • 5. Some articles can be quite bad •Lots of crap articles (“stubs”) •Lots of vandalism (often corrected quickly) •People have been libeled • John Siegenthaler incident • Wikipedia has been sued on more than one occasion
  • 6. Why should we care? •Is very well known •Content is freely licensable, and thus appears elsewhere as well •Ranks very highly in Google
  • 7. Search engine results are crucial •Users rely on search engines 1 • 88% will start with a search engine when asked to do a random online task •“Google Gullibility” - Users use only the top results2 •Therefore search engine results are important - hence the emergence of Search Engine Optimization (SEO) • 1Jacob Neilsen’s Alertbox, http://www.useit.com/alertbox/20040816.html 2Jacob Neilsen’s Alertbox, http://www.useit.com/alertbox/user-skills.html
  • 8. #1 hits in Google • acupuncture, Adam Savage, AIDS denial, alien abduction, Andrew Wakefield, astral projection, attachment therapy, ayurveda, Ben Radford, bigfoot, Breatharian, Carl Sagan, Charles Darwin, chiropractic, Christian Science, clairvoyance, colloidal silver, craniosacral, creationism, critical thinking, cryptid, cupping, debunking, Derek Colanduno, detoxification, double blind, dowsing, Edzard Ernst, evolution, EVP, exorcism, facilitated communication, faith healer, feng shui, ganzfeld, ghosts, Harry Houdini, holistic health, Holocaust denial, homeopathy, hypnosis, Illuminati, intelligent design, iridology, Jehovah's Witnesses, Jenny McCarthy, Kevin Trudeau, Loch Ness monster, Martin Gardner, Matthias Rath, mediums, MMR, moxibustion, naturopathy, new world order, numerology, ozone therapy, parapsychology, Paul Kurtz, Peter Popoff, poltergeist, pseudoscience, psychic, psychic surgery, quackery, Ray Hyman, Rebecca Watson, reiki, reparative therapy, Sai Baba, Scientology, skepticism, Steven Novella, thimerosal, Uri Geller, witchcraft
  • 9. Wikipedia article grades • FA - Featured Article A - Class A GA - Good Article B - Class B C - Class C Start - Good start but incomplete Stub - Very basic Unassessed - Nobody has given it a rating yet FL - Featured list List - An article that is only a list • See: http://en.wikipedia.org/wiki/Wikipedia:Version_1.0_Editorial_Team/Assessment
  • 10. So where are these grades?
  • 11. An easier way - gadgets
  • 13. Other things on Talk Pages •Discussion pages contain many other things... • Further warnings about editing the article • Discussions between editors, particularly when edits are controversial • Whether or not the article was proposed to be deleted in the past • Other notes & links to related administration pages
  • 14. No assessment? Look for references •References should be a variety of reliable sources •Inline footnotes for each fact in article
  • 17. Who are the volunteers that do this? •All content comes from volunteer editors •This includes assessments, warning boxes, etc. •Who vets individual editor actions? Other editors. •That other editor might be you. •Wikipedia keeps an extensive edit history - use it.
  • 19. Manual history review •Tools are not very sophisticated - one edit at a time •Majority of edits on most articles are simple copy editing (punctuation and so on) •Finding when a given piece of text was added can involve a very tedious search •How do you know if the editor involved has any credibility?
  • 20. New Tool: WikiTrust •Analyzes the edit history of an article for you •Shows you the result right inside the article •New, untrusted text is highlighted in orange •Older, trusted text appears normal
  • 22. WikiTrust pros and cons •Advantages • Requires no special knowledge • Doesn’t require you to log in to Wikipedia • One click takes you to the associated history •Disadvantages • Requires Firefox browser
  • 23. Thank you! •Follow me on Twitter, Facebook or FriendFeed: twitter.com/krelnik facebook.com/krelnik friendfeed.com/krelnik I post skeptic news & a Skeptic History item every day. •What’s The Harm is http://whatstheharm.net •Skeptical Software Tools blog is http://skeptools.com