SlideShare a Scribd company logo
The Art and Science of
Data-Driven Journalism
Alexander B. Howard
Tow Fellow, Columbia University
May 30, 2014
You know something, John Snow.
This John Snow knew something.
Newspapers have
used data for centuries
Source: The Guardian
1960s: computer-assisted reporting (CAR)
Bob Woodward, via Cliff1066
Traditional tools applying tech to
journalism…
• Calculators and Graphs
• Mainframe and PCs
• Spreadsheets
• Databases
• Text and code editors
• Statistics
• Programming
In the 1990s, government and civil
society spread the Internet globally
In the 2000s, mobile phones and social
networking connected us ever more
In the 2010s, data creation exploded.
Image Credit: Real Time Rome from Senseable.MIT.edu
“Data-driven journalism is the future”
Source: Tim Berners-Lee in the Guardian
…combined with new tools & context…
• Online spreadsheets and wikis
• Data visualization tools
• Open source frameworks
• Code sharing
• Agile development
• Cloud storage and processing (EC2 & Heroku)
• More data and more access
• Privacy and security riskss
2014: data journalism is the present
Gathering, cleaning, organizing, analyzing,
visualizing and publishing data to support
the creation of acts of journalism
The art and science of data-driven journalism
Trendy but not new
• The collection, protection and
interrogation of data as a source,
complementing traditional “shoe
leather” investigative reporting relying
on witnesses, experts and authorities
The art and science of data-driven journalism
Dollars for Docs
The Guardian
Chicago Tribune
• Flame retardants
The art and science of data-driven journalism
A tangled web
The art and science of data-driven journalism
Los Angeles Times
The art and science of data-driven journalism
La Nacion
Reuters: Connected China
The art and science of data-driven journalism
The art and science of data-driven journalism
The art and science of data-driven journalism
Best practices?
Report it out
The art and science of data-driven journalism
Show people something
new about the world
The art and science of data-driven journalism
Tell a story
Center for Public Integrity
Storytelling still matters.
“We use these tools to find and tell stories.
We use them like we use a telephone.
The story is still the thing.”
- Anthony DeBarros
USA Today
Source: Data Journalism and the Big Picture
Make it personal
The art and science of data-driven journalism
Understand the context for
the data
The art and science of data-driven journalism
Show your data
The art and science of data-driven journalism
Show your work
The art and science of data-driven journalism
Share your code
The art and science of data-driven journalism
Consider ethics
Questions
• Is the data clean?
• Is the data representative?
• What biases might be hidden in the data?
• Was the data legally obtained?
• Does the data contain personally identifiable
information (PII)?
Collection
• Who gathered the data? How?
• Was it clear how data would be used?
• Can people opt-out of collection or
usage?
• “Notice and consent” is not enough
• “Privacy by design” applies to news apps
The art and science of data-driven journalism
Data Analysis & Numeracy
• N = ?
• Average vs Median
• Statistical significance?
• Correlation != causation
• Regression to the mean
The art and science of data-driven journalism
Presentation
Bad Data Viz
wtfviz.net
Present data with context, in context
Be aware of de-anonymization risks
Emerging trends
geojournalism
Networked reporting of corruption
ICIJ: Offshore Leaks
International Consortium of
Investigative Journalists
Offshoring $
80 journalists
40 countries
260 gigabytes
2.5 million files
Create your data
“If Stage 1 of data journalism was “find and
scrape data,” then…
Stage 2 was “ask government agencies to
release data” in easy to use formats.
Stage 3 is going to be “make your own data”,
and those sources of data are going to be
automated and updated in real-time.”
-Javaun Moradi, Mozilla
Safecast
open source
Geiger counter
Networked accountability
Bus route in Nairobi, Kenya
Sensor Journalism
The art and science of data-driven journalism
The art and science of data-driven journalism
Citizens as Sensors: Andhra Pradesh
Drones + data collection
Privacy
challenges
The art and science of data-driven journalism
Open Data, FOIA & Press
Freedom
An expanding number of data sources
The art and science of data-driven journalism
The art and science of data-driven journalism
Social data and crisis data
Open government data platforms
The art and science of data-driven journalism
The art and science of data-driven journalism
Fauxpen Data
In an age of “openwashing”…
We need to:
Evaluate licenses.
Peruse the Terms of Service.
Review the governance.
Look at community.
Check the format.
The art and science of data-driven journalism
The art and science of data-driven journalism
Center for Public Integrity
Accountability for “personalized redlining”
• Gun map graphic
Transparency for geographic profiling
• Gun map graphic
WSJ: Websites vary prices, based upon user information
Monitoring predictive policing
• Gun map graphic
Verge: Chicago crime and profiling Geekwire: Predictive Policing
Investigating human tissue trafficking
• Gun map graphic
ICIJ: The data behind skin and bone
Data + journalism + activism +
responsive institutions = social change
The fun part: predictions,
prognostications and
recommendations!
1) Data will become even more of a
strategic resource for media.
2) Better tools will emerge that
democratize data skills.
3) News apps will explode as a primary
way people consume data journalism.
4) Being digital first means being data-
centric and mobile-friendly.
5. Expect more robo-journalism. Human
relationships and storytelling still matter.
6) More journalists will need to study the
social sciences and statistics.
Source: Ed Yong
7) There will be higher standards for
accuracy and corrections.
Source: Jake Harris
8) Competency in security and data
protection will become more important.
Source: Jake Harris
9) Demand for more transparency on
reader data collection and use.
Source: eConsultancy
10) More conflicts over public records,
data scraping, and ethics will arise.
• Gun map graphic
12) Data-driven personalization and
predictive news in wearables.
13) More diverse newsrooms will
produce better (data) journalism.
SOURCE: The Atlantic
A 2013 ASNE survey of 68 online news organizations
found that 63% of them had no minorities.
14) Be mindful of data-ism and bad
data. Embrace skepticism.

More Related Content

PPTX
Collab Space DC Open Data
PPTX
Data journalism in the second machine age
PPTX
Data journalism Overview
PPTX
Towards a More Open World
PDF
Data! Action! Data journalism issues to watch in the next 10 years
PPTX
Open Data Journalism
PPTX
Moldova Open Data Journalism Workshop
PPT
Open data journalism
Collab Space DC Open Data
Data journalism in the second machine age
Data journalism Overview
Towards a More Open World
Data! Action! Data journalism issues to watch in the next 10 years
Open Data Journalism
Moldova Open Data Journalism Workshop
Open data journalism

What's hot (20)

PPTX
Big data, a city of things and civic innovation
PDF
Data Journalism - Introduction
PDF
Towards a critical data journalism practice
PPTX
data journalism
PPTX
Making open government data sing
PDF
Teaching AI in data journalism
PDF
Introduction to Mining Social Media Data
PPTX
Social media mining hicss 46 part 1
PPTX
Data Journalism
PPTX
Hyperlocal data journalism - Andy Dickinson
PPTX
Data Journalism: An Explication
PDF
Using Data for Science Journalism
PPTX
Data journalism
PDF
Dialogue-Earth:-Mining-Social-Media
PDF
Regional journalists' source protection and information security practice
PDF
Data Journalism and the Remaking of Data Infrastructures
PPTX
Information Literacy, Privacy, & Risk: What Are the Implications of Mass Surv...
PDF
Web 2.0 Collective Intelligence - How to use collective intelligence techniqu...
PDF
Co-Creating Misinformation Resilient Societies
PPTX
Digital Journalism - Principles and Practices
Big data, a city of things and civic innovation
Data Journalism - Introduction
Towards a critical data journalism practice
data journalism
Making open government data sing
Teaching AI in data journalism
Introduction to Mining Social Media Data
Social media mining hicss 46 part 1
Data Journalism
Hyperlocal data journalism - Andy Dickinson
Data Journalism: An Explication
Using Data for Science Journalism
Data journalism
Dialogue-Earth:-Mining-Social-Media
Regional journalists' source protection and information security practice
Data Journalism and the Remaking of Data Infrastructures
Information Literacy, Privacy, & Risk: What Are the Implications of Mass Surv...
Web 2.0 Collective Intelligence - How to use collective intelligence techniqu...
Co-Creating Misinformation Resilient Societies
Digital Journalism - Principles and Practices
Ad

Viewers also liked (13)

PPTX
ANCIR - Data-Driven Investigative Journalism
PDF
Data-driven media relations
PPTX
Predictions 2015: Meaningful & Data-Driven - Marketing Media Communication -...
PPTX
PyData London 2015 - How We Turned EverythingMe Into a Data Driven Company
PDF
Building a Data Driven Company
PDF
Hortonworks & Bilot Data Driven Transformations with Hadoop
PPTX
The Road to Becoming a Data Driven Company
PDF
Pivotal Digital Transformation Forum: Journey to Become a Data-Driven Enterprise
PPTX
Practical advice to build a data driven company
PDF
Pivotal Digital Transformation Forum: Becoming a Data Driven Enterprise
PDF
Fuck Spreadsheets - first steps to become a data-driven company
PPT
Story structure in journalism
PDF
Digital transformation masterclass june 2016
ANCIR - Data-Driven Investigative Journalism
Data-driven media relations
Predictions 2015: Meaningful & Data-Driven - Marketing Media Communication -...
PyData London 2015 - How We Turned EverythingMe Into a Data Driven Company
Building a Data Driven Company
Hortonworks & Bilot Data Driven Transformations with Hadoop
The Road to Becoming a Data Driven Company
Pivotal Digital Transformation Forum: Journey to Become a Data-Driven Enterprise
Practical advice to build a data driven company
Pivotal Digital Transformation Forum: Becoming a Data Driven Enterprise
Fuck Spreadsheets - first steps to become a data-driven company
Story structure in journalism
Digital transformation masterclass june 2016
Ad

Similar to The art and science of data-driven journalism (20)

PPTX
Mac373 med312 data journalism lecture
PDF
The Rise of Data Journalism: The Making of Journalistic Knowledge through Qua...
PPTX
Mac281 big data & journalism lecture 2014
PPTX
Data Journalism: Inside the global future
PDF
Journalism in an Age of Big Data: What It Is, Why It Matters and Where to Start
PDF
How to get started with Data Journalism
PDF
The Power Of Data Data Journalism Production And Ethics Studies 1st Edition Z...
PDF
Data Journalism 101: A Brief Survey
PPTX
Media and Citizen Power: Open Africa Summit
PDF
Data-driven journalism, every day
PDF
Download Complete The Data Journalism Handbook First Edition Liliana Bounegry...
PPTX
Mac201 data journalism lecture
PDF
Future of value of data singapore.compressed
PPT
Analytic Journalism: Investing in an Intellectual Portfolio to Secure Journal...
PPTX
How news organizations are using data to tell
PDF
The Data Journalism Handbook First Liliana Bounegry Jonathan Gray
PDF
Data Driven Journalism Links and Resources
PDF
The Data Journalism Handbook First Edition Liliana Bounegry
PDF
Data Journalism: chapter from Online Journalism Handbook first edition
PPT
Wits dj lecture
Mac373 med312 data journalism lecture
The Rise of Data Journalism: The Making of Journalistic Knowledge through Qua...
Mac281 big data & journalism lecture 2014
Data Journalism: Inside the global future
Journalism in an Age of Big Data: What It Is, Why It Matters and Where to Start
How to get started with Data Journalism
The Power Of Data Data Journalism Production And Ethics Studies 1st Edition Z...
Data Journalism 101: A Brief Survey
Media and Citizen Power: Open Africa Summit
Data-driven journalism, every day
Download Complete The Data Journalism Handbook First Edition Liliana Bounegry...
Mac201 data journalism lecture
Future of value of data singapore.compressed
Analytic Journalism: Investing in an Intellectual Portfolio to Secure Journal...
How news organizations are using data to tell
The Data Journalism Handbook First Liliana Bounegry Jonathan Gray
Data Driven Journalism Links and Resources
The Data Journalism Handbook First Edition Liliana Bounegry
Data Journalism: chapter from Online Journalism Handbook first edition
Wits dj lecture

More from Alexander Howard (14)

PPTX
NICAR: Open government, Gov 2.0 and open data journalism
PPTX
Open innovation in governance
PPT
Social media past, present and future
PDF
Frbny social media-rfp
PPTX
Opening Government
PPTX
Slides on App Contests & Challenges for EPA Webinar
PPTX
Value proposition of open government data
PPTX
Goscon 2010
PPT
Fedtalks Presentation: Chris C. Kemp, NASA CTO
PPTX
Visions of the Future: Spime Watch and Pattern Recognition
PPT
Lewis Shepherd on the Revolution in Scientific Computing
PPTX
Social Media and Government 2.0
PPT
Social Media and Identity
PPT
Social Media and Identity
NICAR: Open government, Gov 2.0 and open data journalism
Open innovation in governance
Social media past, present and future
Frbny social media-rfp
Opening Government
Slides on App Contests & Challenges for EPA Webinar
Value proposition of open government data
Goscon 2010
Fedtalks Presentation: Chris C. Kemp, NASA CTO
Visions of the Future: Spime Watch and Pattern Recognition
Lewis Shepherd on the Revolution in Scientific Computing
Social Media and Government 2.0
Social Media and Identity
Social Media and Identity

Recently uploaded (20)

PDF
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
PPTX
Microsoft-Fabric-Unifying-Analytics-for-the-Modern-Enterprise Solution.pptx
PDF
Business Analytics and business intelligence.pdf
PPTX
importance of Data-Visualization-in-Data-Science. for mba studnts
PPTX
retention in jsjsksksksnbsndjddjdnFPD.pptx
PDF
Votre score augmente si vous choisissez une catégorie et que vous rédigez une...
PPTX
Pilar Kemerdekaan dan Identi Bangsa.pptx
PPTX
New ISO 27001_2022 standard and the changes
PPT
Predictive modeling basics in data cleaning process
PPTX
(Ali Hamza) Roll No: (F24-BSCS-1103).pptx
PPT
ISS -ESG Data flows What is ESG and HowHow
PPTX
Topic 5 Presentation 5 Lesson 5 Corporate Fin
PPTX
Introduction to Inferential Statistics.pptx
PDF
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
PPTX
Database Infoormation System (DBIS).pptx
PPT
lectureusjsjdhdsjjshdshshddhdhddhhd1.ppt
PDF
Systems Analysis and Design, 12th Edition by Scott Tilley Test Bank.pdf
PPTX
Managing Community Partner Relationships
PDF
annual-report-2024-2025 original latest.
PDF
Global Data and Analytics Market Outlook Report
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
Microsoft-Fabric-Unifying-Analytics-for-the-Modern-Enterprise Solution.pptx
Business Analytics and business intelligence.pdf
importance of Data-Visualization-in-Data-Science. for mba studnts
retention in jsjsksksksnbsndjddjdnFPD.pptx
Votre score augmente si vous choisissez une catégorie et que vous rédigez une...
Pilar Kemerdekaan dan Identi Bangsa.pptx
New ISO 27001_2022 standard and the changes
Predictive modeling basics in data cleaning process
(Ali Hamza) Roll No: (F24-BSCS-1103).pptx
ISS -ESG Data flows What is ESG and HowHow
Topic 5 Presentation 5 Lesson 5 Corporate Fin
Introduction to Inferential Statistics.pptx
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
Database Infoormation System (DBIS).pptx
lectureusjsjdhdsjjshdshshddhdhddhhd1.ppt
Systems Analysis and Design, 12th Edition by Scott Tilley Test Bank.pdf
Managing Community Partner Relationships
annual-report-2024-2025 original latest.
Global Data and Analytics Market Outlook Report

The art and science of data-driven journalism