SlideShare a Scribd company logo
Algorithmic Bias:
Where It Comes From and What to Do
About It
(Introduction)
26 March 2017
Andy Oram, Editor, O’Reilly Media
This work is licensed under the
Creative Commons Attribution 4.0 International License.
The Discoveries
https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
2
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2208240
Algorithmic Bias — Andy Oram
The Hype
https://www.theatlantic.com/technology/archive/2016/04/how-big-data-harms-poor-communities/477423/
3
https://www.nytimes.com/2015/08/11/upshot/algorithms-and-bias-q-and-a-with-cynthia-dwork.html
Algorithmic Bias — Andy Oram
https://hbr.org/2013/04/the-hidden-biases-in-big-data
https://www.technologyreview.com/s/602933/how-to-hold-algorithms-accountable/
https://www.brookings.edu/blog/techtank/2016/12/01/addressing-racial-bias-in-the-online-economy/
http://www.pewinternet.org/2017/02/08/code-dependent-pros-and-cons-of-the-algorithm-age/
The Books
4
Algorithmic Bias — Andy Oram
https://weaponsofmathdestructionbook.com/
http://www.hup.harvard.edu/catalog.php?isbn=9780674368279
The Feds
5
Algorithmic Bias — Andy Oram
https://obamawhitehouse.archives.gov/sites/default/files/microsites/ostp/2016_0504_data_discrimination.pdf
Association for Computing Machinery principles
6
Algorithmic Bias — Andy Oram
https://www.acm.org/binaries/content/assets/public-policy/2017_usacm_statement_algorithms.pdf
Questions addressed in this talk
 Why do algorithms discriminate?
7
 What is unfair bias?
 Who is in control of the data?
 How can outsiders validate algorithms?
 Where does free software play a role?
 How should we use algorithms, given these risks?
Algorithmic Bias — Andy Oram
The role of free software
8
Algorithmic Bias — Andy Oram
htttps://qz.com/938635/a-predictive-policing-startup-released-all-its-code-so-it-can-be-scoured-for-bias/
https://github.com/CivicScape
Barriers to opening the source code
 Selfish actors might game the system
9
 Machine learning doesn't produce human-readable decision
processes
 Can't keep up with constant tweaks to the algorithms
 The devil often lies in the data
 Trade secrets and other legal controls
Algorithmic Bias — Andy Oram
Barriers to using the source code if it's open
 How do you know at all if an algorithm is judging you?
10
 Who can understand the algorithms?
 Power imbalances--do you dare to challenge the owner of the
algorithm?
 The devil often lies in the data
Algorithmic Bias — Andy Oram

More Related Content

PDF
Chris Ward - Taking Open Source beyond Software
PPT
WI FAA to_generate_exhaustive_system_test_cas
PDF
Building a data driven culture - ProductCon Seattle - 062519
PPT
Fair Use for Educators
PPT
Fair Use for Educators
PDF
Lean Persona
PDF
Iterative persona
PDF
Experimenting with Experimental Ethics
Chris Ward - Taking Open Source beyond Software
WI FAA to_generate_exhaustive_system_test_cas
Building a data driven culture - ProductCon Seattle - 062519
Fair Use for Educators
Fair Use for Educators
Lean Persona
Iterative persona
Experimenting with Experimental Ethics

Similar to Algorithmic bias: introduction (20)

PDF
Algocracy and the state of AI in public administrations.
PPTX
Design, AI, and "-isms"
PDF
Artificial Intelligence
PDF
AI Presentation - Danial Shaikh
PDF
Algorithmic Bias : What is it? Why should we care? What can we do about it?
PDF
Black Box Learning Analytics? Beyond Algorithmic Transparency
PDF
Lesson intro. Introduction to Open Data
PPTX
Designing AI for Humans
PDF
How To Train Your Computer - Peter Walker
PDF
Society, Privacy and the Semantic Web - Policy and Technology PrivOn 2017
DOCX
Ethics in Technology Handout
PPTX
AI as agent of chaos in higher education
PDF
AIIP 2017: 50 Websites in 60 Minutes Presentation 5/20/17
PPTX
Designing AI for Humanity at dmi:Design Leadership Conference in Boston
PPTX
Social and ethic.ppt
PPTX
Social Implications and Ethics
PPTX
Cybersecurity fundamental
PDF
Software Backdoors, Chiaravalle
PPTX
Future of AI Smart Networks
PDF
Managing future products
Algocracy and the state of AI in public administrations.
Design, AI, and "-isms"
Artificial Intelligence
AI Presentation - Danial Shaikh
Algorithmic Bias : What is it? Why should we care? What can we do about it?
Black Box Learning Analytics? Beyond Algorithmic Transparency
Lesson intro. Introduction to Open Data
Designing AI for Humans
How To Train Your Computer - Peter Walker
Society, Privacy and the Semantic Web - Policy and Technology PrivOn 2017
Ethics in Technology Handout
AI as agent of chaos in higher education
AIIP 2017: 50 Websites in 60 Minutes Presentation 5/20/17
Designing AI for Humanity at dmi:Design Leadership Conference in Boston
Social and ethic.ppt
Social Implications and Ethics
Cybersecurity fundamental
Software Backdoors, Chiaravalle
Future of AI Smart Networks
Managing future products
Ad

Recently uploaded (20)

PPTX
Understanding_Digital_Forensics_Presentation.pptx
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
cuic standard and advanced reporting.pdf
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPT
Teaching material agriculture food technology
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Empathic Computing: Creating Shared Understanding
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PPTX
Programs and apps: productivity, graphics, security and other tools
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
Machine learning based COVID-19 study performance prediction
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
Big Data Technologies - Introduction.pptx
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Understanding_Digital_Forensics_Presentation.pptx
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
cuic standard and advanced reporting.pdf
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Teaching material agriculture food technology
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Empathic Computing: Creating Shared Understanding
Dropbox Q2 2025 Financial Results & Investor Presentation
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Programs and apps: productivity, graphics, security and other tools
The AUB Centre for AI in Media Proposal.docx
Building Integrated photovoltaic BIPV_UPV.pdf
Machine learning based COVID-19 study performance prediction
Per capita expenditure prediction using model stacking based on satellite ima...
Encapsulation_ Review paper, used for researhc scholars
Reach Out and Touch Someone: Haptics and Empathic Computing
Diabetes mellitus diagnosis method based random forest with bat algorithm
Big Data Technologies - Introduction.pptx
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Ad

Algorithmic bias: introduction