SlideShare a Scribd company logo
Implementing Ethics in AI
Professor Pekka Abrahamsson
15th International Conference on Emerging
Technologies for a Smarter World (CEWIT 2019)
Nov-6th, 2019, Stony Brook, NY, USA
JYU. Since 1863. 119.11.2019
JYU. Since 1863. 2
Agenda
• Motivation
• State-of-the-art tools and methods
• Empirical observations
• Conclusions
• References
19.11.2019
JYU. Since 1863. 3
Failing AI
• “San Francisco Bans Facial Recognition Technology”
Source: New York Times, 2019, bit.ly/2Qs9vKi
• Amazon scraps secret AI recruiting tool that showed
bias against women
Source: Reuters, 2018, bit.ly/2Kw77hK
• A Popular Algorithm Is No Better at Predicting Crimes
Than Random People
Source: The Atlantic, 2018, bit.ly/2OrULbA
19.11.2019
JYU. Since 1863. 4
Key ethical risks from the corporate viewpoint
• Bias and discrimination
• Erosion of Privacy
• Poor accountability
• Workforce displacement and transitions
19.11.2019
Source: Schatsky, D., et al 2019. Can AI be ethical? Why enterprises shouldn’t wait for AI regulation.
Deloitte report
Implementing Ethics in AI
Implementing Ethics in AI
Implementing Ethics in AI
Source: https://sloanreview.mit.edu/article/every-leaders-guide-to-the-ethics-of-ai/
Implementing Ethics in AI
Source: https://www.forbes.com/sites/jilliandonfro/2019/04/04/google-cancels-its-ai-ethics
-board-less-than-two-weeks-after-launch-in-the-wake-of-employee-protest/#3e22a5b06e28
JYU. Since 1863. 11
What should the leaders do?
• “Until regulations catch up, AI-oriented companies
must establish their own ethical frameworks”
Source: Sloan Management Review, 2018, bit.ly/2NXF0Ky
19.11.2019
Source: Schatsky, D., et al 2019. Can AI be ethical? Why enterprises shouldn’t wait for AI regulation.
Deloitte report
JYU. Since 1863. 1319.11.2019
14
Source: Sheard, S.A., 1997, August. The frameworks quagmire,
a brief look. In INCOSE International Symposium
(Vol. 7, No. 1, pp. 726-733).
Concerns drawn from Vakkuri, V. and Abrahamsson, P., 2018, June. The Key Concepts of Ethics of Artificial Intelligence.
In 2018 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC) (pp. 1-6). IEEE.
Author’s version available online at https://arxiv.org/abs/1809.07027
JYU. Since 1863. 1619.11.2019
Conceptualization of the Relations Between
Currently Discussed AI Ethics Construct
Vakkuri et al. 2020. Ethically Aligned Design of Autonomous Systems: Industry viewpoint
and an empirical study. To appear in the proceedings of the Transport Research Arena (TRA 2020)
arXiv preprint https://arxiv.org/abs/1906.07946.
JYU. Since 1863. 17
AI Ethics discussion
• Long-standing area of study
Old scenarios slowly becoming reality
• Recent discourse has centered around a few central
constructs
Transparency, Accountability
Responsibility, Fairness… Trustworthiness
• Focus on high-level principles
Discussion largely conceptual
Little empirical data exists
19.11.2019
JYU. Since 1863. 1819.11.2019
Tangible Research Framework
Vakkuri, V., Kemell, K.K. and Abrahamsson, P., 2019.
AI Ethics in Industry: A Research Framework. To appear in the proceedings of the 3rd
Seminar on Technology Ethics, Turku, Finland, arXiv preprint arXiv:1910.12695.
Empirical Study Results
JYU. Since 1863. 1919.11.2019
JYU. Since 1863. 2019.11.2019
Vakkuri et al. 2020. Ethically Aligned
Design of Autonomous Systems:
Industry viewpoint and an empirical
study. To appear in the proceedings
of the Transport Research Arena
(TRA 2020)
arXiv https://arxiv.org/abs/1906.07946.
JYU. Since 1863. 2119.11.2019
Vakkuri et al. 2020. Ethically Aligned Design of Autonomous Systems: Industry viewpoint
and an empirical study. To appear in the proceedings of the Transport Research Arena (TRA 2020)
arXiv preprint https://arxiv.org/abs/1906.07946.
JYU. Since 1863. 2219.11.2019
Vakkuri et al. 2020. Ethically Aligned Design of Autonomous Systems: Industry viewpoint
and an empirical study. To appear in the proceedings of the Transport Research Arena (TRA 2020)
arXiv preprint https://arxiv.org/abs/1906.07946.
JYU. Since 1863. 23
Accountability
“It’s just a prototype”
“We have talked about the risks of decision-making support
systems, but it doesn’t really affect what we do”
"It's really important how you handle any kind of data... that you
preserve it correctly, among researchers, and don't hand it out to
any government actors. [...] I personally can't see any way to harm
anyone with the data we have though."
19.11.2019
Source: Vakkuri V., Kemell KK., Abrahamsson P. (2019) Implementing Ethics in AI: Initial Results of an Industrial Multiple Case Study. In: Franch X., Männistö T.,
Martínez-Fernández S. (eds) Product-Focused Software Process Improvement. PROFES 2019. Lecture Notes in Computer Science, vol 11915. Springer, Cham,
Author’s copy available at arxiv.org/abs/1906.12307
JYU. Since 1863. 24
Responsibility
"Nobody wants to listen to ethics-related technical stuff. [...]
It’s not relevant to the users”
“What could it affect... the distribution of funds in a region,
or it could result in a school taking useless action... it does
have its own risks, but no one is going to die because of it”
19.11.2019
Source: Vakkuri V., Kemell KK., Abrahamsson P. (2019) Implementing Ethics in AI: Initial Results of an Industrial Multiple Case Study. In: Franch X., Männistö T.,
Martínez-Fernández S. (eds) Product-Focused Software Process Improvement. PROFES 2019. Lecture Notes in Computer Science, vol 11915. Springer, Cham,
Author’s copy available at arxiv.org/abs/1906.12307
JYU. Since 1863. 25
Responsibility
• The developers could, when asked, think of ways the
system could negatively affect various stakeholders
• These were not addressed formally
• Developers did not have tools/methods to conduct formal
ethical analyses in order to tackle such issues
19.11.2019
Source: Vakkuri V., Kemell KK., Abrahamsson P. (2019) Implementing Ethics in AI: Initial Results of an Industrial Multiple Case Study. In: Franch X., Männistö T.,
Martínez-Fernández S. (eds) Product-Focused Software Process Improvement. PROFES 2019. Lecture Notes in Computer Science, vol 11915. Springer, Cham,
Author’s copy available at arxiv.org/abs/1906.12307
JYU. Since 1863. 26
Summary
• AI is spreading everywhere
• People voice out their concerns publicly
• AI Ethics is a growing concern for companies
• High level guidelines and principles exist but they fail to provide
actionable advice to developers
• AI is developed by software engineers who need tangible methods
to address the concerns
• Our studies provide empirical insight about the current state of
practice
• First AI Ethics in Software Design methods are being published in
2020
19.11.2019
JYU. Since 1863. 27
Our AI Ethics research results are made public in
Arxiv.org
19.11.2019
The Key Concepts of Ethics
of Artificial Intelligence
arxiv.org/abs/1809.07027
AI Ethics in Industry: A
Research Framework
arxiv.org/abs/1910.12695
Implementing Ethics in AI:
Initial results of an industrial
multiple case study
arxiv.org/abs/1906.12307
Ethically Aligned Design of
Autonomous Systems:
Industry viewpoint
arxiv.org/abs/1906.07946
Ethically Aligned Design: An
empirical evaluation of the
RESOLVEDD-strategy
arxiv.org/abs/1905.06417
JYU. Since 1863. 2819.11.2019

More Related Content

PDF
Ai Ethics
PPTX
A Tutorial to AI Ethics - Fairness, Bias & Perception
PPTX
Ethical Considerations in the Design of Artificial Intelligence
PPTX
Technology for everyone - AI ethics and Bias
PPT
PDF
Ethical issues facing Artificial Intelligence
PDF
Introduction to the ethics of machine learning
PDF
Introduction to AI Ethics
Ai Ethics
A Tutorial to AI Ethics - Fairness, Bias & Perception
Ethical Considerations in the Design of Artificial Intelligence
Technology for everyone - AI ethics and Bias
Ethical issues facing Artificial Intelligence
Introduction to the ethics of machine learning
Introduction to AI Ethics

What's hot (20)

PPTX
Generative AI Risks & Concerns
PDF
Ethics in the use of Data & AI
PPTX
Responsible AI in Industry (ICML 2021 Tutorial)
PDF
Unlocking the Power of Generative AI An Executive's Guide.pdf
PDF
Responsible AI
PDF
GENERATIVE AI, THE FUTURE OF PRODUCTIVITY
PPTX
AI FOR BUSINESS LEADERS
PPTX
Responsible AI
PPTX
Future of AI - 2023 07 25.pptx
PPTX
Responsible AI
PDF
Exploring Opportunities in the Generative AI Value Chain.pdf
PDF
An Introduction to Generative AI - May 18, 2023
PDF
Generative AI
PDF
Responsible AI
PDF
Responsible Generative AI
PDF
A Framework for Navigating Generative Artificial Intelligence for Enterprise
PDF
Leveraging Generative AI & Best practices
PPTX
Explainable AI in Industry (WWW 2020 Tutorial)
PDF
Using the power of Generative AI at scale
PPTX
Generative AI Use cases for Enterprise - Second Session
Generative AI Risks & Concerns
Ethics in the use of Data & AI
Responsible AI in Industry (ICML 2021 Tutorial)
Unlocking the Power of Generative AI An Executive's Guide.pdf
Responsible AI
GENERATIVE AI, THE FUTURE OF PRODUCTIVITY
AI FOR BUSINESS LEADERS
Responsible AI
Future of AI - 2023 07 25.pptx
Responsible AI
Exploring Opportunities in the Generative AI Value Chain.pdf
An Introduction to Generative AI - May 18, 2023
Generative AI
Responsible AI
Responsible Generative AI
A Framework for Navigating Generative Artificial Intelligence for Enterprise
Leveraging Generative AI & Best practices
Explainable AI in Industry (WWW 2020 Tutorial)
Using the power of Generative AI at scale
Generative AI Use cases for Enterprise - Second Session
Ad

Similar to Implementing Ethics in AI (20)

PDF
AI ethics model framework with accountability,
PPTX
Blue Simple Geometric Project Presentation.pptx
PDF
Exploring AI Ethics_ Challenges, Solutions, and Significance
PPTX
Copy-of-Ethics-in-AI-Ensuring-Responsible-Innovation (1).pptx
DOC
Ethical AI - Building Responsible Technology.doc
PPTX
Some Ethical Considerations of AI and GenAI
PDF
The Ethics of AI
PPTX
Ethical Dimensions of Artificial Intelligence (AI) by Rinshad Choorappara
PPTX
The Ethics of Generative AI: A Humanist's Guide
PDF
Ethical Consideration in Artificial Intelligence Development and Deployment
PDF
ETHICAL CONSIDERATION IN ARTIFICIAL INTELLIGENCE DEVELOPMENT AND DEPLOYMENT
PPTX
[DSC Adria 23] Muthu Ramachandran AI Ethics Framework for Generative AI such ...
PPTX
Artificial-Intelligence-and-the-Ethics-of-Responsibility.pptx
PDF
From principles to action: A method for ethically aligned AI design and imple...
PDF
Generative AI - Responsible Path Forward.pdf
PPTX
AI Integration and Ethics: A Responsible Path Forward
PPTX
Ethical-Implementation-in-AI-and-Machine-Learning.pptx.pptx
PPTX
Role-of-Artificial-Intelligence-in-Human-Life.pptx
PDF
The Oxford Handbook Of Ethics Of Ai Markus D Dubber Frank Pasquale Sunit Das
PPTX
Aspa ai webinar
AI ethics model framework with accountability,
Blue Simple Geometric Project Presentation.pptx
Exploring AI Ethics_ Challenges, Solutions, and Significance
Copy-of-Ethics-in-AI-Ensuring-Responsible-Innovation (1).pptx
Ethical AI - Building Responsible Technology.doc
Some Ethical Considerations of AI and GenAI
The Ethics of AI
Ethical Dimensions of Artificial Intelligence (AI) by Rinshad Choorappara
The Ethics of Generative AI: A Humanist's Guide
Ethical Consideration in Artificial Intelligence Development and Deployment
ETHICAL CONSIDERATION IN ARTIFICIAL INTELLIGENCE DEVELOPMENT AND DEPLOYMENT
[DSC Adria 23] Muthu Ramachandran AI Ethics Framework for Generative AI such ...
Artificial-Intelligence-and-the-Ethics-of-Responsibility.pptx
From principles to action: A method for ethically aligned AI design and imple...
Generative AI - Responsible Path Forward.pdf
AI Integration and Ethics: A Responsible Path Forward
Ethical-Implementation-in-AI-and-Machine-Learning.pptx.pptx
Role-of-Artificial-Intelligence-in-Human-Life.pptx
The Oxford Handbook Of Ethics Of Ai Markus D Dubber Frank Pasquale Sunit Das
Aspa ai webinar
Ad

Recently uploaded (20)

PPTX
Infosys Presentation by1.Riyan Bagwan 2.Samadhan Naiknavare 3.Gaurav Shinde 4...
DOCX
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
PDF
Digital Logic Computer Design lecture notes
PDF
Well-logging-methods_new................
PDF
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
PPTX
OOP with Java - Java Introduction (Basics)
PDF
PPT on Performance Review to get promotions
PDF
Structs to JSON How Go Powers REST APIs.pdf
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PPTX
CYBER-CRIMES AND SECURITY A guide to understanding
PPTX
Construction Project Organization Group 2.pptx
PPTX
Lesson 3_Tessellation.pptx finite Mathematics
PPTX
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
PPTX
CH1 Production IntroductoryConcepts.pptx
PPTX
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
PPTX
bas. eng. economics group 4 presentation 1.pptx
PPTX
UNIT 4 Total Quality Management .pptx
PDF
composite construction of structures.pdf
PPT
Mechanical Engineering MATERIALS Selection
PDF
The CXO Playbook 2025 – Future-Ready Strategies for C-Suite Leaders Cerebrai...
Infosys Presentation by1.Riyan Bagwan 2.Samadhan Naiknavare 3.Gaurav Shinde 4...
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
Digital Logic Computer Design lecture notes
Well-logging-methods_new................
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
OOP with Java - Java Introduction (Basics)
PPT on Performance Review to get promotions
Structs to JSON How Go Powers REST APIs.pdf
UNIT-1 - COAL BASED THERMAL POWER PLANTS
CYBER-CRIMES AND SECURITY A guide to understanding
Construction Project Organization Group 2.pptx
Lesson 3_Tessellation.pptx finite Mathematics
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
CH1 Production IntroductoryConcepts.pptx
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
bas. eng. economics group 4 presentation 1.pptx
UNIT 4 Total Quality Management .pptx
composite construction of structures.pdf
Mechanical Engineering MATERIALS Selection
The CXO Playbook 2025 – Future-Ready Strategies for C-Suite Leaders Cerebrai...

Implementing Ethics in AI

  • 1. Implementing Ethics in AI Professor Pekka Abrahamsson 15th International Conference on Emerging Technologies for a Smarter World (CEWIT 2019) Nov-6th, 2019, Stony Brook, NY, USA JYU. Since 1863. 119.11.2019
  • 2. JYU. Since 1863. 2 Agenda • Motivation • State-of-the-art tools and methods • Empirical observations • Conclusions • References 19.11.2019
  • 3. JYU. Since 1863. 3 Failing AI • “San Francisco Bans Facial Recognition Technology” Source: New York Times, 2019, bit.ly/2Qs9vKi • Amazon scraps secret AI recruiting tool that showed bias against women Source: Reuters, 2018, bit.ly/2Kw77hK • A Popular Algorithm Is No Better at Predicting Crimes Than Random People Source: The Atlantic, 2018, bit.ly/2OrULbA 19.11.2019
  • 4. JYU. Since 1863. 4 Key ethical risks from the corporate viewpoint • Bias and discrimination • Erosion of Privacy • Poor accountability • Workforce displacement and transitions 19.11.2019 Source: Schatsky, D., et al 2019. Can AI be ethical? Why enterprises shouldn’t wait for AI regulation. Deloitte report
  • 11. JYU. Since 1863. 11 What should the leaders do? • “Until regulations catch up, AI-oriented companies must establish their own ethical frameworks” Source: Sloan Management Review, 2018, bit.ly/2NXF0Ky 19.11.2019
  • 12. Source: Schatsky, D., et al 2019. Can AI be ethical? Why enterprises shouldn’t wait for AI regulation. Deloitte report
  • 13. JYU. Since 1863. 1319.11.2019
  • 14. 14 Source: Sheard, S.A., 1997, August. The frameworks quagmire, a brief look. In INCOSE International Symposium (Vol. 7, No. 1, pp. 726-733).
  • 15. Concerns drawn from Vakkuri, V. and Abrahamsson, P., 2018, June. The Key Concepts of Ethics of Artificial Intelligence. In 2018 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC) (pp. 1-6). IEEE. Author’s version available online at https://arxiv.org/abs/1809.07027
  • 16. JYU. Since 1863. 1619.11.2019 Conceptualization of the Relations Between Currently Discussed AI Ethics Construct Vakkuri et al. 2020. Ethically Aligned Design of Autonomous Systems: Industry viewpoint and an empirical study. To appear in the proceedings of the Transport Research Arena (TRA 2020) arXiv preprint https://arxiv.org/abs/1906.07946.
  • 17. JYU. Since 1863. 17 AI Ethics discussion • Long-standing area of study Old scenarios slowly becoming reality • Recent discourse has centered around a few central constructs Transparency, Accountability Responsibility, Fairness… Trustworthiness • Focus on high-level principles Discussion largely conceptual Little empirical data exists 19.11.2019
  • 18. JYU. Since 1863. 1819.11.2019 Tangible Research Framework Vakkuri, V., Kemell, K.K. and Abrahamsson, P., 2019. AI Ethics in Industry: A Research Framework. To appear in the proceedings of the 3rd Seminar on Technology Ethics, Turku, Finland, arXiv preprint arXiv:1910.12695.
  • 19. Empirical Study Results JYU. Since 1863. 1919.11.2019
  • 20. JYU. Since 1863. 2019.11.2019 Vakkuri et al. 2020. Ethically Aligned Design of Autonomous Systems: Industry viewpoint and an empirical study. To appear in the proceedings of the Transport Research Arena (TRA 2020) arXiv https://arxiv.org/abs/1906.07946.
  • 21. JYU. Since 1863. 2119.11.2019 Vakkuri et al. 2020. Ethically Aligned Design of Autonomous Systems: Industry viewpoint and an empirical study. To appear in the proceedings of the Transport Research Arena (TRA 2020) arXiv preprint https://arxiv.org/abs/1906.07946.
  • 22. JYU. Since 1863. 2219.11.2019 Vakkuri et al. 2020. Ethically Aligned Design of Autonomous Systems: Industry viewpoint and an empirical study. To appear in the proceedings of the Transport Research Arena (TRA 2020) arXiv preprint https://arxiv.org/abs/1906.07946.
  • 23. JYU. Since 1863. 23 Accountability “It’s just a prototype” “We have talked about the risks of decision-making support systems, but it doesn’t really affect what we do” "It's really important how you handle any kind of data... that you preserve it correctly, among researchers, and don't hand it out to any government actors. [...] I personally can't see any way to harm anyone with the data we have though." 19.11.2019 Source: Vakkuri V., Kemell KK., Abrahamsson P. (2019) Implementing Ethics in AI: Initial Results of an Industrial Multiple Case Study. In: Franch X., Männistö T., Martínez-Fernández S. (eds) Product-Focused Software Process Improvement. PROFES 2019. Lecture Notes in Computer Science, vol 11915. Springer, Cham, Author’s copy available at arxiv.org/abs/1906.12307
  • 24. JYU. Since 1863. 24 Responsibility "Nobody wants to listen to ethics-related technical stuff. [...] It’s not relevant to the users” “What could it affect... the distribution of funds in a region, or it could result in a school taking useless action... it does have its own risks, but no one is going to die because of it” 19.11.2019 Source: Vakkuri V., Kemell KK., Abrahamsson P. (2019) Implementing Ethics in AI: Initial Results of an Industrial Multiple Case Study. In: Franch X., Männistö T., Martínez-Fernández S. (eds) Product-Focused Software Process Improvement. PROFES 2019. Lecture Notes in Computer Science, vol 11915. Springer, Cham, Author’s copy available at arxiv.org/abs/1906.12307
  • 25. JYU. Since 1863. 25 Responsibility • The developers could, when asked, think of ways the system could negatively affect various stakeholders • These were not addressed formally • Developers did not have tools/methods to conduct formal ethical analyses in order to tackle such issues 19.11.2019 Source: Vakkuri V., Kemell KK., Abrahamsson P. (2019) Implementing Ethics in AI: Initial Results of an Industrial Multiple Case Study. In: Franch X., Männistö T., Martínez-Fernández S. (eds) Product-Focused Software Process Improvement. PROFES 2019. Lecture Notes in Computer Science, vol 11915. Springer, Cham, Author’s copy available at arxiv.org/abs/1906.12307
  • 26. JYU. Since 1863. 26 Summary • AI is spreading everywhere • People voice out their concerns publicly • AI Ethics is a growing concern for companies • High level guidelines and principles exist but they fail to provide actionable advice to developers • AI is developed by software engineers who need tangible methods to address the concerns • Our studies provide empirical insight about the current state of practice • First AI Ethics in Software Design methods are being published in 2020 19.11.2019
  • 27. JYU. Since 1863. 27 Our AI Ethics research results are made public in Arxiv.org 19.11.2019 The Key Concepts of Ethics of Artificial Intelligence arxiv.org/abs/1809.07027 AI Ethics in Industry: A Research Framework arxiv.org/abs/1910.12695 Implementing Ethics in AI: Initial results of an industrial multiple case study arxiv.org/abs/1906.12307 Ethically Aligned Design of Autonomous Systems: Industry viewpoint arxiv.org/abs/1906.07946 Ethically Aligned Design: An empirical evaluation of the RESOLVEDD-strategy arxiv.org/abs/1905.06417
  • 28. JYU. Since 1863. 2819.11.2019