SlideShare a Scribd company logo
Can Artificial Intelligence
Predict The Spread
Of Online Hate Speech?
© 2019 Bernard Marr, Bernard Marr & Co. All rights reserved
Title
Text
IntroductionIntroduction
The rise in online hate speech and the way it is reflected in the offline world is a hot
topic in politics right now.
The internet has given everyone a voice, which clearly has positive implications for the
way citizens can publicly challenge authority and debate issues. On the other hand,
when challenge and debate spill over into attacks on minorities or vulnerable people,
there's obviously a potential for harm.
It’s fairly commonly assumed that this form of hate speech, particularly when
encountered alongside other factors such as social deprivation or mental illness, has the
potential to radicalize individuals in dangerous ways, and inspire them to commit illegal
and violent acts.
Can Artificial Intelligence Predict The Spread Of
Online Hate Speech?
© 2019 Bernard Marr, Bernard Marr & Co. All rights reserved
Can Artificial Intelligence Predict The Spread Of
Online Hate Speech?
Just as terrorist organizations like ISIS can be seen using hate speech in videos and
propaganda material intended to incite violence, racist and anti-Islamic material is thought
to have inspired killers like Anders Breivik, who killed 69 youths in a 2011 shooting spree,
and the 2019 Christchurch mosque shooting in which 51 died.
So far these links between online and real-world actions, though common sense tells us
they are likely to exist, have been difficult to prove scientifically. However, a piece of the
puzzle fell into place thanks to research carried out by the UN and the Universitat Pompeu
Fabra, and co-ordinated by IBM.
IBM principle researcher Kush Varshney tells me “I think the main message was that this
was the first study of its kind looking at the relationship between online and offline
behaviors, and most importantly it demonstrates why we should be taking this technical
approach to studying that relationship.”
© 2019 Bernard Marr, Bernard Marr & Co. All rights reserved
Can Artificial Intelligence Predict The Spread Of
Online Hate Speech?
Researchers began by compiling a list of keywords and phrases considered by
governmental agencies and NGOs to be indicators of hate speech. These included
expressions found in both Islamic-extremist and anti-Islamic posts made on Twitter and
Reddit. As the researchers validated that these words and phrases were indeed common
by searching across those platforms, they came across other co-occurring terms that were
also added to the list. Along with news reports of Islamic terrorism or anti-Islamic violence,
this list was the primary sources of data for the investigation.
This user-generated content – over 50 million tweets and 300,000 Reddit posts, made by
around 15 million users - containing these words and phrases were then classified
according to factors including their stance (Islamic-extremist or anti-Islamic), as well as the
severity of the message. The scale of severity ranged from simple use of discriminatory
language to outright incitement to violence, including genocide.
© 2019 Bernard Marr, Bernard Marr & Co. All rights reserved
Can Artificial Intelligence Predict The Spread Of
Online Hate Speech?
After the dataset was compiled and classified, a timeline analysis was carried out, using
machine learning to draw a picture of the correlation between the number of hate speech
messages appearing online, and a number of real-world incidents including the 2016
Orlando nightclub shooting, the 2016 Istanbul airport attack, the 2016 Finsbury Park,
London, vehicular attack and the 2016 Olethe, Kansas shooting. All of the incidents
involved Muslims or Arabs as either victims or perpetrators, and took place within 19
months.
Previously, the majority of machine learning analysis around the concept of hate speech
has focussed on building algorithms to determine whether or not particular posts or
pieces of content are hateful.
Varshney tells me “A lot of people in the machine learning community are tackling the
problem of classifying whether speech is offensive or hateful – we decided it wasn’t
important for us to tackle that problem, and often it’s a question of where you draw the
line, if something is verging on being hateful.
“What we were looking at is what’s the relationship between things that happen in the
online world, and things that happen in the real world.”
© 2019 Bernard Marr, Bernard Marr & Co. All rights reserved
Can Artificial Intelligence Predict The Spread Of
Online Hate Speech?
The study found that, yes, following high-profile incidents of both Islamophobic or
Islamic-extremist violence, incidents of online hate-speech do indeed increase. This didn’t
really come as a surprise to anyone as it was commonly held to be true based on casual
observation. But what was far more interesting was the fact that, in the case of Islamist-
extremist violence it wasn’t just Muslims who faced an increase in hate speech against
them, but attacks were frequently broadened to other minority groups.
Varshney told me, "The severity of the attacks also increases, so people are much more
likely to incite violence … and the target of the online messages also broadens so other
groups that have nothing to do with anything that’s happened in the real world also
experience an increase in hate speech. It could be any other group, such as homosexuals
… those were some interesting findings.”
So, is online hate speech and real-world violence a circular problem? It’s been shown that
one (real-world violence) causes the other – but is the reverse also true, creating a vicious,
self-feeding circle of hatred and violence?
© 2019 Bernard Marr, Bernard Marr & Co. All rights reserved
Can Artificial Intelligence Predict The Spread Of
Online Hate Speech?
Currently, that remains unclear. But proving the causal relationship between hate speech
and violence is a natural next-step for research in the field, Varshney says.
Proving this reverse relationship is likely to be more problematic, however, for a number
of reasons. Including the fact that the process of online radicalization itself is not yet well
understood from a scientific perspective. The question of how much exposure to hateful
material is needed to push a person to commit violence, over what period of time, and
how the mental health of the individual plays its part, have yet to be answered.
Varshey told me “That would probably be an even more important study to do – we didn’t
get into it in this particular project, as some of the causal relationships require techniques
that we don’t yet have.
“That inspires us to do more technical work though – and this direction is clearly a next-
step for the work, that should be done, for sure.”
The research, which can be viewed in full here, was carried out as part of IBM’s Science for
Social Good, which aimed to apply machine learning to 17 issues identified by the UN as
Sustainable Development Goals.
© 2017 Bernard Marr , Bernard Marr & Co. All rights reserved
© 2018 Bernard Marr, Bernard Marr & Co. All rights reserved
Bernard Marr is an internationally best-selling author, popular keynote speaker, futurist, and a
strategic business & technology advisor to governments and companies. He helps
organisations improve their business performance, use data more intelligently, and
understand the implications of new technologies such as artificial intelligence, big data,
blockchains, and the Internet of Things.
LinkedIn has ranked Bernard as one of the world’s top 5 business influencers. He is a frequent
contributor to the World Economic Forum and writes a regular column for Forbes. Every day
Bernard actively engages his 1.5 million social media followers and shares content that
reaches millions of readers.
Visit The
Website
© 2017 Bernard Marr , Bernard Marr & Co. All rights reserved
© 2019 Bernard Marr, Bernard Marr & Co. All rights reserved
Bernard Marr is an internationally best-selling author, popular keynote speaker, futurist, and a
strategic business & technology advisor to governments and companies. He helps
organisations improve their business performance, use data more intelligently, and
understand the implications of new technologies such as artificial intelligence, big data,
blockchains, and the Internet of Things.
LinkedIn has ranked Bernard as one of the world’s top 5 business influencers. He is a frequent
contributor to the World Economic Forum and writes a regular column for Forbes. Every day
Bernard actively engages his 1.5 million social media followers and shares content that
reaches millions of readers.
Visit The
Website
Title
Subtitle
Be the FIRST to receive news,
articles, insights and event
updates from Bernard Marr & Co
straight to your inbox.
Signing up is EASY! Simply fill out
the online form and we’ll be in
touch!
© 2018 Bernard Marr, Bernard Marr & Co. All rights reserved
BernardMarr
hello@bernardmarr.com
www.bernardmarr.com

More Related Content

PDF
War-of-Keywords
DOCX
Social-Media
PDF
Journalism fake news disinformation
PDF
Misinformation, Disinformation, Malinformation, fake news and libraries
PPTX
The fake news debate - what do we know and what can we do?
PPT
Youth Internet Safety
PPTX
Fake News, Real Concerns: Developing Information Literate Students (December ...
DOCX
Capstone_SingleSpaced
War-of-Keywords
Social-Media
Journalism fake news disinformation
Misinformation, Disinformation, Malinformation, fake news and libraries
The fake news debate - what do we know and what can we do?
Youth Internet Safety
Fake News, Real Concerns: Developing Information Literate Students (December ...
Capstone_SingleSpaced

What's hot (20)

DOCX
Galliotti Policy Reccomendation ISIS and social media
PDF
10 Ways to Identify Disinformation
PDF
Dental Access March 2016 Issue
PPTX
Fake news for the masses: evaluating news sources through active learning - L...
PPTX
Pr cyberbullying campaign powerpoint
PPSX
The Role of Social Media in Da'awah
PDF
Defense Against The Digital Dark Arts: Navigating Online Spaces as a Journali...
PPT
Exploring Fake News and Alternative Facts
PDF
SASIG Workshop on “Improving the digital landscape for our children”
PDF
Duty identity-credibility
PDF
Co-Creating Misinformation Resilient Societies
PPT
Internetsafety
PDF
SURENDER SINGH Senior Prosecutor NIA
PPTX
Social Media for Public Safety Telecommunicators
PDF
CILIP Conference - Promoting digital literacy and digital well-being for chil...
PPTX
Privacy, social networks and EU policy
PPTX
Motivations behind Software Piracy: Relevance to Computer Ethics Theories
PPTX
Security and social media
PDF
Boston marathon bombings presentation
PDF
Fake news and how to combat it
Galliotti Policy Reccomendation ISIS and social media
10 Ways to Identify Disinformation
Dental Access March 2016 Issue
Fake news for the masses: evaluating news sources through active learning - L...
Pr cyberbullying campaign powerpoint
The Role of Social Media in Da'awah
Defense Against The Digital Dark Arts: Navigating Online Spaces as a Journali...
Exploring Fake News and Alternative Facts
SASIG Workshop on “Improving the digital landscape for our children”
Duty identity-credibility
Co-Creating Misinformation Resilient Societies
Internetsafety
SURENDER SINGH Senior Prosecutor NIA
Social Media for Public Safety Telecommunicators
CILIP Conference - Promoting digital literacy and digital well-being for chil...
Privacy, social networks and EU policy
Motivations behind Software Piracy: Relevance to Computer Ethics Theories
Security and social media
Boston marathon bombings presentation
Fake news and how to combat it
Ad

Similar to Can Artificial Intelligence Predict The Spread Of Online Hate Speech? (13)

DOCX
Discussion 1 By Karthik KondlaThe capability to connect indivi.docx
PDF
How india muslims are being demonised through whats app groups (a critical study
DOCX
you have to respond to bellow paper I also give example of someo.docx
PDF
Media literacy in the age of information overload
PPTX
Research seminar Queen Mary University of London (CogSci)
DOCX
250 word discussion response james wk 7.docx
PDF
Descriptive Writing Examples Pdf. Descriptive Essay. 20
PDF
Iftf state sponsored_trolling_report
DOCX
Respond to 2 students and professor. 150 words each student no word
PDF
Information disorder: Toward an interdisciplinary framework for research and ...
PPTX
Should Writing Fake News Be Considered a Crime.pptx
PPTX
CMC Group 3: WhatsThat Chrome Extension
PDF
Countering Terrorism, Preventing Radicalization and Protecting Cultural Herit...
Discussion 1 By Karthik KondlaThe capability to connect indivi.docx
How india muslims are being demonised through whats app groups (a critical study
you have to respond to bellow paper I also give example of someo.docx
Media literacy in the age of information overload
Research seminar Queen Mary University of London (CogSci)
250 word discussion response james wk 7.docx
Descriptive Writing Examples Pdf. Descriptive Essay. 20
Iftf state sponsored_trolling_report
Respond to 2 students and professor. 150 words each student no word
Information disorder: Toward an interdisciplinary framework for research and ...
Should Writing Fake News Be Considered a Crime.pptx
CMC Group 3: WhatsThat Chrome Extension
Countering Terrorism, Preventing Radicalization and Protecting Cultural Herit...
Ad

More from Bernard Marr (20)

PPTX
The Top 4 Telecom Trends In 2023
PPTX
How To Use Meta’s Horizon Workrooms For Business
PPTX
The Top 5 Healthcare Trends In 2023
PPTX
The Top 5 In-Demand Tech Skills For Jobs In 2023
PPTX
Policing In The Metaverse: What’s Happening Now
PPTX
Banking In The Metaverse – The Next Frontier For Financial Services
PPTX
The 7 Biggest Business Challenges Every Company Is Facing In 2023
PPTX
Is This The Downfall Of Meta And Social Media As We Know It?
PPTX
The Top Five Cybersecurity Trends In 2023
PPTX
The Top 5 Technology Challenges In 2023
PPTX
How To Build A Positive Hybrid And Remote Working Culture In 2023
PPTX
Beyond Dashboards: The Future Of Analytics And Business Intelligence?
PPTX
The Top 5 Data Science And Analytics Trends In 2023
PPTX
The 5 Biggest Business Trends For 2023
PPTX
12 Practical Steps To Handle Change At Work
PPTX
The Top 12 Virtual Networking Tips To Boost Your Career
PPTX
How AI And Machine Learning Will Impact The Future Of Healthcare
PPTX
Top 16 Essential Soft Skills For The Future of Work
PPTX
Artificial Intelligence And The Future Of Marketing
PPTX
Is AI Really a Job Killer? These Experts Say No
The Top 4 Telecom Trends In 2023
How To Use Meta’s Horizon Workrooms For Business
The Top 5 Healthcare Trends In 2023
The Top 5 In-Demand Tech Skills For Jobs In 2023
Policing In The Metaverse: What’s Happening Now
Banking In The Metaverse – The Next Frontier For Financial Services
The 7 Biggest Business Challenges Every Company Is Facing In 2023
Is This The Downfall Of Meta And Social Media As We Know It?
The Top Five Cybersecurity Trends In 2023
The Top 5 Technology Challenges In 2023
How To Build A Positive Hybrid And Remote Working Culture In 2023
Beyond Dashboards: The Future Of Analytics And Business Intelligence?
The Top 5 Data Science And Analytics Trends In 2023
The 5 Biggest Business Trends For 2023
12 Practical Steps To Handle Change At Work
The Top 12 Virtual Networking Tips To Boost Your Career
How AI And Machine Learning Will Impact The Future Of Healthcare
Top 16 Essential Soft Skills For The Future of Work
Artificial Intelligence And The Future Of Marketing
Is AI Really a Job Killer? These Experts Say No

Recently uploaded (20)

PDF
Introduction to the R Programming Language
PPTX
importance of Data-Visualization-in-Data-Science. for mba studnts
PPTX
01_intro xxxxxxxxxxfffffffffffaaaaaaaaaaafg
PDF
Introduction to Data Science and Data Analysis
PPTX
retention in jsjsksksksnbsndjddjdnFPD.pptx
PPTX
Pilar Kemerdekaan dan Identi Bangsa.pptx
PPTX
modul_python (1).pptx for professional and student
PPTX
Managing Community Partner Relationships
PPT
ISS -ESG Data flows What is ESG and HowHow
PPTX
IMPACT OF LANDSLIDE.....................
PPTX
Introduction to Inferential Statistics.pptx
PPTX
Topic 5 Presentation 5 Lesson 5 Corporate Fin
PPTX
Leprosy and NLEP programme community medicine
PDF
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
PDF
Microsoft Core Cloud Services powerpoint
PDF
Capcut Pro Crack For PC Latest Version {Fully Unlocked 2025}
PDF
Data Engineering Interview Questions & Answers Cloud Data Stacks (AWS, Azure,...
PPTX
Qualitative Qantitative and Mixed Methods.pptx
PDF
Jean-Georges Perrin - Spark in Action, Second Edition (2020, Manning Publicat...
PPTX
Acceptance and paychological effects of mandatory extra coach I classes.pptx
Introduction to the R Programming Language
importance of Data-Visualization-in-Data-Science. for mba studnts
01_intro xxxxxxxxxxfffffffffffaaaaaaaaaaafg
Introduction to Data Science and Data Analysis
retention in jsjsksksksnbsndjddjdnFPD.pptx
Pilar Kemerdekaan dan Identi Bangsa.pptx
modul_python (1).pptx for professional and student
Managing Community Partner Relationships
ISS -ESG Data flows What is ESG and HowHow
IMPACT OF LANDSLIDE.....................
Introduction to Inferential Statistics.pptx
Topic 5 Presentation 5 Lesson 5 Corporate Fin
Leprosy and NLEP programme community medicine
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
Microsoft Core Cloud Services powerpoint
Capcut Pro Crack For PC Latest Version {Fully Unlocked 2025}
Data Engineering Interview Questions & Answers Cloud Data Stacks (AWS, Azure,...
Qualitative Qantitative and Mixed Methods.pptx
Jean-Georges Perrin - Spark in Action, Second Edition (2020, Manning Publicat...
Acceptance and paychological effects of mandatory extra coach I classes.pptx

Can Artificial Intelligence Predict The Spread Of Online Hate Speech?

  • 1. Can Artificial Intelligence Predict The Spread Of Online Hate Speech?
  • 2. © 2019 Bernard Marr, Bernard Marr & Co. All rights reserved Title Text IntroductionIntroduction The rise in online hate speech and the way it is reflected in the offline world is a hot topic in politics right now. The internet has given everyone a voice, which clearly has positive implications for the way citizens can publicly challenge authority and debate issues. On the other hand, when challenge and debate spill over into attacks on minorities or vulnerable people, there's obviously a potential for harm. It’s fairly commonly assumed that this form of hate speech, particularly when encountered alongside other factors such as social deprivation or mental illness, has the potential to radicalize individuals in dangerous ways, and inspire them to commit illegal and violent acts. Can Artificial Intelligence Predict The Spread Of Online Hate Speech?
  • 3. © 2019 Bernard Marr, Bernard Marr & Co. All rights reserved Can Artificial Intelligence Predict The Spread Of Online Hate Speech? Just as terrorist organizations like ISIS can be seen using hate speech in videos and propaganda material intended to incite violence, racist and anti-Islamic material is thought to have inspired killers like Anders Breivik, who killed 69 youths in a 2011 shooting spree, and the 2019 Christchurch mosque shooting in which 51 died. So far these links between online and real-world actions, though common sense tells us they are likely to exist, have been difficult to prove scientifically. However, a piece of the puzzle fell into place thanks to research carried out by the UN and the Universitat Pompeu Fabra, and co-ordinated by IBM. IBM principle researcher Kush Varshney tells me “I think the main message was that this was the first study of its kind looking at the relationship between online and offline behaviors, and most importantly it demonstrates why we should be taking this technical approach to studying that relationship.”
  • 4. © 2019 Bernard Marr, Bernard Marr & Co. All rights reserved Can Artificial Intelligence Predict The Spread Of Online Hate Speech? Researchers began by compiling a list of keywords and phrases considered by governmental agencies and NGOs to be indicators of hate speech. These included expressions found in both Islamic-extremist and anti-Islamic posts made on Twitter and Reddit. As the researchers validated that these words and phrases were indeed common by searching across those platforms, they came across other co-occurring terms that were also added to the list. Along with news reports of Islamic terrorism or anti-Islamic violence, this list was the primary sources of data for the investigation. This user-generated content – over 50 million tweets and 300,000 Reddit posts, made by around 15 million users - containing these words and phrases were then classified according to factors including their stance (Islamic-extremist or anti-Islamic), as well as the severity of the message. The scale of severity ranged from simple use of discriminatory language to outright incitement to violence, including genocide.
  • 5. © 2019 Bernard Marr, Bernard Marr & Co. All rights reserved Can Artificial Intelligence Predict The Spread Of Online Hate Speech? After the dataset was compiled and classified, a timeline analysis was carried out, using machine learning to draw a picture of the correlation between the number of hate speech messages appearing online, and a number of real-world incidents including the 2016 Orlando nightclub shooting, the 2016 Istanbul airport attack, the 2016 Finsbury Park, London, vehicular attack and the 2016 Olethe, Kansas shooting. All of the incidents involved Muslims or Arabs as either victims or perpetrators, and took place within 19 months. Previously, the majority of machine learning analysis around the concept of hate speech has focussed on building algorithms to determine whether or not particular posts or pieces of content are hateful. Varshney tells me “A lot of people in the machine learning community are tackling the problem of classifying whether speech is offensive or hateful – we decided it wasn’t important for us to tackle that problem, and often it’s a question of where you draw the line, if something is verging on being hateful. “What we were looking at is what’s the relationship between things that happen in the online world, and things that happen in the real world.”
  • 6. © 2019 Bernard Marr, Bernard Marr & Co. All rights reserved Can Artificial Intelligence Predict The Spread Of Online Hate Speech? The study found that, yes, following high-profile incidents of both Islamophobic or Islamic-extremist violence, incidents of online hate-speech do indeed increase. This didn’t really come as a surprise to anyone as it was commonly held to be true based on casual observation. But what was far more interesting was the fact that, in the case of Islamist- extremist violence it wasn’t just Muslims who faced an increase in hate speech against them, but attacks were frequently broadened to other minority groups. Varshney told me, "The severity of the attacks also increases, so people are much more likely to incite violence … and the target of the online messages also broadens so other groups that have nothing to do with anything that’s happened in the real world also experience an increase in hate speech. It could be any other group, such as homosexuals … those were some interesting findings.” So, is online hate speech and real-world violence a circular problem? It’s been shown that one (real-world violence) causes the other – but is the reverse also true, creating a vicious, self-feeding circle of hatred and violence?
  • 7. © 2019 Bernard Marr, Bernard Marr & Co. All rights reserved Can Artificial Intelligence Predict The Spread Of Online Hate Speech? Currently, that remains unclear. But proving the causal relationship between hate speech and violence is a natural next-step for research in the field, Varshney says. Proving this reverse relationship is likely to be more problematic, however, for a number of reasons. Including the fact that the process of online radicalization itself is not yet well understood from a scientific perspective. The question of how much exposure to hateful material is needed to push a person to commit violence, over what period of time, and how the mental health of the individual plays its part, have yet to be answered. Varshey told me “That would probably be an even more important study to do – we didn’t get into it in this particular project, as some of the causal relationships require techniques that we don’t yet have. “That inspires us to do more technical work though – and this direction is clearly a next- step for the work, that should be done, for sure.” The research, which can be viewed in full here, was carried out as part of IBM’s Science for Social Good, which aimed to apply machine learning to 17 issues identified by the UN as Sustainable Development Goals.
  • 8. © 2017 Bernard Marr , Bernard Marr & Co. All rights reserved © 2018 Bernard Marr, Bernard Marr & Co. All rights reserved Bernard Marr is an internationally best-selling author, popular keynote speaker, futurist, and a strategic business & technology advisor to governments and companies. He helps organisations improve their business performance, use data more intelligently, and understand the implications of new technologies such as artificial intelligence, big data, blockchains, and the Internet of Things. LinkedIn has ranked Bernard as one of the world’s top 5 business influencers. He is a frequent contributor to the World Economic Forum and writes a regular column for Forbes. Every day Bernard actively engages his 1.5 million social media followers and shares content that reaches millions of readers. Visit The Website © 2017 Bernard Marr , Bernard Marr & Co. All rights reserved © 2019 Bernard Marr, Bernard Marr & Co. All rights reserved Bernard Marr is an internationally best-selling author, popular keynote speaker, futurist, and a strategic business & technology advisor to governments and companies. He helps organisations improve their business performance, use data more intelligently, and understand the implications of new technologies such as artificial intelligence, big data, blockchains, and the Internet of Things. LinkedIn has ranked Bernard as one of the world’s top 5 business influencers. He is a frequent contributor to the World Economic Forum and writes a regular column for Forbes. Every day Bernard actively engages his 1.5 million social media followers and shares content that reaches millions of readers. Visit The Website
  • 9. Title Subtitle Be the FIRST to receive news, articles, insights and event updates from Bernard Marr & Co straight to your inbox. Signing up is EASY! Simply fill out the online form and we’ll be in touch! © 2018 Bernard Marr, Bernard Marr & Co. All rights reserved