SlideShare a Scribd company logo
Wider and Enhanced Verification for You
Carolina Scarton, Kalina Bontcheva
University of Sheffield
C.Scarton@sheffield.ac.uk, K.Bontcheva@sheffield.ac.uk
@carolscarton, @kbontcheva
JRC Workshop, Varese Italy, 8th December 2019
1
WeVerify Tools and Algorithms
➢ Rumour Analysis
➢ Meme and advert OCR
➢ TrulyMedia & TruthNest
• The following SOMA presentation
➢ WeVerify/InVid content verification plugin
• Includes image and video verification algorithms
➢ Disinformation Spread Analysis
➢ Database of “Known Fakes”
2
Verifying Rumours and Analysing Conversational Threads
➢ Rumour is “a circulating story of questionable veracity, which is apparently
credible but hard to verify, and produces sufficient skepticism and/or anxiety”
➢ Key is not only whether it is true or false, but also:
• Who is spreading it?
• Are people believing it?
• Rumour stance: support, deny, question, comment
• Do we need to debunk it or not?
➢ Assist journalists through automated analysis embedded in a user-friendly tool
➢ The tool is undergoing testing, to be integrated within the Browser Plugin
3
Verifying Rumours and Analysing Conversational Threads
4
https://twitter.com/emmanuelmacron/status/1164617008962527232
Verifying Rumours and Analysing Conversational Threads
5
Try it with:
1. https://twitter.com/emmanuelmacron/status/1164617008962527232
2. https://twitter.com/DavidJHarrisJr/status/1059908006043967492
https://tweetveracity.gate.ac.uk/
Verifying Rumours: Demo Example
6
Verifying Rumours and Analysing Conversational Threads (1)
7
Verifying Rumours and Analysing Conversational Threads (2)
8
Analysing Memes and Adverts: Example Ad
9
Settings: Convert to grayscale and Invert; Post-processing: rmgarbage plus
http://demos.gate.ac.uk/weverify/ocr/
Rumour Veracity and Stance as a Service
10
https://cloud.gate.ac.uk
Chrome/Firefox Verification Plugin
11
Chrome/Firefox Verification Plugin: Demo videos
➢ Analyse Facebook, Twitter, or YouTube Videos (demo): https://www.youtube.com/watch?v=eEVTYq1LMxM
➢ Analysing keyframes in videos (demo): https://youtu.be/iNs8y5DoxP8
➢ Analyse YouTube video thumbnails (demo): https://youtu.be/Vn0XGlOkSRQ
➢ Searching for past tweets and other advanced features (demo): https://youtu.be/wzMCtpENuHA
➢ Image Magnifier: https://youtu.be/JljRs8p4aK4
➢ Image Metadata Analyzer + Geolocation (demo): https://youtu.be/Mg6Z-Jc54yo
➢ Image and Video Forensics (demo): https://youtu.be/de862rAPne4
➢ Other demos and tutorials: See Tutorial tab in the plugin
12
New: Twitter Social Network Analysis
13
New: Twitter Social Network Analysis (2)
14
New: Twitter Social Network Analysis (3)
15
Analysing Disinformation Spread with SNA
➢ Social Network analysis investigates how information spreads into information systems
➢ Social Network Analysis is used to:
• Understand how misinformation is spreading within particular groups
• Combined with other digital verification techniques, Social Network analysis can supply evidence:
• Existence of astroturfing operations;
• Influence of particular social groups
• Support decision to proceed to fact-checking
• if disinfo only spread by a small groups with no influence, no need to debunk?
• Currently requires use of highly complex, general tools like Gephi
16
Suavelos: WeVerify SNA Visualisation Tool
The SNA demo:
http://networkx.iti.gr/network/
results/646e2023fbacfb2943267
792d6c313ed00dab114/
Suavelos Study (Le Monde)
https://www.disinfo.eu/2019/0
9/11/suavelos-white-supremaci
sts-funded-through-facebook/
17
Suavelos: Focusing on a Specific Community
18
Suavelos: Mapping Interactions over Time
19
20
Disinformation Repurposes Content
Credit: Denis Teyssou (AFP)
21
Google getting confused
Database of
Known Fakes can
help!
Database of Known Fakes: Overview
22
DBKF: Decontextualised Image
23
DBKF: Decontextualised Image - the AFP debunk
24
Project Contacts
25
• Dr. Milena Yankova-Doseva
Project Coordinator, Ontotext AD
email:milena.yankova@ontotext.com
• Zlatina Marinova
Administrative Coordinator, Ontotext AD
email: zlatina.marinova@ontotext.com
• Prof. Kalina Bontcheva
Scientific Director, University of Sheffield
email: k.bontcheva@sheffield.ac.uk
•
• Nikos Sarris
Exploitation Director, ATC
email: n.sarris@atc.gr
• Denis Teyssou
Innovation Manager, AFP
email: denis.teyssou@afp.com
• Jochen Spangenberg
Dissemination Lead, DW
email: jochen.spangenberg@dw.com
•
Thank you for your attention!
26
www.weverify.eu
https://twitter.com/WeVerify

More Related Content

PDF
Hands on verification training for journalists
PDF
Presentation / invited talk by Kalina Bontcheva at Digilience 2019, Oct 2019
PDF
L tvs disinfo - 24 nov 2020
PDF
Text analysis for disinformation detection 17 dec 2020
PPTX
Context Aggregation and Analysis: A tool for User-Generated Video Verification
PDF
Verification with WeVerify, InVID, Truly Media and more. DW Innovation activi...
PDF
Edmo research + platforms panel
PDF
Presentation of the InVID tool for social media verification
Hands on verification training for journalists
Presentation / invited talk by Kalina Bontcheva at Digilience 2019, Oct 2019
L tvs disinfo - 24 nov 2020
Text analysis for disinformation detection 17 dec 2020
Context Aggregation and Analysis: A tool for User-Generated Video Verification
Verification with WeVerify, InVID, Truly Media and more. DW Innovation activi...
Edmo research + platforms panel
Presentation of the InVID tool for social media verification

What's hot (10)

PPTX
Session 4: Social Media Monitoring & VOST
PDF
TTO Keynote 08 10 2021
PDF
InVID at the IPTC Autumn Meeting 2016
PDF
Social media and technology
PPTX
Video Retrieval for Multimedia Verification of Breaking News on Social Networks
PDF
Second issue of the InVID newsletter
PDF
Reveal - Social Media Verification - poster
PDF
Joining the conversation
PDF
Joining the Conversation
PPT
Fostering Virality
Session 4: Social Media Monitoring & VOST
TTO Keynote 08 10 2021
InVID at the IPTC Autumn Meeting 2016
Social media and technology
Video Retrieval for Multimedia Verification of Breaking News on Social Networks
Second issue of the InVID newsletter
Reveal - Social Media Verification - poster
Joining the conversation
Joining the Conversation
Fostering Virality
Ad

Similar to Presentation JRC Workshop on Disinformation - Dec 2019 (20)

PDF
WeVerify Overview
PPTX
Aggregating and Analyzing the Context of Social Media Content
PDF
We verify @ meta forum 2020 - Dec 2 2020
PPTX
Reffin meetup talk slides 20 02-20c
PDF
EDMO workshop 17 Feb 2021
PDF
Context Aggregation and Analysis: A Tool for User- Generated Video Verificati...
PDF
fake_news_detectionitisaboutfakenewdtection.pdf
PPTX
Preparedness Summit 2014 - Social Media Monitoring for ICS - Tamer Hadi
PDF
Leading Change from the "Other" C-Suite
PPTX
698642933-DdocfordownloadEEP-FAKE-PPT.pptx
PPTX
#GSMCon2016 Virtual Team Presentation
PPTX
fakenews_DBDA_Mar23.pptx
PPTX
Towards policy making 2.0: Rethinking public engagement
PDF
Verification of UGC/Eyewitness Media: Challenges and Approaches
PDF
Jochen Spangenberg - Sourcing stories on social media
PPTX
Social Media in Emergencies
PDF
Accelerating the Social Media Revolution
PDF
2nd workshop em data science 08 02 2021
PDF
Fake News Detection on Social Media using Machine Learning
PPT
How You Can Use Math & Split Testing To Go Viral
WeVerify Overview
Aggregating and Analyzing the Context of Social Media Content
We verify @ meta forum 2020 - Dec 2 2020
Reffin meetup talk slides 20 02-20c
EDMO workshop 17 Feb 2021
Context Aggregation and Analysis: A Tool for User- Generated Video Verificati...
fake_news_detectionitisaboutfakenewdtection.pdf
Preparedness Summit 2014 - Social Media Monitoring for ICS - Tamer Hadi
Leading Change from the "Other" C-Suite
698642933-DdocfordownloadEEP-FAKE-PPT.pptx
#GSMCon2016 Virtual Team Presentation
fakenews_DBDA_Mar23.pptx
Towards policy making 2.0: Rethinking public engagement
Verification of UGC/Eyewitness Media: Challenges and Approaches
Jochen Spangenberg - Sourcing stories on social media
Social Media in Emergencies
Accelerating the Social Media Revolution
2nd workshop em data science 08 02 2021
Fake News Detection on Social Media using Machine Learning
How You Can Use Math & Split Testing To Go Viral
Ad

More from Weverify (20)

PDF
Operation wise attention network for tampering localization fusion
PDF
MeVer tools for disinformation detection
PDF
TTO2021: Cross-Lingual Rumour Stance Classification: a First Study with BERT...
PPTX
MeVer tools for disinformation detection
PPTX
Operation-wise Attention Network for Tampering Localization Fusion.
PDF
RDSM workshop 13 dec2020
PDF
We verify balkan disinformation panel
PDF
20200112 EUDL training for adult learners
PDF
#Semiform2020 02 11 2020
PDF
Stance classification. Presentation at QMUL 11 Nov 2020
PDF
Stance classification. Uni Cambridge 22 Jan 2021
PDF
Qurator keynote berlin 2101 2020
PDF
Aacl / SoBigData 2020 06 12 2020
PDF
Stance classification - Presentation QMUL by Carolina Scarton, USFD
PDF
#Semiform2020 02 11 2020
PDF
Rumour Stance Classification. Presentation at AACL 2020
PDF
WeVerify at EBU by Denis Teyssou, AFP
PDF
WeVerify at DeepTech2020, March 2020
PDF
WeVerify Wébinaire OIF sur la désinformation Internet, April 2020
PDF
WeVerify at artec, March 2020
Operation wise attention network for tampering localization fusion
MeVer tools for disinformation detection
TTO2021: Cross-Lingual Rumour Stance Classification: a First Study with BERT...
MeVer tools for disinformation detection
Operation-wise Attention Network for Tampering Localization Fusion.
RDSM workshop 13 dec2020
We verify balkan disinformation panel
20200112 EUDL training for adult learners
#Semiform2020 02 11 2020
Stance classification. Presentation at QMUL 11 Nov 2020
Stance classification. Uni Cambridge 22 Jan 2021
Qurator keynote berlin 2101 2020
Aacl / SoBigData 2020 06 12 2020
Stance classification - Presentation QMUL by Carolina Scarton, USFD
#Semiform2020 02 11 2020
Rumour Stance Classification. Presentation at AACL 2020
WeVerify at EBU by Denis Teyssou, AFP
WeVerify at DeepTech2020, March 2020
WeVerify Wébinaire OIF sur la désinformation Internet, April 2020
WeVerify at artec, March 2020

Recently uploaded (20)

PPTX
Power Point - Lesson 3_2.pptx grad school presentation
PPTX
June-4-Sermon-Powerpoint.pptx USE THIS FOR YOUR MOTIVATION
PPTX
Mathew Digital SEO Checklist Guidlines 2025
PDF
mera desh ae watn.(a source of motivation and patriotism to the youth of the ...
PPTX
Module 1 - Cyber Law and Ethics 101.pptx
PPTX
E -tech empowerment technologies PowerPoint
PPT
Design_with_Watersergyerge45hrbgre4top (1).ppt
PPTX
SAP Ariba Sourcing PPT for learning material
PDF
The Ikigai Template _ Recalibrate How You Spend Your Time.pdf
PPTX
t_and_OpenAI_Combined_two_pressentations
PPT
Ethics in Information System - Management Information System
PDF
SASE Traffic Flow - ZTNA Connector-1.pdf
PPTX
newyork.pptxirantrafgshenepalchinachinane
PPTX
Funds Management Learning Material for Beg
DOC
Rose毕业证学历认证,利物浦约翰摩尔斯大学毕业证国外本科毕业证
PDF
Sims 4 Historia para lo sims 4 para jugar
PPTX
presentation_pfe-universite-molay-seltan.pptx
PPTX
artificial intelligence overview of it and more
PPTX
Digital Literacy And Online Safety on internet
PPTX
INTERNET------BASICS-------UPDATED PPT PRESENTATION
Power Point - Lesson 3_2.pptx grad school presentation
June-4-Sermon-Powerpoint.pptx USE THIS FOR YOUR MOTIVATION
Mathew Digital SEO Checklist Guidlines 2025
mera desh ae watn.(a source of motivation and patriotism to the youth of the ...
Module 1 - Cyber Law and Ethics 101.pptx
E -tech empowerment technologies PowerPoint
Design_with_Watersergyerge45hrbgre4top (1).ppt
SAP Ariba Sourcing PPT for learning material
The Ikigai Template _ Recalibrate How You Spend Your Time.pdf
t_and_OpenAI_Combined_two_pressentations
Ethics in Information System - Management Information System
SASE Traffic Flow - ZTNA Connector-1.pdf
newyork.pptxirantrafgshenepalchinachinane
Funds Management Learning Material for Beg
Rose毕业证学历认证,利物浦约翰摩尔斯大学毕业证国外本科毕业证
Sims 4 Historia para lo sims 4 para jugar
presentation_pfe-universite-molay-seltan.pptx
artificial intelligence overview of it and more
Digital Literacy And Online Safety on internet
INTERNET------BASICS-------UPDATED PPT PRESENTATION

Presentation JRC Workshop on Disinformation - Dec 2019

  • 1. Wider and Enhanced Verification for You Carolina Scarton, Kalina Bontcheva University of Sheffield C.Scarton@sheffield.ac.uk, K.Bontcheva@sheffield.ac.uk @carolscarton, @kbontcheva JRC Workshop, Varese Italy, 8th December 2019 1
  • 2. WeVerify Tools and Algorithms ➢ Rumour Analysis ➢ Meme and advert OCR ➢ TrulyMedia & TruthNest • The following SOMA presentation ➢ WeVerify/InVid content verification plugin • Includes image and video verification algorithms ➢ Disinformation Spread Analysis ➢ Database of “Known Fakes” 2
  • 3. Verifying Rumours and Analysing Conversational Threads ➢ Rumour is “a circulating story of questionable veracity, which is apparently credible but hard to verify, and produces sufficient skepticism and/or anxiety” ➢ Key is not only whether it is true or false, but also: • Who is spreading it? • Are people believing it? • Rumour stance: support, deny, question, comment • Do we need to debunk it or not? ➢ Assist journalists through automated analysis embedded in a user-friendly tool ➢ The tool is undergoing testing, to be integrated within the Browser Plugin 3
  • 4. Verifying Rumours and Analysing Conversational Threads 4 https://twitter.com/emmanuelmacron/status/1164617008962527232
  • 5. Verifying Rumours and Analysing Conversational Threads 5 Try it with: 1. https://twitter.com/emmanuelmacron/status/1164617008962527232 2. https://twitter.com/DavidJHarrisJr/status/1059908006043967492 https://tweetveracity.gate.ac.uk/
  • 7. Verifying Rumours and Analysing Conversational Threads (1) 7
  • 8. Verifying Rumours and Analysing Conversational Threads (2) 8
  • 9. Analysing Memes and Adverts: Example Ad 9 Settings: Convert to grayscale and Invert; Post-processing: rmgarbage plus http://demos.gate.ac.uk/weverify/ocr/
  • 10. Rumour Veracity and Stance as a Service 10 https://cloud.gate.ac.uk
  • 12. Chrome/Firefox Verification Plugin: Demo videos ➢ Analyse Facebook, Twitter, or YouTube Videos (demo): https://www.youtube.com/watch?v=eEVTYq1LMxM ➢ Analysing keyframes in videos (demo): https://youtu.be/iNs8y5DoxP8 ➢ Analyse YouTube video thumbnails (demo): https://youtu.be/Vn0XGlOkSRQ ➢ Searching for past tweets and other advanced features (demo): https://youtu.be/wzMCtpENuHA ➢ Image Magnifier: https://youtu.be/JljRs8p4aK4 ➢ Image Metadata Analyzer + Geolocation (demo): https://youtu.be/Mg6Z-Jc54yo ➢ Image and Video Forensics (demo): https://youtu.be/de862rAPne4 ➢ Other demos and tutorials: See Tutorial tab in the plugin 12
  • 13. New: Twitter Social Network Analysis 13
  • 14. New: Twitter Social Network Analysis (2) 14
  • 15. New: Twitter Social Network Analysis (3) 15
  • 16. Analysing Disinformation Spread with SNA ➢ Social Network analysis investigates how information spreads into information systems ➢ Social Network Analysis is used to: • Understand how misinformation is spreading within particular groups • Combined with other digital verification techniques, Social Network analysis can supply evidence: • Existence of astroturfing operations; • Influence of particular social groups • Support decision to proceed to fact-checking • if disinfo only spread by a small groups with no influence, no need to debunk? • Currently requires use of highly complex, general tools like Gephi 16
  • 17. Suavelos: WeVerify SNA Visualisation Tool The SNA demo: http://networkx.iti.gr/network/ results/646e2023fbacfb2943267 792d6c313ed00dab114/ Suavelos Study (Le Monde) https://www.disinfo.eu/2019/0 9/11/suavelos-white-supremaci sts-funded-through-facebook/ 17
  • 18. Suavelos: Focusing on a Specific Community 18
  • 21. 21 Google getting confused Database of Known Fakes can help!
  • 22. Database of Known Fakes: Overview 22
  • 24. DBKF: Decontextualised Image - the AFP debunk 24
  • 25. Project Contacts 25 • Dr. Milena Yankova-Doseva Project Coordinator, Ontotext AD email:milena.yankova@ontotext.com • Zlatina Marinova Administrative Coordinator, Ontotext AD email: zlatina.marinova@ontotext.com • Prof. Kalina Bontcheva Scientific Director, University of Sheffield email: k.bontcheva@sheffield.ac.uk • • Nikos Sarris Exploitation Director, ATC email: n.sarris@atc.gr • Denis Teyssou Innovation Manager, AFP email: denis.teyssou@afp.com • Jochen Spangenberg Dissemination Lead, DW email: jochen.spangenberg@dw.com •
  • 26. Thank you for your attention! 26 www.weverify.eu https://twitter.com/WeVerify