CSW2022_01_introduction.pptx.pdf
- 1. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Session01: introduction Disinformation/Malign Inο¬uence Training Disarm Foundation | 2022 1 1
- 2. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Questions for class β Do you want 30 mins or 1 hour lunch break? β What are your backgrounds? β Course will include some information security, data science, psychology, risk analysis, and python coding β What do you want to get out of this course? 2
- 4. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Your instructors, and the Disarm Foundation Todayβs instructors: β SJ Terp β Pablo Breuer β Mike Klein The Disarm Foundation: https://www.disarm.foundation/ 4
- 5. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Disarm Foundation: Frameworks and Training https://www.disarm.foundation/ 5
- 6. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Course outcomes After successfully completing the course, students will be able to: β Elaborate how information security and cognitive security interact β Evaluate persuasive technology at different scales β Evaluate inο¬uence operation mechanisms and tracking techniques β Use tools to investigate account and network-level coordinated inauthentic activities β Understand ethical behaviour around misinformation and disinformation response and research 6
- 7. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Course structure Understand environment 1: Introduction 2: Information and response 3: Threats Set up project 4: Project setup 5: Data collection Manage components 6: Inο¬uence 7: Narratives 8: Behaviours Manage risk 9: Risk assessment 10: Risk measurement Hotwash Module 1: Introduction β Introductions β Deο¬ning βcognitive securityβ β Cognitive Security Exercise: play games 7
- 8. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Course schedule 8 DAY 1: understanding cogsec 9-10:30 Session 1: introduction Exercise: play games 10:30-12 Session 2: information and response Exercise: information & response landscapes 12-1 lunch 1-2:30 Session 3: threats Exercise: threat landscape 2:30-4 Session 4: project setup Exercise: set up your project resources 4-5:30 Session 5: data collection Exercise: gather data for your project DAY 2: managing cogsec 9-10:30 Session 6: influence Exercise: influence analysis 10:30-12 Session 7: narratives Exercise: narrative analysis 12-1 lunch 1-2:30 Session 8: behaviours Exercise: behaviour analysis 2:30-4 Session 9: risk assessment Exercise: purple team 4-5:30 Session 10: risk prioritisation Exercise: hotwash Each session is 55 mins taught, 30 mins exercise
- 10. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Course project Explore an information harm area or incident of your choice: β Assess information, harms, and response environments β Organise project β Gather data β Identify incident artifacts β Identify narratives and behaviours β Suggest counters β Report out - in a format of your choice 10 Image: https://commons.wikimedia.org/wiki/File:Project_Management_(project_control).png
- 11. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Start thinking about your project Outputs β Tweets, report, alert? β Data science, notes, examples? Topics β Medical β Disaster β Elections β Business β War Geography β Region β Country β City etc Creators β Nationstate / criminal / insider / etc Community β Who is affected? Harms β Misinformation β Disinformation β Conspiracies β Rumours Channels β Social media β URLs β Ofο¬ine 11
- 13. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Media: Information disorder 13
- 16. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Cognitive Security: both of them βCognitive Security is the application of artiο¬cial intelligence technologies, modeled on human thought processes, to detect security threats.β - XTN MLSec - machine learning in infosec β ML used in attacks on information systems β ML used to defend information systems β Attacking ML systems and algorithms β βAdversarial AIβ βCognitive Security (COGSEC) refers to practices, methodologies, and efforts made to defend against social engineering attemptsβintentional and unintentional manipulations of and disruptions to cognition and sensemakingβ - cogsec.org CogSec - social engineering at scale β Manipulation of individual beliefs, belonging, etc β Manipulation of human communities β βAdversarial cognitionβ 16
- 17. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Social Engineering: both of them βthe use of centralized planning in an attempt to manage social change and regulate the future development and behavior of a society.β β Mass manipulation etc βthe use of deception to manipulate individuals into divulging conο¬dential or personal information that may be used for fraudulent purposes.β β Phishing etc 17
- 18. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Cognitive Security: Information Security applied to disinformation+ βCognitive security is the application of information security principles, practices, and tools to misinformation, disinformation, and inο¬uence operations. It takes a socio-technical lens to high-volume, high-velocity, and high-variety forms of βsomething is wrong on the internetβ. Cognitive security can be seen as a holistic view of disinformation from a security practitionerβs perspective 18
- 19. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 How Cognitive Security and information security ο¬t together 19
- 20. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Information Security vs Cognitive Security: Objects Computers Networks Internet Data Actions People Communities Internet Beliefs Actions 20
- 21. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Hybrids, and other attack types from infosec 21 β Hybrid: cyber + cognitive + physical β Cyber supporting cognitive β Cognitive supporting cyber β Cyber attack forms adapted to cognitive Image: Verizon DBIR https://www.verizon.com/business/resources/reports/dbir/
- 22. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Your role β Manage lifecycles β Manage risk β Manage teams β Manage objects β Manage behaviours β Manage endpoints β Manage toolset 22 Image: https://www.wsj.com/articles/SB947800469939459913
- 25. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Cogsec: Lifecycle models 25 Images: WHO Europe, https://www.nist.gov/cyberframework/online-learning/components-framework
- 27. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Infosec: risk management models Image: https://www.risklens.com/infographics/fair-model-on-a-page 27
- 28. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 CogSec: Managing risk and resources Manage risks β Risk management β assessment, reduction, remediation β Frequency: β how often? β Losses: β How bad? How big? Who to? β Harm categories: physical, psychological, economic, reputational, cultural, political β Environment β Assets, threats, vulnerabilities Manage resources β Mis/disinformation is everywhere β Detection, mitigation, response β You never have enough resources β People β Technologies β Time β Attention β Connections 28
- 29. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 CogSec: Managing the whole system Information Landscape β’ Information seeking β’ Information sharing β’ Information posting β’ Information sources β’ Information voids Harms Landscape β’ Motivations β’ Sources/ Starting points β’ Effects β’ Misinformation narratives β’ Hateful speech narratives β’ Crossover narratives β’ Tactics and Techniques β’ Artifacts Response Landscape β’Monitoring organisations β’Countering organisations β’Coordination β’Existing policies β’Technologies β’etc 29
- 32. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Cognitive Security Operations Centers 32 Image: DISARM Foundation
- 34. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Infosec model: STIX Image: https://github.com/traut/stixview 34
- 35. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Cogsec: interacting layers of attack/respond Campaigns Incidents Narratives and behaviours Artifacts a t t a c k e r d e f e n d e r 35 Image: DISARM Foundation
- 40. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Infosec model: ATT&CK Image: https://www.mitre.org/capabilities/cybersecurity/overview/cybersecurity-blog/the-attck%E2%84%A2-navigator-a-new-open-source 40
- 41. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Cogsec: DISARM Red 41 Image: DISARM Foundation
- 42. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Infosec model: MITRE DEFEND Image: https://therecord.media/mitre-releases-d3fend-defensive-measures-complimentary-to-its-attck-framework/ 42
- 43. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Cogsec: DISARM Blue 43 Image: DISARM Foundation
- 46. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Typical cogsec toolset Data gathering β Crowdtangle β Tineye / Yandex β Hypothes.is β Maltego β Proο¬l3r β CheckUserNames β Hootsuite Data storage and sharing β CSVs β STIX / TAXII β Archive.org Information sharing β MISP β Ticketing system β Googledocs β Spreadsheets Response β Googledocs & spreadsheets Analysis β Jupyter notebooks β Python libraries β (Pandas) β Gephi β AMITT Navigator β inVid β BuiltWith
- 48. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Infosec: Security training Image: https://www.firewelltechnologysolutions.com/two-factor-authentication-and-account-security/ 48
- 49. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 CogSec: Fake news training Image: https://www.dhs.gov/sites/default/files/publications/19_0717_cisa_the-war-on-pineapple-understanding-foreign-interference-in-5-steps.pdf 49
- 50. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Your ο¬rst exercise: play games 50
- 51. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Using games to prepare your responses Learning game β fun experience that teaches you something β Useful for training large numbers of people simultaneously Red team / Purple team β test an organisationβs defences by thinking like a bad guy β Useful for ο¬nding system vulnerabilities, and predicting future moves Tabletop exercise β key people responding to a simulated event β Useful for creating cohesive teams. Often large scale Simulation β imitation of processes and environment β Useful for βwhat ifβ automated tests 51
- 53. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Assessing a game: look forβ¦ Coverage β Who is this designed for? β Public, inο¬uencers, media etc β Techniques covered β Harms covered β rumours, misinformation, disinformation, conspiracy theories etc β Variants, e.g. languages / countries Viewpoint β Whose point of view are you playing from? β Do you βbreak it then ο¬x itβ? 53 Outcomes β What did you learn from the game? β What are the rewards from the game? Continuation β Where does it suggest you go or do next? β Would you recommend it to your friends?
- 54. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 A sampling of disinformation games Game Point of view Audience Creator Bad News Game, Harmony Square, Go Viral Creator Public DROG News Hero Media Public NATO stratcom Cranky Uncle Family member Public Monash uni Disinformation Diaries Politician Political staff Alliance of dems Learn2Discern Media Public Ukraine Fakey Fact checker Public Uni of Indiana 54
- 55. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Other disinformation games Online games β Fake News: the game https://www.rand.org/research/projects/truth-decay/ο¬ghting-disinformation/search/items/fake-news- the-game.html β Checkology misinformation practice (e.g. https://checkology.org/lessons/teacher/163/elements/2471) β Polititruth https://www.cinqmarsmedia.com/politifact/index.html (Politifact, Tinder-style) β BBC iReporter https://www.bbc.co.uk/news/resources/idt-8760dd58-84f9-4c98-ade2-590562670096 β Digital Compass https://www.gamesforchange.org/game/digital-compass/ β The Republia Times https://www.gamesforchange.org/game/the-republia-times/ β Interland https://beinternetawesome.withgoogle.com/en_us/interland β Propaganda Game https://propagandagame.org/ β Factitious http://factitious.augamestudio.com/#/ β Hindsight2020 https://www.hindsight2020.eu/ Card games β Fake News β Paladone 55
- 56. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Assessing a game: look forβ¦ Coverage β Who is this designed for? β Public, inο¬uencers, media etc β Techniques covered β Harms covered β rumours, misinformation, disinformation, conspiracy theories etc β Variants, e.g. languages / countries Viewpoint β Whose point of view are you playing from? β Do you βbreak it then ο¬x itβ? 56 Outcomes β What did you learn from the game? β What are the rewards from the game? Continuation β Where does it suggest you go or do next? β Would you recommend it to your friends?
- 57. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Annex: Some disinformation games to choose from 57
- 59. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Bad News Game https://www.getbadnews.com/#intro DROG and Uni Cambridge Techniques: β Impersonation β Emotion β Polarization β Conspiracy β Discredit β Trolling 59
- 60. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Harmony Square https://www.harmonysquare.game/en DROG/ GEC Techniques: β Trolling β Emotion β Ampliο¬cation β Escalation 60
- 61. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Go Viral Game https://www.goviralgame.com/ University of Cambridge, DROG Techniques: β Emotion β Fake expert β Conspiracy 61
- 62. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Disinformation Diaries https://www.allianceofdemocracies.org/initiatives/the -campaign/the-disinformation-diaries/ Ora Tanner, Alliance of Democracies Foundation 62
- 63. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Cranky Uncle https://crankyuncle.com/ John Cook, Monash Uni, Autonomy 63
- 64. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Learn 2 Discern game http://irex.mocotms.com/ml_en/story_html5.html?l ms=1 Ukrainian Takes a while to do, but a lovely game 64
- 67. Disinformation/Malign Inο¬uence Training, Disarm Foundation | 2022 Fake It to Make It https://www.fakeittomakeitgame.com/ 67