SlideShare a Scribd company logo
Risk Forecasting & Predictive Analytics HunchLab Research Update Robert Cheetham [email_address] @rcheetham Michael Urciouli [email_address]
Philadelphia Police Department Crime Analysis Unit founded in 1997 Desktop ArcGIS Analysis to support investigations Support COMPSTAT process Web-based crime analysis 3 staff
Who is Azavea? 25 people - software engineers - spatial analysts - project managers Spatial Analysis Web & Mobile High Performance Geoprocessing User Experience R&D
10% Research Program Pro Bono Program Time-to-Give-Back Program Employee-focused Culture  Projects with Social Value
web-based crime analysis, early warning, and risk forecasting
Crime Analysis Mapping (spatial / temporal densities) Trending Intelligence Dashboard Early Warning Statistical & Threshold-based Hunches (data mining) Alerting Risk Forecasting Near Repeat Pattern Load Forecasting
Dashboard
Space + Time
Space + Time
Animation
Early Warning & Notification
 
Risk Forecasting
Crime Analysis Mapping (spatial / temporal densities) Trending Intelligence Dashboard Early Warning Statistical & Threshold-based Hunches (data mining) Alerting Risk Forecasting Near Repeat Pattern Cyclical Forecasting
 
Near Repeat Pattern
Contagious Crime? Near repeat pattern analysis  “ If one burglary occurs, how does the risk change nearby?”
What Do We Mean By Near Repeat? Repeat victimization Incident at the  same   location  at a later time Near repeat victimization Incident at a  nearby   location  at a later time Incident A (place, time) --> Incident B (place, time)
Near Repeat Pattern Analysis The goal: Quantify short term risk due to near-repeat victimization “ If one burglary occurs, how does the risk of burglary for the neighbors change?” What we know: Incident A (place, time) --> Incident B (place, time) Distance between A and B Timeframe between A and B What we need to know: What distances/timeframes are not simply random?
Near Repeat Pattern Analysis The process Observe the pattern in historic data Simulate the pattern in randomized historic data Compare the observed pattern to the simulated patterns Apply the non-random pattern to new incidents
Near Repeat Pattern Analysis An example 180 days of burglaries  Philadelphia Division 6
Near Repeat Pattern Analysis An example 180 days of burglaries  Philadelphia Division 6
Near Repeat Pattern Analysis An example 180 days of burglaries  Philadelphia Division 6
Near Repeat Pattern Analysis
Online Version
Near Repeat Pattern Analysis How can you test your own data? Near Repeat Calculator http://www.temple.edu/cj/misc/nr/ Papers Near-Repeat Patterns in Philadelphia Shootings (2008) One city block & two weeks after one shooting 33% increase in likelihood of a second event Jerry Ratcliffe Temple University
Cyclical Patterns
Improving CompStat “ Given the time of year, day of week, time of day and general trend, what counts of crimes should I expect?”
What Do We Mean By Load Forecasting? Generating aggregate crime counts for a future timeframe using cyclical time series analysis bit.ly/gorrcrimeforecastingpaper Measure cyclical patterns Identify non-cyclical trend Forecast expected count +
Cyclical Forecasting Measure cyclical patterns Take historic incidents (for example: last five years) Generate multiplicative seasonal indices For each time cycle: time of year day of week time of day Count incidents within each time unit (for example: Monday) Calculate average per time unit if incidents were evenly distributed Divide counts within each time unit by the calculated average to generate multiplicative indices Index ~ 1 means at the average Index > 1 means above average Index < 1 means below average
Cyclical Forecasting
Cyclical Forecasting
Cyclical Forecasting
Cyclical Forecasting
Cyclical Forecasting Identify non-cyclical trend Take recent daily counts (for example: last year daily counts) Remove cyclical trends by dividing by indices  Run a trending function on the new counts Simple average Last X Days Smoothing function Exponential smoothing Holt’s linear exponential smoothing
Cyclical Forecasting Forecast expected count Project trend into future timeframe Always flat Simple average Exponential smoothing Linear trend Holt’s linear exponential smoothing Multiple by seasonal indices to reseasonalize the data
Cyclical Forecasting bit.ly/gorrcrimeforecastingpaper Measure cyclical patterns Identify non-cyclical trend Forecast expected count +
Cyclical Forecasting
Cyclical Forecasting
Cyclical Forecasting
Cyclical Forecasting
How Do We Know It Works? Testing Generated forecasting packages (examples) Commonly Used Average of last 30 days Average of last 365 days Last year’s count for the  same time period  Advanced Combinations Different cyclical indices (example: day of year vs. month of year) Different levels of geographic aggregation for indices Different trending functions Scoring methodologies (examples) Mean absolute percent error (with some enhancements) Mean percent error Mean squared error Run thousands of forecasts through testing framework Choose the right technique in the right situation
Ongoing R&D
Research Topics Analysis Real-time Functionality Consume real-time data streams Conduct ongoing, automated analysis Push real-time alerts Risk Forecasting Load forecasting enhancements Machine learning-based model selection Weather and special events Combining short and long term risk forecasts NIJ project with Jerry Ratcliffe & Ralph Taylor Neighborhood composition modeling using ACS data Risk Terrain Modeling
Research Topics Current Implementation Funding Local Byrne Memorial JAG solicitation due July 21, 2011 Research Funding
Acknowledgements National Science Foundation – SBIR Program Grant #IIP-0637589 Grant #IIP-0750507 Philadelphia Police Department Jerry Ratcliffe, Temple University Tony Smith, University of Pennsylvania Peirce County, WA
Upcoming Conferences Crime Mapping Research Conference, October IACP, October
Many Thanks! © Photo used with permission from  Alphafish , via  Flickr.com
Questions Michael Urciouli [email_address] @rcheetham

More Related Content

PPT
Crime Risk Forecasting: Near Repeat Pattern Analysis & Load Forecasting
PPTX
Data Philly Meetup - Big (Geo) Data
PPTX
10 Steps to Optimize Your Crime Analysis
PPT
2011 NIJ Crime Mapping Conference - Data Mining and Risk Forecasting in Web-b...
PPTX
The Real-time Police Force: Publishing Analytic Information to the Field with...
PDF
Deep Learning for Public Safety in Chicago and San Francisco
PDF
Machine Learning Approaches for Crime Pattern Detection
PPTX
Crime prediction-using-data-mining
Crime Risk Forecasting: Near Repeat Pattern Analysis & Load Forecasting
Data Philly Meetup - Big (Geo) Data
10 Steps to Optimize Your Crime Analysis
2011 NIJ Crime Mapping Conference - Data Mining and Risk Forecasting in Web-b...
The Real-time Police Force: Publishing Analytic Information to the Field with...
Deep Learning for Public Safety in Chicago and San Francisco
Machine Learning Approaches for Crime Pattern Detection
Crime prediction-using-data-mining

What's hot (12)

PPTX
Chicago Crime Dataset Project Proposal
PDF
Crime Analysis & Prediction System
PPTX
Rent, Rain, and Regulations | Du Phan, Dataiku | DN18
PPTX
Zhang_Qian_PresentationFinal
PPTX
Crime analysis
PPT
Using Data Mining Techniques to Analyze Crime Pattern
PPT
Crime Mapping & Analysis – Georgia Tech
PDF
Probabilistic data structures
PPTX
Crime Analytics: Analysis of crimes through news paper articles
PDF
Eears (earthquake alert and report system) a real time decision support syst...
DOCX
Jamal Shakeenab Resume
PPTX
Crime Identification Denver Colorado
Chicago Crime Dataset Project Proposal
Crime Analysis & Prediction System
Rent, Rain, and Regulations | Du Phan, Dataiku | DN18
Zhang_Qian_PresentationFinal
Crime analysis
Using Data Mining Techniques to Analyze Crime Pattern
Crime Mapping & Analysis – Georgia Tech
Probabilistic data structures
Crime Analytics: Analysis of crimes through news paper articles
Eears (earthquake alert and report system) a real time decision support syst...
Jamal Shakeenab Resume
Crime Identification Denver Colorado
Ad

Similar to Crime Risk Forecasting and Predictive Analytics - Esri UC (20)

PDF
The International Journal of Engineering and Science (IJES)
PDF
Forecasting Space-Time Events - Strata + Hadoop World 2015 San Jose
PPTX
Technical Seminar
PDF
Crime Analysis based on Historical and Transportation Data
PDF
IRJET- Crime Analysis using Data Mining and Data Analytics
PDF
PDF
Bs4301396400
PDF
Crime forecasting system for soic final
PPTX
Crime Pattern Detection using K-Means Clustering
PDF
Predictive analysis of crime forecasting
PDF
Week 5: Public safety
PPTX
Crime analysis of different situations
PPT
Crime Early Warning: Automated Data Mining of CAD and RMS
PDF
Predictive Modeling for Topographical Analysis of Crime Rate
PPT
Smarter Safety: Flere data, færre kriminelle handlinger, Mauritz Gilberg & St...
PDF
Chicago Crime Analysis
PDF
Crime Data Analysis and Prediction for city of Los Angeles
PDF
Survey on Crime Interpretation and Forecasting Using Machine Learning
PPTX
PPTX
9th may net sci presentation (1)
The International Journal of Engineering and Science (IJES)
Forecasting Space-Time Events - Strata + Hadoop World 2015 San Jose
Technical Seminar
Crime Analysis based on Historical and Transportation Data
IRJET- Crime Analysis using Data Mining and Data Analytics
Bs4301396400
Crime forecasting system for soic final
Crime Pattern Detection using K-Means Clustering
Predictive analysis of crime forecasting
Week 5: Public safety
Crime analysis of different situations
Crime Early Warning: Automated Data Mining of CAD and RMS
Predictive Modeling for Topographical Analysis of Crime Rate
Smarter Safety: Flere data, færre kriminelle handlinger, Mauritz Gilberg & St...
Chicago Crime Analysis
Crime Data Analysis and Prediction for city of Los Angeles
Survey on Crime Interpretation and Forecasting Using Machine Learning
9th may net sci presentation (1)
Ad

More from Azavea (20)

PPTX
Using New Tools to Analyze and Plan Your Urban Forest
PPTX
7 misconceptions about predictive policing webinar
PPTX
Tracking Your Green Infrastructure
PPTX
Growing Your Urban Forest: Using the OpenTreeMap Bulk Uploader
PPTX
November 12, 2014 Webinar: Hackers, Beer Geeks, and Arborly Love - Reaching o...
PPTX
Mobile Citizen Science
PPTX
Getting Started with OpenTreeMap Cloud
PDF
HunchLab 2.0 Getting Started
PDF
Is it a Package or a Wrapper? Designing, Documenting, and Distributing a Pyth...
PPTX
Your New Partners: Understanding Civic Hackathons, Why You Should be Involved...
PDF
HunchLab 2.0 Predictive Missions: Under the Hood
PPTX
Using Open Data and Citizen Science to Promote Citizen Engagement with Green ...
PDF
HunchLab 2.0 Preview Webinar - Place
PDF
Five Technology Trends Every Nonprofit Needs to Know
PPTX
PhillyHistory.org - Tracking Metrics for a Digital Project
PPTX
Fed Geo Day - Applying GeoTrellis at the US Army Corps
PPTX
Fed Geo Day - GeoTrellis Intro
PPTX
Fed Geo Day 2013 - Azavea Intro
PDF
Modeling Count-based Raster Data with ArcGIS and R
PPTX
OpenTreeMap NCGIS
Using New Tools to Analyze and Plan Your Urban Forest
7 misconceptions about predictive policing webinar
Tracking Your Green Infrastructure
Growing Your Urban Forest: Using the OpenTreeMap Bulk Uploader
November 12, 2014 Webinar: Hackers, Beer Geeks, and Arborly Love - Reaching o...
Mobile Citizen Science
Getting Started with OpenTreeMap Cloud
HunchLab 2.0 Getting Started
Is it a Package or a Wrapper? Designing, Documenting, and Distributing a Pyth...
Your New Partners: Understanding Civic Hackathons, Why You Should be Involved...
HunchLab 2.0 Predictive Missions: Under the Hood
Using Open Data and Citizen Science to Promote Citizen Engagement with Green ...
HunchLab 2.0 Preview Webinar - Place
Five Technology Trends Every Nonprofit Needs to Know
PhillyHistory.org - Tracking Metrics for a Digital Project
Fed Geo Day - Applying GeoTrellis at the US Army Corps
Fed Geo Day - GeoTrellis Intro
Fed Geo Day 2013 - Azavea Intro
Modeling Count-based Raster Data with ArcGIS and R
OpenTreeMap NCGIS

Recently uploaded (20)

PDF
KodekX | Application Modernization Development
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Machine learning based COVID-19 study performance prediction
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Encapsulation theory and applications.pdf
PDF
cuic standard and advanced reporting.pdf
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPTX
A Presentation on Artificial Intelligence
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PPTX
Cloud computing and distributed systems.
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Empathic Computing: Creating Shared Understanding
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
KodekX | Application Modernization Development
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Machine learning based COVID-19 study performance prediction
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Encapsulation theory and applications.pdf
cuic standard and advanced reporting.pdf
NewMind AI Weekly Chronicles - August'25 Week I
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
A Presentation on Artificial Intelligence
Spectral efficient network and resource selection model in 5G networks
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
Cloud computing and distributed systems.
Per capita expenditure prediction using model stacking based on satellite ima...
Empathic Computing: Creating Shared Understanding
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
CIFDAQ's Market Insight: SEC Turns Pro Crypto

Crime Risk Forecasting and Predictive Analytics - Esri UC

  • 1. Risk Forecasting & Predictive Analytics HunchLab Research Update Robert Cheetham [email_address] @rcheetham Michael Urciouli [email_address]
  • 2. Philadelphia Police Department Crime Analysis Unit founded in 1997 Desktop ArcGIS Analysis to support investigations Support COMPSTAT process Web-based crime analysis 3 staff
  • 3. Who is Azavea? 25 people - software engineers - spatial analysts - project managers Spatial Analysis Web & Mobile High Performance Geoprocessing User Experience R&D
  • 4. 10% Research Program Pro Bono Program Time-to-Give-Back Program Employee-focused Culture Projects with Social Value
  • 5. web-based crime analysis, early warning, and risk forecasting
  • 6. Crime Analysis Mapping (spatial / temporal densities) Trending Intelligence Dashboard Early Warning Statistical & Threshold-based Hunches (data mining) Alerting Risk Forecasting Near Repeat Pattern Load Forecasting
  • 11. Early Warning & Notification
  • 12.  
  • 14. Crime Analysis Mapping (spatial / temporal densities) Trending Intelligence Dashboard Early Warning Statistical & Threshold-based Hunches (data mining) Alerting Risk Forecasting Near Repeat Pattern Cyclical Forecasting
  • 15.  
  • 17. Contagious Crime? Near repeat pattern analysis “ If one burglary occurs, how does the risk change nearby?”
  • 18. What Do We Mean By Near Repeat? Repeat victimization Incident at the same location at a later time Near repeat victimization Incident at a nearby location at a later time Incident A (place, time) --> Incident B (place, time)
  • 19. Near Repeat Pattern Analysis The goal: Quantify short term risk due to near-repeat victimization “ If one burglary occurs, how does the risk of burglary for the neighbors change?” What we know: Incident A (place, time) --> Incident B (place, time) Distance between A and B Timeframe between A and B What we need to know: What distances/timeframes are not simply random?
  • 20. Near Repeat Pattern Analysis The process Observe the pattern in historic data Simulate the pattern in randomized historic data Compare the observed pattern to the simulated patterns Apply the non-random pattern to new incidents
  • 21. Near Repeat Pattern Analysis An example 180 days of burglaries Philadelphia Division 6
  • 22. Near Repeat Pattern Analysis An example 180 days of burglaries Philadelphia Division 6
  • 23. Near Repeat Pattern Analysis An example 180 days of burglaries Philadelphia Division 6
  • 26. Near Repeat Pattern Analysis How can you test your own data? Near Repeat Calculator http://www.temple.edu/cj/misc/nr/ Papers Near-Repeat Patterns in Philadelphia Shootings (2008) One city block & two weeks after one shooting 33% increase in likelihood of a second event Jerry Ratcliffe Temple University
  • 28. Improving CompStat “ Given the time of year, day of week, time of day and general trend, what counts of crimes should I expect?”
  • 29. What Do We Mean By Load Forecasting? Generating aggregate crime counts for a future timeframe using cyclical time series analysis bit.ly/gorrcrimeforecastingpaper Measure cyclical patterns Identify non-cyclical trend Forecast expected count +
  • 30. Cyclical Forecasting Measure cyclical patterns Take historic incidents (for example: last five years) Generate multiplicative seasonal indices For each time cycle: time of year day of week time of day Count incidents within each time unit (for example: Monday) Calculate average per time unit if incidents were evenly distributed Divide counts within each time unit by the calculated average to generate multiplicative indices Index ~ 1 means at the average Index > 1 means above average Index < 1 means below average
  • 35. Cyclical Forecasting Identify non-cyclical trend Take recent daily counts (for example: last year daily counts) Remove cyclical trends by dividing by indices Run a trending function on the new counts Simple average Last X Days Smoothing function Exponential smoothing Holt’s linear exponential smoothing
  • 36. Cyclical Forecasting Forecast expected count Project trend into future timeframe Always flat Simple average Exponential smoothing Linear trend Holt’s linear exponential smoothing Multiple by seasonal indices to reseasonalize the data
  • 37. Cyclical Forecasting bit.ly/gorrcrimeforecastingpaper Measure cyclical patterns Identify non-cyclical trend Forecast expected count +
  • 42. How Do We Know It Works? Testing Generated forecasting packages (examples) Commonly Used Average of last 30 days Average of last 365 days Last year’s count for the same time period Advanced Combinations Different cyclical indices (example: day of year vs. month of year) Different levels of geographic aggregation for indices Different trending functions Scoring methodologies (examples) Mean absolute percent error (with some enhancements) Mean percent error Mean squared error Run thousands of forecasts through testing framework Choose the right technique in the right situation
  • 44. Research Topics Analysis Real-time Functionality Consume real-time data streams Conduct ongoing, automated analysis Push real-time alerts Risk Forecasting Load forecasting enhancements Machine learning-based model selection Weather and special events Combining short and long term risk forecasts NIJ project with Jerry Ratcliffe & Ralph Taylor Neighborhood composition modeling using ACS data Risk Terrain Modeling
  • 45. Research Topics Current Implementation Funding Local Byrne Memorial JAG solicitation due July 21, 2011 Research Funding
  • 46. Acknowledgements National Science Foundation – SBIR Program Grant #IIP-0637589 Grant #IIP-0750507 Philadelphia Police Department Jerry Ratcliffe, Temple University Tony Smith, University of Pennsylvania Peirce County, WA
  • 47. Upcoming Conferences Crime Mapping Research Conference, October IACP, October
  • 48. Many Thanks! © Photo used with permission from Alphafish , via Flickr.com
  • 49. Questions Michael Urciouli [email_address] @rcheetham