SlideShare a Scribd company logo
Real time applications
using the R Language
Using TIBCO CEP and TERR
Lou Bajuk-Yorgan
Sr. Director Product Management
© Copyright 2000-2014 TIBCO Software Inc.-2-
Why?
• Why use the R language in real time applications?
– Breadth of analytics—more likely to find the “best” answer
– Ease of prototyping new analyses—rapidly respond to changing
opportunities and threats
 E.g., fraud detection of evolving threats
• Challenge
– Applying R quickly enough to keep up with real time events
– Enabling rapid iteration from prototyping to production
© Copyright 2000-2014 TIBCO Software Inc.-3-
Components
• TIBCO Complex Event Processing (CEP)
– Fast Data Platforms from TIBCO
– TIBCO Streambase: graphical workflows representing real time data
streams
– TIBCO Business Events: complex rules-based event processing
• TIBCO Enterprise Runtime for R
– Alternative R Language interpreter developed by TIBCO
– Generally faster, more memory-efficient than open-source R engine
– Based on longtime expertise with S+
– Freely available to R Community
– Embeddable in TIBCO Spotfire, CEP and 3rd party products
– Compatible with RStudio for development
© Copyright 2000-2014 TIBCO Software Inc.-4-
• TERR powers real-time advanced analytics to “Fast Data” in
TIBCO Streambase and TIBCO Business Events
– When an event is identified, the CEP application can trigger:
 An automated business process (e.g., extend a mobile offer to a customer; stop a fraudulent
transaction in process)
 A Spotfire application or dashboard, marrying real-time event data with historical contextual
data, providing immediate root cause analytics (Spotfire Event Analytics)
TERR in TIBCO’s Complex Event Processing
Model
Develop model
Deploy via TERR in
TIBCO Streambase
or Business Events
Act
Automatically monitor
real-time transactions
Automatically trigger
action
Analyze
Analyze data in Spotfire
Uncover patterns,
trends & correlations
© Copyright 2000-2014 TIBCO Software Inc.-5-
Use Cases: TERR in CEP
Logistics Optimization
• Port Congestion Detection
– Real time system triggers TERR
– Analyzes port congestion
– Recommends reduction of speed if no berths
available
• Maritime Abnormality Detection
– Based on Automatic Identification System info,
TERR calculates likelihood of deviation from
normal sailing routes
– Alerts carrier & operator
© Copyright 2000-2014 TIBCO Software Inc.
© Copyright 2000-2014 TIBCO Software Inc.-6-
Use Cases: TERR in CEP
Predictive Maintenance for Oil & Gas
• Oil & Gas Extraction
– Maintenance downtime and equipment
failures are costly
– Engineers track sensor data to find leading
indicators (e.g., temperature, vibration)
• Engineers usually use ad hoc rules on leading
indicators
– R/TERR used to develop predictive
models for preventative maintenance
– Deployed in real-time systems, alert
when maintenance recommended
© Copyright 2000-2014 TIBCO Software Inc.
© Copyright 2000-2014 TIBCO Software Inc.-7-
Use Cases: TERR in CEP
Severe Weather Alerts Tracking for
Facilities
• Alert Facilities Managers to Severe
Weather Alerts
• Use TIBCO Streambase to monitor
alerts in real time
– TERR queries for current weather alerts
– Uses sp & rgdal package to compare
areas of alerts vs. facility locations
• On alert, update Spotfire visualization
with mapped alerts, notify Facilities
managers
© Copyright 2000-2014 TIBCO Software Inc.
© Copyright 2000-2014 TIBCO Software Inc.-8-
Use Cases: TERR in CEP
Customer Loyalty Analytics
• Deliver real-time predictions on whether to
extend an offer to a given customer
• Apply predictive models in real-time decision
making
– Best marketing offer
– Customer churn
– Predictive Maintenance
– Yield optimization
• Rapidly develop and iterate TERR models in
production
– Respond to changing opportunities and
threats
3:23Wednesday, Sep 3
Milano
We see you are nearby.
Stop by today & you’ll
get 10% off!
© Copyright 2000-2014 TIBCO Software Inc.
© Copyright 2000-2014 TIBCO Software Inc.-9-
Summary
• A Fast R-language engine in CEP platforms enables
– Broad access to R analytics to find the “best” model
– Rapid iteration and response to changing conditions
• TIBCO Enterprise Runtime for R (TERR)
– Embeddable in commercial applications, Spotfire, CEP, etc.
– Freely available at tap.tibco.com for R users
– Free version supported through tibcommunity.com
• For more information
– Visit spotfire.tibco.com/terr or contact me (lbajuk@tibco.com)

More Related Content

PDF
Deploying R in BI and Real time Applications
PDF
Sannella use r2013-terr-memory-management
PPTX
How Spark Enables the Internet of Things: Efficient Integration of Multiple ...
PDF
Event Streaming Architecture for Industry 4.0 - Abdelkrim Hadjidj & Jan Kuni...
PDF
How Big Data is Reducing Costs and Improving Outcomes in Health Care
PDF
Streaming Goes Mainstream: New Architecture & Emerging Technologies for Strea...
PPTX
Big Data Paris
PPTX
How Spark Enables the Internet of Things- Paula Ta-Shma
Deploying R in BI and Real time Applications
Sannella use r2013-terr-memory-management
How Spark Enables the Internet of Things: Efficient Integration of Multiple ...
Event Streaming Architecture for Industry 4.0 - Abdelkrim Hadjidj & Jan Kuni...
How Big Data is Reducing Costs and Improving Outcomes in Health Care
Streaming Goes Mainstream: New Architecture & Emerging Technologies for Strea...
Big Data Paris
How Spark Enables the Internet of Things- Paula Ta-Shma

What's hot (20)

PDF
Real-Time Fraud Detection at Scale—Integrating Real-Time Deep-Link Graph Anal...
PDF
Extending the Reach of R to the Enterprise with TERR and Spotfire
PPTX
Cloudera Customer Success Story
PDF
Applying Machine Learning to IOT: End to End Distributed Pipeline for Real- T...
PPTX
I'm being followed by drones
PDF
ML, Statistics, and Spark with Databricks for Maximizing Revenue in a Delayed...
PPTX
Flink Case Study: Bouygues Telecom
PPTX
Integrating Real-Time Video Data Streams with Spark and Kafka
PDF
Demystifying AI, Machine Learning and Deep Learning
PDF
Building Custom Machine Learning Algorithms With Apache SystemML
PDF
Performance and Scale Options for R with Hadoop: A comparison of potential ar...
PDF
Applying Machine learning to IOT: End to End Distributed Distributed Pipeline...
PDF
AI on Spark for Malware Analysis and Anomalous Threat Detection
PPTX
Are You Ready for Big Data Big Analytics?
PDF
Multiplatform Spark solution for Graph datasources by Javier Dominguez
PDF
Streaming Machine learning Distributed Pipeline for Real-Time Uber Data Using...
PDF
A view of graph data usage by Cerved
PDF
Plume - A Code Property Graph Extraction and Analysis Library
PDF
The road ahead for scientific computing with Python
PDF
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
Real-Time Fraud Detection at Scale—Integrating Real-Time Deep-Link Graph Anal...
Extending the Reach of R to the Enterprise with TERR and Spotfire
Cloudera Customer Success Story
Applying Machine Learning to IOT: End to End Distributed Pipeline for Real- T...
I'm being followed by drones
ML, Statistics, and Spark with Databricks for Maximizing Revenue in a Delayed...
Flink Case Study: Bouygues Telecom
Integrating Real-Time Video Data Streams with Spark and Kafka
Demystifying AI, Machine Learning and Deep Learning
Building Custom Machine Learning Algorithms With Apache SystemML
Performance and Scale Options for R with Hadoop: A comparison of potential ar...
Applying Machine learning to IOT: End to End Distributed Distributed Pipeline...
AI on Spark for Malware Analysis and Anomalous Threat Detection
Are You Ready for Big Data Big Analytics?
Multiplatform Spark solution for Graph datasources by Javier Dominguez
Streaming Machine learning Distributed Pipeline for Real-Time Uber Data Using...
A view of graph data usage by Cerved
Plume - A Code Property Graph Extraction and Analysis Library
The road ahead for scientific computing with Python
Structured Streaming Data Pipeline Using Kafka, Spark, and MapR-DB
Ad

Similar to Real time applications using the R Language (20)

PDF
Applying R in BI and Real Time applications EARL London 2015
PPTX
Applying the R Language to BI and Real Time Applications
PDF
Using the R Language in BI and Real Time Applications (useR 2015)
PPTX
R in BI and Streaming Applications for useR 2016
PPTX
Extending the R language to BI and Real-time Applications JSM 2015
PDF
TERR in BI and Real Time applications
PPTX
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
PDF
Extend the Reach of R to the Enterprise (for useR! 2013)
PDF
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...
PDF
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025
PPTX
TIBCO Advanced Analytics Meetup (TAAM) November 2015
PDF
Embracing data science for smarter analytics apps
PDF
Reusing and Managing R models in an Enterprise
PPTX
Houston Energy Data Science Meet up_TIBCO Slides
PDF
TIBCO Advanced Analytics Meetup (TAAM) - June 2015
PDF
Big Data LDN 2018: ACCELERATING YOUR ANALYTICS JOURNEY WITH REAL-TIME AI
PPT
CEP and SOA: An Open Event-Driven Architecture for Risk Management
PPT
Real-Time Analytics for Industries
PDF
Framework and Product Comparison for Big Data Log Analytics and ITOA
PDF
TUCON 2011- Identifying and resolving Middleware Issues 4x faster at 1/5th th...
Applying R in BI and Real Time applications EARL London 2015
Applying the R Language to BI and Real Time Applications
Using the R Language in BI and Real Time Applications (useR 2015)
R in BI and Streaming Applications for useR 2016
Extending the R language to BI and Real-time Applications JSM 2015
TERR in BI and Real Time applications
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Extend the Reach of R to the Enterprise (for useR! 2013)
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025
TIBCO Advanced Analytics Meetup (TAAM) November 2015
Embracing data science for smarter analytics apps
Reusing and Managing R models in an Enterprise
Houston Energy Data Science Meet up_TIBCO Slides
TIBCO Advanced Analytics Meetup (TAAM) - June 2015
Big Data LDN 2018: ACCELERATING YOUR ANALYTICS JOURNEY WITH REAL-TIME AI
CEP and SOA: An Open Event-Driven Architecture for Risk Management
Real-Time Analytics for Industries
Framework and Product Comparison for Big Data Log Analytics and ITOA
TUCON 2011- Identifying and resolving Middleware Issues 4x faster at 1/5th th...
Ad

More from Lou Bajuk (10)

PDF
R Consortium update for EARL Boston Oct 2017
PDF
R consortium update EARL London Sept 2017
PDF
Making Data Science accessible to a wider audience
PPTX
R Consortium Update for EARL June 2017
PDF
Streaming analytics overview for R
PDF
Tibco streaming analytics overview and roadmap
PDF
EARL Sept 2016 R consortium
PPTX
The Importance of an Analytics Platform
PDF
Software Testing and the R language
PDF
The Compatibility Challenge:Examining R and Developing TERR
R Consortium update for EARL Boston Oct 2017
R consortium update EARL London Sept 2017
Making Data Science accessible to a wider audience
R Consortium Update for EARL June 2017
Streaming analytics overview for R
Tibco streaming analytics overview and roadmap
EARL Sept 2016 R consortium
The Importance of an Analytics Platform
Software Testing and the R language
The Compatibility Challenge:Examining R and Developing TERR

Recently uploaded (20)

PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
Empathic Computing: Creating Shared Understanding
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
Spectroscopy.pptx food analysis technology
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Electronic commerce courselecture one. Pdf
DOCX
The AUB Centre for AI in Media Proposal.docx
PPTX
sap open course for s4hana steps from ECC to s4
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Network Security Unit 5.pdf for BCA BBA.
PPTX
MYSQL Presentation for SQL database connectivity
PPT
Teaching material agriculture food technology
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Empathic Computing: Creating Shared Understanding
“AI and Expert System Decision Support & Business Intelligence Systems”
Digital-Transformation-Roadmap-for-Companies.pptx
Diabetes mellitus diagnosis method based random forest with bat algorithm
Spectral efficient network and resource selection model in 5G networks
Spectroscopy.pptx food analysis technology
Understanding_Digital_Forensics_Presentation.pptx
Mobile App Security Testing_ A Comprehensive Guide.pdf
Electronic commerce courselecture one. Pdf
The AUB Centre for AI in Media Proposal.docx
sap open course for s4hana steps from ECC to s4
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Review of recent advances in non-invasive hemoglobin estimation
Network Security Unit 5.pdf for BCA BBA.
MYSQL Presentation for SQL database connectivity
Teaching material agriculture food technology
Encapsulation_ Review paper, used for researhc scholars
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf

Real time applications using the R Language

  • 1. Real time applications using the R Language Using TIBCO CEP and TERR Lou Bajuk-Yorgan Sr. Director Product Management
  • 2. © Copyright 2000-2014 TIBCO Software Inc.-2- Why? • Why use the R language in real time applications? – Breadth of analytics—more likely to find the “best” answer – Ease of prototyping new analyses—rapidly respond to changing opportunities and threats  E.g., fraud detection of evolving threats • Challenge – Applying R quickly enough to keep up with real time events – Enabling rapid iteration from prototyping to production
  • 3. © Copyright 2000-2014 TIBCO Software Inc.-3- Components • TIBCO Complex Event Processing (CEP) – Fast Data Platforms from TIBCO – TIBCO Streambase: graphical workflows representing real time data streams – TIBCO Business Events: complex rules-based event processing • TIBCO Enterprise Runtime for R – Alternative R Language interpreter developed by TIBCO – Generally faster, more memory-efficient than open-source R engine – Based on longtime expertise with S+ – Freely available to R Community – Embeddable in TIBCO Spotfire, CEP and 3rd party products – Compatible with RStudio for development
  • 4. © Copyright 2000-2014 TIBCO Software Inc.-4- • TERR powers real-time advanced analytics to “Fast Data” in TIBCO Streambase and TIBCO Business Events – When an event is identified, the CEP application can trigger:  An automated business process (e.g., extend a mobile offer to a customer; stop a fraudulent transaction in process)  A Spotfire application or dashboard, marrying real-time event data with historical contextual data, providing immediate root cause analytics (Spotfire Event Analytics) TERR in TIBCO’s Complex Event Processing Model Develop model Deploy via TERR in TIBCO Streambase or Business Events Act Automatically monitor real-time transactions Automatically trigger action Analyze Analyze data in Spotfire Uncover patterns, trends & correlations
  • 5. © Copyright 2000-2014 TIBCO Software Inc.-5- Use Cases: TERR in CEP Logistics Optimization • Port Congestion Detection – Real time system triggers TERR – Analyzes port congestion – Recommends reduction of speed if no berths available • Maritime Abnormality Detection – Based on Automatic Identification System info, TERR calculates likelihood of deviation from normal sailing routes – Alerts carrier & operator © Copyright 2000-2014 TIBCO Software Inc.
  • 6. © Copyright 2000-2014 TIBCO Software Inc.-6- Use Cases: TERR in CEP Predictive Maintenance for Oil & Gas • Oil & Gas Extraction – Maintenance downtime and equipment failures are costly – Engineers track sensor data to find leading indicators (e.g., temperature, vibration) • Engineers usually use ad hoc rules on leading indicators – R/TERR used to develop predictive models for preventative maintenance – Deployed in real-time systems, alert when maintenance recommended © Copyright 2000-2014 TIBCO Software Inc.
  • 7. © Copyright 2000-2014 TIBCO Software Inc.-7- Use Cases: TERR in CEP Severe Weather Alerts Tracking for Facilities • Alert Facilities Managers to Severe Weather Alerts • Use TIBCO Streambase to monitor alerts in real time – TERR queries for current weather alerts – Uses sp & rgdal package to compare areas of alerts vs. facility locations • On alert, update Spotfire visualization with mapped alerts, notify Facilities managers © Copyright 2000-2014 TIBCO Software Inc.
  • 8. © Copyright 2000-2014 TIBCO Software Inc.-8- Use Cases: TERR in CEP Customer Loyalty Analytics • Deliver real-time predictions on whether to extend an offer to a given customer • Apply predictive models in real-time decision making – Best marketing offer – Customer churn – Predictive Maintenance – Yield optimization • Rapidly develop and iterate TERR models in production – Respond to changing opportunities and threats 3:23Wednesday, Sep 3 Milano We see you are nearby. Stop by today & you’ll get 10% off! © Copyright 2000-2014 TIBCO Software Inc.
  • 9. © Copyright 2000-2014 TIBCO Software Inc.-9- Summary • A Fast R-language engine in CEP platforms enables – Broad access to R analytics to find the “best” model – Rapid iteration and response to changing conditions • TIBCO Enterprise Runtime for R (TERR) – Embeddable in commercial applications, Spotfire, CEP, etc. – Freely available at tap.tibco.com for R users – Free version supported through tibcommunity.com • For more information – Visit spotfire.tibco.com/terr or contact me (lbajuk@tibco.com)