SlideShare a Scribd company logo
LAMBDA-B-GONE:
IN-MEMORY CASE STUDY FOR FASTER, SMARTER
AND SIMPLER ANSWERS
DENNIS DUCKWORTH
VOLTDB
See all the presentations from the In-Memory Computing
Summit at http://imcsummit.org
VOLTDB
 An operational database purpose-built to run 100% in-memory at web scal
In-Memory
Relational, SQL, fully ACID compliant
Scale-out on commodity hardware
Reliability, HA, fault tolerant
Integration with OLAP, Hadoop, DW
 Best use cases: operational and transactional workloads
ORIGINAL LAMBDA ARCHITECTURE
VOLTDB-IMPROVED VERSION OF LAMBDA ARCHITECTURE
CASE STUDY
5
Content Delivery Network Service
Provider
Business challenges:
- Real-time analytics for customers
- Data accuracy: over/under billing
- Scalability
 SQL interface unlike Trident or Spark-Streaming
 Merges the good things of the old-world like SQL and transactions with the
good things of the new world like ‘no-locks’, ‘k-factor’ HA, etc….
 Very simple and intuitive API and usage
 k-factor + logs + snapshots eliminates the need to backup the system
 Fast query performance
 Horizontal scalability
MAXCDN FINDINGS: VOLTDB ADVANTAGES
MAXCDN FINDINGS: VOLTDB ADVANTAGES
MAXCDN RESULTS
8
Simplified system architecture
1/10th the compute resources
100% budget accuracy,
eliminated $$$ under/over
spending
Faster time to value
“We chose to go with VoltDB over other streaming
aggregate solutions (like Trident) for its SQL
interface, real-time Ad-Hoc queries over our raw
data, and simpler overall design”
Behzad Pirvali, Architect, MaxCDN
REAL-TIME IN-MEMORY OLTP AND ANALYTICS WITH APACHE
IGNITE ON AWS BY BABU ELUMALAI
HTTP://BLOGS.AWS.AMAZON.COM/BI
GDATA/POST/TX3RS3V80XNRJH3/RE
AL-TIME-IN-MEMORY-OLTP-AND-
ANALYTICS-WITH-APACHE-IGNITE-
ON-AWS
AMAZON DYNAMODB
AMAZON DYNAMODB + AWS LAMBDA + KINESIS FIREHOSE +
S3 + REDSHIFT
AMAZON DYNAMODB + AWS LAMBDA + KINESIS FIREHOSE +
S3 + REDSHIFT + SPARK + SPARK STREAMING +
AMAZON DYNAMODB + AWS LAMBDA + KINESIS FIREHOSE +
S3 + REDSHIFT + SPARK + SPARK STREAMING IGNITE + KCL
VOLTDB-IMPROVED VERSION OF LAMBDA ARCHITECTURE
VOLTDB-IMPROVED VERSION OF LAMBDA ARCHITECTURE
ONE LAST THOUGHT: WORD OF THE DAY
IDEMPOTENCE
THE PROPERTY OF CERTAIN OPERATIONS IN MATHEMATICS AND
COMPUTER SCIENCE, THAT CAN BE APPLIED MULTIPLE TIMES
WITHOUT CHANGING THE RESULT BEYOND THE INITIAL
APPLICATION.
DONE - THANK YOU
If you want to talk about how real transactions (and
idempotence) can help you, come see us.
http://voltdb.com
@dennisduckworth
dduckworth@voltdb.com

More Related Content

PPTX
IMC Summit 2016 Breakout - Ken Gibson - The In-Place Working Storage Tier
PPTX
IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Da...
PPTX
IMC Summit 2016 Breakout - Steve Wikes - Making IMC Enterprise Grade
PDF
Introduce_non-volatile_generic_object_programming_model_for_In-Memory_Computing
PPTX
IMC Summit 2016 Breakout - Brian Bulkowski - NVMe, Storage Class Memory and O...
PPTX
IMC Summit 2016 Innovation - Girish Mutreja - Unveiling the X Platform
PDF
Introducing the Hub for Data Orchestration
PDF
Building Software to Scale
IMC Summit 2016 Breakout - Ken Gibson - The In-Place Working Storage Tier
IMC Summit 2016 Innovation - Steve Wilkes - Tap Into Your Enterprise – Why Da...
IMC Summit 2016 Breakout - Steve Wikes - Making IMC Enterprise Grade
Introduce_non-volatile_generic_object_programming_model_for_In-Memory_Computing
IMC Summit 2016 Breakout - Brian Bulkowski - NVMe, Storage Class Memory and O...
IMC Summit 2016 Innovation - Girish Mutreja - Unveiling the X Platform
Introducing the Hub for Data Orchestration
Building Software to Scale

What's hot (20)

PPTX
PowerStream Demo
PDF
Speeding Up Atlas Deep Learning Platform with Alluxio + Fluid
PPTX
RedisConf17 - IoT Backend with Redis and Node.js
PDF
Data in Motion: Building Stream-Based Architectures with Qlik Replicate & Kaf...
PDF
Presto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data Stores
PPTX
RedisConf18 - The Intelligent Database Proxy
PDF
Logging, Metrics, and APM: The Operations Trifecta
PPTX
Introduction to AWS Kinesis
PDF
Scylla Summit 2022: ScyllaDB Cloud: Simplifying Deployment to the Public Cloud
PDF
Extracting Value from IOT using Azure Cosmos DB, Azure Synapse Analytics and ...
PPTX
Google Cloud and Data Pipeline Patterns
PDF
RedisConf17 - Redis Enterprise on IBM Power Systems
PPTX
Data & Analytics Forum: Moving Telcos to Real Time
PDF
How to Build a new under filesystem in Alluxio: Apache Ozone as an example
PDF
Real-Time Vote Platform Benchmark
PDF
Real-Time Analytics with Confluent and MemSQL
PDF
AWS Study Group - Chapter 04 - Hybrid Cloud Architectures [Solution Architect...
PPTX
IronSource Atom - Redshift - Lessons Learned
PPTX
RedisConf17 - Building Large High Performance Redis Databases with Redis Ente...
PDF
(New)SQL on AWS: Aurora serverless
PowerStream Demo
Speeding Up Atlas Deep Learning Platform with Alluxio + Fluid
RedisConf17 - IoT Backend with Redis and Node.js
Data in Motion: Building Stream-Based Architectures with Qlik Replicate & Kaf...
Presto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data Stores
RedisConf18 - The Intelligent Database Proxy
Logging, Metrics, and APM: The Operations Trifecta
Introduction to AWS Kinesis
Scylla Summit 2022: ScyllaDB Cloud: Simplifying Deployment to the Public Cloud
Extracting Value from IOT using Azure Cosmos DB, Azure Synapse Analytics and ...
Google Cloud and Data Pipeline Patterns
RedisConf17 - Redis Enterprise on IBM Power Systems
Data & Analytics Forum: Moving Telcos to Real Time
How to Build a new under filesystem in Alluxio: Apache Ozone as an example
Real-Time Vote Platform Benchmark
Real-Time Analytics with Confluent and MemSQL
AWS Study Group - Chapter 04 - Hybrid Cloud Architectures [Solution Architect...
IronSource Atom - Redshift - Lessons Learned
RedisConf17 - Building Large High Performance Redis Databases with Redis Ente...
(New)SQL on AWS: Aurora serverless
Ad

Viewers also liked (11)

PPTX
IMC Summit 2016 Breakout - Gordon Patrick - Developments in Persistent Memory
PDF
IMC Summit 2016 Breakout - Yanping Wang - Non-volatile Generic Object Program...
PPTX
IMC Summit 2016 Breakout - Girish Kathalagiri - Decision Making with MLLIB, S...
PPTX
IMC Summit 2016 Breakout - Per Minoborg - Work with Multiple Hot Terabytes in...
PPTX
IMC Summit 2016 Breakout - Henning Andersen - Using Lock-free and Wait-free I...
PDF
IMC Summit 2016 Breakout - Nikita Shamgunov - Propelling IoT Innovation with ...
PPTX
IMC Summit 2016 Breakout - Andy Pavlo - What Non-Volatile Memory Means for th...
PPTX
IMC Summit 2016 Breakout - Matt Coventon - Test Driving Streaming and CEP on ...
PPTX
IMC Summit 2016 Breakout - Girish Mutreja - Extreme Transaction Processing in...
PPTX
IMC Summit 2016 Breakout - Roman Shtykh - Apache Ignite as a Data Processing Hub
PDF
Introducing Apple Watch
IMC Summit 2016 Breakout - Gordon Patrick - Developments in Persistent Memory
IMC Summit 2016 Breakout - Yanping Wang - Non-volatile Generic Object Program...
IMC Summit 2016 Breakout - Girish Kathalagiri - Decision Making with MLLIB, S...
IMC Summit 2016 Breakout - Per Minoborg - Work with Multiple Hot Terabytes in...
IMC Summit 2016 Breakout - Henning Andersen - Using Lock-free and Wait-free I...
IMC Summit 2016 Breakout - Nikita Shamgunov - Propelling IoT Innovation with ...
IMC Summit 2016 Breakout - Andy Pavlo - What Non-Volatile Memory Means for th...
IMC Summit 2016 Breakout - Matt Coventon - Test Driving Streaming and CEP on ...
IMC Summit 2016 Breakout - Girish Mutreja - Extreme Transaction Processing in...
IMC Summit 2016 Breakout - Roman Shtykh - Apache Ignite as a Data Processing Hub
Introducing Apple Watch
Ad

Similar to IMC Summit 2016 Innovation - Dennis Duckworth - Lambda-B-Gone: The In-memory Case Study for Faster, Smarter and Simpler Answers (19)

PDF
Lambda-B-Gone: In-memory Case Study for Faster, Smarter and Simpler Answers
PDF
Serverless Architectural Patterns & Best Practices
PDF
4K Media Workflows on AWS By Usman Shakeel of Amzaon AWS
PDF
Big data and serverless - AWS UG The Netherlands
PPTX
Big Data Goes Airborne. Propelling Your Big Data Initiative with Ironcluster ...
PDF
5 Factors When Selecting a High Performance, Low Latency Database
PDF
Slides: Proven Strategies for Hybrid Cloud Computing with Mainframes — From A...
PPTX
NWCloud Cloud Track - Best Practices for Architecting in the Cloud
PDF
Aws-What You Need to Know_Simon Elisha
PDF
re:Invent ARC307 - Serverless architectural patterns and best practices.pdf
PDF
Cloud Native Applications on OpenShift
PDF
BoxLang-Dynamic-AWS-Lambda by Luis Majano.pdf
PDF
Flying Server-less on the Cloud with AWS Lambda
PDF
Introduction to apache kafka, confluent and why they matter
PPTX
Dev/Test Environment Provisioning and Management on AWS
PDF
When NOT to use Apache Kafka?
PDF
When NOT to Use Apache Kafka? With Kai Waehner | Current 2022
PDF
Best Practices for Building Open Source Data Layers
PPTX
Azure Databricks - An Introduction 2019 Roadshow.pptx
Lambda-B-Gone: In-memory Case Study for Faster, Smarter and Simpler Answers
Serverless Architectural Patterns & Best Practices
4K Media Workflows on AWS By Usman Shakeel of Amzaon AWS
Big data and serverless - AWS UG The Netherlands
Big Data Goes Airborne. Propelling Your Big Data Initiative with Ironcluster ...
5 Factors When Selecting a High Performance, Low Latency Database
Slides: Proven Strategies for Hybrid Cloud Computing with Mainframes — From A...
NWCloud Cloud Track - Best Practices for Architecting in the Cloud
Aws-What You Need to Know_Simon Elisha
re:Invent ARC307 - Serverless architectural patterns and best practices.pdf
Cloud Native Applications on OpenShift
BoxLang-Dynamic-AWS-Lambda by Luis Majano.pdf
Flying Server-less on the Cloud with AWS Lambda
Introduction to apache kafka, confluent and why they matter
Dev/Test Environment Provisioning and Management on AWS
When NOT to use Apache Kafka?
When NOT to Use Apache Kafka? With Kai Waehner | Current 2022
Best Practices for Building Open Source Data Layers
Azure Databricks - An Introduction 2019 Roadshow.pptx

More from In-Memory Computing Summit (15)

PDF
IMC Summit 2016 Innovation - Derek Nelson - PipelineDB: The Streaming-SQL Dat...
PPTX
IMC Summit 2016 Breakout - Noah Arliss - The Truth: How to Test Your Distribu...
PPTX
IMC Summit 2016 Breakout - Aleksandar Seovic - The Illusion of Statelessness
PPTX
IMC Summit 2016 Breakout - Greg Luck - How to Speed Up Your Application Using...
PPTX
IMC Summit 2016 Breakout - Pandurang Naik - Demystifying In-Memory Data Grid,...
PPTX
IMC Summit 2016 Breakout - William Bain - Implementing Extensible Data Struct...
PPTX
IMC Summit 2016 Keynote - Arthur Sainio - NVDIMM: Changes are Here So What’s ...
PPTX
IMC Summit 2016 Keynote - Robert Barr - In Memory Computing for Financial Ser...
PPTX
IMC Summit 2016 Breakout - Nikita Ivanov - Shared In-Memory RDDs – Missing Li...
PPTX
IMCSummite 2016 Breakout - Nikita Ivanov - Apache Ignite 2.0 Towards a Conver...
PPTX
IMC Summit 2016 Keynote - Jason Stamper - In-Memory: The Foundation of the In...
PPTX
IMCSummit 2016 Keynote - Benzi Galili - More Memory for In-Memory Easy
PPTX
IMCSummit 2016 Keynote - Abe Kleinfeld - The In-Memory Computing Landscape: L...
PPTX
Accelerating the Hadoop data stack with Apache Ignite, Spark and Bigtop
PDF
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...
IMC Summit 2016 Innovation - Derek Nelson - PipelineDB: The Streaming-SQL Dat...
IMC Summit 2016 Breakout - Noah Arliss - The Truth: How to Test Your Distribu...
IMC Summit 2016 Breakout - Aleksandar Seovic - The Illusion of Statelessness
IMC Summit 2016 Breakout - Greg Luck - How to Speed Up Your Application Using...
IMC Summit 2016 Breakout - Pandurang Naik - Demystifying In-Memory Data Grid,...
IMC Summit 2016 Breakout - William Bain - Implementing Extensible Data Struct...
IMC Summit 2016 Keynote - Arthur Sainio - NVDIMM: Changes are Here So What’s ...
IMC Summit 2016 Keynote - Robert Barr - In Memory Computing for Financial Ser...
IMC Summit 2016 Breakout - Nikita Ivanov - Shared In-Memory RDDs – Missing Li...
IMCSummite 2016 Breakout - Nikita Ivanov - Apache Ignite 2.0 Towards a Conver...
IMC Summit 2016 Keynote - Jason Stamper - In-Memory: The Foundation of the In...
IMCSummit 2016 Keynote - Benzi Galili - More Memory for In-Memory Easy
IMCSummit 2016 Keynote - Abe Kleinfeld - The In-Memory Computing Landscape: L...
Accelerating the Hadoop data stack with Apache Ignite, Spark and Bigtop
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...

Recently uploaded (20)

PPTX
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
PPTX
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
PPTX
IB Computer Science - Internal Assessment.pptx
PPTX
Computer network topology notes for revision
PPTX
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
PPTX
Introduction to Basics of Ethical Hacking and Penetration Testing -Unit No. 1...
PPTX
05. PRACTICAL GUIDE TO MICROSOFT EXCEL.pptx
PPT
Chapter 3 METAL JOINING.pptnnnnnnnnnnnnn
PPTX
IBA_Chapter_11_Slides_Final_Accessible.pptx
PPTX
Introduction-to-Cloud-ComputingFinal.pptx
PPTX
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
PPTX
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
PDF
Introduction to Business Data Analytics.
PPTX
Global journeys: estimating international migration
PPTX
climate analysis of Dhaka ,Banglades.pptx
PDF
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
PPT
Miokarditis (Inflamasi pada Otot Jantung)
PDF
Launch Your Data Science Career in Kochi – 2025
PPTX
oil_refinery_comprehensive_20250804084928 (1).pptx
PPTX
CEE 2 REPORT G7.pptxbdbshjdgsgjgsjfiuhsd
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
IB Computer Science - Internal Assessment.pptx
Computer network topology notes for revision
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
Introduction to Basics of Ethical Hacking and Penetration Testing -Unit No. 1...
05. PRACTICAL GUIDE TO MICROSOFT EXCEL.pptx
Chapter 3 METAL JOINING.pptnnnnnnnnnnnnn
IBA_Chapter_11_Slides_Final_Accessible.pptx
Introduction-to-Cloud-ComputingFinal.pptx
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
Introduction to Business Data Analytics.
Global journeys: estimating international migration
climate analysis of Dhaka ,Banglades.pptx
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
Miokarditis (Inflamasi pada Otot Jantung)
Launch Your Data Science Career in Kochi – 2025
oil_refinery_comprehensive_20250804084928 (1).pptx
CEE 2 REPORT G7.pptxbdbshjdgsgjgsjfiuhsd

IMC Summit 2016 Innovation - Dennis Duckworth - Lambda-B-Gone: The In-memory Case Study for Faster, Smarter and Simpler Answers

  • 1. LAMBDA-B-GONE: IN-MEMORY CASE STUDY FOR FASTER, SMARTER AND SIMPLER ANSWERS DENNIS DUCKWORTH VOLTDB See all the presentations from the In-Memory Computing Summit at http://imcsummit.org
  • 2. VOLTDB  An operational database purpose-built to run 100% in-memory at web scal In-Memory Relational, SQL, fully ACID compliant Scale-out on commodity hardware Reliability, HA, fault tolerant Integration with OLAP, Hadoop, DW  Best use cases: operational and transactional workloads
  • 4. VOLTDB-IMPROVED VERSION OF LAMBDA ARCHITECTURE
  • 5. CASE STUDY 5 Content Delivery Network Service Provider Business challenges: - Real-time analytics for customers - Data accuracy: over/under billing - Scalability
  • 6.  SQL interface unlike Trident or Spark-Streaming  Merges the good things of the old-world like SQL and transactions with the good things of the new world like ‘no-locks’, ‘k-factor’ HA, etc….  Very simple and intuitive API and usage  k-factor + logs + snapshots eliminates the need to backup the system  Fast query performance  Horizontal scalability MAXCDN FINDINGS: VOLTDB ADVANTAGES
  • 8. MAXCDN RESULTS 8 Simplified system architecture 1/10th the compute resources 100% budget accuracy, eliminated $$$ under/over spending Faster time to value “We chose to go with VoltDB over other streaming aggregate solutions (like Trident) for its SQL interface, real-time Ad-Hoc queries over our raw data, and simpler overall design” Behzad Pirvali, Architect, MaxCDN
  • 9. REAL-TIME IN-MEMORY OLTP AND ANALYTICS WITH APACHE IGNITE ON AWS BY BABU ELUMALAI HTTP://BLOGS.AWS.AMAZON.COM/BI GDATA/POST/TX3RS3V80XNRJH3/RE AL-TIME-IN-MEMORY-OLTP-AND- ANALYTICS-WITH-APACHE-IGNITE- ON-AWS
  • 11. AMAZON DYNAMODB + AWS LAMBDA + KINESIS FIREHOSE + S3 + REDSHIFT
  • 12. AMAZON DYNAMODB + AWS LAMBDA + KINESIS FIREHOSE + S3 + REDSHIFT + SPARK + SPARK STREAMING +
  • 13. AMAZON DYNAMODB + AWS LAMBDA + KINESIS FIREHOSE + S3 + REDSHIFT + SPARK + SPARK STREAMING IGNITE + KCL
  • 14. VOLTDB-IMPROVED VERSION OF LAMBDA ARCHITECTURE
  • 15. VOLTDB-IMPROVED VERSION OF LAMBDA ARCHITECTURE
  • 16. ONE LAST THOUGHT: WORD OF THE DAY IDEMPOTENCE THE PROPERTY OF CERTAIN OPERATIONS IN MATHEMATICS AND COMPUTER SCIENCE, THAT CAN BE APPLIED MULTIPLE TIMES WITHOUT CHANGING THE RESULT BEYOND THE INITIAL APPLICATION.
  • 17. DONE - THANK YOU If you want to talk about how real transactions (and idempotence) can help you, come see us. http://voltdb.com @dennisduckworth dduckworth@voltdb.com