SlideShare a Scribd company logo
Thursday, November 3, 11
for Dummies
                              Galder Zamarreño
                           Senior Software Engineer
                                 Red Hat, Inc




Thursday, November 3, 11
Who is Galder?
                           • R&D engineer (Red Hat Inc):
                            • Infinispan developer
                           • Contributor and committer:
                            • JBoss AS, Hibernate, JGroups...etc
                           • More about me?
                            • Blog: zamarreno.com
                            • Twitter: @galderz


Thursday, November 3, 11
Agenda

                           • What is Infinispan?
                           • Infinispan as in-memory cache
                           • Infinispan as in-memory data grid
                           • Data-as-a-Service with Infinispan
                           • Clustering and migration challenges
                           • Who uses Infinispan?



Thursday, November 3, 11
What is Infinispan?

                           • Data grid platform:
                            • Open source (LGPL)
                            • In-memory
                            • Highly available
                            • Elastic




Thursday, November 3, 11
Local in-memory cache
                           • Performance booster
                           • Good for data that is:
                            • Hard to calculate
                            • Expensive to retrieve...etc
                           • Why not ConcurrentHashMap? Infinispan offers:
                            • Greater concurrency with MVCC
                            • Built-in eviction...etc


Thursday, November 3, 11
Local cache example




Thursday, November 3, 11
Clustered in-memory cache


                           • Same as local but cluster-aware
                           • More shared-cache space!
                           • Can help you cluster your framework too!
                           • Invalidation cache mode commonly used




Thursday, November 3, 11
Invalidation




Thursday, November 3, 11
Invalidation




Thursday, November 3, 11
Invalidation




Thursday, November 3, 11
Cache.putForExternalRead()
                                         put()                   putForExternalRead()

                                 Use for updating state          Use to cache state read from
                                                                       external source

                            Regular lock acquisition timeout               Fail-fast


                               Could throw an exception                  Fails quietly


                           Could cause existing transaction to     Will never affect existing
                                          fail                           transactions




Thursday, November 3, 11
Clustered cache configuration




Thursday, November 3, 11
P2P Embedded Architecture




Thursday, November 3, 11
In-memory data grid
                           • It’s a data store, not just a cache
                           • An authoritative data sink
                           • FADE
                            • Fast
                            • Available
                            • Distributed
                            • Elastic


Thursday, November 3, 11
Distribution vs Replication




Thursday, November 3, 11
Replication




Thursday, November 3, 11
Distribution
                           • With number of copies = 2




Thursday, November 3, 11
Consistent Hashing




Thursday, November 3, 11
Virtual Nodes




Thursday, November 3, 11
Client/Server Architecture


                                          •   Supported protocols
                                              •   REST
                                              •   Memcached
                                              •   Hot Rod




Thursday, November 3, 11
Server Endpoint Comparison




Thursday, November 3, 11
Hot Rod server and clients




Thursday, November 3, 11
Traditional 3-tier App




Thursday, November 3, 11
Typical IaaS App




Thursday, November 3, 11
Typical PaaS App




Thursday, November 3, 11
State




Thursday, November 3, 11
Virtualize data

                           • Some public services exist
                            • Amazon RDS and SimpleDB
                            • FathomDB, Cloudant...etc
                           • But not all cloud deployments are public!
                            • Private cloud very important
                            • How can you build a DaaS yourself?



Thursday, November 3, 11
Characteristics of DaaS

                           • Elastic data
                           • Need to scale with other tiers
                           • Response times should be linear
                           • Needs to be highly available!
                            • Nodes with die! The service shouldn’t




Thursday, November 3, 11
DaaS with Infinispan




Thursday, November 3, 11
Clustering challenges

                           • JGroups taking care of clustering
                            • Default config file good for 4-16 nodes
                           • Bigger clusters require tweaking...
                           • Adjust transport and discovery to environment limitations
                            • Especially where UDP multicast not allowed
                           • These adjustments do not require altering code



Thursday, November 3, 11
Migration best practices


                           • ‘RadarGun’ project benchmarks different data grid products
                           • Benchmark your use case!
                           • Helps with mapping between different provider APIs
                           • XSLTs distributed to transform configuration




Thursday, November 3, 11
Who uses Infinispan?

                           • Examples:
                            • As a cache:
                              • Hibernate for the second level cache
                              • HTTP session cache in JBoss AS 6 and AS 7
                            • As a data grid:
                              • Real-time trading app of a well known stock exchange



Thursday, November 3, 11
What’s next?


                           • Distributed Executors and Map/Reduce
                           • Hibernate OGM (Object-Grid-Mapping)
                             • JPA-like interface backed by Infinispan
                           • ...etc




Thursday, November 3, 11
Summary

                           • Infinispan is a fast powerful local cache
                           • More space and scales up when cache is clustered
                           • Infinispan is also a distributed elastic data grid
                           • Accessible in embedded and client/server mode
                           • Build your own Data-as-a-Service with Infinispan




Thursday, November 3, 11
Questions?

                           • infinispan.org
                           • blog.infinispan.org
                           • @infinispan on twitter
                            • #infinispan for comments
                           • IRC: #infinispan on FreeNode
                           • speakerrate.com/galder



Thursday, November 3, 11

More Related Content

PPTX
Infinispan, a distributed in-memory key/value data grid and cache
PDF
The Hot Rod Protocol in Infinispan
PPTX
Security and Data Governance using Apache Ranger and Apache Atlas
PDF
Etl is Dead; Long Live Streams
PDF
Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...
PDF
Building a Marketing Data Warehouse from Scratch - SMX Advanced 202
PDF
Cilium - Network security for microservices
PPTX
Apache Flink in the Cloud-Native Era
Infinispan, a distributed in-memory key/value data grid and cache
The Hot Rod Protocol in Infinispan
Security and Data Governance using Apache Ranger and Apache Atlas
Etl is Dead; Long Live Streams
Best Practices for ETL with Apache NiFi on Kubernetes - Albert Lewandowski, G...
Building a Marketing Data Warehouse from Scratch - SMX Advanced 202
Cilium - Network security for microservices
Apache Flink in the Cloud-Native Era

What's hot (20)

PDF
Deep Dive into Building Streaming Applications with Apache Pulsar
PDF
Introduction to Apache NiFi dws19 DWS - DC 2019
PPTX
Apache Kylin – Cubes on Hadoop
PDF
Secure Kafka at scale in true multi-tenant environment ( Vishnu Balusu & Asho...
PDF
PDF
Dynamically Scaling Data Streams across Multiple Kafka Clusters with Zero Fli...
PDF
Data ingestion and distribution with apache NiFi
PPTX
How YugaByte DB Implements Distributed PostgreSQL
PPTX
The Columnar Era: Leveraging Parquet, Arrow and Kudu for High-Performance Ana...
PPTX
Apache Arrow Flight Overview
PDF
A Thorough Comparison of Delta Lake, Iceberg and Hudi
PDF
Strongly Consistent Global Indexes for Apache Phoenix
PDF
Apache Pulsar @Splunk
PDF
Apache Nifi Crash Course
PDF
Schema Registry 101 with Bill Bejeck | Kafka Summit London 2022
PDF
Cloud Cost Management and Apache Spark with Xuan Wang
PPTX
Building Data Pipelines for Solr with Apache NiFi
PPTX
High throughput data replication over RAFT
PDF
Flink powered stream processing platform at Pinterest
PDF
Massive Data Processing in Adobe Using Delta Lake
Deep Dive into Building Streaming Applications with Apache Pulsar
Introduction to Apache NiFi dws19 DWS - DC 2019
Apache Kylin – Cubes on Hadoop
Secure Kafka at scale in true multi-tenant environment ( Vishnu Balusu & Asho...
Dynamically Scaling Data Streams across Multiple Kafka Clusters with Zero Fli...
Data ingestion and distribution with apache NiFi
How YugaByte DB Implements Distributed PostgreSQL
The Columnar Era: Leveraging Parquet, Arrow and Kudu for High-Performance Ana...
Apache Arrow Flight Overview
A Thorough Comparison of Delta Lake, Iceberg and Hudi
Strongly Consistent Global Indexes for Apache Phoenix
Apache Pulsar @Splunk
Apache Nifi Crash Course
Schema Registry 101 with Bill Bejeck | Kafka Summit London 2022
Cloud Cost Management and Apache Spark with Xuan Wang
Building Data Pipelines for Solr with Apache NiFi
High throughput data replication over RAFT
Flink powered stream processing platform at Pinterest
Massive Data Processing in Adobe Using Delta Lake
Ad

Viewers also liked (20)

PDF
Data Grids and Data Caching
PDF
Why RESTful Design for the Cloud is Best
PDF
Infinispan – the open source data grid platform by Mircea Markus
PDF
What's New in Infinispan 6.0
PDF
Infinispan,Lucene,Hibername OGM
PDF
Infinispan
PDF
Infinispan Data Grid Platform
PDF
London JBUG April 2015 - Performance Tuning Apps with WildFly Application Server
PDF
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
PDF
Open Stack Cheat Sheet V1
PDF
Tachyon-2014-11-21-amp-camp5
PDF
Linux Filesystems, RAID, and more
PDF
Lessons Learned with Spark at the US Patent & Trademark Office-(Christopher B...
PDF
Accelerating Cassandra Workloads on Ceph with All-Flash PCIE SSDS
PDF
Advanced Data Retrieval and Analytics with Apache Spark and Openstack Swift
PDF
Scaling up genomic analysis with ADAM
PDF
JBoss Community Introduction
PDF
Apache conbigdata2015 christiantzolov-federated sql on hadoop and beyond- lev...
PPTX
Архитектура Apache Ignite .NET
PDF
Building Wall St Risk Systems with Apache Geode
Data Grids and Data Caching
Why RESTful Design for the Cloud is Best
Infinispan – the open source data grid platform by Mircea Markus
What's New in Infinispan 6.0
Infinispan,Lucene,Hibername OGM
Infinispan
Infinispan Data Grid Platform
London JBUG April 2015 - Performance Tuning Apps with WildFly Application Server
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
Open Stack Cheat Sheet V1
Tachyon-2014-11-21-amp-camp5
Linux Filesystems, RAID, and more
Lessons Learned with Spark at the US Patent & Trademark Office-(Christopher B...
Accelerating Cassandra Workloads on Ceph with All-Flash PCIE SSDS
Advanced Data Retrieval and Analytics with Apache Spark and Openstack Swift
Scaling up genomic analysis with ADAM
JBoss Community Introduction
Apache conbigdata2015 christiantzolov-federated sql on hadoop and beyond- lev...
Архитектура Apache Ignite .NET
Building Wall St Risk Systems with Apache Geode
Ad

Similar to Infinispan for Dummies (20)

PDF
soft-shake.ch - Data grids and Data Caching
PDF
Data Grids vs Databases
PDF
soft-shake.ch - Data grids and Data Grids
PDF
Riak Use Cases : Dissecting The Solutions To Hard Problems
PDF
Hadoop: A Hands-on Introduction
PDF
Cloud is such stuff as dreams are made on
PDF
Membase Meetup - San Diego
PDF
MongoDB Use Cases and Roadmap
PPT
Borthakur hadoop univ-research
PPTX
Взгляд на облака с точки зрения HPC
PDF
Hadoop.mapreduce
PDF
Notes on data-intensive processing with Hadoop Mapreduce
PDF
AFCEA C4I Symposium: The 4th C in C4I Stands for Cloud:Factors Driving Adopti...
PDF
NoSQL overview implementation free
PDF
DataMapper on Infinispan
PDF
Riak intro to..
PPTX
From cache to in-memory data grid. Introduction to Hazelcast.
PDF
Paris NoSQL User Group - In Memory Data Grids in Action (without transactions...
PDF
Paris NoSQL User Group - In Memory Data Grids in Action (without transactions...
PDF
Non-Relational Databases & Key/Value Stores
soft-shake.ch - Data grids and Data Caching
Data Grids vs Databases
soft-shake.ch - Data grids and Data Grids
Riak Use Cases : Dissecting The Solutions To Hard Problems
Hadoop: A Hands-on Introduction
Cloud is such stuff as dreams are made on
Membase Meetup - San Diego
MongoDB Use Cases and Roadmap
Borthakur hadoop univ-research
Взгляд на облака с точки зрения HPC
Hadoop.mapreduce
Notes on data-intensive processing with Hadoop Mapreduce
AFCEA C4I Symposium: The 4th C in C4I Stands for Cloud:Factors Driving Adopti...
NoSQL overview implementation free
DataMapper on Infinispan
Riak intro to..
From cache to in-memory data grid. Introduction to Hazelcast.
Paris NoSQL User Group - In Memory Data Grids in Action (without transactions...
Paris NoSQL User Group - In Memory Data Grids in Action (without transactions...
Non-Relational Databases & Key/Value Stores

Recently uploaded (20)

PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Empathic Computing: Creating Shared Understanding
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Encapsulation theory and applications.pdf
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
NewMind AI Monthly Chronicles - July 2025
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
cuic standard and advanced reporting.pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Modernizing your data center with Dell and AMD
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Advanced methodologies resolving dimensionality complications for autism neur...
Empathic Computing: Creating Shared Understanding
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Dropbox Q2 2025 Financial Results & Investor Presentation
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
NewMind AI Weekly Chronicles - August'25 Week I
Encapsulation theory and applications.pdf
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
The AUB Centre for AI in Media Proposal.docx
NewMind AI Monthly Chronicles - July 2025
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Agricultural_Statistics_at_a_Glance_2022_0.pdf
“AI and Expert System Decision Support & Business Intelligence Systems”
cuic standard and advanced reporting.pdf
Encapsulation_ Review paper, used for researhc scholars
Modernizing your data center with Dell and AMD
Diabetes mellitus diagnosis method based random forest with bat algorithm

Infinispan for Dummies

  • 2. for Dummies Galder Zamarreño Senior Software Engineer Red Hat, Inc Thursday, November 3, 11
  • 3. Who is Galder? • R&D engineer (Red Hat Inc): • Infinispan developer • Contributor and committer: • JBoss AS, Hibernate, JGroups...etc • More about me? • Blog: zamarreno.com • Twitter: @galderz Thursday, November 3, 11
  • 4. Agenda • What is Infinispan? • Infinispan as in-memory cache • Infinispan as in-memory data grid • Data-as-a-Service with Infinispan • Clustering and migration challenges • Who uses Infinispan? Thursday, November 3, 11
  • 5. What is Infinispan? • Data grid platform: • Open source (LGPL) • In-memory • Highly available • Elastic Thursday, November 3, 11
  • 6. Local in-memory cache • Performance booster • Good for data that is: • Hard to calculate • Expensive to retrieve...etc • Why not ConcurrentHashMap? Infinispan offers: • Greater concurrency with MVCC • Built-in eviction...etc Thursday, November 3, 11
  • 8. Clustered in-memory cache • Same as local but cluster-aware • More shared-cache space! • Can help you cluster your framework too! • Invalidation cache mode commonly used Thursday, November 3, 11
  • 12. Cache.putForExternalRead() put() putForExternalRead() Use for updating state Use to cache state read from external source Regular lock acquisition timeout Fail-fast Could throw an exception Fails quietly Could cause existing transaction to Will never affect existing fail transactions Thursday, November 3, 11
  • 15. In-memory data grid • It’s a data store, not just a cache • An authoritative data sink • FADE • Fast • Available • Distributed • Elastic Thursday, November 3, 11
  • 18. Distribution • With number of copies = 2 Thursday, November 3, 11
  • 21. Client/Server Architecture • Supported protocols • REST • Memcached • Hot Rod Thursday, November 3, 11
  • 23. Hot Rod server and clients Thursday, November 3, 11
  • 25. Typical IaaS App Thursday, November 3, 11
  • 26. Typical PaaS App Thursday, November 3, 11
  • 28. Virtualize data • Some public services exist • Amazon RDS and SimpleDB • FathomDB, Cloudant...etc • But not all cloud deployments are public! • Private cloud very important • How can you build a DaaS yourself? Thursday, November 3, 11
  • 29. Characteristics of DaaS • Elastic data • Need to scale with other tiers • Response times should be linear • Needs to be highly available! • Nodes with die! The service shouldn’t Thursday, November 3, 11
  • 31. Clustering challenges • JGroups taking care of clustering • Default config file good for 4-16 nodes • Bigger clusters require tweaking... • Adjust transport and discovery to environment limitations • Especially where UDP multicast not allowed • These adjustments do not require altering code Thursday, November 3, 11
  • 32. Migration best practices • ‘RadarGun’ project benchmarks different data grid products • Benchmark your use case! • Helps with mapping between different provider APIs • XSLTs distributed to transform configuration Thursday, November 3, 11
  • 33. Who uses Infinispan? • Examples: • As a cache: • Hibernate for the second level cache • HTTP session cache in JBoss AS 6 and AS 7 • As a data grid: • Real-time trading app of a well known stock exchange Thursday, November 3, 11
  • 34. What’s next? • Distributed Executors and Map/Reduce • Hibernate OGM (Object-Grid-Mapping) • JPA-like interface backed by Infinispan • ...etc Thursday, November 3, 11
  • 35. Summary • Infinispan is a fast powerful local cache • More space and scales up when cache is clustered • Infinispan is also a distributed elastic data grid • Accessible in embedded and client/server mode • Build your own Data-as-a-Service with Infinispan Thursday, November 3, 11
  • 36. Questions? • infinispan.org • blog.infinispan.org • @infinispan on twitter • #infinispan for comments • IRC: #infinispan on FreeNode • speakerrate.com/galder Thursday, November 3, 11