SlideShare a Scribd company logo
Oracle CoherenceBy Mustafa Ahmed1
AgendaThe ProblemSolutionData GridsReplicated TopologyPartitioned TopologyNear TopologyEventsQueryRead Through CachingWrite Through CachingWrite Behind CachingCoherence Code ExamplesConclusionPerformance
Availability
Scalability 2
DataExtreme increase in Access Volume & Complexity of DataDriving Data DemandVirtualizationAbility to move applications around several machinesService Oriented Architecture (SOA)Integrated services that can be used in Multiple business domainsRelying on other servicesThe Problem 3
Provide Reliable, Scalable, Universal Data Access and Management. PerformanceSolves Latency and Bandwidth ProblemsAvailabilityHaving the data available at all timesScalability Handle growing demand of Data Efficiently4Solution – Oracle Coherence
Manages Information in a grid environmentLots of servers working together
Servers do not run independently Server manages stateEven server failure occurs.Adding more serversConcept of scale outIt will manage more data and can handle more transactions per second. Data as a ServiceMiddle Tier
In App ServerData Integration is in Data ServiceIntegration can occur in Domain Model5Data Grids
Combines Data Management with Data ProcessingPush processing where data is being managed
Read or Write data across any number of serversSingle System ImageNo need to show server infrastructure
Pretend all the information is Local
Logical view of all data in all the servers6Data Grids
There are two things you can move in a Distributed EnvironmentStateDistribution of a state is referred to as replicationBehaviorMoving messagesData Grids combine these two conceptsYou can either move data or the processing where data is sitting
Push all the processes to the Information7Data Grids
Locality of DataMost applications spend most of the time waiting for data
If the data is partitioned with non overlapping regions the behavior can be moved to the server that owns the data to process
Results In lower latency8Data Grids
Technology introduced In 2001Replicate information among all serversData is replicated to all members in Data GridProblemsScalability ProblemCapacity of    Information Stays   the same9Replicated Topology
10Replicated TopologyExpensiveUpdate Each Server every time
Conceptually its expensive Each Information is spread out across the servers (Peer to Peer)Load BalancerKeeps track of the load
Move from one server to another
Sends to the server which owns the dataExactly one server owns the informationHas a sync back up for it11Partitioned Topology
12Partitioned TopologyFailure OccursThe operation still finishes correctly
Increase servers from 2 to 2000 servers it increases scalability
All servers are disposable at any period of timeL2 Cache vs. L1 CachePartitioned Topology as L2 Cache
Near Topology as L1 CacheStores it LocallyIf asks again then gets it locallyDemand base replicated cachingZero Latency access to recently used data13Near Topology

More Related Content

PPTX
Oracle Coherence
PPTX
Coherence Overview - OFM Canberra July 2014
PPT
Oracle Coherence: in-memory datagrid
PPT
An Engineer's Intro to Oracle Coherence
PDF
Data Grids with Oracle Coherence
PDF
Hazelcast 3.6 Roadmap Preview
PPTX
GemFire In-Memory Data Grid
PDF
Die 10 besten PostgreSQL-Replikationsstrategien für Ihr Unternehmen
 
Oracle Coherence
Coherence Overview - OFM Canberra July 2014
Oracle Coherence: in-memory datagrid
An Engineer's Intro to Oracle Coherence
Data Grids with Oracle Coherence
Hazelcast 3.6 Roadmap Preview
GemFire In-Memory Data Grid
Die 10 besten PostgreSQL-Replikationsstrategien für Ihr Unternehmen
 

What's hot (20)

PDF
JCConf 2016 - Cloud Computing Applications - Hazelcast, Spark and Ignite
PDF
Cloud Migration Paths: Kubernetes, IaaS, or DBaaS
 
PPTX
OracleStore: A Highly Performant RawStore Implementation for Hive Metastore
PDF
Leveraging docker for hadoop build automation and big data stack provisioning
PPTX
Manage Microservices & Fast Data Systems on One Platform w/ DC/OS
PPTX
Scaling HDFS at Xiaomi
PDF
Big Data Tools in AWS
PPTX
Ozone: scaling HDFS to trillions of objects
PPTX
My Dissertation 2016
PDF
DATA LAKE AND THE RISE OF THE MICROSERVICES - ALEX BORDEI
PDF
IMCSummit 2015 - Day 2 General Session - Flash-Extending In-Memory Computing
PDF
Big Data, Simple and Fast: Addressing the Shortcomings of Hadoop
PDF
20150716 introduction to apache spark v3
PPT
Oracle 10g rac_overview
PPTX
Webinar | Introducing DataStax Enterprise 4.6
PDF
F233842
PPTX
Debunking Common Myths of Hadoop Backup & Test Data Management
PPTX
Built-In Security for the Cloud
PPTX
In memory grids IMDG
PDF
Creating Data Fabric for #IOT with Apache Pulsar
JCConf 2016 - Cloud Computing Applications - Hazelcast, Spark and Ignite
Cloud Migration Paths: Kubernetes, IaaS, or DBaaS
 
OracleStore: A Highly Performant RawStore Implementation for Hive Metastore
Leveraging docker for hadoop build automation and big data stack provisioning
Manage Microservices & Fast Data Systems on One Platform w/ DC/OS
Scaling HDFS at Xiaomi
Big Data Tools in AWS
Ozone: scaling HDFS to trillions of objects
My Dissertation 2016
DATA LAKE AND THE RISE OF THE MICROSERVICES - ALEX BORDEI
IMCSummit 2015 - Day 2 General Session - Flash-Extending In-Memory Computing
Big Data, Simple and Fast: Addressing the Shortcomings of Hadoop
20150716 introduction to apache spark v3
Oracle 10g rac_overview
Webinar | Introducing DataStax Enterprise 4.6
F233842
Debunking Common Myths of Hadoop Backup & Test Data Management
Built-In Security for the Cloud
In memory grids IMDG
Creating Data Fabric for #IOT with Apache Pulsar
Ad

Viewers also liked (10)

PDF
Real World Use Cases and Success Stories for In-Memory Data Grids (TIBCO Acti...
PDF
Redis as a message queue
PDF
Performance Test Driven Development with Oracle Coherence
PDF
Caipira agil automacao front end selenium
PDF
Top Legacy Sins
PDF
RestMQ - HTTP/Redis based Message Queue
PPTX
How to write a formal Report
PDF
REST vs. Messaging For Microservices
PPTX
Oracle Coherence Strategy and Roadmap (OpenWorld, September 2014)
PDF
Sample of Minutes of meeting
Real World Use Cases and Success Stories for In-Memory Data Grids (TIBCO Acti...
Redis as a message queue
Performance Test Driven Development with Oracle Coherence
Caipira agil automacao front end selenium
Top Legacy Sins
RestMQ - HTTP/Redis based Message Queue
How to write a formal Report
REST vs. Messaging For Microservices
Oracle Coherence Strategy and Roadmap (OpenWorld, September 2014)
Sample of Minutes of meeting
Ad

Similar to Oracle Coherence (20)

PPT
Chapter 6-Consistency and Replication.ppt
PPTX
Database System Architectures
PPT
JPA and Coherence with TopLink Grid
PPTX
storage-systems.pptx
PPT
Waters Grid & HPC Course
PPT
App Grid Dev With Coherence
PPT
Application Grid Dev with Coherence
PPT
App Grid Dev With Coherence
PPTX
NoSQL Introduction, Theory, Implementations
PDF
Talon systems - Distributed multi master replication strategy
PDF
Document 22.pdf
PDF
Apache Kafka® and the Data Mesh
PPT
Ogf2008 Grid Data Caching
PPT
Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010
PPT
Hadoop and Voldemort @ LinkedIn
PDF
System Design Basics by Pratyush Majumdar
PDF
Alluxio Data Orchestration Platform for the Cloud
PDF
Cassandra Essentials Day Cambridge
PDF
(Speaker Notes Version) Architecting An Enterprise Storage Platform Using Obj...
PDF
In search of the perfect IoT Stack - Scalable IoT Architectures with MQTT
Chapter 6-Consistency and Replication.ppt
Database System Architectures
JPA and Coherence with TopLink Grid
storage-systems.pptx
Waters Grid & HPC Course
App Grid Dev With Coherence
Application Grid Dev with Coherence
App Grid Dev With Coherence
NoSQL Introduction, Theory, Implementations
Talon systems - Distributed multi master replication strategy
Document 22.pdf
Apache Kafka® and the Data Mesh
Ogf2008 Grid Data Caching
Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010
Hadoop and Voldemort @ LinkedIn
System Design Basics by Pratyush Majumdar
Alluxio Data Orchestration Platform for the Cloud
Cassandra Essentials Day Cambridge
(Speaker Notes Version) Architecting An Enterprise Storage Platform Using Obj...
In search of the perfect IoT Stack - Scalable IoT Architectures with MQTT

Oracle Coherence

  • 2. AgendaThe ProblemSolutionData GridsReplicated TopologyPartitioned TopologyNear TopologyEventsQueryRead Through CachingWrite Through CachingWrite Behind CachingCoherence Code ExamplesConclusionPerformance
  • 5. DataExtreme increase in Access Volume & Complexity of DataDriving Data DemandVirtualizationAbility to move applications around several machinesService Oriented Architecture (SOA)Integrated services that can be used in Multiple business domainsRelying on other servicesThe Problem 3
  • 6. Provide Reliable, Scalable, Universal Data Access and Management. PerformanceSolves Latency and Bandwidth ProblemsAvailabilityHaving the data available at all timesScalability Handle growing demand of Data Efficiently4Solution – Oracle Coherence
  • 7. Manages Information in a grid environmentLots of servers working together
  • 8. Servers do not run independently Server manages stateEven server failure occurs.Adding more serversConcept of scale outIt will manage more data and can handle more transactions per second. Data as a ServiceMiddle Tier
  • 9. In App ServerData Integration is in Data ServiceIntegration can occur in Domain Model5Data Grids
  • 10. Combines Data Management with Data ProcessingPush processing where data is being managed
  • 11. Read or Write data across any number of serversSingle System ImageNo need to show server infrastructure
  • 12. Pretend all the information is Local
  • 13. Logical view of all data in all the servers6Data Grids
  • 14. There are two things you can move in a Distributed EnvironmentStateDistribution of a state is referred to as replicationBehaviorMoving messagesData Grids combine these two conceptsYou can either move data or the processing where data is sitting
  • 15. Push all the processes to the Information7Data Grids
  • 16. Locality of DataMost applications spend most of the time waiting for data
  • 17. If the data is partitioned with non overlapping regions the behavior can be moved to the server that owns the data to process
  • 18. Results In lower latency8Data Grids
  • 19. Technology introduced In 2001Replicate information among all serversData is replicated to all members in Data GridProblemsScalability ProblemCapacity of Information Stays the same9Replicated Topology
  • 21. Conceptually its expensive Each Information is spread out across the servers (Peer to Peer)Load BalancerKeeps track of the load
  • 22. Move from one server to another
  • 23. Sends to the server which owns the dataExactly one server owns the informationHas a sync back up for it11Partitioned Topology
  • 24. 12Partitioned TopologyFailure OccursThe operation still finishes correctly
  • 25. Increase servers from 2 to 2000 servers it increases scalability
  • 26. All servers are disposable at any period of timeL2 Cache vs. L1 CachePartitioned Topology as L2 Cache
  • 27. Near Topology as L1 CacheStores it LocallyIf asks again then gets it locallyDemand base replicated cachingZero Latency access to recently used data13Near Topology
  • 29. 15EventsAll the dataset provide events regardless of TopologyEvents are distributed efficiently to the interested listeners
  • 30. Parallel QueryQuery performed parallel across the data grid using indexing
  • 31. All doing the local portion of the Query16Query
  • 32. Continuous QueryCombines a Query with Events to provide a local materialized view
  • 33. Result is up to date in real time
  • 34. Like in near topology but always contains the desired data17Query
  • 35. 18Read Through CachingFinds it in L1 or L2 CacheOtherwise sends a request to the databaseOnly sends one requestsCoalesces multiple reads to reduce the database load
  • 36. Writes first to the database and then commits to the cacheNot a Two-Phase CommitKeeps the in-memory data and the database in sync.19Write Through Caching
  • 37. First writes it to the cacheLater commits it to the databaseThis assures the latest version of the cacheBatches all the writes into one objectGeico uses itImproved performance90% reduction in database usage20Write Behind Caching
  • 38. Joins an existing cluster or forms a new oneLeaves the current cluster21Coherence Code ExamplesCluster cluster = CacheFactory.ensureCluster();CacheFactory.shutdown();
  • 39. 22Coherence Code ExamplesNamedCachenc = CacheFactory.getCache(“mine”);Object previous = nc.put(“key”, “hello world”);Object current = nc.get(“key”);int size = nc.size();boolean exists = nc.containsKey(“key”);
  • 40. Observe changes in real time as the occur23Coherence Code ExamplesNamedCachenc = CacheFactory.getCache(“stocks”);nc.addMapListener(new MapListener() { public void onInsert(MapEventmapEvent) { } public void onUpdate(MapEventmapEvent) { } public void onDelete(MapEventmapEvent) { } });
  • 41. PerformanceSolves Latency Problems And Preserve network bandwidthCache recently used dataAbility to execute tasks parallel across the data grid Moving the process where the data is24Conclusion - Performance
  • 42. AvailabilityRemove all single point of failureAdded redundancy to improve availabilityAble to Queue updates if database is not availableIncrease availability from 11 days to 2.5 hours per year25Conclusion - Availability
  • 43. ScalabilityScale Out functionalityDatabase ShardingCoherence eliminates Database ShardingDistributed cache Updates performed against the cache dataScaling both capacity and throughput Adding more nodes to the Coherence Cluster26Conclusion - Scalability