Deep dive into event store using Apache Cassandra
4 likes3,469 views
The document provides an in-depth exploration of big data and Apache Cassandra, discussing its architecture, use cases, and functionalities. It addresses the significance of big data, the four V's of big data, and the advantages of using Cassandra for scalable data storage. Additionally, it includes a demonstration and examples of companies, like Disqus, that utilize Cassandra for content recommendations and analytics.
Deep dive into event store using Apache Cassandra
- 1. It's about time : Deep dive into event store using Apache Cassandra by Nikunj Thakkar
- 2. Agenda ● What is Big Data? ● So far in AJM Bigdata Series ● Where it is? Am I using it? Big Data at-a-glance Introduction to Apache Cassandra ● What, When and Why of Cassandra ● Protocol, Architecture, Queries and Evrything else ● Interesting Use-cases ● Demo
- 6. What is Big Data? Large amount of data that can only be processed during night hours
- 7. क्यया कममी रह गयमीथमी ममेरमे जजॉब डडिडसकस रप्शन मम? What is Big Data?
- 8. So far in AJM Big Data Series
- 9. 4 V's Of Big Data
- 10. 4 V's Of Big Data Volume Variety Velocity Veracity
- 11. CAP Theoram
- 14. Family of NOSQL DATABASES Wide Column Store / Column Families Document Store Wide Column Store / Column FamiliesWide Column Store / Column Families Key Value / Tuple Store Graph Databases Multimodel Databases Object Databases Grid & Cloud Database Solutions Object Databases XML Databases Multidimensional Databases Multivalue Databases
- 15. Big Data: Where it is?
- 16. Big Data: Am I using it?
- 17. Targeted marketing Public sector Big Data: Am I using it? Health care Social media and web data Global personal location tracking Social media and web data Social media and web data Automated device generated data
- 19. Hey wait, First tell me about events and event stores.
- 21. Top level Apache Project
- 22. Born at Facebook
- 23. Google's Big Table + Amazone's Dynamo = Cassandra
- 24. Demo Time
- 26. Network Topology – Multiple DC
- 29. Always on architecture - No single point of failure
- 35. Apache Cassandra: When to use?
- 37. Just kidding.... We will cover this part in use cases. :) :)
- 38. Apache Cassandra: Interesting Facts
- 42. Apache Cassandra: Interesting Facts Architecture Key structures ➔ Node ➔ Data Center ➔ Cluster ➔ Commit Log ➔ Table ➔ SSTable
- 44. Apache Cassandra: Interesting Facts Architecture Key components ➔ Gossip ➔ Partitioner ➔ Replication factor ➔ Replica placement strategy ➔ Snitch
- 46. Apache Cassandra: Interesting Facts Cassandra Query Language ➔ CRUD ➔ Data Modeling ➔ Indexing
- 48. Apache Cassandra@ Disqus ➔ Disqus - Disqus is a discussion platform for the web. It connects publishers with users and allow them to have a public discourse in a medium that allows communication across the web.
- 49. Apache Cassandra@ Disqus ➔ Disqus uses Cassandra in a number of different places. Mainly in the product; it’s used for content recommendation and also a little bit of advertising. Let’s say you’re on that article reading about the war in Syria and you notice that there’s another interesting article relating to what the British PMs have released as a public statement relating to whether or not it’s legal to go to war, and maybe you’re interested in reading that response. What Cassandra does is it powers the analytics and content engine behind how disqus recommends content.
- 50. Apache Cassandra@ Disqus ➔ Main cluster - 24 nodes ➔ CPU - 6-core Xeons 3Ghz – Biggest – Because turning out to be a small bottleneck at times ➔ 24GB RAM – Per node – 8 GB Heap Size ➔ 32 or 48GBs RAM wasn't helping much ➔ it’s handling our load of about 30,000 reads a second
- 51. Apache Cassandra@ Many other companies
- 53. Thank you :)
- 54. Resources for Material ● http://smartdatacollective.com/bernardmarr/277731/big-data-25-facts-everyone-need s-know ● http://blog.gramener.com/1984/indian-elections-2014-big-data-for-billion-people ● http://indiaspora.org/blog/indian-elections-2014-big-data-for-billion-people/ ● http://www.slideshare.net/BernardMarr/140228-big-data-volume-velocity-variety-varac ity-value ● http://www.datastax.com/documentation/cassandra/2.1/cassandra/gettingStartedCass andraIntro.html ● http://planetcassandra.org/ ● http://planetcassandra.org/blog/disqus-discusses-migration-from-redis-to-cassandra-for -horizontal-scalability/ ● http://wiki.apache.org/cassandra/
- 55. Resources for Graphics ● http://newstonight.net/content/obesity-pushing-diabetes-cases ● http://lordapes.blogspot.in/ ● http://blog.marketo.com/2013/07/big-data-it-doesnt-mean-what-you-think-it-means.html ● http://www.portaloko.hr/clanak/20-stvari-koje-muskarci-nikada-nece-shvatiti-kod-zena/0/59710/ ● http://www.blankchapters.com/wp-content/uploads/2012/12/meme-data-data-everywhere.png ● https://medium.com/media-changes/don-draper-applies-for-a-job-in-2013-59aec7398582 ● http://techblog.netflix.com/2011/11/benchmarking-cassandra-scalability-on.html ● http://www.slideshare.net/planetcassandra/apache-cassandra-and-datastax-enterprise-explained- with-peter-halliday-at-wildhacks-nu ● http://qph.is.quoracdn.net/main-qimg-dce3b73956c5313650022a5b22068982?convert_to_webp =true ● http://treasure.diylol.com/uploads/post/image/553987/resized_kevin-hart-meme-generator-i-woul d-take-questions-but-the-way-my-presentation-is-set-up-f1cfd6.jpg