Unlock the value of your big data infrastructure
Download as PPTX, PDF0 likes201 views
This document summarizes a presentation about unlocking the value of big data infrastructure. It discusses key components of Apache Hadoop and Spark including HDFS, MapReduce, YARN, and Spark cores/RDDs. It also discusses leveraging graph databases for business, NoSQL databases in big data frameworks like MongoDB, Cassandra, and Redis. Finally, it discusses discovering and mapping issues, and forecasting utilization trends to plan capacity.
Unlock the value of your big data infrastructure
- 1. Applications Manager Unlock the value of your big data infrastructure
- 2. Presenter : Selvaraj Please comment 'YES' in the chat panel if the presenter's voice is audible and the presentation screen is clear.
- 3. Week Module Date Schedule Status 1. Key to Optimal End User Experience Nov 13 6:00 AM GMT 11:00 AM EST Completed Completed 2. Unlock the value of your big data infrastructure Nov 20 6:00 AM GMT 11:00 AM EST Completed In Progress 3. Building the right website monitoring strategy Dec 4 6:00 AM GMT 11:00 AM EST Upcoming Upcoming 4. Monitoring Cloud,Containers and hyperconverged infrastructure Dec 11 6:00 AM GMT 11:00 AM EST Upcoming Upcoming
- 4. Agenda Big data apps: Apache Hadoop & Spark Leverage graph database for your business NoSQL databases in Big Data frameworks Forecasting utilization trends and planning capacity
- 5. Discovery & mapping Big data apps
- 7. The key Hadoop components • HDFS • MapReduce • YARN • NoSQL Database
- 8. HDFS
- 9. MapReduce
- 10. YARN
- 11. Apache Spark architecture Spark Driver program Spark Scheduler Worker node Worker node HDFS NoSQ L Mesos /YARN
- 12. Spark key components • Drivers and Workers in Spark • Memory and resource utilization • Spark cores and applications • Spark RDDs • NoSQL database
- 13. Workers
- 14. Memory
- 15. Memory
- 16. Spark Core and Applications
- 17. RDDs
- 18. Leverage graph database for your business
- 20. The key metrics • Nodes & Relationship • Memory • Page Cache • Transactions
- 22. Memory
- 23. Page Cache
- 24. Transactions
- 25. The NoSQL databases in Big Data set ups
- 26. MongoDB - Network & connections • Connections used • Connections available • Network traffic received • Network traffic sent
- 27. MongoDB - Lock & Asserted errors • Read Lock, Write Lock • Message, User asserts
- 28. Cassandra - CPU usage
- 29. Cassandra - Keyspace latency • Read Latency (/min) • Write Latency (/min)
- 30. Redis - Keys • Number of keys • Expired keys
- 31. Redis - Clients • Connected clients • Blocked clients
- 32. Discovery & mapping Disk and Memory issues in NoSQL databases
- 35. Cassandra Memory Utilization • Free Memory • Used Memory
- 36. Cassandra-Cluster • Node state • Unreachable nodes
- 39. Discovery & mapping Forecasting utilization trends and planning capacity
- 40. Trend analysis report Pull at a glance report of the DB server to have a quick glance at all monitored attributes
- 41. Trend analysis report Quick glance at the performance of all monitored attributes: • History Report • Hour of Day Report • Day of Week Report • Statistical Report • Heat Chart
- 42. Compare performance attribute reports of different monitors. View & compare reports
- 43. • Balance hardware costs with computing needs. • Plan future utilization requirements. Forecast report
- 44. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Quick Recap Big Data and the non-relational database • Big data apps: Apache Hadoop & Spark • Leverage graph database for your business • NoSQL databases in Big Data frameworks • Forecasting utilization trends and planning capacity
- 45. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Questions?
- 46. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Can I discover all the nodes in Mongo DB through Applications Manager?
- 47. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Am already monitoring my Cassandra DB with AppManager, However I need to customize polling for few metrics. Is it possible?
- 48. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Can I get a automatic report of Availability of my databases everyday?
- 49. Upcoming topics : Dec 4, 2019 Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com Building the right website monitoring strategy • Track key metrics of Apache, IIS, NGINX, NGINX Plus, etc. • Optimize individual URLs for better end user experience • Simulate web transactions with synthetic transaction monitoring • Detect unauthorized content changes in your website
- 50. Contact : eval-apm@manageengine.com Online Demo : demo.appmanager.com