Cloudera – One Platform to Rule Them All
1 like836 views
Cloudera provides a comprehensive platform integrating Hadoop's ecosystem for processing and storage, featuring open-source components and added functionalities for operations and governance. The platform supports various use cases, including data lakes, analytics, and operational systems, and enhances data science capabilities with collaborative tools. Key takeaways emphasize that Cloudera encompasses both batch and near real-time analytics, leveraging the entire Hadoop framework.
Cloudera – One Platform to Rule Them All
- 1. Cloudera – One Platform to Rule Them All
- 2. • A Bit of History • The Platform • The Use Cases • Summary AGENDA
- 3. A BIT OF HISTORY
- 4. RDBMS VS CLOUDERA …according to Google Trends (since January 2010)
- 5. HADOOP – THE EARLY DAYS • Hadoop Distributed Filesystem (HDFS) • Hadoop MapReduce
- 6. X86 X86 X86 X86 NODE1 NODE2 NODE3 NODEN ...
- 8. HADOOP OVERTIME • Hive – SQL-like query • Pig - Programming model • HBase – NoSQL database (operational) • YARN – Resource Manager • Impala – Online SQL (analytics) • Spark – Streaming, Batch, ML • Kafka – Messaging … new additions
- 10. THE PLATFORM
- 13. CLOUDERA ENTERPRISE DATA HUB • Processing and Storage Core is 100% open source • Only tested – at large scale – Apache components get in • Value added features (operations and governance) • Reactive and Pro-active & Predictive Support • Easy, Fast & Secure • The best partners – us
- 15. CLOUDERA MANAGER • Operations • Monitoring • Configuration Management • Multi-tenant Management • Backup & Disaster Recovery • Extensible Integration … for cluster operations
- 16. CLOUDERA DIRECTOR … makes Cloudera cloud ready
- 18. CLOUDERA NAVIGATOR • Audit & Trace • Alert • Lineage • Encryption • Optimizer … for cluster governance & security
- 19. THE USE CASES
- 20. HADOOP – THE ULTIMATE DATA TOOLKIT
- 21. DATA LAKE / ENTERPRISE DATA HUB Sensor Data Blogs Emails Web Logs Docs (e.g.PDF) Images Videos CRM ERP Legacy 3rd Patry Extract (includesFileTansfer),TransformandLoad Scale-out DistributedDatabase Visualization(Reporting,ExplorationandSandboxing) RawDataSources Operational Systems DW&DATAMARTs
- 22. DATA LAKE / ENTERPRISE DATA HUB
- 23. MESSAGING
- 24. MESSAGING
- 25. IOT Devices with sensors & actuators Devices with sensors & actuators Gateway Gateway EDH
- 26. IOT
- 27. DATA SCIENCE
- 28. DATA SCIENCE
- 29. CLOUDERA DATA SCIENCE WORKBENCH Use R, Python or Scala No need to sample Collaborative research Bring Analysis to the data Secure by default Flexible Deployment
- 30. SUMMARY
- 31. SUMMARY • Hadoop is an eco-system, not two projects • Spark will not replace Hadoop, Spark “is” Hadoop • Cloudera has a complete offering • Cloudera is for Batch & NRT • Cloudera is for Analytics & Operational … key takeaways
- 32. THANK YOU
- 33. Credits • Includes icons (pages 8 and 15) made by Freepik from www.flaticon.com • Cloudera images from www.cloudera.com