The DAP - Where YARN, HBase, Kafka and Spark go to Production
Download as PPTX, PDF2 likes1,142 views
The document summarizes the Cask Data Application Platform (CDAP), which provides an integrated framework for building and running data applications on Hadoop and Spark. It consolidates the big data application lifecycle by providing dataset abstractions, self-service data, metrics and log collection, lineage, audit, and access control. CDAP has an application container architecture with reusable programming abstractions and global user and machine metadata. It aims to simplify deploying and operating big data applications in enterprises by integrating technologies like YARN, HBase, Kafka and Spark.
The DAP - Where YARN, HBase, Kafka and Spark go to Production
- 1. The DAP – Where YARN, HBase, Kafka and Spark Go to Production Hadoop Summit - June 30th, 2016 cask.co Cask, CDAP, Cask Hydrator and Cask Tracker are trademarks or registered trademarks of Cask Data. Apache Spark, Spark, the Spark logo, Apache Hadoop, Hadoop and the Hadoop logo are trademarks or registered trademarks of the Apache Software Foundation. All other trademarks and registered trademarks are the property of their respective owners.
- 3. cask.co The Many Faces of Hadoop 3 Developer Data Scientist IT Pro / Ops LOB Manager Advanced Programming Focuses on App Logic Basic Programming Focuses on Data Configuration & Monitoring Focuses on Operations Analysis & Decision Making Focuses on Insights
- 5. cask.co Building a Big Data App 5
- 6. cask.co Deploying and Operating a Big Data App 6
- 7. cask.co Today’s Integration Solutions are Silo’ed 7 Data Integration App Integration Cloud Integration Governance
- 9. cask.co9 Enter Cask Key Customers and Partners Named a Gartner Cool Vendor 2016 Founded in 2011 by early Hadoop engineers from Facebook and Yahoo!
- 10. cask.co Introducing the Cask Data App Platform 10
- 11. cask.co CDAP Overview 11 Open Source, Integrated Framework for Building and Running Data Applications on Hadoop and Spark
- 12. cask.co12 â—Ź Provides a platform with framework level correctness â—Ź Dataset abstractions & self-service data â—Ź One framework: Prototype to Production â—Ź Unified approach across all paradigms â—‹ Metrics & Log collection â—‹ Lineage, Audit, Access Control CDAP Consolidates Big Data App Lifecycle
- 14. cask.co CDAP Architecture 14 â—Ź Application Container Architecture â—Ź Reusable Programming Abstractions â—Ź Global User and Machine Metadata
- 17. cask.co Hadoop in the Enterprise – Simplified with CDAP 17