SAP HORTONWORKS
1 like1,227 views
The document outlines a reference architecture for integrating SAP and Hortonworks technologies to optimize big data processing and analytics. It emphasizes real-time analytics, data ingestion, and storage solutions for processing large-scale datasets and provides tools for data management and analysis. Key components include the Hortonworks Data Platform, SAP HANA, and various analytical services for efficient data exploration and reporting.
SAP HORTONWORKS
- 1. Page 1 © Hortonworks Inc. 2011 – 2014. All Rights Reserved SAP and Hortonworks Reference Architecture June 2014 Hortonworks. We Do Hadoop.
- 2. Page 2 © Hortonworks Inc. 2011 – 2014. All Rights Reserved A Modern Data Architecture With SAP OPERATIONS TOOLS Provision, Manage & Monitor DEV & DATA TOOLS Build & Test DATASYSTEMSAPPLICATIO NS Repositories ROOMS Statistical Analysis BI / Reporting, Ad Hoc Analysis Interactive Web & Mobile Applications Enterprise Applications EDW MPP RDBM S EDW MPP Governance &Integration Security Operations Data Access Data Management SOURCES OLTP, ERP, CRM Systems Documents & Emails Web Logs, Click Streams Social Networks Machine Generated Sensor Data Geo-location Data HANA
- 3. Big Data Reference Architecture HADOOP DATA LAKE SAP HANA APPLICATONS Low Cost Scale- Out Storage Data Processing Transformation, Rationalization Deep Analytics & Exploration Stream Processing Accelerated Analytics Application Services Analytic Predictive Web Mobile DataIngestion&Provisioning Sensor Logs Text Structured Social Weather Geo Other SOURCES
- 4. © 2013 SAP AG. All rights reserved. 4Customer SAP/Hortonworks Real-Time Big Data Architecture SAP HANA Real-Time Analytics, Interactive Data Exploration & Application Platform Federated Smart Data Access Transfer Datasets OLAP Engine Predictive Engine Spatial Engine Application Logic & Rendering(XS) Transactional, Analytical, Online Applications Customer Mobile Applications SAP Mobile Platform SAP Business Objects BI Suite Exploration, Reporting, Dashboarding, Predictive, Mobile SAPBusinessObjects DataService Batch Data Feeds TransactionalSystems,Databases, FlatFiles,BatchDataFeeds Real-Time Data Ingestion Real-Time Recommendation Applications Real-Time Response Inline Predictive Analytics for Transactional Applications Close-Looped Analytics Smart Mobile Applications Real-time Real-TimeDataAcquisition StreamingDataEvents,ReplicateData TablesfromTransactionalApplications Sybase Event Stream Processor Sybase Replication Server SAPSLT Hortonworks Data Platform Data Reservoir Large Scale Data Capture, Generate Analytical Datasets, Train and Validate Predictive Models
- 5. © 2013 SAP AG. All rights reserved. 5Customer Parallel load of valuable data Load, then transform at scale: MapReduce, Pig, Java SAP/Hortonworks ETL Rationalization (loading data faster) SAP HANA Real-Time Analytics, Interactive Data Exploration & Application Platform Federated Smart Data Access OLAP Engine Predictive Engine Spatial Engine Application Logic & Rendering(XS) Dataorchestration Services Batch Data Feeds TransactionalSystems,Databases, FlatFiles,BatchDataFeeds 2 3 Falcon 1 ► Low Latency ingestion of data from operational systems ► Tiered Storage model offers partitioning into Hot-Warm-Cold data during ingestion. ► On-the-fly transformation for Hot Data can be performed in memory using HANA ► Off-load pre-processing of data to the Hadoop Platform Hortonworks Data Platform Data Reservoir Hortonworks Data Platform Data Reservoir Large Scale Data Capture, Generate Analytical Datasets, Train and Validate Predictive Models
- 6. © 2013 SAP AG. All rights reserved. 6Customer Big Data Interactive Data Exploration SAP HANA Real-Time Analytics, Interactive Data Exploration & Application Platform Federated Smart Data Access OLAP Engine Predictive Engine Spatial Engine Application Logic & Rendering(XS) Visualization and Reporting ► Interactive high performance Analytics and Visualization ► Agile modeling and shorter turn-around on reports & dashboards ► Exploration of Data in –memory and interactively with Hadoop. ► Uniform Data Science Experience on in-memory and multi-terabyte data sets Hcatalog Late binding schemas 1 SAS, ML, custom Science through scalable stats and analysis Hive Interactive SQL Hortonworks Data Platform Data Reservoir Large Scale Data Capture, Generate Analytical Datasets, Train and Validate Predictive Models SAPBusinessObjects DataService Batch Data Feeds TransactionalSystems,Databases, FlatFiles,BatchDataFeeds
- 7. © 2013 SAP AG. All rights reserved. 7Customer SAP/Hortonworks Real-Time Stream Processing SAP HANA Real-Time Analytics, Interactive Data Exploration & Application Platform Federated Smart Data Access OLAP Engine Predictive Engine Spatial Engine Application Logic & Rendering(XS) Online apps Mobile apps Visualization and Reporting Real-time Real-TimeDataAcquisition StreamingDataEvents,ReplicateDataTables fromTransactionalApplications Sybase Event Stream Processor Sybase Replication Server SAPSLT App events, mobile location data flows into platform for analysis 1 ► Real-time ingestion from operational systems, sensors and smart devices ► Pattern detection, anomaly detection and streaming analytics on data in flight. ► Scalable storage for offline model tuning and data science. ► Instant visibility across operations and corporate functions Hortonworks Data Platform Data Reservoir Large Scale Data Capture, Generate Analytical Datasets, Train and Validate Predictive Models Storm 2 Dataorchestration Services Batch Data Feeds TransactionalSystems,Databases, FlatFiles,BatchDataFeeds
- 8. © 2013 SAP AG. All rights reserved. 8Customer SAP/Hortonworks Real-Time Insights and Models SAP HANA Real-Time Analytics, Interactive Data Exploration & Application Platform Federated Smart Data Access OLAP Engine Predictive Engine Spatial Engine Application Logic & Rendering(XS) Online apps Mobile apps Visualization and Reporting Real-time Real-TimeDataAcquisition StreamingDataEvents,ReplicateData TablesfromTransactionalApplications Real-Time Data Ingestion Real-Time Recommendation Applications Real-Time Response Inline Predictive Analytics for Transactional Applications Close-Looped Analytics Smart Mobile Applications Sybase Event Stream Processor Sybase Replication Server SAPSLT Hortonworks Data Platform Data Reservoir Large Scale Data Capture, Generate Analytical Datasets, Train and Validate Predictive Models Dataorchestration Services Batch Data Feeds TransactionalSystems,Databases, FlatFiles,BatchDataFeeds
- 9. © 2013 SAP AG. All rights reserved. 9Customer SAP/Hortonworks Real-Time Big Data Architecture SAP HANA Real-Time Analytics, Interactive Data Exploration & Application Platform Federated Smart Data Access OLAP Engine Predictive Engine Spatial Engine Application Logic & Rendering(XS) Online apps Mobile apps Visualization and Reporting Real-time Real-TimeDataAcquisition StreamingDataEvents,ReplicateData TablesfromTransactionalApplications Real-Time Data Ingestion Real-Time Recommendation Applications Real-Time Response Inline Predictive Analytics for Transactional Applications Close-Looped Analytics Smart Mobile Applications Sybase Event Stream Processor Sybase Replication Server SAPSLT Hortonworks Data Platform Data Reservoir Large Scale Data Capture, Generate Analytical Datasets, Train and Validate Predictive Models Dataorchestration Services Batch Data Feeds TransactionalSystems,Databases, FlatFiles,BatchDataFeeds