Hadoop und IoT
Download as PPTX, PDF0 likes428 views
The document discusses the Internet of Things (IoT) and its strategic implications in the context of industrial advancements, particularly focusing on the evolution and architecture of Hadoop. It outlines the challenges and potential of big data analytics, including the limitations of current data architectures and the transition from reactive to proactive predictive capabilities. The content is framed within the landscape of Industry 4.0 and digital transformation trends impacting data governance and architecture.
Hadoop und IoT
- 1. 1July, 2016CSC Proprietary and Confidential Hadoop und IoT M.Sc. Lukas Ott Sommersemester 2016 Hochschule Aschaffenburg
- 2. 2July, 2016CSC Proprietary and Confidential Agenda • IoT – Strategische Sicht • Datenzentriert vs. Prozesszentriert • Hadoop 1.0 • Hadoop 2.0 • The Internet of Anything (Diskussionsrunde)
- 3. 3July, 2016CSC Proprietary and Confidential Gartner Hype Cycle 2015
- 4. 4July, 2016CSC Proprietary and Confidential
- 5. 5July, 2016CSC Proprietary and Confidential Industrie 4.0 - Michael Porter - Dezember 2015
- 6. 6July, 2016CSC Proprietary and Confidential Industrie 4.0 – The strategic fight for the social network provider for machines ERP MES ERP realtime MES 4.0 Evolution Top-Down Approach from the ERP Software Producers (providing an IoT platform) Evolution Bottom-Up Shopfloor Approach (from the MES Software producers) Horizontal Approach from the developer engineer side (PDM Software) Disruptive approach from other software players (e.g. Amazon IoT Plattform )
- 7. 7July, 2016CSC Proprietary and Confidential Digital trends in Manufacturing Industry can also be categorized in two main views Process and Information Flow Data • IoT • Swarm-systems • Knowledge Graph • Big Data Analytics • Semantically Enriched services • Smart Robots (self-learning) • Digital Security • Central Data organization unit • Data Governance • Interdisciplinary Data science teams • Connecting Data streams / Data Lake / Product Clouds • Semantically enriched Data usage for every Business unit
- 8. 8July, 2016CSC Proprietary and Confidential Datavolume growth in the next few years INTERNET OF ANYTHING 44ZB DATA TOMORROW Source: hortonworks.com
- 9. 9July, 2016CSC Proprietary and Confidential Source: hortonworks.com
- 10. 11July, 2016CSC Proprietary and Confidential Die ideale Big Data Architektur
- 11. 12July, 2016CSC Proprietary and Confidential Shift from Reactive……to…... Proactive & Proscriptive …to Behavioral Insight From reaction to human activity …to Resource Optimization From static resource planning From break then fix …to Preventative Maintenance Source: hortonworks.com
- 12. 13July, 2016CSC Proprietary and Confidential The Current Data Architectures Limits Predictive Capabilities DATASYSTEMS Enterprise Data Warehouse Hot MPP In-Memory 1 2 RDBMS ERPCRM Systems of Record ANALYTICS Data Marts Business Analytics Visualization & Dashboards 3 1. Data Silos: difficult to find predictive correlations 2. Data Volumes: cannot store enough data to find patterns 3. New Data Sources: unable to capture and use new data for real- time analysis Source: hortonworks.com
- 13. 14July, 2016CSC Proprietary and Confidential Balancing between new technologies and existing infrastructure Source: cloudera.com
- 14. 15July, 2016CSC Proprietary and Confidential Hadoop started 2006 Source: cloudera.com
- 15. 16July, 2016CSC Proprietary and Confidential History of Hadoop Source: cloudera.com
- 16. 17July, 2016CSC Proprietary and Confidential Big Data Functional Architecture New Data Stream Store Pre-Compute Views & Deep Learning Process Streams Incremental Views Business View Business View Query SPEED LAYER BATCH LAYER SERVING LAYER HADOOP 1 Source: hortonworks.com
- 17. 18July, 2016CSC Proprietary and Confidential Hadoop 1.0 Source: hortonworks.com
- 18. 19July, 2016CSC Proprietary and Confidential Source: hortonworks.com
- 19. 20July, 2016CSC Proprietary and Confidential MapReduce Example
- 20. 21July, 2016CSC Proprietary and Confidential MapReduce Example
- 21. 22July, 2016CSC Proprietary and Confidential Big Data Functional Architecture Source: hortonworks.com
- 22. 23July, 2016CSC Proprietary and Confidential YARN und HDFS Source: hortonworks.com
- 23. 24July, 2016CSC Proprietary and Confidential Hadoop 2.0 Source: hortonworks.com
- 24. 25July, 2016CSC Proprietary and Confidential Hadoop 2.0 Source: hortonworks.com
- 25. 26July, 2016CSC Proprietary and Confidential Wir stehen hier… *Innovators & enthusiasts Late majority & conservatives Laggards & Skeptics Early majority & pragmatists Early adopters & visionaries Source: hortonworks.com
- 26. 27July, 2016CSC Proprietary and Confidential The Current Data Architectures Limits Predictive Capabilities Source: hortonworks.com
- 27. 28July, 2016CSC Proprietary and Confidential Source: hortonworks.com
- 28. 29July, 2016CSC Proprietary and Confidential Actionable Intelligence from Connected Data Platforms Source: hortonworks.com
- 29. 30July, 2016CSC Proprietary and Confidential Das Internet der Dinge – Diskussionsrunde INTERNET OF ANYTHING Source: hortonworks.com
- 30. 31July, 2016CSC Proprietary and Confidential CSC Analytics Platform as a Service Source: hortonworks.com
- 31. 32July, 2016CSC Proprietary and Confidential
- 32. 33July, 2016CSC Proprietary and Confidential Ausblick und Zusammenfassung Internet der Dinge IoT Plattform
- 33. 34July, 2016CSC Proprietary and ConfidentialCSC Proprietary and Confidential 34 Vielen Dank! Fragen? Feedback!
- 34. 35July, 2016CSC Proprietary and Confidential Quellen • Gartner Hype Cycle • hortonworks.com • http://www.cloudera.com/ • https://www.ge.com/digital/predix • https://www.thingworx.com/ • https://www.bosch-si.com/de/produkte/bosch-iot-suite/platform-as- service/paas.html • csc.com • http://assets1.csc.com/de/downloads/Folder_Industrie_4_0_END_20 150206_final_web.pdf (Industrie 4.0 Broschure)
- 35. 36July, 2016CSC Proprietary and Confidential
- 36. 37July, 2016CSC Proprietary and Confidential Source: waterline.com
- 37. 38July, 2016CSC Proprietary and Confidential
- 38. 39July, 2016CSC Proprietary and Confidential
- 39. 40July, 2016CSC Proprietary and Confidential Gartner Vector Model
- 40. 41July, 2016CSC Proprietary and Confidential