Evolving From Monolithic to Distributed Architecture Patterns in the Cloud
1 like492 views
The document discusses a data virtualization webinar focusing on overcoming data integration challenges associated with cloud migration and modernization. It highlights the evolution from monolithic to distributed architecture, customer case studies, and the benefits of using Denodo's data virtualization platform to improve data access and minimize disruption during cloud transitions. Key topics include application modernization, multi-cloud strategies, and the importance of hybrid data integration to avoid silos and maximize cloud benefits.
Evolving From Monolithic to Distributed Architecture Patterns in the Cloud
- 1. DATA VIRTUALIZATION PACKED LUNCH WEBINAR SERIES Sessions Covering Key Data Integration Challenges Solved with Data Virtualization
- 2. Evolving from Monolithic to Distributed Architecture Patterns in the Cloud Paul Moxon VP Data Architectures & Chief Evangelist, Denodo Ruben Fernandez Sales Engineer, Denodo
- 3. Agenda 1. The Cloud Changes Everything 2. Accelerating Cloud Migration & Modernization 3. Customer Case Study 4. Demo – Denodo 7.0 5. Q&A 3
- 5. Data Integration – “The Way We Were…” 5
- 6. Data Integration – A Modern Data Ecosystem 6
- 7. Gartner: Predicts 2018: Data Management Strategies Continue to Shift Toward Distributed …..the collection of data as well as the need to connect to data are rapidly becoming the new normal, and that the days of a single data store with all the data of interest — the enterprise data warehouse — are long gone.”
- 8. Data Integration – A Modern Data Ecosystem 8
- 9. Data Integration – A Modern Data Ecosystem 9
- 10. Rightscale, 2017 State of the Cloud Report 85 percent of enterprises have a multi- cloud strategy, up from 82 percent in 2016”
- 11. A (Typical) Cloud Journey 11On-Premise On-Premise + SaaS On-Premise + SaaS + Private Cloud On-Premise + SaaS + Private Cloud + iPaaS Cloud Native
- 12. Distributed Cloud Data Architectures • Pure Cloud (“Cloud Native”) • Single Cloud provider • Private or public Cloud • Hybrid • Cloud and on-premise • Pure Cloud…but multiple Cloud providers • Data in multiple data stores, multiple locations • Applications (SaaS) storing data in Cloud 12
- 13. Challenges in Cloud Data Integration • Data is in many locations, data repositories, formats, etc. • Cloud, on-premise, SaaS, … • How do they know what data is available? • How to users find and access the data? • Simple tasks become more challenging as the data gets more dispersed 13
- 14. Accelerating Cloud Migration & Modernization 14
- 15. Application Modernization with the Cloud • Moving from legacy – typically monolithic – applications and application suites deployed on-premise to specialized SaaS applications in the Cloud • e.g. from Oracle E-Business Suite, PeopleSoft, Siebel, etc. • e.g. to Salesforce, NetSuite, Workday, Taleo, etc. • Cost savings can be substantial 15
- 16. Application Modernization (Cont’d) Data challenges for application modernization: • How do you access the data in the SaaS applications? • How do you get a holistic view of data in specialized applications? • How do you get data into the SaaS apps? • Are you going to give users access to each and every SaaS application? This is where Cloud Data Virtualization can play a significant role 16
- 17. Denodo’s Cloud Data Virtualization Architecture 17 Execution Agent Execution Agent Metadata Repository Execution Engine & Optimizer Data center A Data center B Corporate Security Monitoring & Auditing “The Cloud”
- 18. Application Modernization – Bio-Tech Company 18 Data Virtualization Web, Cloud and SaaS • HR Performance • Compliance • Recruitment • Workforce Mang. • Compensation H R M S • Core HR Functions H R M S Internal Enterprise Systems • Recruitment • Workforce Management • Compensation Moving to the Cloud …
- 19. Data Migration to Cloud Moving data sources from on premise to Cloud – or even from Cloud to Cloud • Using Data Virtualization as an abstraction layer to isolate the business from the effects of the change • Using Data Virtualization as a hybrid data access layer to access data, whether on- premise or in the Cloud 19
- 20. Data Migration to Cloud - Asurion 20 • Growing internationally, moving into different privacy and data protection jurisdictions • New products – need for different data types and sources • Mixing structured, multi-structured, streaming, text, video, voice, geo-location, etc. • Moving to Cloud for increased speed and agility • Easier to spin up new virtual servers for new data sets • Competing pressures for securing data and providing access to data sets
- 21. Data Migration to Cloud - Asurion 21 Security Constraints Geographical Constraints Contractual Client Obligations PII Protection Departmental Restrictions Fast Changing Hadoop & Cloud Technologies Hive, Spark, Redshift Maintaining different code base Discover, Co-relate, Enable Predictive Analytics Text, CSV, Voice, JSON, Streaming, 3rd Party Data 60TB+ structured, 200TB+ telemetry & unstructured data
- 22. Data Migration to Cloud - Asurion 22
- 24. Cloud Data Integration - Logitech 24 • Logitech struggling with scalability of Exadata data warehouse • Too expensive to scale up with more data and higher workloads • Needed to move to Cloud for increased speed and agility • Easier to dynamically scale for changing workloads • Wanted analytical engines running on AWS for speed and agility • Redshift, AWS EMR, Spark, etc. • But some data staying on-premises • Needed platform to bridge Cloud and on-premise and to enable the migration with minimal impact on business
- 25. Cloud Data Integration - Logitech 25
- 27. Logitech - Benefits 27 Data Fest Presentation by Tekin Mentes, Enterprise Data Architect & Data Evangelist, Logitech
- 28. Product Demonstration Evolving From Monolithic to Distributed Architecture Patterns in the Cloud Ruben Fernandez Sales Engineer, Denodo
- 29. Combine Cloud EDW with other Cloud sources (Cloud SaaS, Hadoop, etc.) for agile reporting and analytics Benefits • Fresh data coming straight from Cloud systems • Avoid local replication of cloud systems Example Report: Sales volume per lead source in last 30 days (EDW + CRM) Scenario: Cloud EDW + SaaS CRM + Cloud Hadoop 29 Event (dim) User (dim) Customer feedback Semantic Model Original Model Sales (fact)Leads Amazon Redshift Amazon EMRCRM
- 30. Performance & Optimizations SELECT u.state AS state, SUM(s.pricepaid) AS sales_total FROM sales s JOIN users u ON s.buyerid = u.userid JOIN salesforce_lead l ON u.email = l.email WHERE l.leadsource= 'Web' GROUP BY u.state; System Execution Time Data Transferred Denodo 3 sec. 34k Non-optimized 8 min 100 M 100 M 2k join group by 32k join group by email Group by state join join optimizer 2k
- 31. Demo 31
- 32. Summary • Moving to Cloud can be disruptive • Data Virtualization can help minimize the impact on business by isolating the changes • Without proper hybrid integration layer, Cloud apps and databases can become yet more silos • Cloud Data Virtualization can open up these silos and allow users to access all data, anywhere • If you’re struggling with integration of Cloud data, you might lose the Cloud benefits of lower TCO and agility • Cloud Data Virtualization can improve agility, lower TCO and help ensure the benefits of Cloud Modernization 32
- 33. Summary • Benefits of using Denodo Platform include: • Isolate business from changes in underlying infrastructure • e.g. moving from Teradata to Snowflake • Provides hybrid data access layer • Access all data from anywhere - Cloud-to-Ground, Cloud-to-Cloud • Common and consistent governance and security across all data • Enable speed and agility in new environment • Avoid expensive Cloud ‘data egress’ charges • Move processing to the data and not the data to the processor 33
- 34. Q&A
- 35. Next steps Access Denodo Platform for Azure: https://www.denodo.com/en/denodo- platform/denodo-platform-for-azure Access Denodo Platform on AWS: www.denodo.com/en/denodo-platform/denodo- platform-for-aws
- 36. Thank you! © Copyright Denodo Technologies. All rights reserved Unless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm, without prior the written authorization from Denodo Technologies.