Denodo in the Age of Containers: How to Simplify Operation of your Virtual Layer
1 like214 views
The document outlines a webinar series on data virtualization, focusing on integration challenges and solutions provided by Denodo in the context of modern technologies like Docker, Kubernetes, and cloud services. It provides a historical overview of virtualization and containerization, detailing their evolution and significance in cloud computing, as well as specific applications of Denodo's tools for deployment and orchestration in these environments. Additionally, it discusses how Denodo interacts with major cloud platforms like AWS and Azure, providing resources and guides for users.
Denodo in the Age of Containers: How to Simplify Operation of your Virtual Layer
- 1. DATA VIRTUALIZATION PACKED LUNCH WEBINAR SERIES Sessions Covering Key Data Integration Challenges Solved with Data Virtualization
- 2. Denodo in the Age of Containers: How to Simplify the Operation of your Virtual Layer Pablo Alvarez-Yanez Director of Product Management, Denodo
- 3. Agenda 1. Introduction 2. A Brief History 3. Docker 4. Kubernetes 5. AWS and other cloud providers 6. Denodo 8
- 5. 5
- 6. 66 The Other Virtualization Although we normally use the term virtualization applied to data, virtualization is a common term in computer science It just means to create non physical (made by software) version of a device or resource, such as a server, storage device, network or even an operating system (OS) Virtual Servers (aka Virtual Machines or VMs) and the API to manage them have fueled the raise of cloud computing OS-level virtualization (aka Containerization) has radically changed application packaging and deployment and enable modern architectures like microservices
- 7. 77 Why? 1. Provisioning flexibility • Decoupling physical HW from servers and applications 2. Simplify SW installation, distribution and packaging • No need for SW installation • Pre-integrated with OS and other libraries reduce compatibility issues 3. Infrastructure for automation and scaling
- 8. 88 A brief history: VMs The first approach to Virtual Machines was created in the early ‘70s by IBM, with mainframes like CP/CMS However, it wasn’t until the mid ‘90s when virtual machines as we know them today started to evolve. Apple’s Virtual PC was launched in 1997 and VMWare in 1999 For efficiency, modern hypervisors (the software that runs the VMs) don’t even require a host OS and run directly on bare metal. • Examples of this are VMWare ESX (launched in 2001), Xen (used by AWS and Citrix, launched in 2003) and Nitro (current AWS hypervisor, launched in 2018) This flexibility to allocate new (virtual) machines on demand drove the idea of cloud computing, private clouds, and eventually the mega-vendors of today like AWS, Azure and GCP
- 9. 99 A brief history: Containers Similarly, the story of OS-virtualization goes back to the late ‘70s, when Unix V7 introduced the chroot command, beginning the idea of process isolation In the early 2000’s, BSD, Linux and Solaris started to offer “jail mechanisms” to partition resources (file systems, network addresses, memory) on a computer system With the publication of Docker in 2013, containers exploded in popularity To manage container clusters and their workload, orchestration layers like Kubernetes or Mesos have been created in recent years (2015) and continue to evolve
- 11. 1111 Denodo and Docker A Denodo docker container is one of the options available for download in the Denodo support site • Created with Denodo’s latest update • Includes all Denodo components • Can be launched with a SA license or via Solution Manager • QuickStart guide available in the Denodo Community Additionally, you can also create your own personalized Docker images (e.g. specific configuration and pre-loaded metadata) • “How to create your own Docker Images” available in the Denodo Community
- 12. 1212 Demo
- 14. 1414 What is Kubernetes As we have seen, spinning up a containerized Denodo server is very easy,. However, in order to provide clustering, scaling and HA capabilities we will need an additional layer Kubernetes is a software for orchestration of containers that provides those additional capabilities: • Container grouping using pods • Self-healing • Scaling and auto-scaling • Load balancing • Resource monitoring and logging
- 16. 1616 Denodo and Kubernetes In order to deploy Denodo in Kubernetes, you need yaml configuration files that define the service and the deployment A description of these files and some other configuration options can be found in the Denodo Community, in the article “Deploying Denodo in Kubernetes” You can also find more advanced configuration options in the article “Configuring Autoscaling of Denodo in Kubernetes”
- 18. 1818 Demo
- 19. Denodo, VMs and Cloud Providers AWS, Azure, etc.
- 20. 2020 The Cloud Ecosystems One of the key offerings of all major cloud providers (AWS, Azure, GCP, etc. ) are virtual machines • Users can pick among different configurations (cores, memory, etc.) and pre- installed packages through a marketplace • Can also create and customize their own VM images • Pay per use (depending on chosen configuration) Additionally, these vendors also provide a rich ecosystem with other components and the APIs to automate their usage • Load balancers, virtual networks, scaling options, monitoring, distributed storage, etc. • Also, Docker and Kubernetes services, for example ECS and EKS in AWS These ecosystems are the foundation of modern cloud computing and SaaS offerings
- 22. 2222 Denodo in the AWS Ecosystem Denodo offers multiple resources to implement complex architectures in AWS • Marketplace instances (Free trial, BYOL, and pay-per-use) • Instructions for manual installation in EC2 • Scaling and auto-scaling in AWS with ELB, auto-scaling groups and Denodo’s Solution Manger for license control • Monitoring with AWS CloudWatch, to create monitoring dashboards, log search and alerts • Logging directly into S3 Upcoming: • Guide to use CloudWatch metrics for auto-scaling • CloudFront templates for typical cluster deployments (with ELB) • Equivalent documentation for the Azure ecosystem
- 23. Denodo 8
- 24. 2424 Denodo 8 in AWS Infrastructure is transparently managed via web UI • Definition of new instances and clusters based on AMI • Including automated set up of TLS and load balancing with ELB • Scaling and auto-scaling options • Automation of update installation • SSO integration and configuration • Integration with monitoring tool Actual servers run in customer account • Better performance (closer to data) • Simpler security and legal compliance • Similar to deployment models of Databricks and Qubole
- 25. 2525 Demo 8
- 27. 27 Next Steps Access Denodo Platform in the Cloud! Take a Test Drive today! www.denodo.com/TestDrive GET STARTED TODAY
- 28. Thank you! © Copyright Denodo Technologies. All rights reserved Unless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm, without prior the written authorization from Denodo Technologies.