SlideShare a Scribd company logo
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Build with Containers
Seoul, South Korea
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Your presenters
Omar Lari,
Container Service
• Held engineering and leaderships roles at various
silicon valley startups, enterprise organization and
consulting firms
• 3 years at AWS – Solutions Architect specializing in
container adoption and container services business
development
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Excited to be in South Korea!
• My first time here
• Suggestions for food, sights and soju drinking tips
are welcome J
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Today’s Agenda
09:30 Welcome
09:35 Building with Kubernetes on AWS
10:20 Amazon EKS Hands-On Lab
12:45 Lunch
13:15 Partner Presentation
13:45 Building with Fargate and Amazon ECS
14:30 Fargate Hands-On Lab
16:30 Closing Discussion
17:00 End
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Important information
• Bathrooms
• Slides will be provided after the event via slideshare
• You will receive a survey after the event in your email. It only
takes 3 minutes to complete! Let us know how we did and what to
improve.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Containers on AWS
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Container Services Landscape
MANAGEMENT
Deployment, Scheduling, Scaling &
Management of containerized
applications
HOSTING
Where the containers run
Amazon Elastic
Container Service
Amazon Elastic
Container Service
for Kubernetes
Amazon EC2 AWS Fargate
Higher Level Services
Application Management
Amazon Elastic
Container Registry
Compute
Where the containers run
Spot Instance GPU Instance
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Omar Lari, Container Services
March 4th, 2019
Kubernetes on AWS
Open source container management
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Agenda
• Why containers?
• What is Kubernetes?
• Key concepts
• Running Kubernetes on AWS
• Demonstration
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why containers? FizzBuzz!
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Application environment components
Runtime Engine Code
Dependencies Configuration
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Local Laptop Staging / QA Production On-Premises
Different environments
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Local Laptop Staging / QA Production On-Prem
It worked on my machine, why not in
prod?
v6.0.0 v7.0.0 v4.0.0 v7.0.0
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Containers to the rescue
Runtime Engine
Code
Dependencies
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Docker
Lightweight container virtualization platform.
Tools to manage and deploy your applications.
Licensed under the Apache 2.0 license.
First released March 2013
Built by Docker, Inc.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Docker Image
Read only image that is used as a
template to launch a container.
Start from base images that have
your dependencies, add your custom
code.
Docker file for easy, reproducible
builds.
bootfs
kernel
Base image
Image
Image
W
ritable
Container
add
ngix
add
nodejs
U
buntu
References
parent
image
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Local Laptop Staging / QA Production On-Prem
Four environments, same container
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Container Implementation
Server (Host)
Hypervisor
Guest OS
Bins/Libs
App 2
Guest OS
Bins/Libs
App 3
Guest OS
Bins/Libs
App 1
Server (Host)
Hypervisor
Guest OS
App 2
Guest OS
App 3
Guest OS
App 1
Guest OS / Docker Engine
Bins/Libs Bins/LibsBins/Libs
Server (Host)
Operating System (OS)
Guest OS Guest OSGuest OS Libraries
App 1, 2, 3
Bare Metal Virtual Machine Containers
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
But how do we make this work at scale?
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
We need to
• start, stop, and monitor lots of containers running on
lots of hosts
• decide when and where to start or stop containers
• control our hosts and monitor their status
• manage rollouts of new code (containers) to our hosts
• manage how traffic flows to containers and how
requests are routed
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
aka ‘k8s’
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Container Services Landscape
MANAGEMENT
Deployment, Scheduling,
Scaling & Management
HOSTING
Where the containers run
Amazon EC2
IMAGE REGISTRY
Container Image Repository
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Open source container
management platform
Helps you run
containers at scale
Gives you primitives
for building
modern applications
What is Kubernetes?
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Containers on Hosts
A host is a server – e.g. EC2 virtual machine.
We run these hosts together as a cluster.
Web App
To start let’s run a 3 copies of our web
app across our cluster of EC2 hosts.
3x
Our simple example web application is
already containerized.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Run n containers
We define a deployment and set the replicas
to 3 for our container.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Scale up!
Need more containers?
Update the replication set!
The new containers are started on the cluster.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Untimely termination
Oh no! Our host has died!
Kubernetes notices only 3 of the 5
containers are running and starts 2
additional containers on the remaining
hosts.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Containers IRL
In production, we want to do more complex
things like,
• Run a service to route traffic to a set of
running containers
• Manage the deployment of containers to
our cluster
• Run multiple containers together and
specify how they run
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Pods
• Define how your containers should run
• Allow you to run 1 to n containers together
Containers in pods have
• Shared IP space
• Shared volumes
• Shared scaling (you scale pods not
individual containers)
When containers are started on our cluster,
they are always part of a pod.
(even if it’s a pod of 1)
Container A
Container B
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Services
One of the ways traffic gets to your pods.
• Internal IP addresses are assigned to each pod
• Services are connected to pods
and use labels to reference which pod
to route requests to
containers.
container
containers
containers
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Deployments
Services work with deployments to manage
updating or adding new pods.
Let’s say we want to deploy a new version of our
web app as a ‘canary’ and see how it handles
traffic.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Deployments
The deployment creates a new replication set
for our new pod version.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Deployments
Only after the new pod returns a healthy
status to the service do we add more new
pods and scale down the old.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Running Kubernetes on AWS
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
51%of Kubernetes workloads
run on AWS today
— Cloud Native Computing Foundation
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Elastic Container Service for Kubernetes
Managed K8s control plane — highly available API server and etcd nodes
aws eks create-cluster 
--name <> 
--role-arn <> 
--resources-vpc-config <> 
...
Bring your own EC2 worker nodes
Core tenets
• Platform for enterprises to run production-grade workloads
• Provides a native and upstream Kubernetes experience – Kubernetes certified
• Seamless integration with AWS services
• Actively contributes to the Kubernetes project
APIs
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
eksctl – eks the easy way
CLI to provision and managed your EKS cluster
apiVersion: eksctl.io/v1alpha4
kind: ClusterConfig
metadata:
name: demo
region: ap-northeast-2
version: '1.11’
nodeGroups:
...
Quickly get started without worrying about VPC, IAM and Node design
eksctl create cluster
Or define a config file for more detailed configuration control
eksctl create cluster –f config.yaml
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
EKS Customers
C r e a t e E K S c l u s t e r
P r o v i s i o n w o r k e r n o d e s
L a u n c h a d d - o n s
L a u n c h w o r k l o a d s
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
EKS – Kubernetes control plane
C r e a t e c l u s t e r
C r e a t e H A c o n t r o l
p l a n e
I A M i n t e g r a t i o n
C e r t i f i c a t e
m a n a g e m e n t
S e t u p L B
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
EC2 Worker
Nodes
EKS
Control
Plane
Customer VPC EKS VPC
Network Load
Balancer
ENI
API Access
Kubectl
Exec/Logs
TLS
Static IPs
ENI Attachment
Autoscaling Group
EKS Architecture
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Native VPC networking
with CNI plugin
Pods have the same VPC
address inside the pod
as on the VPC
Simple, secure
networking
Open source and
on GitHub
…{ }
https://github.com/aws/amazon-vpc-cni-k8s
Container Networking Interface (CNI)
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
VPC CNI plugin
• Bridge between the K8s land – AWS VPC
• AWS Routable IPs
• Thin layer – no performance impact
• Pod IP ENI secondary IP
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS IAM Authenticator for Kubernetes
• AWS native access management
• Built in collaboration with Heptio
• Kubectl and worker nodes
• Works with Kubernetes Role-Based Authentication (RBAC)
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
IAM roles for Kubectl
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Tracing
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CICD for Kubernetes Apps
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CI/CD of apps on Kubernetes—choices
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Jenkins
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
EKS Deployment Pipeline
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Questions?
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Start at https://eksworkshop.com

More Related Content

PDF
はじめてのグラフデータベース 〜 Amazon Neptune と主なユースケース 〜
PDF
20180724 AWS Black Belt Online Seminar Amazon Elastic Container Service for K...
PDF
AWS 기반 지속 가능한 데이터 분석 플랫폼 구축하기 - 소성운, 지그재그 :: AWS Summit Seoul 2019
PDF
Firecracker, 서버리스 컴퓨팅을 위한 오픈소스 microVM 기술 :: 류한진 - AWS ...
PDF
Amazon GameLift – 김성수 (AWS 솔루션즈 아키텍트)
PDF
20190206 AWS Black Belt Online Seminar Amazon SageMaker Basic Session
PDF
[AWS Start-up ゼミ / DevDay 編] よくある課題を一気に解説! 御社の技術レベルがアップする 2018 秋期講習
PDF
20190911 AWS Black Belt Online Seminar AWS Batch
はじめてのグラフデータベース 〜 Amazon Neptune と主なユースケース 〜
20180724 AWS Black Belt Online Seminar Amazon Elastic Container Service for K...
AWS 기반 지속 가능한 데이터 분석 플랫폼 구축하기 - 소성운, 지그재그 :: AWS Summit Seoul 2019
Firecracker, 서버리스 컴퓨팅을 위한 오픈소스 microVM 기술 :: 류한진 - AWS ...
Amazon GameLift – 김성수 (AWS 솔루션즈 아키텍트)
20190206 AWS Black Belt Online Seminar Amazon SageMaker Basic Session
[AWS Start-up ゼミ / DevDay 編] よくある課題を一気に解説! 御社の技術レベルがアップする 2018 秋期講習
20190911 AWS Black Belt Online Seminar AWS Batch

What's hot (20)

PDF
AWS で構築するコンピュータビジョンアプリケーション
PDF
20191023 AWS Black Belt Online Seminar Amazon EMR
PDF
20191009 AWS Black Belt Online Seminar Amazon GameLift
PDF
신입 개발자가 스타트업에서 AWS로 살아남는 이야기 - 조용진, 모두의 캠퍼스 :: AWS Summit Seoul 2019
PDF
20191002 AWS Black Belt Online Seminar Amazon EC2 Auto Scaling and AWS Auto S...
PDF
마이크로서비스를 위한 App Mesh & Cloud Map - 김세호 솔루션즈 아키텍트, AWS :: AWS Summit Seoul 2019
PDF
e커머스 통합운영 자동화 사례 및 보안강화 방안 - 양수연 상무, 삼성SDS / 임선진 팀장, 삼성SDS :: AWS Summit Seou...
PDF
게임 고객사를 위한 ‘AWS 컨테이너 교육’ 자료 - 유재석 솔루션즈 아키텍트, AWS :: Gaming Immersion Day 201...
PDF
AWS Transit Gateway를 통한 Multi-VPC 아키텍처 패턴 - 강동환 솔루션즈 아키텍트, AWS :: AWS Summit ...
PDF
AWS Black Belt Online Seminar 2018 AWS Certificate Manager
PDF
RoboMaker로 DeepRacer 자율 주행차 만들기 :: 유정열 - AWS Community Day 2019
PDF
Amazon SageMaker 推論エンドポイントを利用したアプリケーション開発
PDF
Service Mesh, 좀 더 쉽게 - AWS App Mesh :: 안주은 - AWS Community Day 2019
PDF
20190731 Black Belt Online Seminar Amazon ECS Deep Dive
PDF
AWS 미디어 서비스를 이용한 글로벌 라이브 스트리밍 서비스 구축 - 황윤상 솔루션즈 아키텍트, AWS / 조용진 솔루션즈 아키텍트, AW...
PDF
20190306 AWS Black Belt Online Seminar Amazon EC2 スポットインスタンス
PDF
AWS Lambda@Edge でできること!
PPTX
2019-11-05 AWS Pretoria Meetup - Setting up your first environment and adding...
PDF
Serverless ASP.NET Core 2.0 Applicationsを作ってみた
PPTX
Secure and Fast microVM for Serverless Computing using Firecracker
AWS で構築するコンピュータビジョンアプリケーション
20191023 AWS Black Belt Online Seminar Amazon EMR
20191009 AWS Black Belt Online Seminar Amazon GameLift
신입 개발자가 스타트업에서 AWS로 살아남는 이야기 - 조용진, 모두의 캠퍼스 :: AWS Summit Seoul 2019
20191002 AWS Black Belt Online Seminar Amazon EC2 Auto Scaling and AWS Auto S...
마이크로서비스를 위한 App Mesh & Cloud Map - 김세호 솔루션즈 아키텍트, AWS :: AWS Summit Seoul 2019
e커머스 통합운영 자동화 사례 및 보안강화 방안 - 양수연 상무, 삼성SDS / 임선진 팀장, 삼성SDS :: AWS Summit Seou...
게임 고객사를 위한 ‘AWS 컨테이너 교육’ 자료 - 유재석 솔루션즈 아키텍트, AWS :: Gaming Immersion Day 201...
AWS Transit Gateway를 통한 Multi-VPC 아키텍처 패턴 - 강동환 솔루션즈 아키텍트, AWS :: AWS Summit ...
AWS Black Belt Online Seminar 2018 AWS Certificate Manager
RoboMaker로 DeepRacer 자율 주행차 만들기 :: 유정열 - AWS Community Day 2019
Amazon SageMaker 推論エンドポイントを利用したアプリケーション開発
Service Mesh, 좀 더 쉽게 - AWS App Mesh :: 안주은 - AWS Community Day 2019
20190731 Black Belt Online Seminar Amazon ECS Deep Dive
AWS 미디어 서비스를 이용한 글로벌 라이브 스트리밍 서비스 구축 - 황윤상 솔루션즈 아키텍트, AWS / 조용진 솔루션즈 아키텍트, AW...
20190306 AWS Black Belt Online Seminar Amazon EC2 スポットインスタンス
AWS Lambda@Edge でできること!
2019-11-05 AWS Pretoria Meetup - Setting up your first environment and adding...
Serverless ASP.NET Core 2.0 Applicationsを作ってみた
Secure and Fast microVM for Serverless Computing using Firecracker
Ad

Similar to [AWS Container Service] Getting Started with Kubernetes on AWS (8)

PPTX
Amazon Elastic Container Service for Kubernetes (Amazon EKS) I AWS Dev Day 2018
PDF
More Containers Less Operations
PDF
CMP376 - Another Week, Another Million Containers on Amazon EC2
PPTX
Deep Dive on Amazon Elastic Container Service (ECS) I AWS Dev Day 2018
PPTX
Containers State of the Union I AWS Dev Day 2018
PDF
AWS Black Belt Online Seminar 2018 re:Invent Recap: Compute, Container and Ne...
PDF
Builders' Day- Mastering Kubernetes on AWS
PDF
AWS에서 Kubernetes 실전 활용하기::유병우::AWS Summit Seoul 2018
Amazon Elastic Container Service for Kubernetes (Amazon EKS) I AWS Dev Day 2018
More Containers Less Operations
CMP376 - Another Week, Another Million Containers on Amazon EC2
Deep Dive on Amazon Elastic Container Service (ECS) I AWS Dev Day 2018
Containers State of the Union I AWS Dev Day 2018
AWS Black Belt Online Seminar 2018 re:Invent Recap: Compute, Container and Ne...
Builders' Day- Mastering Kubernetes on AWS
AWS에서 Kubernetes 실전 활용하기::유병우::AWS Summit Seoul 2018
Ad

More from Amazon Web Services Korea (20)

PDF
[D3T1S01] Gen AI를 위한 Amazon Aurora 활용 사례 방법
PDF
[D3T1S06] Neptune Analytics with Vector Similarity Search
PDF
[D3T1S03] Amazon DynamoDB design puzzlers
PDF
[D3T1S04] Aurora PostgreSQL performance monitoring and troubleshooting by use...
PDF
[D3T1S07] AWS S3 - 클라우드 환경에서 데이터베이스 보호하기
PDF
[D3T1S05] Aurora 혼합 구성 아키텍처를 사용하여 예상치 못한 트래픽 급증 대응하기
PDF
[D3T1S02] Aurora Limitless Database Introduction
PDF
[D3T2S01] Amazon Aurora MySQL 메이저 버전 업그레이드 및 Amazon B/G Deployments 실습
PDF
[D3T2S03] Data&AI Roadshow 2024 - Amazon DocumentDB 실습
PDF
AWS Modern Infra with Storage Roadshow 2023 - Day 2
PDF
AWS Modern Infra with Storage Roadshow 2023 - Day 1
PDF
사례로 알아보는 Database Migration Service : 데이터베이스 및 데이터 이관, 통합, 분리, 분석의 도구 - 발표자: ...
PDF
Amazon DocumentDB - Architecture 및 Best Practice (Level 200) - 발표자: 장동훈, Sr. ...
PDF
Amazon Elasticache - Fully managed, Redis & Memcached Compatible Service (Lev...
PDF
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
PDF
[Keynote] 슬기로운 AWS 데이터베이스 선택하기 - 발표자: 강민석, Korea Database SA Manager, WWSO, A...
PDF
Demystify Streaming on AWS - 발표자: 이종혁, Sr Analytics Specialist, WWSO, AWS :::...
PDF
Amazon EMR - Enhancements on Cost/Performance, Serverless - 발표자: 김기영, Sr Anal...
PDF
Amazon OpenSearch - Use Cases, Security/Observability, Serverless and Enhance...
PDF
Enabling Agility with Data Governance - 발표자: 김성연, Analytics Specialist, WWSO,...
[D3T1S01] Gen AI를 위한 Amazon Aurora 활용 사례 방법
[D3T1S06] Neptune Analytics with Vector Similarity Search
[D3T1S03] Amazon DynamoDB design puzzlers
[D3T1S04] Aurora PostgreSQL performance monitoring and troubleshooting by use...
[D3T1S07] AWS S3 - 클라우드 환경에서 데이터베이스 보호하기
[D3T1S05] Aurora 혼합 구성 아키텍처를 사용하여 예상치 못한 트래픽 급증 대응하기
[D3T1S02] Aurora Limitless Database Introduction
[D3T2S01] Amazon Aurora MySQL 메이저 버전 업그레이드 및 Amazon B/G Deployments 실습
[D3T2S03] Data&AI Roadshow 2024 - Amazon DocumentDB 실습
AWS Modern Infra with Storage Roadshow 2023 - Day 2
AWS Modern Infra with Storage Roadshow 2023 - Day 1
사례로 알아보는 Database Migration Service : 데이터베이스 및 데이터 이관, 통합, 분리, 분석의 도구 - 발표자: ...
Amazon DocumentDB - Architecture 및 Best Practice (Level 200) - 발표자: 장동훈, Sr. ...
Amazon Elasticache - Fully managed, Redis & Memcached Compatible Service (Lev...
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
[Keynote] 슬기로운 AWS 데이터베이스 선택하기 - 발표자: 강민석, Korea Database SA Manager, WWSO, A...
Demystify Streaming on AWS - 발표자: 이종혁, Sr Analytics Specialist, WWSO, AWS :::...
Amazon EMR - Enhancements on Cost/Performance, Serverless - 발표자: 김기영, Sr Anal...
Amazon OpenSearch - Use Cases, Security/Observability, Serverless and Enhance...
Enabling Agility with Data Governance - 발표자: 김성연, Analytics Specialist, WWSO,...

Recently uploaded (20)

PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Encapsulation theory and applications.pdf
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
KodekX | Application Modernization Development
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
cuic standard and advanced reporting.pdf
PDF
Approach and Philosophy of On baking technology
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
Spectroscopy.pptx food analysis technology
PPTX
sap open course for s4hana steps from ECC to s4
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Unlocking AI with Model Context Protocol (MCP)
Digital-Transformation-Roadmap-for-Companies.pptx
Chapter 3 Spatial Domain Image Processing.pdf
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Reach Out and Touch Someone: Haptics and Empathic Computing
Encapsulation theory and applications.pdf
“AI and Expert System Decision Support & Business Intelligence Systems”
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Advanced methodologies resolving dimensionality complications for autism neur...
20250228 LYD VKU AI Blended-Learning.pptx
KodekX | Application Modernization Development
Network Security Unit 5.pdf for BCA BBA.
cuic standard and advanced reporting.pdf
Approach and Philosophy of On baking technology
Dropbox Q2 2025 Financial Results & Investor Presentation
Per capita expenditure prediction using model stacking based on satellite ima...
Spectral efficient network and resource selection model in 5G networks
Spectroscopy.pptx food analysis technology
sap open course for s4hana steps from ECC to s4
Programs and apps: productivity, graphics, security and other tools
Unlocking AI with Model Context Protocol (MCP)

[AWS Container Service] Getting Started with Kubernetes on AWS

  • 1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Build with Containers Seoul, South Korea
  • 2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Your presenters Omar Lari, Container Service • Held engineering and leaderships roles at various silicon valley startups, enterprise organization and consulting firms • 3 years at AWS – Solutions Architect specializing in container adoption and container services business development
  • 3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Excited to be in South Korea! • My first time here • Suggestions for food, sights and soju drinking tips are welcome J
  • 4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Today’s Agenda 09:30 Welcome 09:35 Building with Kubernetes on AWS 10:20 Amazon EKS Hands-On Lab 12:45 Lunch 13:15 Partner Presentation 13:45 Building with Fargate and Amazon ECS 14:30 Fargate Hands-On Lab 16:30 Closing Discussion 17:00 End
  • 5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Important information • Bathrooms • Slides will be provided after the event via slideshare • You will receive a survey after the event in your email. It only takes 3 minutes to complete! Let us know how we did and what to improve.
  • 6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Containers on AWS
  • 7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Container Services Landscape MANAGEMENT Deployment, Scheduling, Scaling & Management of containerized applications HOSTING Where the containers run Amazon Elastic Container Service Amazon Elastic Container Service for Kubernetes Amazon EC2 AWS Fargate Higher Level Services Application Management Amazon Elastic Container Registry Compute Where the containers run Spot Instance GPU Instance
  • 8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Omar Lari, Container Services March 4th, 2019 Kubernetes on AWS Open source container management
  • 9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Agenda • Why containers? • What is Kubernetes? • Key concepts • Running Kubernetes on AWS • Demonstration
  • 10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Why containers? FizzBuzz!
  • 11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Application environment components Runtime Engine Code Dependencies Configuration
  • 12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Local Laptop Staging / QA Production On-Premises Different environments
  • 13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Local Laptop Staging / QA Production On-Prem It worked on my machine, why not in prod? v6.0.0 v7.0.0 v4.0.0 v7.0.0
  • 14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Containers to the rescue Runtime Engine Code Dependencies
  • 15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Docker Lightweight container virtualization platform. Tools to manage and deploy your applications. Licensed under the Apache 2.0 license. First released March 2013 Built by Docker, Inc.
  • 16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Docker Image Read only image that is used as a template to launch a container. Start from base images that have your dependencies, add your custom code. Docker file for easy, reproducible builds. bootfs kernel Base image Image Image W ritable Container add ngix add nodejs U buntu References parent image
  • 17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Local Laptop Staging / QA Production On-Prem Four environments, same container
  • 18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Container Implementation Server (Host) Hypervisor Guest OS Bins/Libs App 2 Guest OS Bins/Libs App 3 Guest OS Bins/Libs App 1 Server (Host) Hypervisor Guest OS App 2 Guest OS App 3 Guest OS App 1 Guest OS / Docker Engine Bins/Libs Bins/LibsBins/Libs Server (Host) Operating System (OS) Guest OS Guest OSGuest OS Libraries App 1, 2, 3 Bare Metal Virtual Machine Containers
  • 19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. But how do we make this work at scale?
  • 20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. We need to • start, stop, and monitor lots of containers running on lots of hosts • decide when and where to start or stop containers • control our hosts and monitor their status • manage rollouts of new code (containers) to our hosts • manage how traffic flows to containers and how requests are routed
  • 21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. aka ‘k8s’
  • 22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Container Services Landscape MANAGEMENT Deployment, Scheduling, Scaling & Management HOSTING Where the containers run Amazon EC2 IMAGE REGISTRY Container Image Repository
  • 23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Open source container management platform Helps you run containers at scale Gives you primitives for building modern applications What is Kubernetes?
  • 24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Containers on Hosts A host is a server – e.g. EC2 virtual machine. We run these hosts together as a cluster. Web App To start let’s run a 3 copies of our web app across our cluster of EC2 hosts. 3x Our simple example web application is already containerized.
  • 25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Run n containers We define a deployment and set the replicas to 3 for our container.
  • 26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Scale up! Need more containers? Update the replication set! The new containers are started on the cluster.
  • 27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Untimely termination Oh no! Our host has died! Kubernetes notices only 3 of the 5 containers are running and starts 2 additional containers on the remaining hosts.
  • 28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Containers IRL In production, we want to do more complex things like, • Run a service to route traffic to a set of running containers • Manage the deployment of containers to our cluster • Run multiple containers together and specify how they run
  • 29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Pods • Define how your containers should run • Allow you to run 1 to n containers together Containers in pods have • Shared IP space • Shared volumes • Shared scaling (you scale pods not individual containers) When containers are started on our cluster, they are always part of a pod. (even if it’s a pod of 1) Container A Container B
  • 30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Services One of the ways traffic gets to your pods. • Internal IP addresses are assigned to each pod • Services are connected to pods and use labels to reference which pod to route requests to containers. container containers containers
  • 31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Deployments Services work with deployments to manage updating or adding new pods. Let’s say we want to deploy a new version of our web app as a ‘canary’ and see how it handles traffic.
  • 32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Deployments The deployment creates a new replication set for our new pod version.
  • 33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Deployments Only after the new pod returns a healthy status to the service do we add more new pods and scale down the old.
  • 34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Running Kubernetes on AWS
  • 35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 51%of Kubernetes workloads run on AWS today — Cloud Native Computing Foundation
  • 36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Elastic Container Service for Kubernetes Managed K8s control plane — highly available API server and etcd nodes aws eks create-cluster --name <> --role-arn <> --resources-vpc-config <> ... Bring your own EC2 worker nodes Core tenets • Platform for enterprises to run production-grade workloads • Provides a native and upstream Kubernetes experience – Kubernetes certified • Seamless integration with AWS services • Actively contributes to the Kubernetes project APIs
  • 37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. eksctl – eks the easy way CLI to provision and managed your EKS cluster apiVersion: eksctl.io/v1alpha4 kind: ClusterConfig metadata: name: demo region: ap-northeast-2 version: '1.11’ nodeGroups: ... Quickly get started without worrying about VPC, IAM and Node design eksctl create cluster Or define a config file for more detailed configuration control eksctl create cluster –f config.yaml
  • 38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EKS Customers C r e a t e E K S c l u s t e r P r o v i s i o n w o r k e r n o d e s L a u n c h a d d - o n s L a u n c h w o r k l o a d s
  • 40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EKS – Kubernetes control plane C r e a t e c l u s t e r C r e a t e H A c o n t r o l p l a n e I A M i n t e g r a t i o n C e r t i f i c a t e m a n a g e m e n t S e t u p L B
  • 41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EC2 Worker Nodes EKS Control Plane Customer VPC EKS VPC Network Load Balancer ENI API Access Kubectl Exec/Logs TLS Static IPs ENI Attachment Autoscaling Group EKS Architecture
  • 42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Native VPC networking with CNI plugin Pods have the same VPC address inside the pod as on the VPC Simple, secure networking Open source and on GitHub …{ } https://github.com/aws/amazon-vpc-cni-k8s Container Networking Interface (CNI)
  • 43. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. VPC CNI plugin • Bridge between the K8s land – AWS VPC • AWS Routable IPs • Thin layer – no performance impact • Pod IP ENI secondary IP
  • 44. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 45. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS IAM Authenticator for Kubernetes • AWS native access management • Built in collaboration with Heptio • Kubectl and worker nodes • Works with Kubernetes Role-Based Authentication (RBAC)
  • 46. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. IAM roles for Kubectl
  • 47. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 48. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 49. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Tracing
  • 50. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 51. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CICD for Kubernetes Apps
  • 52. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CI/CD of apps on Kubernetes—choices
  • 53. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Jenkins
  • 54. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EKS Deployment Pipeline
  • 55. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Questions?
  • 56. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Start at https://eksworkshop.com