【IVS CTO Night & Day】Amazon Container Services
0 likes2,914 views
- Amazon EKS and AWS Fargate were highlighted as two services for running containers on AWS. - Amazon EKS allows users to easily run Kubernetes on AWS and manages the control plane, while AWS Fargate allows running containers without managing servers. - AWS Fargate launches containers without needing to provision or manage servers, providing a simpler experience for developing and operating containerized applications.
![© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
TASK DEFINITION
{
"family": “scorekeep",
"containerDefinitions": [
{
"name":“scorekeep-frontend",
"image":"xxx.dkr.ecr.us-east-1.amazonaws.com/fe"
},
{
"name":“scorekeep-api",
"image":"xxx.dkr.ecr.us-east-1.amazonaws.com/api"
}
]
}
Immutable, versioned document
Identified by family:version
Contains a list of up to 10 container definitions
All containers are co-located on the same host
Each container definition has:
• A name
• Image URL (Amazon ECR or Public Images)
• And more…stay tuned!
Task Definition Snippet](https://image.slidesharecdn.com/ctonightamazoncontainerservices-171220085908/85/IVS-CTO-Night-Day-Amazon-Container-Services-51-320.jpg)
![© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
PRICING DIMENSIONS
{
”cpu": “1 vCPU”,
”memory": “2 gb”,
"networkMode": ”AWSVPC",
"compatibilities": [”FARGATE", ”EC2"],
"placementConstraints": [],
"containerDefinitions": [
{
<snip>…....
Task level resources
• Configurable independently (within a range)
Dimensions: Task level CPU and memory
Per-second billing
Task
Level
Resources](https://image.slidesharecdn.com/ctonightamazoncontainerservices-171220085908/85/IVS-CTO-Night-Day-Amazon-Container-Services-64-320.jpg)
【IVS CTO Night & Day】Amazon Container Services
- 3. StartupのCTOが⾔いたい事を⾔いまくってる感… • "We learned along the way, but it was painful because in our minds, marketing is marketing. Iʼm an engineer; marketing is all that stuff that I donʼt want to do.” • "I really, really, really did not want to be sending that email saying, “Thanks for an awesome ride; you got a week to vacate the premises.” I hate those emails." Docker
- 4. Lightning Talks at PyCon 2013 § Dockerをオープンソース化する前に何百⼈の前でリーク！ https://www.youtube.com/watch?v=wW9CAH9nSLs オフィスの外で初めて⼈に⾒せるよ的なこと話しながら 今となっては皆さまお馴染みの『 docker run 』 Docker
- 5. The future of Linux Containers at PyCon 2013 § dotCloudのUnder the Hoodを⾒せてやるぜ！ § ⽴ち⾒が出るほど満員(男だらけ)の会場を完全にロック https://www.youtube.com/watch?v=wW9CAH9nSLs Docker
- 6. The future of Linux Containers at PyCon 2013 § ⾃信満々なプレゼンの中でのタイポとか臨場感あってグッとくる https://www.youtube.com/watch?v=wW9CAH9nSLs Docker
- 8. Amazon Container Services Amazon Elastic Container Service (Amazon ECS) • フルマネージドなコンテナオーケストレーションサービス • コンテナ化されたアプリケーションを AWS に簡単にデプロイ、管理、およびスケール • AWSの各種機能とシームレスに連携 Amazon Elastic Container Service for Kubernetes (Amazon EKS) • Kubernetes を AWS 上で簡単に実⾏できるようにするマネージド型サービス • 各クラスターの Kubernetes コントロールプレーンの可⽤性とスケーラビリティを管理 Amazon Elastic Container Registry (Amazon ECR) • マネージド型の Docker コンテナレジストリ AWS Fargate • 基盤となるインフラストラクチャを管理せずに、コンテナをデプロイおよび管理できる テクノロジー • EC2のプロビジョニング、構成、およびスケールの管理が不要に • 開発者はアプリケーションの設計と実⾏に専念することが可能 https://aws.amazon.com/jp/containers/
- 9. Amazon Container Services Amazon Elastic Container Service (Amazon ECS) • フルマネージドなコンテナオーケストレーションサービス • コンテナ化されたアプリケーションを AWS に簡単にデプロイ、管理、およびスケール • AWSの各種機能とシームレスに連携 Amazon Elastic Container Service for Kubernetes (Amazon EKS) • Kubernetes を AWS 上で簡単に実⾏できるようにするマネージド型サービス • 各クラスターの Kubernetes コントロールプレーンの可⽤性とスケーラビリティを管理 Amazon Elastic Container Registry (Amazon ECR) • マネージド型の Docker コンテナレジストリ AWS Fargate • 基盤となるインフラストラクチャを管理せずに、コンテナをデプロイおよび管理できる テクノロジー • EC2のプロビジョニング、構成、およびスケールの管理が不要に • 開発者はアプリケーションの設計と実⾏に専念することが可能 https://aws.amazon.com/jp/containers/ 今回は - Amazon EKS - AWS Fargate をピックアップします!
- 10. Kubernetes k8s
- 11. Docker and Kubernetes Docker platform is integrating support for Kubernetes https://blog.docker.com/2017/10/kubernetes-docker-platform-and-moby-project/ http://www.publickey1.jp/blog/17/dockerkubernetesdockercon_eu_2017.html
- 12. Kubernetes What is Kubernetes? • 新しい技術であるがAWSユーザーにも急速に広まっている • 12-factor appパターンに準拠したアプリケーションの開発を可能にする オープンソースのコンテナ 管理プラットフォーム コンテナのスケール管理を 容易に モダンなアプリケーション の構築の⼿助けに
- 13. Kubernetes Why Developers Love Kubernetes? • ⾮常に活発なユーザーコミュニティ！ • Github上で最も⼈気のあるオープンソースプロジェクトの⼀つ • 〜390K comments, Almost 30K starts, almost 60K commits, 1500 contributors!
- 14. Kubernetes Why Developers Love Kubernetes? • Run Anywhere • オンプレミスでレガシーなアプリケーションをコンテナ化するもよし、クラウドネイティブな アプリケーションをデプロイするもよし、どこでも同じオーケストレーションフレームワーク を活⽤可能 O N - P R E M I S E S C L O U D
- 15. Kubernetes Why Developers Love Kubernetes? • A single extensible API • 拡張可能なAPIは抽象化を⾏うことでAWSおよびオンプレミスのどちらでも同⼀のAPIでの操 作を可能に • KubernetesをAWSで稼働させることによりスケール、パフォーマンス、そしてKubernetes のクラウドインテグレーションを通じて様々なAWSの機能を使いこなすことが可能に S C A L E P E R F O R M A N C E B R E A DT H
- 16. Kubernetes 63%のKubernetesのワークロードがAWSで稼働している • By Cloud Native Computing Foundation (CNDF) 63% of Kubernetes workloads run on AWS today ̶CNCF survey
- 17. CNCF Cloud Native Computing Foundation https://www.cncf.io/announcement/2017/08/09/amazon-web-services-joins-cloud-native-computing-foundation-platinum-member/
- 18. CNCF Cloud Native Computing Foundation https://www.cncf.io/announcement/2017/08/09/amazon-web-services-joins-cloud-native-computing-foundation-platinum-member/ Adrian Cockcroft, Vice President of Cloud Architecture Strategy at AWS, will join CNCFʼs Governing Board
- 19. KubeCon + CloudNativeCon North America 2017 Keynote: Cloud Native at AWS • Adrian Cockcroft, VP Cloud Architecture Strategy, Amazon Web Services
- 20. 先⽇来⽇しました Adrian Cockcroft, VP Cloud Architecture Strategy, AWS
- 22. Kubernetes on AWS Kubernetes • 3x Kubernetes Masters for HA • 3つの異なるAZにmasterを配置することで可⽤性の⾼いcontrol planeの実現
- 23. Kubernetes on AWS Kubernetes master • KubeDNSのようなadd-onやダッシュボードも利⽤可能 API server Cloud controller Controller manager Scheduler Add-onsKubeDNS
- 24. Kubernetes on AWS Architecture • Masterに加えてKubernetesのPersistence Layerであるetcdを稼働させる必要がある • Etcdは分散KeyValue Store。オプションとしてmasterとetcdを同じインスタンスに配置して も良い – 但し、クラスタのアップグレードの際に⾜かせになってしまうこともありえるのでトレードオフ – ⾃⾝でKubernetesのインフラを構築しようとするとハマりがちなことの⼀つ Availability Zone 1 Etcd Master Etcd Master Etcd Master Availability Zone 2 Availability Zone 3
- 25. Kubernetes on AWS Architecture • 構築したアプリケーションが動作するworker nodes • AutoScaling Groupにデプロイされることも多い Availability Zone 1 Etcd Master Etcd Master Availability Zone 2 Availability Zone 3 Etcd Master
- 26. Kubernetes on AWS KOPS to build a K8s Cluster on AWS 1 . I n s t a l l B i n a r i e s & To o l s : k o p s , AW S C L I t o o l s , k u b e c t l 2 . S e t I A M U s e r t o “ k o p s ” 3 . A l l o w “ k o p s ” u s e r F u l l a c c e s s t o E C 2 , Ro u t e 5 3 , S 3 , I A M , V P C 4 . C o n f i g u r e AW S c l i e n t t o n e w I A M u s e r “ k o p s ” 5 . C o n f i g u r e D N S ( o r ) D e p l o y a g o s s i p - b a s e d c l u s t e r : • We h o s t e d t h e s u b d o m a i n “d n i s h i . k 8 s d e m o l a b s . c o m” i n Ro u t e 5 3 6 . C r e a t e a S 3 b u c k e t t o s a v e c l u s t e r c o n f i g : “d n i s h i - k o p s - s t o r e ” 7 . S e t t h e “ k o p s e n v i r o n m e n t a l va r i a b l e s ” 8 . C r e a t e c l u s t e r : ” k o p s c r e a t e c l u s t e r ” a n d “ k o p s va l i d a t e c l u s t e r ”
- 27. Kubernetes on AWS “Native AWS Integrations.” ”An Open Source Kubernetes Experience.”
- 28. E L A S T I C C O N TA I N E R S E RV I C E F O R K U B E R N E T E S (EKS)
- 29. Amazon EKS Tenets 1. EKS is a platform for enterprises to run production-grade workloads 2. EKS provides a native and upstream Kubernetes experience Allow “kops” user Full access to EC2, Route53, S3, IAM, VPC 3. If EKS customers want to use additional AWS services, the integrations are seamless and eliminate undifferentiated heavy lifting 4. EKS team actively contributes to the Kubernetes project 5. Create a S3 bucket to save cluster config: “dnishi-kops-store” 6. Set the “kops environmental variables” 7. Create cluster: ”kops create cluster” and “kops validate cluster”
- 30. Kubernetes on AWS おさらい Availability Zone 1 Etcd Master Etcd Master Availability Zone 2 Availability Zone 3 Etcd Master
- 31. Amazon EKS mycluster.eks.amazonaws.com Availability Zone 1 Availability Zone 2 Availability Zone 3 Kubectl
- 32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. APIAPIAPIAPI EKS
- 33. Amazon EKS commands • aws eks create-cluster –cluster-name reinvent2017 –desired-master-version 1.7.1 – role-arn arn:aws:iam::account-id:role/role-name • aws eks describe-cluster –cluster-name reinvent2017 • aws eks list-clusters • aws eks delete-cluster –cluster-name reinvent2017
- 35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. INTRODUCING FARGATE!
- 36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CHANGING COMPUTE CONSUMPTION MODEL No instances to manage Task native API Resource based pricing Simple, easy to use, powerful – and new consumption model =
- 37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. PRODUCTION WORKLOADS ON AWS AWS VPC networking mode Advanced task placement Deep integration with AWS services ECS CLI…{ } Global footprint (in 2018) Powerful scheduling engines Auto scaling CloudWatch metrics Load balancers
- 38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EKS SUPPORT FOR FARGATE IN 2018
- 39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. FARGATE: UNDER THE HOOD
- 40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. MICROSERVICES
- 41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. BATCH JOBS
- 42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. MIGRATION TO THE CLOUD
- 43. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. HOW DO I RUN CONTAINERS ON FARGATE?
- 44. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RUNNING CONTAINER
- 45. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EC2 Instance TaskTask Task Task EC2 Instance TaskTask Task Task EC2 Instance TaskTask Task Task EC2 Instance TaskTask Task Task EC2 Instance TaskTask Task Task RUNNING CONTAINERS
- 46. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Scheduling and Orchestration Cluster Manager Placement Engine RUNNING CONTAINERS AT SCALE WITH ECS Availability Zone #1 Availability Zone #2 Availability Zone #3
- 47. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ECS AMI Docker agent ECS agent ECSTaskECSTask ECSTaskECSTask EC2 Instance
- 48. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Scheduling and Orchestration Cluster Manager Placement Engine ECS AMI Docker agent ECS agent EC2 Instance ECS AMI Docker agent ECS agent EC2 Instance ECS AMI Docker agent ECS agent EC2 Instance
- 49. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RUNNING FARGATE CONTAINERS WITH ECS
- 50. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Define application containers: Image URL, CPU & Memory requirements, etc. register Task Definition create Cluster • Infrastructure Isolation boundary • IAM Permissions boundary run Task • A running instantiation of a task definition • Use FARGATE launch type create Service Elastic Load Balancer • Maintain n running copies • Integrated with ELB • Unhealthy tasks automatically replaced ECS CONSTRUCTS
- 51. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. TASK DEFINITION { "family": “scorekeep", "containerDefinitions": [ { "name":“scorekeep-frontend", "image":"xxx.dkr.ecr.us-east-1.amazonaws.com/fe" }, { "name":“scorekeep-api", "image":"xxx.dkr.ecr.us-east-1.amazonaws.com/api" } ] } Immutable, versioned document Identified by family:version Contains a list of up to 10 container definitions All containers are co-located on the same host Each container definition has: • A name • Image URL (Amazon ECR or Public Images) • And more…stay tuned! Task Definition Snippet
- 52. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RUNNING FARGATE CONTAINERS WITH ECS Use ECS APIs to launch Fargate Containers Easy migration – Run Fargate and EC2 launch type tasks in the same cluster Same Task Definition schema
- 53. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. NETWORKING
- 54. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. VPC INTEGRATION 172.31.0.0/16 Subnet 172.31.1.0/24 Internet Other Entities in VPC EC2 LB DB etc. Private IP 172.31.1.164 • AWS VPC Networking Mode – each task gets its own interface • All Fargate Tasks run in customer VPC and subnets • Configure security groups to control inbound & outbound traffic • Public IP support • Spread your application across subnets in multiple Availability Zones (AZs) for resiliency us-east-1a us-east-1b us-east-1c ENI Fargate TaskPublic / 208.57.73.13 /
- 55. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. LOAD BALANCING APPLICATION LOAD BALANCER NETWORK LOAD BALANCER
- 56. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SECURITY
- 57. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CLUSTER LEVEL ISOLATION PROD Cluster Infrastructure DEV Cluster Infrastructure BETA Cluster Infrastructure QA Cluster Infrastructure Web Web Shopping Cart Shopping Cart Notifications NotificationsWeb Shopping Cart NotificationsWeb Shopping Cart Shopping Cart Notifications NotificationsWeb Web PROD CLUSTER BETA CLUSTER DEV CLUSTER QA CLUSTER
- 58. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. PERMISSION TIERS Cluster Permissions Application Permissions Task Housekeeping Permissions Cluster Fargate Task Cluster Permissions: Who can run/see tasks in the cluster? Application (Task) Permissions: Which of my AWS resources can this application access? Housekeeping Permissions: What permissions do I want to grant ECS to perform? e.g. • ECR Image Pull • CloudWatch Logs pushing • ENI creation • Register/Deregister targets into ELB
- 59. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CONTAINER REGISTRIES
- 60. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. REGISTRY SUPPORT 3rd Party Private Repositories (coming soon!) Public Repositories supported Amazon Elastic Container Registry (ECR)
- 61. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. VISIBILITY AND MONITORING Service-level metrics available CloudWatch Logs CloudWatch Events supported
- 62. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. STORAGE Container Storage Space – 10GB Ephemeral storage backed by EBS Shared volume space for containers within the task – 4GB
- 63. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CONFIGURATIONS & PRICING
- 64. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. PRICING DIMENSIONS { ”cpu": “1 vCPU”, ”memory": “2 gb”, "networkMode": ”AWSVPC", "compatibilities": [”FARGATE", ”EC2"], "placementConstraints": [], "containerDefinitions": [ { <snip>….... Task level resources • Configurable independently (within a range) Dimensions: Task level CPU and memory Per-second billing Task Level Resources
- 65. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. TASK CPU & MEMORY CONFIGURATIONS Flexible configuration options – 50 CPU/memory configurations CPU Memory 256 (.25 vCPU) 512MB*, 1GB, 2GB 512 (.5 vCPU) 1GB to 4GB (1GB increments) 1024 (1 vCPU) 2GB to 8GB (1GB increments) 2048 (2 vCPU) 4GB to 16GB (1GB increments) 4096 (4 vCPU) 8GB to 30GB (1GB increments)
- 67. AWS re:Invent 2017 Fargate関連セッション CON333 – Deep Dive into AWS Fargate CON201 – Containers on AWS – State of the Union CON404 – Deep Dive into Container Scheduling with Amazon ECS CON401 – Container Networking Deep Dive with Amazon ECS CON402 – Advanced Patterns in Microservices Implementation with Amazon ECS
- 68. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. DAY ONE!
- 70. C4 R3 M4R3 R3 R3 R3 R3 M4 M4 M4 M4 M4 C4 C4 C4 C4 C4 Map Service Search Service Directions Service https://www.youtube.com/watch?v=UR8BI2Exkbc
- 71. C4 ECS Cluster R3 M4R3 R3 R3 R3 R3 M4 M4 M4 M4 M4 C4 C4 C4 C4 C4 Map Service Search ServiceDirections Service https://www.youtube.com/watch?v=UR8BI2Exkbc
- 73. インスタンスを多 様化して使うこと でSpotの安定性 を獲得 C4 ECS Cluster R3 R3 R3 R3 R3 R3 M4 M4 M4 M4 M4 M4 C4 C4 C4 C4 C4 Map Service Search ServiceDirections Service Spot Fleet C4 C4 R3 R3 https://www.youtube.com/watch?v=UR8BI2Exkbc
- 74. 25% より少ないインスタンス数 80-90% EC2の毎⽉のコスト削減 https://www.youtube.com/watch?v=UR8BI2Exkbc