Shakr - Container CI/CD with Google Cloud Platform
18 likes2,224 views
The document outlines a CI/CD pipeline using Google Cloud Platform with an emphasis on Docker and Travis CI for continuous integration. It details the process of building, testing, and deploying containerized applications to Google Container Registry and managing these on Google Compute Engine. Key concepts covered include image tagging, container orchestration, and infrastructure management using YAML configurations for pods and replication controllers.
![cloud-init.yml
#cloud-config
users:
- name: myservice
uid: 2000
write_files:
- path: /etc/systemd/system/myservice.service
permissions: 0644
owner: root
content: |
[Unit]
Description=Start a simple docker container
[Service]
ExecStartPre=/usr/share/google/dockercfg_update.sh
ExecStart=/usr/bin/docker run --rm -u 2000 --net=host --name=myservice -e RACK_ENV=production -p 80:80
gcr.io/project/myservice:latest
ExecStop=/usr/bin/docker stop myservice
ExecStopPost=/usr/bin/docker rm myservice
runcmd:
- systemctl daemon-reload
- systemctl enable myservice.service
- systemctl start myservice.service](https://image.slidesharecdn.com/googlecloud-201612-161214112612/85/Shakr-Container-CI-CD-with-Google-Cloud-Platform-57-320.jpg)
Shakr - Container CI/CD with Google Cloud Platform
- 1. Container CI/CD with Google Cloud Platform Minku Lee CTO, Shakr
- 8. GitHub DEVELOPMENT Travis CI CONTINUOUS INTEGRATION Container Registry IMAGE REGISTRY
- 9. GitHub DEVELOPMENT Travis CI CONTINUOUS INTEGRATION Container Registry IMAGE REGISTRY Compute Engine & Container Engine INFRASTRUCTURE
- 10. GitHub
- 12. Pull Request
- 13. Travis CI
- 14. Travis CI
- 15. Travis CI
- 16. .travis.yml sudo: required services: - docker before_script: - docker build -t videobox:$TRAVIS_BUILD_NUMBER . - docker images script: - docker run videobox:$TRAVIS_BUILD_NUMBER bundle exec rubocop - docker run videobox:$TRAVIS_BUILD_NUMBER bundle exec rspec - openssl aes-256-cbc -K $encrypt_key -iv $encrypt_iv -in service_account.json.enc -out service_account.json -d - docker login -e docker@sha.kr -u _json_key -p "$(cat service_account.json)" https://us.gcr.io - docker tag videobox:$TRAVIS_BUILD_NUMBER gcr.io/shakr/videobox:$TRAVIS_BUILD_NUMBER - docker push gcr.io/shakr/videobox:$TRAVIS_BUILD_NUMBER notifications: slack: "..."
- 18. Docker before_script: - docker build -t videobox:$TRAVIS_BUILD_NUMBER . - docker images
- 19. Dockerfile
- 20. Dockerfile
- 21. script: - docker run videobox:$TRAVIS_BUILD_NUMBER bundle exec rubocop - docker run videobox:$TRAVIS_BUILD_NUMBER bundle exec rspec
- 22. Container Registry - docker login -e docker@sha.kr -u _json_key -p "$(cat service_account.json)" https://us.gcr.io - docker tag videobox:$TRAVIS_BUILD_NUMBER gcr.io/shakr/videobox:$TRAVIS_BUILD_NUMBER - docker push gcr.io/shakr/videobox:$TRAVIS_BUILD_NUMBER https://cloud.google.com/container-registry/docs/advanced-authentication
- 25. Google Compute Engine 인스턴스에서
- 26. Google Compute Engine 인스턴스에서 US, EU, ASIA
- 27. Google Compute Engine 인스턴스에서 US, EU, ASIA Nearline GCS
- 28. gcloud CLI $ gcloud docker pull gcr.io/google_appengine/nodejs Using 'pull gcr.io/google_appengine/nodejs' for DOCKER_ARGS. Using default tag: latest latest: Pulling from google_appengine/nodejs a3ed95caeb02: Pull complete .. Digest: sha256:a7fcfb84b.. Status: Downloaded newer image for gcr.io/google_appengine/ nodejs:latest
- 29. gcloud CLI $ docker login -e docker@sha.kr -u _json_key -p "$(cat service_account.json)" https://us.gcr.io $ docker pull gcr.io/my_gcp_project/private_image:latest https://cloud.google.com/container-registry/docs/advanced-authentication
- 30. Cloud Console
- 32. Google Container Engine as a service
- 33. Google Container Engine Container Scheduling Auto-healing Service Discovery Config Management Load Balancing
- 34. pod.yaml apiVersion: v1 kind: Pod metadata: name: Videobox labels: name: videobox spec: containers: - name: videobox image: gcr.io/shakr/videobox:xxx imagePullPolicy: IfNotPresent env: - name: RACK_ENV value: production restartPolicy: Always dnsPolicy: default
- 35. rc.yaml apiVersion: v1 kind: ReplicationController metadata: name: videobox spec: replicas: 3 selector: app: videobox template: metadata: name: videobox labels: app: videobox spec: # Pod spec here...
- 38. Pods Nodes Replication Controllers Persistent Volumes Stateful Sets (Pet Set) Cron Jobs Secrets Services Volumes Replica Sets
- 39. Pods Nodes Replication Controllers Persistent Volumes Stateful Sets (Pet Set) Cron Jobs Secrets Services Volumes Replica Sets
- 43. Pod gcr.io/shakr/videobox:1 Pod gcr.io/shakr/videobox:1 Pod gcr.io/shakr/videobox:1 ReplicationController videobox replicas=3 replica scale-up/ scale-down k8s worker worker
- 48. (Infrastructure as Code) Git On-Premise PaaS PaaS master/worker
- 49. Preemptible VM PVM Node Pool (Beta)
- 50. Preemptible VM PVM Node Pool (Beta) Cluster Autoscaler (Beta)
- 51. Preemptible VM PVM Node Pool (Beta) Cluster Autoscaler (Beta) (>50GB per pod) Local SSD를 Pod
- 52. Google Compute Engine with containers!
- 54. Chromium OS Verified Boot Active-passive systemd cloud-init Google Container-Optimized OS (BETA)
- 55. gcloud CLI $ gcloud compute instances create gci-instance-test --image-project google-containers --image-family gci-stable --zone asia-northeast1-a --machine-type n1-standard-1
- 56. cloud-init $ gcloud compute instances create gci-instance-test --image-project google-containers --image-family gci-stable --zone asia-northeast1-a --machine-type n1-standard-1 --metadata-from-file user-data=cloud-init.yml
- 57. cloud-init.yml #cloud-config users: - name: myservice uid: 2000 write_files: - path: /etc/systemd/system/myservice.service permissions: 0644 owner: root content: | [Unit] Description=Start a simple docker container [Service] ExecStartPre=/usr/share/google/dockercfg_update.sh ExecStart=/usr/bin/docker run --rm -u 2000 --net=host --name=myservice -e RACK_ENV=production -p 80:80 gcr.io/project/myservice:latest ExecStop=/usr/bin/docker stop myservice ExecStopPost=/usr/bin/docker rm myservice runcmd: - systemctl daemon-reload - systemctl enable myservice.service - systemctl start myservice.service
- 58. systemd
- 59. VM Preemptible VM, Regional Managed Instance Group 등 Kubernetes
- 60. GitHub DEVELOPMENT Travis CI CONTINUOUS INTEGRATION Container Registry IMAGE REGISTRY Compute Engine & Container Engine INFRASTRUCTURE
- 61. Google Cloud Platform 가장 앞선 컨테이너 기술을 빠르고 쉽게 적용 가능한 플랫폼
- 62. Thank you We're looking for talented engineers! Minku Lee minku@sha.kr