DevOps Summit 2016 - The immutable Journey
10 likes1,164 views
The document discusses immutable infrastructure, highlighting its benefits such as reducing errors and simplifying operations through Docker and Kubernetes. It covers the integration of configuration management tools like Packer and Chef with continuous deployment pipelines using Jenkins. Additionally, it addresses the challenges and phases of image creation for different application environments while emphasizing the efficiency of container orchestration in development processes.
DevOps Summit 2016 - The immutable Journey
- 1. The Immutable Journey Tom Tsai @ Startup
- 2. hello! I am Tom Tsai I am here because I want to give life to the servers Startup (DevOps) Trend Micro (QA, DevOps) DevOps Lecturer
- 3. “ Why Come To This Section ?
- 4. Outline What is Immutable Infrastructure? Configuration Management == Die Container Orchestration - Kubernetes Image CD Pipeline Build Up Q & A
- 6. Build A stack that you build once (be it a virtual machine image, container image, or something else), run one or many instances of, and never change again. Ref V0.0.1
- 7. Deploy The deployment model is to terminate the instance/container and start over from a new one Ref V0.0.2 V0.0.1
- 8. What is the Benefit Simplifying operations Continuous deployments, fewer failures Reduces errors and threats Ref
- 9. Yes ! Docker is Immutable Infrastructure Docker containers wrap a piece of software in a complete filesystem that contains everything needed to run: code, runtime, system tools, system libraries
- 10. Golden Image Is there a image to execute all kind of application ? Ruby Python C# PHP Javascript Perl R Java Groovy Clojure GoF# Pig
- 11. Image Layer How to prepare the image for all kind of application in alpha, beta, production phase using? OS Environment Application Change Seldomly Change Frequently
- 12. Dockerfile Is Dockerfile the only solution?
- 14. “Which Configuration Management Do You Use?
- 15. If the server is Immutable, Can We Throw away CM?
- 16. Dockerfile Easy to use, hard to maintain, extend configuration management should Be Die !? Configuration Management Steep Learning Curve, easy to maintain, extend
- 17. Using Cm to provision Image Packer is a tool for creating machine and container images for multiple platforms from a single source configuration.
- 18. Packer Template Builders: Base image Provisioners: Select prepare tool (e.g. Chef) Post-Processors: store image (e.g. dockerhub, aws ecr)
- 19. Image Layer Separate Image to two part, OS+Environment & Application OS Environment Application Change Seldomly Change Frequently
- 20. Chef X Docker X Packer 1. Push tag to trigger webhook 2. Execute Packer to provision image 3. Get Provision script from Chef 4. Push Image to dockerhub, image tag equal to git tag Ref
- 21. “ Different phase Images ? V0.0.1 alpha V0.0.1 beta V0.0.1 prod
- 22. All PhaSe Image Get $PHASE from environment variable. Get different phase configuration in one image. app/start.sh /binary /conf/alpha.yml /beta.yml /prod.yml Build Structure ln -s /app/conf/$PHASE.yml /app/conf/current.yml binary -conf /app/conf/current.yml start.sh
- 23. 3. Kubernetes
- 24. Without K8S ...
- 25. With K8S ...
- 26. K8S Infra
- 27. K8S Terminology Pod A group of one or more containers Replica Set Ensures that a specified number of pod “replicas” are running Deployment Provides declarative updates for Pods and Replica Sets Service a logical set of Pods and a policy by which to access them
- 28. K8S Deployment Create a Deployment to bring up a Replica Set and Pods. Update Deployment (e.g. rolling update Pods) Rollback to an earlier Deployment revision Pause and resume a Deployment.
- 29. COntainer Deployment K8S API 1. Create Deployment 2. Update Image ver. 3. Create Service 4. Of course, Testing
- 30. Setup K8S is so Hard Use it in google cloud engine will be easy
- 31. But I still Try in AWS By AWS CloudFormation Chef Don’t forgot to add tag KubernetesCluster in all aws resource AWS
- 33. “Have you ever heard Jenkins? How dare you ...
- 34. Not to mention DeployBuild Test CM X Docker X Packer Kubernetes Depends ...
- 35. Place your screenshot here Jenkins 2.0 Pipeline is Good Leverage Groovy DSL to achieve pipeline as code Loading Script Text from Version Control Retaining Global Libraries Everything is done, take a break ?!
- 36. More and More Job Using Jenkins Pipeline Plugin after one month, I feel there is still room for improvement...
- 37. insufficient Pipeline Job: Still need to maintain Manually Develop: Inside Jenkins website Groovy: Cannot include third-party library
- 38. Jenkins Job DSL Trigger Seed Job just like compile your General Jenkins job Seed Job Job A DSL Job B DSL Job A Pipeline Job B Pipeline
- 39. After Using ... Pipeline Job: Generate automatically Develop: everywhere Groovy: embed other language
- 40. demo
- 41. Jenkins Deployable Now ! /CM Script/ # do anything you want /dsl-repo/dsl/ # job dsl for generate jenkins job /pipeline/ # pipeline script for job dsl including /jobs/ # Jenkins Job generating by job dsl /workflow-libs/ #Pipeline Global Library Jenkins Build Structure (/var/lib/jenkins/...)
- 42. Script Security Script security plugin block groovy script, after enabling global security… (workaround)
- 43. Test Your Jenkins Job?