Continuous Integration: SaaS vs Jenkins in Cloud
9 likes12,082 views
The document compares on-premise Jenkins with SaaS CI tools like Travis and CircleCI, discussing pros and cons related to setup costs, ease of use, and flexibility. It emphasizes the cost-effectiveness of using AWS reserved instances for Jenkins deployment, alongside insights on containerization with Docker. Additionally, it touches on the evolution of container technology and highlights the benefits of Jenkins for continuous integration and delivery, particularly with its support for pipelines.
![Example Project
FROM ideato/trusty_php_CI:5.5
ENV DB default
RUN apt-get install -yq
npm
openjdk-7-jre
openjdk-7-jdk
nodejs
RUN wget https://download.elastic.co/elasticsearch/
elasticsearch/elasticsearch-1.7.3.deb
RUN dpkg -i elasticsearch-1.7.3.deb
ADD bin/run_tests /
ENTRYPOINT [“./bin/run_tests”]](https://image.slidesharecdn.com/idi2016-160401145547/85/Continuous-Integration-SaaS-vs-Jenkins-in-Cloud-62-320.jpg)
Continuous Integration: SaaS vs Jenkins in Cloud
- 1. Continuous Integration SaaS vs Jenkins in cloud
- 2. GLUTEN FREE Alessandro Mazzoli alendmazz am@ideato.it Who am I? sysadmin@ideato AWS solution architect
- 3. Why I should prefer on premise Jenkins vs SaaS like Travis or CircleCI?
- 5. Jenkins is a famous cross-platform, continuous integration and continuous delivery application
- 6. cross platform support SCM tools released under MIT license Java based (war file)
- 7. job execution monitoring reports, notifications rich of plugins(Docker, Github, Slack, Build Pipeline) hooks, triggers, conditionals
- 9. Let’s talk about $$$ 170 US$ 130 US$ Travis Startup AWS c4.xlarge costs estimated on demand c4.xlarge up for 24h/day
- 10. I have also to configure and maintain Jenkins…
- 17. AWS CLI + CRONJOBS
- 18. !/bin/bash EC2_ID=i-abcdefgh EIP=52.*.*.*. IAM=ideato_jenkins aws ec2 start-instances --instance-ids ${EC2_ID} profile ${IAM} aws ec2 associate-address --instance-id ${EC2_ID} --public-ip ${EIP} --profile ${IAM} exit 0 jenkins_on.sh
- 19. !/bin/bash EC2_ID=i-abcdefgh IAM=ideato_jenkins aws ec2 stop-instances --instance-ids ${EC2_ID} —profile ${IAM} exit 0 jenkins_off.sh
- 20. Let’s talk again about $$$ 54 US$ 130 US$ Travis Startup AWS c4.xlarge costs estimated on demand c4.xlarge up for 8h/day
- 21. Save more money?
- 22. Put your Jenkins on Reserved Instances
- 23. Reserved Instances capacity reservation for one or three years inside an AZ help AWS on capacity planning hourly billing rate lower
- 24. Reserved Instances switch AZ within the same region Change the instance size within the same instance type not just EC2 billing mechanism
- 25. Reserved Instances reservation cannot be refundable applied to a single instance types restricted inside a region
- 26. Reserved Instances all upfront 3y save up 70% all upfront 1y save up 30%
- 27. Let’s talk again about $$$ 34 US$ 130 US$ Travis Startup AWS c4.xlarge costs estimated on reserved 1y upfront c4.xlarge up for 8h/day
- 28. Ok but….
- 29. different stacks?! • OS (Debian vs RedHat) • PHP(5.x), Java, Python • Elasticsearch(0.9->1.7) • Mongo • MySQL,PostgreSQL
- 30. On Travis I just have to edit .travis.yaml
- 34. not suited for CI system one virtualenv active at once
- 35. Containers history 1979 - chroot unix syscall to change root directory of a process to a new location only visible by that process
- 36. Containers history 2007 - cgroups used for limiting, isolating and accounting defining CPU, RAM, I/O
- 37. Containers history 2008 - LXC first implementation of Linux containers with several features: cgroups, namespace, CAP, API bindings on Ruby,Python..
- 38. Containers history 2013 - Docker
- 41. was LXC
- 42. isolation
- 43. encapsulation
- 44. portability
- 45. was LXC now runc (Open Container Initiative)
- 50. AUFS Advanced Unification FileSystem Layered FS Copy on Write enable Docker Image layers
- 51. Docker Images read only layer used to be containers composed by layers
- 54. Our Docker Images FROM ubuntu:trusty RUN apt-get install -yq software-properties-common python-software-properties git vim wget curl
- 56. Our Docker Images FROM ideato/trusty ENV DEBIAN_FRONTEND noninteractive RUN add-apt-repository -y ppa:ondrej/php5 RUN apt-get install -yq --no-install-recommends php5 php5-cli php5-common php5-dev php5-gd php5-curl php5-mcrypt libapache2-mod-php5
- 58. Our Docker Images FROM ideato/trusty_php:5.5 RUN apt-get install -yq mysql-server-5.5 RUN wget https://phar.phpunit.de/ phpunit.phar RUN chmod +x phpunit.phar RUN mv phpunit.phar /usr/local/bin/phpunit
- 60. Workflow.. these Dockerfiles should be built on top of CI Images
- 62. Example Project FROM ideato/trusty_php_CI:5.5 ENV DB default RUN apt-get install -yq npm openjdk-7-jre openjdk-7-jdk nodejs RUN wget https://download.elastic.co/elasticsearch/ elasticsearch/elasticsearch-1.7.3.deb RUN dpkg -i elasticsearch-1.7.3.deb ADD bin/run_tests / ENTRYPOINT [“./bin/run_tests”]
- 63. Example Project #!/bin/bash cd /exampleproj/workspace service mysql start service elasticsearch start bin/idx build
- 65. Our Jenkins web hook docker build -q -t ideato:exampleproj -f Dockerfile .
- 66. Our Jenkins web hook docker build -q -t ideato:exampleproj - f Dockerfile . docker run --rm=true -v $WORKSPACE:/example_project -t ideato:exampleproj
- 67. Our Jenkins web hook docker build -q -t ideato:exampleproj - f Dockerfile . docker run --rm=true -v $WORKSPACE:/example_project -t ideato:exampleproj channel notification
- 68. Resuming…. 1 day for Jenkins setup ~ 280$ (one time cost) + AWS c4.xlarge 34$ x 12 ~ 600$ vs TravisCI Startup Plan 130€ x 12 = 1560$
- 69. oh wait… ~ 1/3 build time than Travis
- 70. in the next few months…
- 72. built in support for delivery pipelines
- 73. pipeline as code
- 74. Jenkinsfile!!!
- 80. try it ! docker pull jenkinsci/ jenkins:2.0-alpha-3
- 81. what else?
- 82. on dev we are using OSX + Vagrant + Ansible and no Docker atm
- 83. why?
- 84. Add more complexity to FE devs
- 85. customers won’t pay to migrate old projects
- 86. no native support until now…
- 88. no more VirtualBox, native hypervisor support Mac -> xhyve Windows -> HyperV
- 89. on Mac, Docker Engine will run inside a Alpine Linux on top of xhyve
- 91. on OSX….
- 92. volume mounting for code/data with auto update on file changes (GIT, Sublime,PhpStorm)
- 93. tools integrated inside Docker Toolbox Docker Engine, Docker Compose, Kitematic
- 94. Links JenkinsCI Jenkins 2.0 AWS Reserved Instances Docker Docker on OSX & Windows
- 95. Thanks!
- 96. Questions ??