Jenkins multibranch pipeline workshop sep 2018
- 2. SoftServe Confidential Oleksandr Metelytsia ometel@softserveinc.com metelitsa.alexandr@gmail.com Yermek Kadyrbayev ykad@softserveinc.com kadyrbayev.yermek@gmail.com
- 3. SoftServe Confidential Content ● CI ● Git branching ● Shift left ● Docker ● Workshop
- 4. SoftServe Confidential What is this?
- 8. Why?
- 12. SoftServe Confidential Jenkins Blue Ocean
- 15. Docker 101 docker build docker run docker login docker pull docker images docker ps docker exec docker network Dockerfile Image vs container What is docker registry?
- 18. SoftServe Confidential WiFi: SS-GUEST Password: Welcome!
- 19. SoftServe Confidential https://goo.gl/D5Ee3B Link to presentation
- 20. SoftServe Confidential Do not forget to switch to Linux Containers For Windows 10
- 21. SoftServe Confidential Start from pulling The very first command, but it may take some time so do it right now: $ mkdir workshop $ cd workshop $ pwd $ docker login https://registry-1.docker.io $ docker pull jenkinsci/blueocean * if have unauthorised error, run following command: Create working dir and cd to it:
- 22. SoftServe Confidential Start Jenkins container $ docker run --rm -u root -p 8080:8080 -v jenkins-data:/var/jenkins_home -v /var/run/docker.sock:/var/run/docker.sock jenkinsci/blueocean From “docker run --help”: -v, --volume list Bind mount a volume * For Win10 use ^ instead of
- 23. SoftServe Confidential Setup Wizard 1. Go to http://localhost:8080 2. Unlock Jenkins with password which is in terminal between two sets of asterisks 3. Click “Install suggested plugins” 4. Create First Admin User 5. Save and Finish 6. Start using Jenkins
- 24. SoftServe Confidential Stop and restart Jenkins (if needed) If something went “terribly wrong”: 1. Stop Jenkins by Ctrl+C in terminal 2. Run the same “docker run …” command to restart 3. Wait till login page 4. Login back If you want to debug container: 1. Add flag “--name jenkins-workshop” to “docker run …” command 2. In separate terminal window run: $ docker exec -it jenkins-workshop bash
- 26. SoftServe Confidential Fork repo with tests
- 27. SoftServe Confidential Clone forked repo $ git clone https://YOUR_BITBUCKET_USERNAME @bitbucket.org/YOUR_BITBUCKET_USERNAME /multibranch-pipeline-project.git
- 28. SoftServe Confidential Create and push branches: dev and prod $ cd multibranch-pipeline-project $ git branch dev $ git branch prod $ git branch dev * master prod $ git push origin -u dev:dev $ git push origin -u prod:prod
- 29. SoftServe Confidential Create pipeline project in BlueOcean 1. Browse to http://localhost:8080/blue and log in or browse to http://localhost:8080, login and click Open Blue Ocean on the left 2. Click on “Create a new Pipeline” 3. Where do you store your code: “Bitbucket Cloud” 4. Connect to bitbucket with your own bitbucket credentials and fork of the repo
- 30. SoftServe Confidential Setup Scan Trigger Open pipeline settings by clicking on Gear button and setup: f
- 31. SoftServe Confidential Let’s take a look on Jenkinsfile stub $ cat Jenkinsfile pipeline { agent any stages { stage('Build') { steps { sh 'echo "Hello world!"' } } } }
- 33. SoftServe Confidential Finally branching... Now we want to start CI development on a branch. $ git checkout dev Add new stage to Jenkinsfile which will build web docker container: $ cat Jenkinsfile pipeline { agent none stages { stage('Build web') { agent { dockerfile { additionalBuildArgs '-t web' } } steps { sh 'echo web built' } } } }
- 34. SoftServe Confidential View new stage on Jenkins UI $ git commit -a -m "Add build web stage" $ git push origin dev
- 35. SoftServe Confidential Next stage: build test env container Add to Jenkins file stage to build container with selenium, firefox, etc. stage('Build Test Env') { agent { dockerfile { dir 'tests' additionalBuildArgs '-t test_env' } } steps { sh 'echo test env container was built' } }
- 36. SoftServe Confidential Back to Jenkins UI $ git commit -a -m "Add build test env stage" $ git push origin dev
- 37. SoftServe Confidential “General” stage: e.g. Create network We can run any kind of bash scripts or commands. Let’s run ‘create_network.sh’. stage('Create network') { agent any steps { sh 'sh ./create_network.sh' } } $ cat create_network.sh #!/usr/bin/env sh if docker network ls | grep net; then echo "Network with net name was found. Skipping network creation." else docker network create net fi Add new stage to Jenkinsfile:
- 38. SoftServe Confidential Jenkins UI $ git commit -a -m "Add create network stage" $ git push origin dev
- 39. SoftServe Confidential Run Application locally $ docker network ls | grep net > /dev/null || docker network create net $ docker run --rm --network net -p 6379:6379 --name redis -d redis $ docker run --rm --network net -p 80:80 --name web -d web $ curl 127.0.0.1:80 <h3>Hello World!</h3><b>Visits:</b><b id='visits'>1</b><br/> Go to in browser http://localhost:80 * for Win10 just run: $ docker network create net
- 40. SoftServe Confidential Run tests locally $ docker ps CONTAINER ID IMAGE COMMAND NAMES 572c2c78327f web "python app.py" web c5fa2dbd7e05 redis "docker-entrypoint.s…" redis 3f8df588fc5e jenkinsci/blueocean "/sbin/tini -- /usr/…" blissful_nightingale $ docker run --network net test_env test_app (test.SeleniumTest) ... ok ---------------------------------------------------------------------- Ran 1 test in 2.734s OK $ docker kill web redis
- 41. SoftServe Confidential Finally Test stage (yey) stage('Test') { agent any steps { sh 'docker run --rm --network net -p 6379:6379 --name redis -d redis' sh 'echo Redis started!' sh 'docker run --rm --network net -p 80:80 --name web -d web' sh 'echo Web started!' sh 'docker run --network net test_env' } post { always { sh 'docker kill web 2>/dev/null || true' sh 'docker kill redis 2>/dev/null || true' } } }
- 42. SoftServe Confidential Jenkins UI $ git commit -a -m "Add create Test stage" $ git push origin dev
- 43. SoftServe Confidential ‘bad feature’ development $ git checkout -b bad_feature Edit app.py: change “Hello World!” to “Goodbye World!”. $ git commit -a -m "New cool feature done" $ git push origin bad_feature Create pull request from bad_feature branch to dev branch. Make sure you are doing PR against your Fork repo and not AlexMetelitsa repo.
- 45. SoftServe Confidential See broken tests before PR merge
- 46. SoftServe Confidential Add deploy to Dev and to Prod stages $ git checkout dev Add deploy stages: stage('Deploy for Dev') { agent any when { branch 'dev' } steps { sh 'echo Deploying to dev...' sh 'echo Deployed to Dev!' } } stage('Deploy for Prod') { agent any when { branch 'prod' } steps { input message: 'Click proceed to continue' sh 'echo Deploying to Prod...' sh 'echo Deployed to Prod!' } }
- 47. SoftServe Confidential View new stages on Jenkins UI $ git commit -a -m "Add build web stage" $ git push
- 48. SoftServe Confidential Create PR and merge to prod Create PR dev to prod and merge it: