Introduction to Concourse CI #渋谷Java
3 likes3,865 views
This document introduces Concourse CI, an open source continuous integration and delivery tool. It provides an overview of Concourse and compares it to Jenkins. It describes Concourse's architecture including tasks, resources, jobs and pipelines. It then explains how to install Concourse using Vagrant, executable binaries or BOSH. Finally it provides examples of simple "hello world" and more advanced Java project and Cloud Foundry deployment pipelines.
![Simple!
jobs:
-‐‑‒ name: hello
plan:
-‐‑‒ task: say-‐‑‒hello
config:
platform: linux
image_̲resource:
type: docker-‐‑‒image
source:
repository: alpine
run:
path: echo
args: ["Hello, world!"]](https://image.slidesharecdn.com/introduction-to-concourseci-160423053037/85/Introduction-to-Concourse-CI-Java-15-320.jpg)
![Hello Pipeline
jobs:
-‐‑‒ name: hello
plan:
-‐‑‒ task: say-‐‑‒hello
config:
platform: linux
image_̲resource:
type: docker-‐‑‒image
source:
repository: alpine
run:
path: echo
args: ["Hello, world!"]
pipeline.yml
Script
Task
Job](https://image.slidesharecdn.com/introduction-to-concourseci-160423053037/85/Introduction-to-Concourse-CI-Java-32-320.jpg)
![-‐‑‒ name: deploy-‐‑‒to-‐‑‒cf
serial: true
plan:
-‐‑‒ get: source-‐‑‒repo
trigger: true
passed: [ unit-‐‑‒test ]
-‐‑‒ task: unit
config:
platform: linux
image_̲resource:
type: docker-‐‑‒image
source: {repository: java, tag: 8-‐‑‒alpine}
inputs:
-‐‑‒ name: source-‐‑‒repo
outputs:
-‐‑‒ name: output
run:
path: sh
args:
-‐‑‒ -‐‑‒c
-‐‑‒ |
cd source-‐‑‒repo
./mvnw package -‐‑‒Dmaven.test.skip=true
cp target/*.jar ../output/demo.jar
-‐‑‒ put: cf
params:
manifest: source-‐‑‒repo/manifest.yml
path: output/demo.jar
current_̲app_̲name: concourse-‐‑‒ci-‐‑‒demo
Output = Deploy to Cloud Foundry
-‐‑‒ name: cf
type: cf
source:
api: {{cf-‐‑‒api}}
username: {{cf-‐‑‒username}}
password: {{cf-‐‑‒password}}
organization: {{cf-‐‑‒org}}
space: {{cf-‐‑‒space}}
skip_̲cert_̲check: true](https://image.slidesharecdn.com/introduction-to-concourseci-160423053037/85/Introduction-to-Concourse-CI-Java-39-320.jpg)
Introduction to Concourse CI #渋谷Java
- 1. Introduction to Concourse CI Toshiaki Maki (@making) Sr. Solutions Architect @Pivotal 2016-‐‑‒04-‐‑‒23 渋⾕谷Java
- 2. Agenda •Concourse CI? •Concourse vs. •Architecture •Three Concepts •How to Install •Pipeline Examples
- 9. Concourse CI •Concourse is originally made for Pivotal Cloud Foundry •But itʼ’s independent from PCF can be use outside of PCF too. •Written in Golang
- 11. Concourse VS • https://concourse.ci/concourse-‐‑‒vs.html pipelines s a first class citizen YAML Isolated Nice UI
- 12. Jenkins as a Deployment Pipeline
- 14. Architecture (Worker) Worker • Independent • Stateless • Multi-‐‑‒platform • Scale • Isolated
- 15. Simple! jobs: -‐‑‒ name: hello plan: -‐‑‒ task: say-‐‑‒hello config: platform: linux image_̲resource: type: docker-‐‑‒image source: repository: alpine run: path: echo args: ["Hello, world!"]
- 17. Pipeline
- 18. Resources
- 19. Resources • Resource used by the jobs in your pipeline • For example: • Git repository • Docker image • S3 • Pivotal Tracker • Semver • Cloud Foundry etc… • As well as input that output .. • You can create your own resource… • Slack • GitHub Pull Request...
- 20. Jobs
- 21. Jobs •Actions to be done in your pipeline •Compose by resource and task together to DO SOMETHING •Basically: • What I need to do ? ===> Task • What I need to use ? ===> Resource • What I need to produce ? ===> Resource
- 22. Tasks •Basically run script inside container. •Stateless no hell dependencies
- 23. How to Install •Vagrant Image •Executable Binaries •BOSH Release https://concourse.ci/installing.html Easy Hard Production Ready Local Dev
- 24. Vagrant $ vagrant init concourse/lite $ vagrant up
- 25. Vagrant
- 26. BOSH $ bosh-‐‑‒init deploy bosh.yml $ bosh target <Director's IP> $ bosh upload stemcell https://d26ekeud912fhb.cloudfront.net/bosh-‐‑‒stemcell/aws/light-‐‑‒bosh-‐‑‒stemcell-‐‑‒3215.4-‐‑‒aws-‐‑‒ xen-‐‑‒hvm-‐‑‒ubuntu-‐‑‒trusty-‐‑‒go_̲agent.tgz $ bosh upload release https://bosh.io/d/github.com/concourse/concourse?v=1.1.0 $ bosh upload release https://bosh.io/d/github.com/cloudfoundry-‐‑‒incubator/garden-‐‑‒linux-‐‑‒release?v=0.337.0 $ bosh update cloud-‐‑‒config cloud.yml $ bosh deployment concourse.yml $ bosh -‐‑‒n deploy
- 27. BOSH
- 28. BOSH VPC(10.0.0.0/16) Private(10.0.16.0/20) ELB Web DB Worker NAT BOSH Director
- 29. BOSH -‐‑‒ name: worker instances: 3 vm_̲type: worker $ bosh -‐‑‒n deploy concourse.yml
- 30. BOSH VPC(10.0.0.0/16) Private(10.0.16.0/20) ELB Web DB Worker NAT BOSH Director Worker Worker
- 32. Hello Pipeline jobs: -‐‑‒ name: hello plan: -‐‑‒ task: say-‐‑‒hello config: platform: linux image_̲resource: type: docker-‐‑‒image source: repository: alpine run: path: echo args: ["Hello, world!"] pipeline.yml Script Task Job
- 33. Deploy Pipeline $ fly -‐‑‒t lite login -‐‑‒c http://192.168.100.4:8080 $ fly -‐‑‒t lite set-‐‑‒pipeline -‐‑‒p hello-‐‑‒world -‐‑‒c hello.yml $ fly -‐‑‒t lite unpause-‐‑‒pipeline -‐‑‒p hello-‐‑‒world
- 34. Trigger Job $ fly -‐‑‒t lite trigger-‐‑‒job -‐‑‒j hello-‐‑‒world/hello
- 36. Build Java Project resources: -‐‑‒ name: source-‐‑‒repo type: git source: {uri: 'https://github.com/making/ci-‐‑‒demo', branch: master} jobs: -‐‑‒ name: unit-‐‑‒test serial: true public: true plan: -‐‑‒ get: source-‐‑‒repo trigger: true -‐‑‒ task: unit config: platform: linux image_̲resource: type: docker-‐‑‒image source: {repository: java, tag: 8-‐‑‒alpine} inputs: -‐‑‒ name: source-‐‑‒repo run: path: sh args: -‐‑‒ -‐‑‒c -‐‑‒ | cd source-‐‑‒repo ./mvnw test Resource Task Java Image Script Input
- 37. $ fly -‐‑‒t lite set-‐‑‒pipeline -‐‑‒p java-‐‑‒demo -‐‑‒c pipeline.yml $ fly -‐‑‒t lite unpause-‐‑‒pipeline –p java-‐‑‒demo
- 39. -‐‑‒ name: deploy-‐‑‒to-‐‑‒cf serial: true plan: -‐‑‒ get: source-‐‑‒repo trigger: true passed: [ unit-‐‑‒test ] -‐‑‒ task: unit config: platform: linux image_̲resource: type: docker-‐‑‒image source: {repository: java, tag: 8-‐‑‒alpine} inputs: -‐‑‒ name: source-‐‑‒repo outputs: -‐‑‒ name: output run: path: sh args: -‐‑‒ -‐‑‒c -‐‑‒ | cd source-‐‑‒repo ./mvnw package -‐‑‒Dmaven.test.skip=true cp target/*.jar ../output/demo.jar -‐‑‒ put: cf params: manifest: source-‐‑‒repo/manifest.yml path: output/demo.jar current_̲app_̲name: concourse-‐‑‒ci-‐‑‒demo Output = Deploy to Cloud Foundry -‐‑‒ name: cf type: cf source: api: {{cf-‐‑‒api}} username: {{cf-‐‑‒username}} password: {{cf-‐‑‒password}} organization: {{cf-‐‑‒org}} space: {{cf-‐‑‒space}} skip_̲cert_̲check: true
- 40. $ git clone https://github.com/Pivotal-‐‑‒Field-‐‑‒Engineering/PCF-‐‑‒demo.git $ cd ci $ fly -‐‑‒t lite set-‐‑‒pipeline -‐‑‒p demo -‐‑‒c pipeline.yml -‐‑‒l credentials.yml $ fly -‐‑‒t lite unpause-‐‑‒pipeline -‐‑‒p demo Write Once Run Anywhere