Concourse and Database
- Concourse is a open source CI/CD tool that allows building and testing projects in containers. It uses a pluggable resource interface to check for changes and run builds in isolated containers. - While Concourse natively supports running builds in containers, it does not support running external services like databases that may be needed to test against. - One solution is to use "Docker in Docker in Garden" (DCINDG), which runs a Docker daemon inside a Docker container managed by Concourse's Garden container runtime. This allows testing tasks to use Docker Compose to stand up external services in isolated containers. - The presentation demonstrated this approach with a sample project on GitHub and discussed Concourse concepts like jobs, resources
![Docker Compose docker-compose.yml
] Database
Task
Very useful “links”](https://image.slidesharecdn.com/concourse-and-database-170314002335/85/Concourse-and-Database-22-320.jpg)
Concourse and Database
- 2. About me Etourneau Gwenn Sr Solution Architect https://github.com/shinji62 https://twitter.com/the_shinji62
- 3. Pivotal • Spring Framework • RabbitMQ • Concourse • Cloud Foundry • Pivotal Tracker • Gemfire
- 4. Agenda • Concourse • Docker Compose • Demo • Q&A
- 5. Concourse
- 6. Concourse • Pluggable Resource Interface • Running builds in Containers Natively • Zero Snowflake-able Configuration • Submitting builds from the local file system up to run in CI • Pipeline pipeline pipeline !!! • Reproducible
- 7. Concourse
- 8. Concourse but … • No core support for service • No docker daemon • Only support external resource
- 10. • Running service (databases) to test against • Avoiding snowflakes • Strict isolation between job • Some caching Wanted
- 12. DCIND* ? Docker in Docker ?
- 13. DCIND* ? Docker in Docker ?
- 14. DCINDING* ? Docker in Docker in Garden ?
- 15. Docker in Docker in Garden • Just one solution example • Works :) • Generic • More than one service Redis + MySql + …. • One file to setup
- 16. Worker Workers Garden image_resource: type: docker-image source: repository: ubuntu/…. Garden image_resource: type: docker-image source: repository: ubuntu/…. Garden image_resource: type: docker-image source: repository: ubuntu/…. Garden image_resource: type: docker-image source: repository: ubuntu/…. VM Operating System
- 17. Garden image_resource: type: docker-image source: repository: dcind/…. VM Operating System + testing task Task inside dc compose
- 18. OR
- 19. Task outside dc compose Garden image_resource: type: docker-image source: repository: dcind/…. VM Operating System testing task
- 20. Concourse • Jobs • Resource } PIPELINE • Task
- 21. Task testing.yml Docker image dcind Start Docker daemon use cached image run compose app
- 22. Docker Compose docker-compose.yml ] Database Task Very useful “links”
- 23. Docker Compose Links Links inject environment variable which help for service discovery for container to container
- 24. Resource source code repos Docker image to be cached
- 25. Job
- 26. Demo
- 28. Online Resource
- 29. Documentation Tutorials • Official documentation http://concourse.ci • S&B https://github.com/starkandwayne/concourse-tutorial • Flight-School http://concourse.ci/flight-school.html
- 31. Q & A
- 32. Thank You !!