MongoDB, Cloudformation and Chef
2 likes2,330 views
The document discusses the automation of MongoDB resource creation using Chef and AWS CloudFormation, focusing on managing large-scale MongoDB shards. It emphasizes resilience by planning for failures and highlights the benefits of CI/CD integration for database management through Jenkins and Chef. Ultimately, it illustrates a streamlined approach to deploy, manage, and recover MongoDB environments effectively.
![/etc/chef/dna.json
{
"run_list": [ "role[mongo-core]", "role[ebs-raid]" ],
"raid_groups": [{ "type": 0, "mount_range_start": "b", "name": "mongo_data",
"mount_point": "/mnt/data", "num_vols": 20 }]
}
This is how the raid groups are defined and
eventually built automatically when the
instance is spun up.](https://image.slidesharecdn.com/mongodb-2c-20cloudformation-20and-20chef-131126132759-phpapp02/85/MongoDB-Cloudformation-and-Chef-20-320.jpg)
MongoDB, Cloudformation and Chef
- 2. Bryan Kroger • Sr. Automation Engineer at HTC • Previously worked at HP on the HPCloud • • project. Big fan of all things cloud and DevOps. Startups are my passion. “If it can’t be automated, it shouldn’t exist.”
- 3. README This session is focused on using chef and CloudFormation to automate and manage a large-scale MongoDB shard.
- 4. Scope Automating MongoDB resource creation. Shards Config servers Not using repl sets • • •
- 5. Resilience? 1. the ability of a substance or object to spring back into shape; elasticity. 2. the capacity to recover quickly from difficulties; toughness. Planning around the idea of bouncing back from failure is more productive than trying to prevent failure from happening. Failure is inevitable, so plan for it!
- 6. Use case “CloudRim” is a game I created using CloudFormation, based the movie “Pacific Rim” The Kaijus emerge from the rift and start destroying cities. The Jaegers are dispatched to fight the monsters.
- 7. CloudFormation • Built on the Simple Workflow platform. • Amazon does most of the work. • Auto scaling rocks! • Forces good automation practices. • Resilient design. Lazy as a Service ( LaaS )
- 9. CloudFormation Templates Big things from small bits of JSON… Auto Scale Groups EBS Volumes EBS Attachments • • •
- 10. Chef bits /etc/chef/dna.json • mdadm raid creation • format array • mount formatted array • CloudFormation callback ( “I’m done!” )
- 11. Building with Jenkins Jobs are built with chef. Build pipelines help maintain state.
- 13. Many blocks... Pros ● Load is distributed over many network attached disks. ● Potentially spreading this load over more, different spindles. ● Networking is cheap. ● Potentially higher I/O performance over all. Cons ● More complicated layout ( which is mostly mitigated by chef and CF, but still a valid concern ) ● Software RAID overhead. ● Introducing more potential for failure.
- 14. Single disk Pros Cons ● Manual operations are easier. ● Less complication. ● Potentially using many spindles on the backend. ● No RAID overhead. ● Potential bottleneck if the entire block is allocated on one spindle.
- 15. What is the goal? Fast I/O, of course! Customers are fickle, latency costs money. But so does downtime. Fast I/O = many EBS volumes. Replication sets give us redundancy. But chef and jenkins gives us resilience.
- 16. Start with chef building jenkins Everything starts with our ability to build the thing that builds the things. This is where chef’s LWRP’s come in: mongodb_build_pipeline “us-east-1b” do num_shards 10 num_config_servers 3 end
- 17. CI / CD Jenkins is configured to run the build pipelines at given intervals. CloudFormation does all of the work to manage rollbacks if something goes wrong. This gives us CI / CD at the database level.
- 18. CI / CD at the db level? Are you nuts? No, my mother had me tested. This allows us to dynamically scale our shards, and ensure that if someone does something stupid we can recover. Reslience!!
- 19. CloudFormation handoff to chef CloudFormation allows us to send a little snippet of bash to our new instances. In that bash we call the following: chef-client -j /etc/chef/dna.json This is where the magic happens.
- 20. /etc/chef/dna.json { "run_list": [ "role[mongo-core]", "role[ebs-raid]" ], "raid_groups": [{ "type": 0, "mount_range_start": "b", "name": "mongo_data", "mount_point": "/mnt/data", "num_vols": 20 }] } This is how the raid groups are defined and eventually built automatically when the instance is spun up.
- 21. The chef AWS cookbook Why not use it? Because CloudFormation does a better job of creating and attaching the volumes. Keeping the resource definitions in the same place is a good thing. Chef is a tool!
- 22. Conclusion Chef -> Jenkins -> AWS CloudFormation Resources ( config servers and shards ) are configured and coordinated with chef. Route53 allows us to name everything. VPC’s are used to isolate everything. Git is used to track everything.