MongoDB on EC2 and EBS
Download as PPTX, PDF118 likes21,807 views
This document summarizes a webinar about deploying MongoDB on Amazon Web Services. It discusses the various MongoDB components that can be deployed, including MongoDB nodes, config servers, arbiters, and shard routers. It also discusses Amazon EC2 instance types suitable for different MongoDB components. Several deployment scenarios on EC2 are presented, including replica sets, sharded clusters, and operational considerations like automation, backups, security groups. The document encourages testing MongoDB on EC2 and provides resources for more information.
MongoDB on EC2 and EBS
- 1. MongoDB on Amazon Web ServicesWebinar 3-14-2011
- 2. AgendaMongoDB deployment componentsAmazon EC2 infrastructureDeployment scenarios
- 5. Needs RAM + Disk IO
- 6. Can run as Arbiter
- 7. No data
- 8. Just votes to elect primary
- 10. Typically run on App Servers
- 12. Stores small amounts of data
- 13. Infrequently queried/updated by MongoSReplica SetsPrimaryPrimaryPrimarySecondarySecondarySecondarySecondaryArbiterSecondarySecondarySecondary
- 15. Amazon EC2
- 16. Amazon EC2 Instance Types32-bit = Don’t UseTypical MongoDConfigD/ ArbiterBig MongoD32-bit = Don’t UseHigh CPU not necessary
- 17. OSTurn off atimeRaise file descriptor limitscat >> /etc/security/limits.conf << EOF* hard nofile 65536* soft nofile 65536EOFDO NOT use large VM pagesUse ext4, xfsUse RAIDRAID10 on MongoDRAID1 on ConfigbDBWarning! Known problems with Ubuntu 10.04 & EBShttps://bugs.launchpad.net/ubuntu/+source/linux-ec2/+bug/614853https://bugzilla.kernel.org/show_bug.cgi?id=16991
- 18. Mongodb components on ec2
- 19. MongoD on EC2MongoD64-Bit EC2 InstanceLVM orMDADMRAID 10EBS Volumes
- 20. MongoS on EC2Language Specific DriverYour App32- or 64-Bit EC2 Instance(Typically your app server)MongoS
- 21. Arbiter on EC264-Bit EC2 Instance(Micro Instance is Fine)ArbiterLocal Instance Storage
- 22. ConfigDB on EC264-Bit EC2 Instance(Micro Instance is Fine)ConfigDBLVM or MDADMRAID 1EBS Volumes
- 24. 3-Node Replica Set Your AppLargeLargeLargeMongoD(Primary)MongoD(Secondary)MongoD(Secondary)RAID 10RAID 10RAID 10
- 25. 2-Nodes + ArbiterYour AppLargeLargeMicroMongoD(Primary)MongoD(Secondary)ArbiterRAID 10RAID 10
- 26. 3-Node Replica Set Your AppUS WestUS EastLargeLargeLargeMongoD(Primary)MongoD(Secondary)MongoD(Secondary)Priority = 0RAID 10RAID 10RAID 10
- 27. Config DBShardingAmazon ELBApp TierShard 2Shard 1Shard 3
- 28. Running in ec2
- 29. Operational Considerations Automating Deployment PuppetChef Amazon CloudFormation
- 30. Backup / RestoreEBS SnapshotsAlso for rapid replica provisioningLVM SnapshotsUse secondaries for zero downtime backupshttp://www.mongodb.org/pages/viewpage.action?pageId=19562846
- 31. Security GroupsAll nodes listen on all interfaces unless –bind_ip is specified
- 32. Specify alternate port with –port
- 33. Don’t mix names & IP’s. Names preferred
- 34. Use security groups as access control lists
- 35. (e.g. allow 27017 from app servers, but not everybody)Final thoughtsEC2 is a great platform for MongoLots of production use Try it out! Test a big cluster for cheap! We’re here to help!
- 36. Questions? I amJared Rosoff (jsr@10gen.com) @forjaredTry it out! http://www.mongodb.org/downloadshttp://www.mongodb.org/display/DOCS/Amazon+EC2