Mongo db at_customink
Download as PPTX, PDF1 like836 views
Nathen Harvey from CustomInk discusses the company's adoption of MongoDB for their technology stack, shifting from Oracle to a more flexible schema with document-based storage to accommodate frequently changing product requirements. The presentation highlights the benefits of MongoDB such as easy modifications, improved developer experience, and an automated deployment process using Chef. Challenges discussed include limited prior experience, data handling issues, and the complexity of managing production environments.
Mongo db at_customink
- 2. Hello!Nathen HarveyWeb Operations at CustomInknharvey@customink.com@nathenharveyOrganize MongoDCMeetupsSee you there next month!@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 3. Thanks for attendingIn the other trackEliot Horowitz, CTO & Co-Founder, 10genSchema Design at Scale@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 11. Customer ReviewsNathen HarveyNathen Harvey
- 12. CustomInk TechnologyDivide our technology into two classes:ECommerce – pre-checkout and shopping cartOperations Technology – post-check-out, fulfillment, etc.Ruby on RailsWith some legacy JavaApproximately 30 different applications running in production@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 13. CustomInk DatabasesPrimarily OracleWas the “right” choice 11 years ago when the company was startedNo longer a good solution for usMySQLPercona Server with XtraDBMongoDB@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 14. MongoDBChampionsEasy to set-up and configure“Greenfield” projects with loose schema definitionsMakes development easier and developers happyLimited amount of time between releasesChallengesNo prior experience with running productionLimited amount of time between releasesUnproven solutionNathen HarveyNathen Harvey
- 15. ProblemComplex Production EnvironmentsOrchestratedServices@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 16. Why Mongo?Introduces company to MongoDBEasily to modify document structureLightweight developmentEasy to install and deployCapped Collections@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 17. Central LoggerSubclasses Buffered LoggerIt’s a gem loaded into Rails applications as a RailtieCaptures useful metadataUse the MongoDB Ruby Driverhttp://github.com/customink/central_logger@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 18. Central Logger
- 20. Log Viewer
- 22. Why Mongo?Frequently changing requirementsGridFSWide variety of products with varied characteristics@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 23. Case for Document-based Schema@nathenharveyNathen Harvey
- 24. Application ArchitectureRails application for managing the product catalogWrites to MongoDB as it’s databaseUtilizes GridFS for storing filesUses Mongoid as the ODM@nathenharveyNathen Harvey
- 25. Implementation FlowECommerceApplicationCatalogApplicationMongoDBOracle@nathenharveyNathen Harvey
- 26. Next StepsContinue to adopt MongoDB in the Operations Technology applicationsBegin using MongoDB with ECommerce applicationsReporting artwork usageCapturing JavaScript logs@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 27. Automated DeploymentChef is an open source systems integration framework built to bring the benefits of configuration management to your entire infrastructure.We use Chef to manage our infrastructure and deploy MongoDB@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 28. MongoDB CookbookUse Vagrant and VirtualBox as the development environment for our CookbooksCookbook shared on Github and, soon, OpsCode Community Site.@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 31. Lessons LearnedCapped CollectionsTesting replica set failoverSchema free != design freeJSON in the DB, JQuery in the browser == happy developersmongo_import could not handle carriage returns in CSV filesUnserializable data typesData transformations on a large dataset still painfulUnless you’re sharding, map reduce probably slower and more complex than what you’re used to@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 32. MongoDCMeetupJoin fellow MongoDB enthusiasts for a monthly meetupMeetings are held at CustomInk in McLean, VAhttp://www.meetup.com/Washington-DC-MongoDB-Users-Group/@nathenharveyNathen Harvey@nathenharveyNathen Harvey
- 33. Thank You!Nathen HarveyWeb Operations at CustomInknharvey@customink.com@nathenharveyOrganize MongoDCMeetupsSee you there next month!@nathenharveyNathen Harvey@nathenharveyNathen Harvey
Editor's Notes
- #32: Tempfile https://github.com/mongodb/mongo-ruby-driver/blob/master/lib/bson/bson_ruby.rb#L153MongoDB maintains deleted lists of space within the datafiles when objects or collections are deleted. This space is reused but never freed to the operating system.http://www.mongodb.org/display/DOCS/Durability+and+Repair