Gridfs and MongoDB
21 likes10,030 views
The document discusses GridFS, a specification for storing and retrieving files that are larger than the BSON-document size limit of 16MB in MongoDB. It describes how GridFS stores file data as fragments in collections and uses a separate collection to store metadata like filename, content type, and hash. This allows files to be retrieved or streamed similarly to a standard file system while taking advantage of MongoDB's features like sharding and replication. Benefits of GridFS over traditional storage methods include network access, scalability, reliability, and storing metadata that enables additional reporting and analytics capabilities.
Gridfs and MongoDB
- 1. GridFS Mitch Pirtle CTO Sounday Music MongoTorino, 2011-10-01
- 2. Who?
- 3. Who? Joomla! founder, OSM founder
- 4. Who? Joomla! founder, OSM founder New Yorker, moved to Torino in May 2011
- 5. Who? Joomla! founder, OSM founder New Yorker, moved to Torino in May 2011 Skateboard, snowboard, bike, bass, guitar, drums, dad
- 6. Who? Joomla! founder, OSM founder New Yorker, moved to Torino in May 2011 Skateboard, snowboard, bike, bass, guitar, drums, dad CTO at Sounday Music
- 7. Who? Joomla! founder, OSM founder New Yorker, moved to Torino in May 2011 Skateboard, snowboard, bike, bass, guitar, drums, dad CTO at Sounday Music Contributor to MongoDB, evangelist for Lithium PHP Framework
- 8. Who? Joomla! founder, OSM founder New Yorker, moved to Torino in May 2011 Skateboard, snowboard, bike, bass, guitar, drums, dad CTO at Sounday Music Contributor to MongoDB, evangelist for Lithium PHP Framework Yes, I am learning Italian :-)
- 10. How the web began
- 11. How the web began
- 12. How the web began Grey pages
- 13. How the web began Grey pages Black text
- 17. Added some stuff... Images Colored backgrounds
- 18. Added some stuff... Images Colored backgrounds Blinking text
- 19. More stuff...
- 20. More stuff...
- 22. More stuff... Javascript Flash
- 23. More stuff... Javascript Flash Streaming media
- 24. More stuff... Javascript Flash Streaming media Social media
- 25. Mess!
- 26. All the media types PNG MPEG JPG OGG GIF MP3 MOV / QT ...and so on FLA FLV AVI
- 27. Where does all this go?
- 29. Approach 1: Filesystem Store media locally on hard drive of webserver
- 30. Approach 1: Filesystem Store media locally on hard drive of webserver Fast access
- 31. Approach 1: Filesystem Store media locally on hard drive of webserver Fast access Simple management
- 32. Approach 1: Filesystem Store media locally on hard drive of webserver Fast access Simple management Easy for code
- 33. Approach 2: SAN
- 34. Approach 2: SAN Network access to files from N webservers
- 35. Approach 2: SAN Network access to files from N webservers Redundant
- 36. Approach 2: SAN Network access to files from N webservers Redundant Scalable
- 37. Approach 2: SAN Network access to files from N webservers Redundant Scalable Hey, at least it’s not NFS
- 39. Approach 3: Database Easy access from application
- 40. Approach 3: Database Easy access from application Additional reporting possibilities
- 41. Why they all suck
- 42. Why they all suck Filesystems are a pain to keep in sync NAS are €xpen$ive Media storage was an afterthought for databases Databases are the hardest part to scale right?
- 44. New approach: GridFS Stores media in the database
- 45. New approach: GridFS Stores media in the database Access to sharding, replication
- 46. New approach: GridFS Stores media in the database Access to sharding, replication Network access
- 47. New approach: GridFS Stores media in the database Access to sharding, replication Network access Documents == metadata!
- 49. It is a standard.
- 51. Why GridFS is better
- 52. Why GridFS: Access Available to network Support for many programming languages Access parts of larger files, or stream entire file
- 53. Why GridFS: It’s MongoDB MongoDB sharding == scale Replica sets == redundancy Slaves == reliability and performance
- 55. Why GridFS: Metadata Separately stores metadata from actual file data
- 56. Why GridFS: Metadata Separately stores metadata from actual file data Schemaless, you can add attributes as you need
- 57. Why GridFS: Metadata Separately stores metadata from actual file data Schemaless, you can add attributes as you need Opens new possibilities for reporting, access, analytics
- 58. Sho me da money! (insert code)
- 61. Time for my favorite game Stump the Nerd™
- 62. Thanks! Email: mitch.pirtle@gmail.com Twitter: @mitchitized Web: http://about.me/mitchitized Slides: slideshare.net/spacemonkeylabs
Editor's Notes
- #2: \n
- #3: \n
- #4: \n
- #5: \n
- #6: \n
- #7: \n
- #8: \n
- #9: \n
- #10: \n
- #11: \n
- #12: \n
- #13: \n
- #14: \n
- #15: \n
- #16: \n
- #17: \n
- #18: \n
- #19: \n
- #20: \n
- #21: \n
- #22: \n
- #23: \n
- #24: \n
- #25: \n
- #26: \n
- #27: \n
- #28: \n
- #29: \n
- #30: \n
- #31: \n
- #32: \n
- #33: \n
- #34: \n
- #35: \n
- #36: \n
- #37: \n
- #38: \n
- #39: \n
- #40: \n
- #41: \n
- #42: \n
- #43: \n
- #44: \n
- #45: \n
- #46: \n
- #47: \n
- #48: \n
- #49: \n
- #50: \n
- #51: \n
- #52: \n
- #53: \n