The Path to Truly Understanding Your MongoDB Data
Download as PPTX, PDF0 likes174 views
1. The document discusses data visualization and analytics using MongoDB. It covers terminology, data growth trends, the importance of visualization, and different tools for visualizing MongoDB data including Compass, the BI Connector, and MongoDB Charts. 2. Examples of early data visualizations are shown and different architectures for analytics using hidden replicas are described. 3. The presentation emphasizes choosing the right solution based on needs, such as custom solutions, Compass, the BI Connector, or MongoDB Charts. A demo of the visualization lifecycle is promised.
The Path to Truly Understanding Your MongoDB Data
- 1. #MDBlocal DATA ANALYTICS / UNDERSTANDING YOUR DATA SEATTLE
- 2. # M D B l o c a l
- 3. #MDBlocal WIFI: MONGODB PW: mdb
- 4. #MDBlocal SAM WEAVER PRODUCT MANAGER, MONGODB @samuel_weaver
- 5. #MDBlocal AGENDA 1. Background 2. The importance of data visualization 3. Methods for data visualization in MongoDB 4. Lunch
- 6. #MDBlocal WHERE ARE WE NOW?
- 8. #MDBlocal DATA GROWTH IS EXPLOSIVE • More data created in the last 2 years than entire previous history of the human race • By 2020: • 1.7MB per person every second
- 9. #MDBlocal THE STATE OF ANALYTICS • Analytics is big $! • $130B in 2016 • $200B+ in 2020 • Less than 0.5% of data is analyzed and used – imagine the potential!
- 10. #MDBlocal EVOLUTION OF ANALYTICS • Self service • Mobile access • Spark • Real time analytics • On-prem and cloud • On demand reporting 2018 Today2015 20162012 • Dedicated reporting team • Desktop access • Hadoop • Batch analytics • On prem only • Monthly reports
- 11. #MDBlocal IMPORTANCE OF DATA VIZ
- 12. #MDBlocal
- 13. #MDBlocal EARLY DATA VISUALIZATIONS Charles Minard (1869) -- Napolean’s march and retreat on Moscow in 1812.
- 14. #MDBlocal I X Y 10 8.04 8 6.95 13 7.58 9 8.81 11 8.33 14 9.96 6 7.24 4 4.26 12 10.84 7 4.82 5 5.68 9.00 7.50 10.00 3.75 0.816
- 15. #MDBlocal I X Y 10 8.04 8 6.95 13 7.58 9 8.81 11 8.33 14 9.96 6 7.24 4 4.26 12 10.84 7 4.82 5 5.68 9.00 7.50 10.00 3.75 0.816
- 16. #MDBlocal I X Y 10 8.04 8 6.95 13 7.58 9 8.81 11 8.33 14 9.96 6 7.24 4 4.26 12 10.84 7 4.82 5 5.68 9.00 7.50 10.00 3.75 0.816 II III IV X Y X Y X Y 10 9.14 10 7.46 8 6.58 8 8.14 8 6.77 8 5.76 13 8.74 13 12.74 8 7.71 9 8.77 9 7.11 8 8.84 11 9.26 11 7.81 8 8.47 14 8.1 14 8.84 8 7.04 6 6.13 6 6.08 8 5.25 4 3.1 4 5.39 19 12.5 12 9.13 12 8.15 8 5.56 7 7.26 7 6.42 8 7.91 5 4.74 5 5.73 8 6.89 9.00 7.50 9.00 7.50 9.00 7.50Mean 10.00 3.75 10.00 3.75 10.00 3.75Variance (Population) 0.816 0.816 0.817 Correlation (Pearson)
- 17. #MDBlocal
- 18. #MDBlocal
- 20. #MDBlocal SO YOU WANT TO VISUALIZE?
- 21. #MDBlocal
- 22. # M D B l o c a l
- 23. #MDBlocal • Use the correct architecture • Determine what your needs are • Multiple data sources? • Huge amounts of complex data? • Quick self service? • Choose the right solution for you THINGS TO THINK ABOUT
- 25. #MDBlocal HIDDEN REPLICAS • Hidden secondary's maintain a copy of the primaries data set • Hidden secondary's are used for workloads with different access patterns • Cannot become primary Client Primary Secondary Secondary Secondary Secondary P=0 Hidden=True Analytics
- 27. #MDBlocal BUILD YOUR OWN • Pro’s • Custom tailored solution: fits exactly as required! • Con’s • High investment • Maintenance • Deep understanding of the underlying tech and its language(s)
- 28. #MDBlocal USE THE TOOLS WE GIVE YOU
- 29. #MDBlocal MONGODB COMPASS • Developer tool • Data management and manipulation • Interesting schema analysis • Used daily: a good first place to start
- 30. #MDBlocal WHEN TO USE • Day-to-day development/operations • Adding indexes • Viewing server stats • Data manipulation • 10,000->1ft view of data
- 31. #MDBlocal BI CONNECTOR • Visualize and explore MongoDB data in SQL-based BI tools: • Automatically discovers the schema • Translates complex SQL statements issued by the BI tool into MongoDB aggregation queries • Converts the results into a tabular format for rendering inside the BI tool
- 33. #MDBlocal WHEN TO USE • Multi datasources (not just mongodb) • Business analysts • Extremely powerful but high ramp
- 34. #MDBlocal MONGODB CHARTS • Lightweight • Intuitive • Build visualizations on MongoDB data (nested, polymorphic) • Share content in a dashboard
- 35. #MDBlocal WHEN TO USE • When you want quick answers • No need to flatten / ETL your mongodb data • Self service for the technical audience
- 36. #MDBlocal DEMO
- 37. #MDBlocal LIFE CYCLE 1. Acquire 2. Prep - Calcs - Groups - Data types 3. Visualize - Bar - Pie - Line 4. Explore - Dashboards 5. Share - Export - Collaborate - Embed
- 39. # M D B l o c a l
- 40. # M D B l o c a l
- 41. # M D B l o c a l
- 42. # M D B l o c a l
- 43. # M D B l o c a l
- 44. # M D B l o c a l
- 45. # M D B l o c a l
- 46. # M D B l o c a l
- 47. # M D B l o c a l
- 48. # M D B l o c a l