Visualizing Mobile Broadband with MongoDB
2 likes835 views
The document discusses the FCC's Measuring Broadband America project which collects mobile broadband speed test data from over 100,000 Android and 50,000 iOS device installs of their app. It describes how they store the speed test results in MongoDB and use aggregation and geo-spatial queries to analyze the data and build heat maps visualizing carrier performance. Their goal is to release these visualizations and the underlying data and source code publicly in autumn 2014 to provide transparency into mobile broadband speeds.
![Developing the API
/api/carrier/verizon.json?lat=39.8&lon=-105&geo=hex10k
geo_find = {geometry:
{ $geoIntersects: { $geometry:
{ type: 'Point', coordinates: [lon,
lat] }}}};
json, jsonp, geojson, and xml are supported](https://image.slidesharecdn.com/mongodaysdc14-ericspry-141014110014-conversion-gate01/85/Visualizing-Mobile-Broadband-with-MongoDB-22-320.jpg)
Visualizing Mobile Broadband with MongoDB
- 1. Visualizing Mobile Broadband Federal Communications Commission Eric Spry, Acting Geographic Information Officer
- 2. Measuring Broadband America Fixed: 12,000 participants Mobile: nearly 100,000 installs for Android, and 50,000 for iOS www.fcc.gov/measuring-broadband-america
- 3. Download This App available in Google Play and iTunes App Store
- 4. "I like the idea of this app but it's not that useful when I can only see my data. I'm waiting to see if they release their heat maps & infographics of carrier performance in Nov 2014 like they promised... " -- Google Play Store Comment
- 6. How the Gov't normally releases info
- 7. There is a better way
- 10. xkcd on Heat Maps
- 11. Hex Binning Reference: http://indiemaps.com/blog/2011/10/hexbins/
- 13. Later Versions (based on early draft data)
- 14. SQL approach was good for early investigation, but not for delivering a useful product to consumers. Enter MongoDB
- 16. MongoDB "tests" : [ { "type" : "JHTTPGETMT", "timestamp" : "1398965279", "warmup_time" : "5323371", "target_ipaddress" : "4.71.185.62", "success" : "true", "number_of_threads" : "3", "transfer_bytes" : "6813952", "bytes_sec" : "453803", "datetime" : "2014-05-01T17:27:59+0000", "target" : "samknows1.nyc2.level3.net", "warmup_bytes" : "2627029", "transfer_time" : "15015192" }, { "type" : "JHTTPPOSTMT", "timestamp" : "1398965305", "warmup_time" : "5569560", "target_ipaddress" : "4.71.185.62", "success" : "true", "number_of_threads" : "3", "transfer_bytes" : "3569696", "bytes_sec" : "227745", "datetime" : "2014-05-01T17:28:25+0000", "target" : "samknows1.nyc2.level3.net", "warmup_bytes" : "1313376", "transfer_time" : "15674058" },
- 17. Importing the Speed Test Files
- 18. Aggregation Validated Mobile tests are stored in a collection for aggregation. $geoIntersects Operator is Used to Determine the Hexagons That Each Test is Contained By.
- 19. Aggregation
- 20. Now, Let's Make a Map!
- 21. Actually, let's make 36 maps!
- 22. Developing the API /api/carrier/verizon.json?lat=39.8&lon=-105&geo=hex10k geo_find = {geometry: { $geoIntersects: { $geometry: { type: 'Point', coordinates: [lon, lat] }}}}; json, jsonp, geojson, and xml are supported
- 23. Developing the UI Some inspiration from the Yahoo Weather App
- 25. Finish with something everyone is proud of
- 26. Putting it all together Planned Release in Autumn 2014: Web application, API, Developer Resources, Data Download, and all source code released on GitHub.
- 27. Next Steps: Deploy the web application Start the next cycle. Get more data!
- 28. With Heartfelt Thanks —Computech Team —FCC staffers —Sam and team at SamKnows, UK —MongoDB Support
- 29. Download the FCC Speed Test App from the Google Play or iTunes App Store and help us put the CROWD in crowdsouce. www.fcc.gov/measuring-broadband-america