MongoDB & Machine Learning
28 likes14,300 views
The document provides an overview of machine learning, detailing its algorithms such as decision trees, random forests, and neural networks. It discusses the applications of machine learning in areas like spam filtering, auto-tagging, and sentiment analysis, highlighting the various programming languages used, including Java and Python. Additionally, it mentions practical implementations, like the Social Harvest tool, which analyzes social data for insights.
MongoDB & Machine Learning
- 1. Machine Learning Tom Maiaroto @shift8creative
- 2. What is Machine Learning?
- 3. Algorithms & Approaches Decision trees Random forests Artificial neural networks k-NN (nearest neighbour) Naive Bayesian classifier
- 4. Algorithms & Approaches Decision trees Random forests Artificial neural networks k-NN (nearest neighbour) Naive Bayesian classifier
- 5. So could machines one day rule the earth?
- 6. So could machines one day rule the earth? Maybe (ok probably not)
- 7. What can Machine Learning do for Apps? Spam filtering
- 8. What can Machine Learning do for Apps? Auto-tagging
- 9. What can Machine Learning do for Apps? All Sorts of Categorization
- 10. What can Machine Learning do for Apps? Sentiment Analysis
- 11. Languages Commonly Used Java Java-ML, WEKA, Apache Mahout, many more... Python NLTK, scikit-learn, PyML, a good deal more... C++ libDAI, Armadillo, Orange, tons more... and then some others...
- 12. Languages Commonly Used http://www.mloss.org
- 16. Replication
- 17. Geo-spatial Indexing Did someone say nearest neighbour?
- 18. Geo-spatial Indexing Did someone say nearest neighbour? Design geeks, imagine the visualizations...
- 19. Replication Store massive amounts of data
- 21. Dedicated databases for calculations All the obvious benefits.
- 22. Map/Reduce It's the brain.
- 23. Map/Reduce It's the brain. It's not just for aggregation.
- 24. Map/Reduce It's the brain. It's not just for aggregation. It's faster than you might think.
- 25. Map/Reduce It's the brain. It's not just for aggregation. It's faster than you might think. It runs in the database.
- 26. Map/Reduce In the computer. ..
- 27. Example Time! It's simple...Just take this...
- 28. Example Time! It's simple...Just take this...
- 29. Example Time! Just kidding... Let's Break Down a Naive Bayes Classifier
- 30. Classification /Naive Bayes Training the System
- 31. Classification /Naive Bayes Training the System Simple... $inc
- 32. Classification /Naive Bayes Just Keep Count of Words per Category
- 33. Classification /Naive Bayes Reduce:
- 34. Classification /Naive Bayes Reduce:
- 35. Classification /Naive Bayes Finalize:
- 36. Classification /Naive Bayes Finalize:
- 37. Classification /Naive Bayes Call the Command:
- 38. Classification /Naive Bayes Results: Can see total words. Can also see word counts per category.
- 39. Classification /Naive Bayes Results: ...and of course the scores per category... cae = arts and entertainment cs = science ...
- 40. Classification /Naive Bayes Accurate even with little training
- 41. MongoDB on a small VM Took 1.7 seconds
- 42. Compared to say PHP 33 seconds and timed out
- 43. More training data == exponentially faster than PHP
- 44. Classification /Naive Bayes This wasn't even a full map/reduce
- 45. Your mileage will vary based on formula
- 46. You can cache certain values for speed
- 47. Don't forget about stored JavaScript (but use it wisely)
- 48. Porter Stemming Algorithm Thank You Martin Porter http://tartarus.org/martin/PorterStemmer
- 49. Porter Stemming Algorithm Exists for nearly every language
- 50. MongoDB will use JavaScript of course
- 52. Porter Stemming Algorithm About 2.5x faster than PHP class
- 53. 663x faster than a web browser
- 54. Porter Stemming Algorithm About 2.5x faster than PHP class
- 55. 663x faster than a web browser
- 56. 7x slower than PHP PECL extension
- 57. Real World Application Social Harvest Analyzes social data from the internet to determine languages spoken, gender, age, sentiment analysis, and categories. www.social-harvest.com
- 58. Real World Application Social Harvest Who doesn't like pie charts?
- 60. Follow Tom @shift8creative www.shift8creative.com www.social-harvest.com www.union-of-rad.com Thank You!