How to create a personal knowledge graph IBM Meetup Big Data Madrid 2017
6 likes1,371 views
This document discusses how to create a personal knowledge graph. It begins by explaining why a knowledge graph is needed, as the speaker manages a lot of information from different sources and needs a way to organize and query it. It then discusses how to build a knowledge graph using concepts like explicit and implicit information, graph databases, and collective intelligence. The speaker advocates using cloud services, containers, notebooks and machine learning to build the knowledge graph. The first steps proposed are to name the project "Boosterme" and start a GitHub repository.
How to create a personal knowledge graph IBM Meetup Big Data Madrid 2017
- 1. How to create a Personal Knowledge Graph Juantomás García - Open Sistemas
- 2. Juantomás García Data Solutions Manager @ Open Sistemas Google Developer Expert for cloud Others Co-Author of the first spanish book about free software “La Pastilla Roja” Former President of Hispalinux (Spanish Linux User Group) Organizer of the Machine Learning Spain and GDG Cloud Madrid. Who am I
- 3. How this talk is Organized I’m a big fan of the golden circle
- 4. Why: Need a Knowledge Graph • I managed a lot of information. • Every day: • Browse lots of websites (~100 even more) • See a couple of videos. • I interact with persons (mails, chats, slacks, calendars, etc). • Read documents (pdfs, papers, etc)
- 5. Why: Need a Knowledge Graph • I need to organize all this My current way of organizing and not forgetting things does not scale!
- 6. Why: Need a Knowledge Graph •I need to: •Query/browse the information. •Understand the information to turn it into knowledge
- 7. Why: Need a Knowledge Graph • I need more: • I have no interest in all the global information. • I just want to organize a graph with my subjects of interest
- 8. Why: Need a Knowledge Graph • Event I need more: • I want to have a system that do the hard and boring work for me. • I wish to have a recommendation system that know me and grow with me. • I want to have a system that explore and discovery information for me.
- 9. How: Make a Knowledge Graph Lets me introduce some interesting concepts about how.
- 10. How: Make a Knowledge Graph Explicit vs Implicit
- 11. How: Make a Knowledge Graph Examples of wrong recommendations from pocket (~8k favorites)
- 12. How: Make a Knowledge Graph Examples of good recommendations from pocket (~8k favorites)
- 13. How: Make a Knowledge Graph Graphs •Probably under the radar of too many people •For me a big change in the way to think and work with information
- 14. How: Make a Knowledge Graph Graphs: traditional database
- 15. How: Make a Knowledge Graph Graph Database
- 16. How: Make a Knowledge Graph Graph Databases vs Relational
- 17. How: Make a Knowledge Graph Collective Intelligence
- 18. How: Make a Knowledge Graph Collective Intelligence
- 19. How: Make a Knowledge Graph Collective Intelligence A A A B B B C
- 20. How: Make a Knowledge Graph Collective Intelligence A A A
- 21. How: Make a Knowledge Graph I love Unix Pipes awk '{print $7}' access.log| sort | uniq -c | sort -rn | head -n 5
- 22. How: Make a Knowledge Graph I love Unix Pipes
- 23. How: Make a Knowledge Graph Smart Agents •Bots every where. •With AI powering it. •New interfaces: interacting with the KG using bots. •B2B: Bot2Bot
- 24. How: Make a Knowledge Graph Think Big
- 25. How: Make a Knowledge Graph Think Big •Forget Legacy Architectures •Forget Old Tools •Use Light Technologies •Use pieces of Lego •Mix different technologies from diverse sources
- 26. How: Make a Knowledge Graph Not to do list •Avoid to install & config a server even a VM. •Avoid to installs tools instead use containers and/or cloud services. •In general: think if there is a simpler way to do it and needs less effort
- 27. How: Make a Knowledge Graph Architecture & Tools •Use Cloud Services is no brainer decision. •Git + Containers •Use the best language* for each module. •Use Notebooks: Jupyter, Zeppelin, DSX (*) Even java might be an option - unprovable
- 28. How: Make a Knowledge Graph Big Data & Machine Learning •That’s a big data project. •At least you need to design it as if were. •Even if look simpler, using ML will improve the results.
- 29. How: Make a Knowledge Graph Gathering Info •There are lots of sources. •The idea just create recolector and processors.
- 30. How: Make a Knowledge Graph Gathering Info: web navigation
- 31. How: Make a Knowledge Graph Gathering Info
- 32. How: Make a Knowledge Graph Gathering Info
- 33. How: Make a Knowledge Graph Gathering Info
- 34. How: Make a Knowledge Graph Gathering Info
- 35. What: Make a Knowledge Graph So lets start with the “What” First Steps: • Project Name: Boosterme • Github: https://github.com/boosterme/ boosterme
- 36. What: Make a Knowledge Graph Global Architecture
- 37. What: Make a Knowledge Graph Questions?
- 38. How: Make a Knowledge Graph Thank You!!! •email: juantomas@opensistemas.com •twitter: @juantomas •GitHub: https://github.com/boosterme/ boosterme This talk have a free questions lifetime warranty: If you have any questions or concerns about this talk, feel free to contact me anytime.