InsightDataengineering_Henok_Final
1 like189 views
This document describes a tool called Where is my Tweet that visualizes how tweets spread. It extracts original tweets and re-tweets from Twitter data and builds a graph to show how tweets are spread by re-tweets. The tool ingests tweet data in real-time, builds the re-tweet graph, and allows users to query the graph to understand who their audiences are and which followers are most influential in spreading their tweets. It also provides a demo of the tool online.
InsightDataengineering_Henok_Final
- 1. Where is my tweet? Henok Mengistu Insight Data Engineering Fellow Silicon Valley Summer 2016
- 2. Motivation
- 3. Motivation But, this number doesn't show how the tweet spreads-out?
- 4. But, a re-tweet graph could show
- 8. The data ● An original tweet { …. "text": "McAllen, Texas- 8 miles from U.S. - Mexico border ", "id": 743485792585146368, "user": { "id": 25073877,"screen_name": "realDonaldTrump" },"created_at": "Thu Jun 16 16:50:00 +0000 2016" …. } ● A re-tweet {… "text": “McAllen, Texas- 8 miles from U.S. - Mexico border” "screen_name": "trinnitythomps1","created_at": "Thu Jun 16 16:50:13 +0000 2016", "user": {"id": 2894078186} "retweeted_status":{"id": 743485792585146368} ...}
- 9. Data Pipeline Watches out for a tweet by a specific user Filter and sort re-tweets and put them in Redis Builds graph Creates a topic with tweets as messages
- 10. ● I am Henok – Originally, from Ethiopia – Currently, a PhD student at the University of Wyoming ● Working on Evolutionary Computation – I like playing and watching Soccer – But skiing, not so much so
- 11. Thank you!
- 12. Queries ● On the re-tweet graph – who are my audiences? ● Geographically, social groups – Betweenness centrality ● Who is relevant to spread out my tweet? ● Identify influential followers