Technology stack of social networks [MTS]
- 1. social networks The technology stack of Philipp Weber HDE MTS 2015.01.23
- 2. Table of Contents ● Overview ● Included networks ● The stacks ● Comments / Takeaway
- 3. *Some of the displayed numbers and technologies reach back to the year of 2011. **Rights to the registered Names / Logos / Trademarks featured are property of and belong to their respective owners. Disclaimer
- 4. Facebook - 1.35 billion monthly active users Tumblr - 420 million users Twitter - 284 million monthly active users LinkedIn - 300 million users Google+ - 300 million monthly active users Included Networks
- 5. Frontend Backend The stack Databases Cache (Hosting) Meta Templating / Javascript Intermediate- Layer Programming Languages Server specifics Offline processing
- 6. The stack - Facebook ● 864 million daily active users ● 700 million mobile daily active users
- 7. Facebook Haystack (Object-store) Memcached Facebook markup Language PhpCassandra Hadoop + Hive BigPipe → pagelets Thrift Java Varnish HTTP-accel. HipHopVM - Php-compiler Frontend Backend Meta
- 8. The stack - Tumblr ● Microblog / social networking website ● ~40k requests per second ● 15 billion page views per month ● belongs to Yahoo
- 9. The stack - Tumblr HBase Redis (Hosting) Gearman and Kestrel PHP HA-Proxy Scala Ruby MySQL Apache Kafka Finagle Frontend Backend Meta
- 10. The stack - Twitter ● 80% of Twitter active users are on mobile ● Average of ~5750 Tweets/s ● Record 143.199 Tweets/s
- 11. Twitter Flock Memcached (Hosting) Bootstrap JVM Finagle Java Netty JavaScriptRedis Hadoop+ Scalding Scala Frontend Backend Meta User-Store
- 12. The stack - LinkedIn ● Leader in Professional networking ● Opened their Network data to busines-research in 2008
- 13. The stack - LinkedIn Oracle Voldemort Node.js Java GRails = Java-Rails Hadoop Espresso Scala JRuby JavaScript MySQLJQuery Backbone.js Frontend Backend Meta
- 14. The stack - Google+ ● Build on Circle API ● Usually use special Google technology and libraries ● Close interaction with android planned
- 15. The stack - Google+ BigTable Closure Java Custom JVM GoogleFile System Closure C++ PythonJQuery Frontend Backend Meta
- 16. Takeaway So what can we learn from these examples?
- 17. Takeaways #1 Embrace Open Source Open Source systems benefit from university research and a big community. Facebook and Twitter release or found many of their software in OpenSource projects.
- 18. Takeaways #2 Scalability: Prepare for scalability starting at the foundation. Monolithic systems make rapid growth impossible or error-proned.
- 19. Takeaways #3 Discover new solutions: Highscalability.com writes a very in-depth technology-blog with interviews from tech- giants and their experiences. Definitely worth a read.
- 20. Thank you for your Attention