Slideshare And Aws
Download as PPT, PDF1 like744 views
SlideShare uses Amazon Web Services like S3, EC2, and SQS to handle its large storage and computing needs. It stores all presentations on S3 for secure and public access. It moved its conversion system to EC2 instances to gain scalability and reliability over unstable on-premise servers. It uses SQS as an inexpensive and reliable messaging channel between its hosting services and EC2 conversion cluster. It also takes advantage of Spot Instances which are less than half the price of regular EC2 instances.
Slideshare And Aws
- 1. Bhupendra Singh SlideShare and AWS
- 2. Prologue: About Us Founded in 2006 First and The Largest Presentation Sharing Site Based in San Francisco / Delhi 25 Employees Flash based client RoR Backend
- 3. Last Chapter: Traffic Approximately 10k Slideshows are added daily, which requires additional more than 100 GB storage per day computation power to convert them into various formats daily peak number of uploads per hour can be 25x daily low
- 4. Chapter 1: Slideshare and S3 - Since beginning (2007) - SlideShare stores almost everything on S3 i.e. ppt, pdf, swf etc. Wildly Popular Both secure and public access lots of support (we use right_aws) makes embeds available while SlideShare is having a downtime
- 5. Chapter 2: Conversion System - FreeBSD Boxes Configuration process was painful Unstable system due to fragile nature of software Older boxes were more unstable required restart of conversion process in every 2-3 days Scalability issues
- 6. Chapter 3: Red Army and 2008
- 7. Chapter 5: Beginning of EC2 Conversion System on EC2 Configure, bundle and howzat! kill unstable system and fire a new one Precautionary Measure: Kill every system after 24 hours and start fresh ones Scalability, Bazzinga!
- 8. Scalability and EC2 Regular Conversion Instances Suicide Bombers Gather, analyze and be proactive Peak handling + Cost Control Free EC2 to S3 transfer and vice-versa Less bandwidth cost
- 9. Chapter 4: SQS After moving to new Hosting Service (2008) Glue between new Host and previous Host (conversion system was still there) Amazingly Simple Reliable ?? Who cares?? Messaging Channel between new Host and EC2 conversion cluster Inexpensive We are using it HEAVILY!
- 10. Chapter 6: Spot Instances Latest feature from Amazon less than half price than regular instances Suits us very well We’re on it!
- 11. Elastic Computing Cloud S3 AWS User SlideShare Server Cluster SQS
- 12. Thanks
Editor's Notes
- #2: http://www.flickr.com/photos/7210687@N08/3042350908/