How to Build a SaaS App With Twitter-like Throughput on Just 9 Servers
Download as KEY, PDF34 likes10,408 views
The document outlines how New Relic efficiently handles application monitoring on just 9 servers, managing over 20 billion daily metrics from 150,000 application processes. It highlights the architecture, data collection rates, and real-time monitoring capabilities, emphasizing the application's simplicity and scalability. Key challenges include data purging, MySQL optimization, and handling large accounts, with five lessons learned regarding best practices in app development.
How to Build a SaaS App With Twitter-like Throughput on Just 9 Servers
- 1. How to build an app with Twitter-like throughput on just 9 servers... Lew Cirne, Founder & CEO - New Relic
- 3. What our app does APM as a Service In-app agent instrumentation (BCI, etc) 150,000+ app processes monitored, globally (10K customers) Each process reports a few hundred metrics per minute 5 Languages (Ruby, Java, PHP, .NET, Python)
- 4. Each day we collect 20 billion measurements, from 150,000 application processes, for over 10,000 customers.
- 5. Each day we collect 20 billion measurements, from 150,000 application processes, for over 10,000 customers. All on 9 servers.
- 6. We capture “Timeslices” Each o ne is about Response Time 250 bytes 4 hours from 11:04 to 15:04 Count: 1242 A single tweet Avg: 337 ms is about the Min: 0.63 ms Max: 95669 ms same size Std Dev: 782
- 7. timeslice insertion rate: 100K/second >7 billion rows per day Twitter peak insertion rate: 8K rows per second 9 Servers handle all data collection
- 9. Collecting is one thing... • We provide realtime monitoring • One minute granularity • Data is almost always stale • Each user/account has different data • Page caching and other easy solutions don’t work for us.
- 10. Our most popular page... age e Full P Averag Time: Load 2.4 Sec
- 11. Our most popular page... age e Full P Averag Time: Load 2.4 Sec
- 12. Main App Software stack User Interface Data Collectors Data Store & REST API MySQL Servlets on Jetty Sharded by accounts Rails 2.3
- 13. Simplified architecture... 9 Collector / Aggregator / DB’s Sustained 100K insertion rate per second S Customer’s environment HTTP 24 Core Intel Nehalem 48 GB RAM SAS attached RAID 5 No Virtualization (either cloud or datacenter) 2 Web App Servers 12 Core Intel Nehalem 48 GB RAM
- 14. Even more data! On May 17, we launched Real User Monitoring • Using Episodes to measure browser load time of every page view • Browser reports data to our ‘Beacon’ servers • Monitoring >1 Billion page views per week • Doubled our total inbound HTTP requests in a MONTH
- 15. Beacon Architecture Response Time 0.15ms RUM Beacons Real User Asynchronously Browsers Billions of metrics from Servlets Capture and across the globe enqueue (in-memory) aggregate and forward Timeslices to our Collectors Over 1 Billion user sessions measured for performance in first Currently at EC2 month.
- 16. Challenges • Data Purging • Determining what to pre-aggregate • Large Accounts • MySQL Optimization and Tuning • I/O performance - (virtualized to dedicated) ...
- 18. 1. Keep it simple
- 19. 2. Less is more
- 20. 3. Trendy != Reliable
- 21. 4. Plan for scale
- 22. s s ode Epi New Ja Relic va y ub 5. Use the right technology Ngin x Je/y R Rails for a given task
- 23. See New Relic Monitor New Relic at our booth