Postgres Sql at TripAdvisor
5 likes1,770 views
TripAdvisor is the world's largest travel site with over 40 million monthly visitors. It runs its business on Postgres, using a large-scale deployment across multiple servers and data centers. Postgres powers the site's critical functions and stores over 1 terabyte of data, including a sharded pin table with over 1.5 billion rows. The deployment utilizes replication, clustering, and a disaster recovery system to ensure high availability.
Postgres Sql at TripAdvisor
- 1. No, we’re not a travel agencywww.tripadvisor.com/careers
- 2. Postgres at TripAdvisorByDon O’Neill & Boris Partensky2© 2011 TripAdvisor LLC All rights reserved.
- 3. TripAdvisor is the world’s largesttravel site3© 2011 TripAdvisor LLC All rights reserved.
- 4. 440Mmonthly visitors4Mvisitors/day20+M registered members45+Mreviews & opinions© 2011 TripAdvisor LLC All rights reserved.
- 5. Business runs on PostgresLarge Mission critical deploymentCombination of 8.3 and 8.4Site Technologies includeLinux (CentOS), ApacheJava, Tomcat, Velocity, and MemcachedNo commercial Software – All Open SourceWeb Scale DeploymentOver 100 Frontend and Backend servers per Data Center14 Postgres Database Servers per Data CenterDR Data Center with Replication between the twoPlatform5© 2011 TripAdvisor LLC All rights reserved.
- 6. 33 Postgres Servers across 3 Data CentersNot including Dev and QA serversSSD’s instead of Spinning disks for select serversMultiple Read Only DB Servers Load Balanced using BigIPSync’d using DB Mirror replicationJust under 1 TB of data in multiple databasesSharded Pin Table Over 1.5 billion rowsSharded to improve read and write performance Spread over 12 databases on 2 ServersScale out to multiple servers as neededRouting logic built into our application layerBy the Numbers6© 2011 TripAdvisor LLC All rights reserved.
- 7. All Servers configured as Active/Passive ClusterNot using Shared Disks or SAN’sDRBD for Block level replication between systemsHeartbeat for automatic failover between nodesData Replicated to DR SiteTripAdvisor has 2 Data centers (MA and VA)One site “Live” at a timeEqual capacity at both sitesRoutinely switch between sitesData Replicated between data centersRedundancy/Failover7© 2011 TripAdvisor LLC All rights reserved.
- 8. Replication based on DBmirrorLike Slonyonly deprecated Community project once part of the core distributionTrigger based Master/Slave ReplicationWritten in C and PerlAll replicated tables must have primary keysTripAdvisor Updates includeA Rewrite in Java!Support for SQL ServerLots of Hardening for large scale useReplication8© 2011 TripAdvisor LLC All rights reserved.
- 9. 20 TB Data Warehouse todayExpecting to grow significantly in 12 months16 Node cluster expanding to 24Based on Hadoop and HiveReporting and Cubes built with SQL ServerEnd users access the data via Excel and Reporting ServicesCritical for the growth of the businessLong term data storage in Hadoop and not our SAN!Mobile ApplicationsAward winning travel applicationSupported in iPhone, iPad, Android, Nokia, Windows, Palmhttp://www.tripadvisor.com/MobileAppsFacebook IntegrationMore and more users logging in via FacebookBetter social experience on the siteMajor Initiatives9© 2011 TripAdvisor LLC All rights reserved.
- 10. Q&AQuestions?Did I mention we’re hiring?10© 2011 TripAdvisor LLC All rights reserved.