RedisConf18 - The Intelligent Database Proxy
Download as PPTX, PDF0 likes295 views
1) The document discusses an intelligent database proxy called Heimdall Data that intercepts and forwards SQL traffic between applications and databases. 2) Heimdall caches SQL results automatically if there is a performance benefit and ensures data consistency. 3) It provides features like automated database failover, horizontal scaling, SQL analytics, and auditing without requiring code changes to applications.
RedisConf18 - The Intelligent Database Proxy
- 1. The Intelligent Database Proxy
- 3. More users and applications implies • Higher data volumes • More tables, changes to schema • Higher latency responses Web Scale Challenges
- 5. Removes network latency Auto-caching Auto-invalidation Distributed, client SQL Optimization Heimdall Data Distributed Proxy
- 6. • No code changes • Database vendor neutral Heimdall Database Proxy
- 7. Application Heimdall Data Proxy Vendor Database Driver Application Server Runs as an agent Application Heimdall Data JDBC Vendor JDBC Driver JDBC driver, .jar file Application Server Any JDBC data source Heimdall Software Options
- 8. Use case Customer Benefit SQL Results Caching • Auto-caching / Auto-invalidate • NO code changes Automated failover • Faster failover (MySQL, SQL Server AlwaysOn) • PGPool-II Replacement Horizontal Scale-out • Better use of read replicas • Lag detection to guarantee fresh data • NO code changes Auditing for Privacy Compliance • Logs data access: Who, what, when • GDPR, SOX, PCI, HIPPA Heimdall Data Use Cases
- 9. L2 Cache Heimdall DB Proxy Removes network latency Application Server Local Cache Application SQL SQL Amazon Elasticache Application Tier SQL Caching
- 10. Application Server Application Heimdall Data Application Servers Application Server Application Heimdall Data Application Server Application Heimdall Data L2 cache communicates to local cache of invalidations Heimdall Cache Invalidation / Coherency
- 11. Application Server Application Heimdall Data Application Server Application Server Application Heimdall Data Application Server Application Heimdall Data Application Server Heimdall Central Console • You choose the storage • Heimdall auto-caches • Heimdall auto-invalidates Automated DB Failover Elasticache SQL Analytics Audit Logging Amazon RDS/Aurora Heimdall Distributed Deployment
- 12. 1) Heimdall intercepts and forwards SQL traffic between app & database. 2) Heimdall caches SQL results only if there is a performance benefit. 3) Heimdall insures data consistency. How it works
- 13. Uses real-time analysis and statistics on: • Query frequency and variability • Relative performance of Cache vs. Database Provides: • Auto-cache only if there is a performance benefit • Cache recommendations and benefits What to cache?
- 14. Heimdall Data Application Heimdall DataMicro service Micro service Micro service Heimdall Data for Microservices Microservice Application Hosts Application Heimdall Data Micro service Heimdall Data Solution DB Failover Connection Pooling Caching SQL Analytics Audit logging Micro service Micro service Heimdall DataApplication Heimdall DataMicro service Heimdall Data Micro service Micro service
- 15. Global online ticketing website with over 1.5 million users, deployed in AWS. The Challenge: • Surge in traffic overloaded the database • Too costly to develop a caching solution Why Heimdall Data: • Diagnosis and cure of SQL bottlenecks • “One-click” auto-caching into Amazon Elasticache Benefits: • 10x increase in DB scalability • Saved 2 developer resources ($200,000) • Installed in one day Customer Case Study
- 17. Latency Client-side SQL Caching Challenges Solved: 1. Slow application performance due to network latency 2. High operational costs to get caching done right: Consistency, time-to-market On-premise Amazon Web Services Application Hybrid Cloud
- 18. 1. Automate use of read replicas (read/write splits) 2. Replication lag detection to ensure data freshness 3. Scale out the database with no application changes! Write Application Server Application Heimdall Data Read 1 Read 2 Read 3 Application Server Horizontal Scale-out
- 19. Heimdall DB Proxy Application Server Application SQL Heimdall Central Console Identifies performance bottleneck • Application? • Database? • Network? End-to-end SQL analytics
- 20. Demo Video
- 21. • Free download at: www.heimdalldata.com • Use Analytics to quickly identify benefits of caching Next Steps
- 22. Thank You