Optimize Your Vertica Data Management Infrastructure
Download as PPTX, PDF1 like427 views
The document outlines the importance of optimizing data management infrastructure for businesses, emphasizing the high costs and risks associated with data loss and the need for robust recovery strategies. It introduces Talena's architecture which employs an incremental-forever backup model for efficient data management and recovery, highlighting features such as deep de-duplication, metadata management, and cloud integration. Additionally, it compares replication and backup methods, advocating for a tailored approach to meet evolving business needs in data recovery.
Optimize Your Vertica Data Management Infrastructure
- 1. Confidential and Proprietary1 Optimize Your Vertica Data Management Infrastructure Srinivas Vadlamani, Chief Architect January 2017
- 2. Confidential and Proprietary2 My background Co-founder and Chief Architect at Talena. Prior to Talena, I was an early architect at Couchbase and Aster Data, helping design some of their key data management capabilities.
- 3. Confidential and Proprietary3 ing Data Management Drivers Application Iteration Compliance 70% of businesses lost data over the past two years 40% of businesses hit by ransomware in 2016 Robust testing requires up-to-date data 90% of enterprises delay application rollouts waiting for production data Average Global 2000 company has seven copies of prod data Storage costs for archival growing by 35% yearly $900K average cost of a data loss incident $1.08M cost to implement manual test data efforts $300K average yearly cost of managing archives BUSINESSCHALLENGESFINANCIALIMPACT Data Loss Source: EMC, CA, Ponemon
- 4. Confidential and Proprietary4 Key Big Data Protection Principles Replication and backup are not the same You need an incremental forever architecture It really is about recovery, not backup Even commodity storage is expensive
- 5. Confidential and Proprietary5 Replication vs Backup Replication: ideal for hardware failures Backup: ideal to protect against human errors and application corruption Need both as part of your Vertica data protection strategy
- 6. Confidential and Proprietary6 Why Incremental-Forever? Data volumes are getting too large for traditional backup methods. Backing up hundreds of terabytes on a weekly basis is not feasible as a backup policy
- 7. Confidential and Proprietary7 A Recovery-centric Architecture How quickly you recover impacts your business and brand Your recovery architecture needs to handle changes to the production topology over time Your recovery flexibility (whole database or at a schema level) will influence your recovery point and recovery time objectives
- 8. Confidential and Proprietary8 Speeding Up Application Delivery Real versus Synthetic Data Supporting Compliance Initiatives Minimizing Network Overhead
- 9. Confidential and Proprietary9 What’s Different In The Cloud Metadata management is made more complex PROBLEM Storage optimization becomes that much more difficult PROBLEM Relying on traditional backup mechanisms does not scale PROBLEM
- 10. Confidential and Proprietary10 The Talena Architecture • Deep de-duplication and compression with app-aware architecture • Incremental-forever backup architecture • High availability via erasure coding in distributed cluster architecture Smart Storage Optimizer
- 11. Confidential and Proprietary11 The Talena Architecture Native querying and analytics via active compute layer Unbounded scale with a Hadoop-native architecture Smart Storage Optimizer Active Compute Services Distributed File System
- 12. Confidential and Proprietary12 The Talena Architecture • Google-like catalog shortens data recovery time • Automatic schema generation for mirroring and backups • Granular recovery at an object level • Recovery to multiple topologies • Native integration with LDAP and Kerberos for authentication • Role-based access control defines specific privileges • Transparent data encryption • Masking for PII data Smart Storage Optimizer Active Compute Services Distributed File System Metadata Catalog Data Orchestration ServicesSecurity Services
- 13. Confidential and Proprietary13 Smart Storage Optimizer The Talena Architecture GUI CLI API Active Compute Services Distributed File System • ‘Single pane of glass’ for multiple use cases and data platforms • Agentless architecture minimizes management overhead • GUI, CLI, REST-based Talena API options Metadata Catalog Data Orchestration ServicesSecurity Services
- 14. Confidential and Proprietary14 Talena and vbr.py vbr.py Talena Recovery to different Vertica version No Yes Recovery to different Vertica topology No Yes Google-like metadata catalog for rapid discovery No Yes Built-in storage optimization No Yes UI for automated policy and workflow creation No Yes Ability to support test data management No Yes Inherent scalable infrastructure No Yes Data masking support No Yes Sampling support No Yes
- 15. Confidential and Proprietary15 Q&A We’ll send you a link to our eBook “The Vertica Backup Guide” Additional resources: talena- inc.com/resources and talena-inc.com/blog Ping us with any additional questions: info@talena- inc.com
- 16. Confidential and Proprietary16 Q and A
Editor's Notes
- #2: .
- #4: Data Loss Source: https://www.emc.com/collateral/presentation/emc-dpi-key-findings-global.pdf Test Data Management Source: http://www.ca.com/content/dam/ca/us/files/industry-analyst-report/the-total-economic-impact-of-the-ca-technologies-test-data-manager-solution.pdf Compliance Source: http://www.ponemon.org/blog/the-true-cost-of-compliance-a-benchmark-study-of-multinational-organizations
- #11: The next few slides will introduce the unique Talena architecture and highlight how this architecture delivers on these core business benefits. One of the most significant components of our architecture is our Smart Storage Optimizer. By integrating compute and storage management into our storage optimizer, we’re able to deliver significant cost savings. Our application-aware architecture enables us to do deep de-duplication and compression. Our backup process is incremental-forever, saving on storage costs, and by incorporating erasure coding we also ensure high availability no matter how large a Talena cluster you choose to deploy.
- #13: Supports transparent data encryption in the security services section
- #14: Our agentless architecture makes Talena an ideal solution for big data architectures and minimizes your operational overhead. Furthermore, Talena can support multiple data platforms, versions, and use cases in a single deployment of Talena, thereby providing a “single pane of glass” for all your big data management needs. While most of our clients work within our user interface, we also provide a REST-based API to accomplish the same tasks.