MasterCard Optimizes Big Data Management with BMC High Speed Utilities for DB2®
2 likes2,237 views
The document discusses the challenges faced by businesses, particularly in managing growing data and the complexities of modern database systems. MasterCard is highlighted as an example of a digital master leveraging BMC's next-generation technology to improve database management and application performance. Key innovations include automated database maintenance, zero downtime operations, and intelligent centralized architecture to handle unstructured data and optimize performance.
MasterCard Optimizes Big Data Management with BMC High Speed Utilities for DB2®
- 1. © Copyright 2016 BMC Software, Inc. 1 — Kate Kavanaugh – MasterCard Phil Grainger – BMC Software MasterCard: Digital Masters BMC Next Generation Technology
- 2. © Copyright 2016 BMC Software, Inc. 2 Digital Business… is challenging Mainframe IT Baby boomers retiring Training new staff Unpredictable transaction patterns Growing transaction volumes Multi-platform complexity and integrations Systems Cost More non-revenue generating transactions Capacity growth MLC costs increase yearly Quickly deploy new applications Instant response time 24x7 availability Data Enormous data growth New data types Objects too big to easily manage Customers demand more, always available, faster applications
- 3. © Copyright 2016 BMC Software, Inc. 3 Waves of Data are Flooding your Database • Routine Database Maintenance Keeps Your Applications Afloat The Most Important Responsibilities for DBAs* #1 Database Maintenance - 70% #2 Performance – 69% Data that is physically well- organized can improve the performance of access paths that rely on index or table scans, and reduce the amount of disk storage used for the data.** • 90% Unstructured data
- 4. © Copyright 2016 BMC Software, Inc. 4 The key to digital success is to transform to of the time 100% Manage all of your database objects Automatically. Ensure the integrity of your Structured and Unstructured Data with no additional effort Application performance improvement with 10% Zero Outage a Digital Master Master the wave of data for a competitive edge!
- 5. © Copyright 2016 BMC Software, Inc. 5 — Digital Masters with Next Generation Technology Kate Kavanaugh MasterCard Technologies
- 6. © Copyright 2016 BMC Software, Inc. 6 MasterCard: Digital Masters Transforming the way people pay and get paid Helping businesses grow Improving the shopping experience Advancing financial inclusion around the world. Operates the world’s fastest payment processing network, connecting consumers, financial institutions, merchants, governments and businesses in more than 210 countries and territories
- 7. © Copyright 2016 BMC Software, Inc. 7 Who is MasterCard? 7 Consumers want better ways to pay. We invent them. Checkout lines are too slow. We help them move faster. Commuters are busy. We speed them on their way. Procurement is complicated. We make it simple. People want financial access. We find ways to serve them.
- 8. © Copyright 2016 BMC Software, Inc. 8 Who is MasterCard? 8 210 countries and territories 11,300 employees 48.3 billion processed transactions US $4.6 trillion* gross dollar volume US $9.7 billion net revenue
- 9. © Copyright 2016 BMC Software, Inc. 9 MasterCard: Our Environment 9 60 Data z/OS Subsystems Data Sharing and non-Data Sharing DB2 V10 and V11 CM 104.3 TB of Data Stored in DB2 9 DBAs DB2 Applications Mix of batch and online Some Standalone – Some interact across subsystems
- 10. © Copyright 2016 BMC Software, Inc. 10 The Digital Challenge – Flood of Data Leaving Indexes Disorganized Impacts Application Performance 10B ROWs 366 Partitions 1 NPI 7 indexes Approaching Limited to Current data Daily Reorgs 3-4 Partitions/Day Non Partitioned Index – Primary key Not Reorganized as part of daily reorg
- 11. © Copyright 2016 BMC Software, Inc. 11 Online Schema Change Need to Convert DSSIZE from 4G to 32G Requires a Full TS REORG 10TB! Dilemma Time not available for 5B IBM Reorg took 48 hours to reorg 2B rows IBM would require the purchase of 6 TB of DASD
- 12. © Copyright 2016 BMC Software, Inc. 12 BMC Next Generation Technology Innovative Processing Methods – Scalable for Digital Business • Goal was 24 hours • NGT REORG Converted the object in 5 hours with a full reorg • Daily process reduced from 4 hours to 45 minutes • Indexes always reorganized – Increased application performance
- 13. © Copyright 2016 BMC Software, Inc. 13 Database Maintenance with Availability Innovative Processing Methods • No application downtime (-904s) – RW all the time • Automation is able to suspend DPROP for a few seconds enabling drains – Automatically resumed • Online Schema changes require materialization – DB2 process can exceed timeout value
- 14. © Copyright 2016 BMC Software, Inc. 14 — BMC Data Management with Next Generation Technology
- 15. © Copyright 2016 BMC Software, Inc. 15 BMC High Speed Utilities with Next Generation Technology A new paradigm in Database Management Complete suite of DB2 High Speed Utilities with a Intelligent, Centralized Architecture Zero Outage Data Base Management Intelligent, self-learning automation Scalable to the extremes of digital business Intelligent Centralized Architecture
- 16. © Copyright 2016 BMC Software, Inc. 16 Intelligent Centralized Architecture Leverages DB2 and z Systems resources for performance and scalability Simplify data management with Intelligent policy driven automation Increase application performance with Zero Downtime with Innovative Processing Methods Guarantee data integrity of structured and unstructured data Manage growing databases with scalable parallelism that handles DB2 extremes Intelligent Centralized Architecture • Intelligent Policy Drive Automation • Innovative Processing Methods • Data Integrity • Scalable Parallelism
- 17. © Copyright 2016 BMC Software, Inc. 17 • Analyze your database as the utility runs based on real-time information • Ensures constant optimization • Eliminates JCL generation • Eliminates the need to manually handle exception objects • No templates or profiles to maintain Analyze entire databases in real time Dynamic Object Selection NGT Criteria Table NGT Schedule Table NGT Exception Table DBASE1 REORG TABLESPACE DBASE1.% RTS Force or exclude? Can it run now? Does it need to run? • Index only? • Copy only? DB2 RTS TABLES
- 18. © Copyright 2016 BMC Software, Inc. 18 0 10 20 30 40 50 60 70 80 90 CPU Elapsed IBM NGT Increased performance reduces costs and enables digital business Innovative Processing Methods • Patented No-SORT Technology • Leverage the power of z Systems and DB2 to achieve incredible performance • No need to decompress/recompress data reducing processing time and storage needs • PBGs processed in parallel reducing required time and resources
- 19. © Copyright 2016 BMC Software, Inc. 19 Maintain optimal application performance and guarantee data integrity Internal Data Integrity Checks • Indexes are always reorganized online; never updated or rebuilt • Integrity checking performed every time a utility is run • Save resources by automatically processing only indexes if required • Ex: Bank achieved a 90% improvement in applications when indexes were reorganized
- 20. © Copyright 2016 BMC Software, Inc. 20 Manage and validate unstructured data automatically Guarantee data integrity of LOBs with no change to operations • Proper LOB Management requires CHECK IX, CHECK DATA, CHECK LOB, REORG • What can go wrong? – Errors with LOBS occur when there are inconsistencies between the three main component objects • 60% of DBAs admit to not validating LOBs* • LOBMaster automatically validates and reorganizes LOBs as part of your automated database reorg – No change to your operations *Forrester Survey comissioned by BMC
- 21. © Copyright 2016 BMC Software, Inc. 21 Server SYSPLEX NODE NGT PROCESSES Server Server Utility Job Dynamic parallel processing that leverages the power of system Z Spread work across a sysplex One statement can process thousands of objects Future Proof Technology ready to handle the extremes of DB2 Easily Manage Extreme Data Growth Scalable Parallel Processing
- 22. © Copyright 2016 BMC Software, Inc. 22 Unleash the Power and Value of Your Mainframe • Review your data trends, environment and current capabilities • Review your processes and tools against best practices • Identify gaps and remediation options • Assess business benefits to close gaps Next Steps: Digital Data Management Review