Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI verticals
5 likes2,051 views
The document presents Oracle's GoldenGate solution for real-time data replication and integration, highlighting its capabilities for zero downtime migrations, high availability, and disaster recovery. It details the advantages of using GoldenGate, such as reduced system overhead, cost savings, and improved migration processes across different database environments. The content serves as an informational overview rather than a commitment to deliver specific features or functionalities.
Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI verticals
- 1. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.1 Oracle Real Time Replica Solution : Oracle GoldenGate Milomir Vojvodic EMEA Senior Business Development Manager Oracle Data Integration Product Group September 2012
- 2. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.2 The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Safe Harbor Statement
- 3. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.3 New DB/HW/OS/APP Fully Active DB Reporting Database and/or DR database Data Warehouse OGG OGG OGG ADG OGG Zero Downtime Migrations & Upgrades Active/Active High Availability Query Off-Loading and Disaster Recovery BI&DW Synchronization and Loading Migrations & Consolidations ODI ODI Oracle Data Integration Solutions Together EDQ EDQ
- 4. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.4 Oracle Real Time Replica Solution (Oracle GoldenGate)
- 5. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.5 Target DB OGG Source DB What is OGG?
- 6. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.6 New DB/HW/OS/APP Fully Active DB Reporting Database and/or DR database Data Warehouse OGG OGG OGG ADG OGG Zero Downtime Migrations & Upgrades Active/Active High Availability Query Off-Loading and Disaster Recovery BI&DW Synchronization and Loading Migrations & Consolidations Use Cases Of OGG
- 7. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.7 Target DB OGG Source DB First OGG Differentiator Accessing directly transaction logs Second OGG Differentiator Moving only committed transactions Why Is OGG Different?
- 8. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.8 TIME REQUIRED FOR THE END OF DAY PROCEDURE Hours NO OF CPUs REQUIRED FOR SAME PERFORMANCE* No Of Required CPUs ESTIMATED COSTS FOR SERVER AND LICENSE** Estimated Cost of Purchase in USD 0 50 100 150 Year1 Year2 Year3 Year4 Year5 Currently during the End Of Day utilizes the Server CPU by 40-50% and the IO by 90%. Probably the IO is the bottleneck. 0 20 40 60 80 100 120 Year1 Year2 Year3 Year4 Year5 Disaster Recovery Test and Development Primary Site $- $1 $1 $2 $2 $3 Millions Oracle License Costs Hardware Costs Daily load time can reach 5 days with the current HW OR Replacing Batch Window First OGG Differentiator Accessing directly transaction logs
- 9. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.9 Physical Replication OGG Like-to-like databases and platforms Heterogeneous databases and platforms One-to-one topology with all-or-nothing data replication Many-to-many topology with selective and optimized data movement No transaction integrity Guaranteed transaction integrity Data corruption propagated to target Data corruption is isolated at source No rollback or point-in-time recovery Selective and dynamic rollback with advanced point-in-time recovery Target system unavailable for data processing Both source and target systems are available No data transformation capability Data transformation and enrichment Geographic distance limitation between data source and target No distance limitations OR Second OGG Differentiator Moving only committed transactions Replacing Storage Replica Begin, TX 1 Insert, TX 1 Begin, TX 2 Update, TX 1 Insert, TX 2 Commit, TX 2 Begin, TX 3 Insert, TX 3 Begin, TX 4 Commit, TX 3 Delete, TX 4 Begin, TX 2 Insert, TX 2 Commit, TX 2 Begin, TX 3 Insert, TX 3 Commit, TX 3 Begin, TX 2 Insert, TX 2 Commit, TX 2 Capture Checkpoint Pump Checkpoint Delivery Checkpoint
- 10. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.10 Unidirectional Query Offloading Zero-Downtime Migration Bi-Directional Hot Standby or Active-Active for HA Peer-to-Peer Load Balancing Multi-Master Broadcast Data Distribution Integration/Consolidation Data Warehouse BPM BAM CEP Data Distribution via Messaging Directions
- 11. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.11 Log-based change data capture – High volume – Low overhead Decoupled architecture – Multiple capture processes may be used to scale, but generally not required – Possible to split “hot” tables into a separate capture process Filtering and compression – Unnecessary change data is discarded immediately – Updates and deletes are “compressed” by default – Before images are discarded by default OGG Capture
- 12. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.13 New DB/HW/OS/APP Fully Active DB Reporting Database and/or DR database Data Warehouse OGG OGG OGG ADG OGG Zero Downtime Migrations & Upgrades Active/Active High Availability Query Off-Loading and Disaster Recovery BI&DW Synchronization and Loading Migrations & Consolidations Use Cases Of OGG
- 13. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.14 Reduce the workload on production Annual amortization of HW purchase 250 000 USD (1 000 000 USD per 4 years) Annual HW maintanence 100 000 USD Annual SW maintance 200 000 USD Energy, floor space 200 000 USD Overall 800 000 USD, as there are 36 CPUs, Annual cost 22 000 USD per CPU Overhead 8% with other solution, overhead 3% with GoldenGate Cost of overhead 64 000 USD vs 24 000 USD Savings 40 000 USD per year Alternative option for target server DB software first option 100 000 USD, DB software second option 50 000 USD, Annual DB software support 22 000 USD vs 11 000 USD OGG Offload Reporting Benefits
- 14. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.15 New DB/HW/OS/APP Fully Active DB Reporting Database and/or DR database Data Warehouse OGG OGG OGG ADG OGG Zero Downtime Migrations & Upgrades Active/Active High Availability Query Off-Loading and Disaster Recovery BI&DW Synchronization and Loading Migrations & Consolidations Use Cases Of OGG
- 15. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.16 APPS APPS APPS ONLY REPORTINGAPPS OGG Benefits For Dual Active DBs
- 16. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.17 New DB/HW/OS/APP Fully Active DB Reporting Database and/or DR database Data Warehouse OGG OGG OGG ADG OGG Zero Downtime Migrations & Upgrades Active/Active High Availability Query Off-Loading and Disaster Recovery BI&DW Synchronization and Loading Migrations & Consolidations Use Cases Of OGG
- 17. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.18 Analysis and script generation using PL/SQL New SAP implementation Existing SAP implementation Capture Source Trail Delivery Target Trail Migration scripts are created to create new DB, table-space and implement GoldenGate and allow verification Installation and commencement of real-time GoldenGate transactional data capture does not require system downtime and has limited impact on production system performance (“remote capture” can be used if needed) • Minimum Oracle database version for the production system is 9.2.0.8 • Oracle version on the target can be 10.2 or 11.2 and any UNIX, Linux or Windows platform is supported • All SAP products and solutions where Oracle database is certified are supported (such as R/3, BW, CRM or XI) • Supplemental Logging must be enabled on the source database prior to Oracle GoldenGate implementation • The source Oracle database cannot contain any OLTP compressed tables Oracle 9i or above Existing Platform Oracle 11g New Platform Migration scripts are executed against the target/new implementation and large tables are transferred directly to new DB GoldenGate delivery commences into new database with optimization to support migration needs Final switch over takes place – SAP tasks are undertaken and production users move to migrated system GoldenGate process can continue running for as long as needed to ensure that target system is optimized for use – no time limits SAP Note 1508271
- 18. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.19 Available – no issues • Planned outage • Upgrade • Migration • Maintenance • Unplanned outage • System failure • Data failure • Semi-available • Performance issues Reusability Of OGG Licenses
- 19. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.20 Available – no issues • Planned Outage • Upgrade • Migration • Maintenance • Unplanned Outage • System Failure • Data Failure • Need Additional Computing Resources • Performance issues • Growth Reusability Of OGG Licenses
- 20. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.21 Available – no issues Reusability Of OGG Licenses • Planned Outage • Upgrade • Migration • Maintenance • Unplanned Outage • System Failure • Data Failure • Need Additional Computing Resources • Performance issues • Growth
- 21. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.22 Reusability Of OGG Licenses
- 22. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.23 Reusability Of OGG Licenses
- 23. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.24 Reusability Of OGG Licenses
- 24. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.25 GoldenGate as a platform for all use cases -70% -80% -70%• Reduce downtime (end user productivity and customer satisfaction ) by 70% • Reduce migration and recovery effort by 80% • Reduce source system overhead (and costs for stronger HW) by at least 70% • Decrease TCO because of report server by 80% • Communication Cost Savings by 10% • Global optimization of resources as having real time insight in regional capacities • Avoiding data loss • Consolidating and modernizing into more efficient systems Performance Flexible & Extendable Reliable OGG Value Proposition
- 25. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.26 Avoids expensive network infrastructure upgrades: – Moves only the committed changed data on a continuous basis – Avoids moving the same data more than once – Allows low overhead on the network – No need for fibre channel upgrade or investment – Reduce source system overhead (and costs for stronger HW) – Reduce TCO for Reporting Server Requires minimal labour resources for deployment and management: – Provides fast and easy deployment – Requires minimal intervention once deployed – Offers fast and complete recovery from any outages or interruptions – Reducing downtime, increasing work force satisfaction and productivity – Avoiding Data Loss, additional costs from inaccurate data man/days to recover from data loss – Reduced recovery efforts in events of network or communication failure Real Time Replica And OGG Value Proposition
- 26. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.27 Oracle GoldenGate Director: Has basic configuration, management, monitoring, and alerting. Based on legacy pull infrastructure. Works on legacy GoldenGate instances. OGG Director
- 27. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.28 Oracle GoldenGate Monitor: Has advanced monitoring, alerting (SNMP support), lag graphs, and historical repository. Based on new agent infrastructure, which will be the foundation for all future integration projects. OGG Monitor
- 28. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.29 • A high-speed, low impact data comparison solution • Identifies and reports data discrepancies between heterogeneous databases without interrupting their availability • Benefits: • Reduce financial/legal risk exposure • Speed and simplify IT work in comparing data sources • No disruption to business systems • Improved failover to backup systems • Confident decision-making and reporting OGG Monitor
- 29. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.30 ODI OGG OWB =Gateways for non Oracle sources =Declarative Design =Integrating with other Oracle Products INFA PowerCenter =No such reusability already built best practice procedures =Push Down =Client Installation Manual Coding =Metadata Repository =Designing DW schema =Profile in advance source apps Talend =Metadata Level Limitations =Datatype Conversion =Separation between Physical and Logical resources IBM DataStage =Legacy Code =Push Down =Universe DB INFA PowerExchange =Disturb source CDC operation when scale =Auto-restart feature, trapping apply side errors&exceptions =DDL support Streams =Streams capture changes immediately in Redo. =Advanced Queuing =Multiple Stored Procedures IBM InfoSphere CDC =Check-pointing mechanism stored as database tables Storage Level Replica =Commit Transactions =Transformation =Corrupted Data Competition 3 Key Functional Differences Shareplex =Data Transformations =Pre-image check =DDL and data types
- 30. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.31 References Extract For Financial Services
- 31. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.32 References Extract for Telco
- 32. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.33 Real Time Replica (Oracle GoldenGate) For Financial Services
- 33. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.34 Migration of Card Authorization System Migration of Core Banking Systems + Migration of Payment Processing System DR+AA for Payment Processing System DR+AA for Payment Processing System + unidirectional to DW Feeds from Payment Processing System to Fraud Detection System Feeds from Payment Processing System to Device Monitoring System Feeds from Core Banking Systems to other Back Office Applications (Risk Management, Clearing and Settlement, Reporting to Member Banks) Offload Reporting from Core Banking Systems in order to improve performance Bi-directional synchronization between Payment Processing and Card Management System Real Time Replica In Financial Services
- 34. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.35 Credit Cards Loans, Mortgages Funds, Assets Business Unit A Marketing System Business Unit B Accounting System Group Risk Management Group Risk Management CRM Regulatory reporting Statutory reporting Management Information Systems Customers Accounts … ODI EDQ Core Banking (Payment Processing, Accounts) ODI R Fraud Detection OGG OGG OGG OGG OGG OGG OGG OGG OGG Real Time Replica In Financial Services
- 35. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.36 Core Banking Loans, Mortgages Credit Cards Funds, Assets Business Unit A Marketing System Business Unit B Accounting System Group Risk Management Group Risk Management CRM Regulatory reporting Statutory reporting Management Information Systems Banking Architecture
- 36. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.39 Customer Place Order Telephone Network Bill Customer Customer Care Billing Collect Usage Self Care CRM Call Center Customers ODI EDQ Billing R R SR ODS ODI OGG OGG OGG OGG R Real Time Replica In Telco
- 37. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.40 Telephone Network Service Fulfillment Service Assurance Configure Network Monitor Network Order Fulfillment R Network ODI Intentory and Workorder Management System Network Alarms Monitoring System Network Performance Monitoring System Network Managament System ODI OGG Real Time Replica In Telco
- 38. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.41 The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Safe Harbor Statement