SlideShare a Scribd company logo
EnterpriseDB’s
xDB Replication solution
Setup and Success stories by Ashnik in ASEAN
25/8/2014
Confidentialinformation,forinternaluseonly
Confidentialinformation,forinternaluseonly
2
POSTGRES
innovation
ENTERPRISE
reliability
24/7
support
Services
& training
Enterprise-class
features & tools
Indemnification
Product
road-map
Control
Thousands
of developers
Fast
development
cycles
Low cost
No vendor
lock-in
Advanced
features
Get The Best
Of Both Worlds
• Asynchronous cascading master to multiple replicas
• Asynchronous multi-master
• Can be used for:
• Improved performance for geographically
dispersed users
• High availability
• Load distribution (OLTP vs. reporting)
xDB Replication Server
3
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
• High Availability uses
• Geographic distribution of load
• For creation of Testing/staging env using snapshot replication
• Segregate OLTP and reporting
xDB Replication Use Cases
4
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
Replication
xDB Replication Server (Single Master)
5
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
Supports EDB and Oracle near real-time heterogeneous replication
Supports Postgres to Postgres replication now
Trigger-based system with less than 10% performance impact
Applications
• For customers “stuck” on an Oracle database
• Offload reporting to EDB
• Keep Oracle database running fast for transactions
xDB Single-Master Replication (SMR)
6
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
Table
D
Table
C
Table
B
Table
A
Table
C
Table
D
Procs
Objects
ReportsQueries
Continuous
or Scheduled
----------------
Filtered
or All Rows
Transaction
Replication
Improved
OLTP
Performance
Inexpensive
Query /
Reporting
Oracle Server Postgres Plus Advanced Server
7
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
xDB Replication – Heterogeneous DB Support
Source  Target Oracle
Microsoft SQL
Server
2005/2008
PostgreSQL
Postgres Plus
Advanced
Server (Oracle
mode)
Postgres Plus
Advanced
Server
(PostgreSQL
mode)
Oracle Yes Yes Yes
Microsoft SQL Server Yes Yes Yes
PostgreSQL Yes Yes* Yes Yes*
Postgres Plus Advanced
Server (Oracle mode)
Yes Yes Yes*
Postgres Plus Advanced
Server (PostgreSQL mode)
Yes Yes* Yes Yes*
* Supported in Multi-Master mode
8
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
Master-to-Master Replication for 2 or more nodes
Trigger-based asynchronous implementation
• Delay of a couple of seconds to possibly minutes depending
on configuration and load
Automatic Conflict Detection
• Uniqueness
• Update
• Delete
Multiple Conflict Resolution
• Earliest or Latest Timestamp
• Node priority – one node always wins
• Manual – Administrator reviews and actions
xDB Replication Server (Multi-Master)
9
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
Ideal for Geo-dispersed Servers
Each geography updates a local master faster than to a single common
master
Allows failover of one geography to another geography
Provides write availability
• Java-based Replication Server and Replication Console
• Delta changes recorded in shadow tables via post Insert/Update/Delete triggers
• Data Replication through JDBC channel
xDB MMR Architecture
10
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
• Multi Master Replication – State Farms Insurance, USA
• DR Site Replication – ToT, Thailand
• Reporting Server Replication- Packet1, Malaysia
Production Implementation of xDB
11
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
12
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
SUCCESS STORIES in ASEAN
Issues in Environment
- Delayed Reports
- Additional Oracle Server for
reporting = Extra Cost
- Extra Add-on component needed
for Replication between OLTP and
Reporting DB
- Reports being pulled from two
Databases- ArchiveDB and LiveDB
- No Primary Keys in database to
implement change data capture
Solution Suggested
- Migrate Archive DB to Postgres Plus
- Do daily snapshot of changes from Oracle to
Postgres Plus
- Use xDB replication for Snapshot
Implementation
- Migrated 1.2TB of Archive and 700MB of
Live DB
- 500MB of Differential data replicated on
daily basis
- Result – Reports are generated on time!
- OLTP Performance improved due to
offloading
Packet1- A Major Telco in Malaysia improves Reporting
Performance with EnterpriseDB
13
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
ToT, Thailand plans to replace Oracle Exadata-TimesTen In-
memory database with HP-EnterpriseDB stack
14
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
Background
• Largest public sector company in telecom in Thailand
• Has very stringent response time SLA (20ms response time for user requests ~ 3-5 read queries)
• Current setup has Oracle Exadata and four TimeTen In-memory databases
Current Challenges in Oracle Stack
• Issues in sync of Exadata with
In-memory databases
• Full refresh locks the tables
• Current system can go upto 1500 tps
• Dynamic Partitioning for huge table
• Current system load is 750 TPS with
write operations
• 5000 user requests (16.5K read queries)
per second with 4 servers
HP-EnterpriseDB Stack Proposed to be DR for Exadata
• HP DL-980 (4 CPU * 10 cores, 256GB RAM)
• 1TB VMA Disks for faster access
• Simulation tests show 2800 write-TPS achieved
• Flexible Partitioning scheme in PPAS (add partition on the fly for
each new date, no manual intervention)
• Currently this server is being tested as DR for Exadata
• Replication using xDB near-relatime replication for 1000 tps
• Scalability achieved using cascaded replication and Infinite Cache
• Setup can handle 5500 user requests (18K queries per second)
with 1.5-2.5ms response time per query
PostgreSQL – Postgres Plus Users, Globally
15
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
16
PostgreSQL – Postgres Plus Users, across ASEAN
CONFIDENTIAL
©2011EnterpriseDB.Allrightsreserved.
Malaysia
Philippines
Singapore
Vietnam Thailand
Indonesia
Confidentialinformation,forinternaluseonly
17

More Related Content

DOC
Riesgos maritimos portuarios
PDF
xDB 5.0シングルマスター機能説明 シングルマスター編
PDF
Enterprise Manager 3.0
PDF
xDB Replication ブローシャー
PDF
[data analytics showcase] B16: Live Demo! データ分析基盤を支えるデータレプリケーション技術とデータワークロード分...
PDF
Art of MySQL Replication.
PDF
Enterprise PostgreSQL - EDB's answer to conventional Databases
PDF
Active/Active Database Solutions with Log Based Replication in xDB 6.0
 
Riesgos maritimos portuarios
xDB 5.0シングルマスター機能説明 シングルマスター編
Enterprise Manager 3.0
xDB Replication ブローシャー
[data analytics showcase] B16: Live Demo! データ分析基盤を支えるデータレプリケーション技術とデータワークロード分...
Art of MySQL Replication.
Enterprise PostgreSQL - EDB's answer to conventional Databases
Active/Active Database Solutions with Log Based Replication in xDB 6.0
 

Similar to X-DB Replication Server and MMR (20)

PPTX
Enterprise-class security with PostgreSQL - 2
PDF
EDB Postgres Replication Server
 
PPTX
EDB Database Servers and Tools
PDF
Reducing the Risks of Migrating Off Oracle
 
PDF
Powerplay: Postgres and Lenovo for the Best Performance & Savings
 
PPTX
PPCD_And_AmazonRDS
PDF
Drive DBMS Transformation with EDB Postgres
 
PPTX
EDB: Power to Postgres
PPTX
Powering GIS Application with PostgreSQL and Postgres Plus
PDF
Save money with Postgres on IBM PowerLinux
 
PDF
From Database to Strategy - Sandor Klein
PDF
EDB & ELOS Technologies - Break Free from Oracle
 
PPT
EDB corporate prague_march_2015
PDF
Optimizing Open Source for Greater Database Savings & Control
 
PDF
Postgres Integrates Effectively in the "Enterprise Sandbox"
 
PDF
Best Practices for a Complete Postgres Enterprise Architecture Setup
 
PDF
Technical Introduction to PostgreSQL and PPAS
PDF
Which postgres is_right_for_me_20130517
 
PDF
Reducing Database Pain & Costs with Postgres
 
PPTX
Postgres survey podcast
Enterprise-class security with PostgreSQL - 2
EDB Postgres Replication Server
 
EDB Database Servers and Tools
Reducing the Risks of Migrating Off Oracle
 
Powerplay: Postgres and Lenovo for the Best Performance & Savings
 
PPCD_And_AmazonRDS
Drive DBMS Transformation with EDB Postgres
 
EDB: Power to Postgres
Powering GIS Application with PostgreSQL and Postgres Plus
Save money with Postgres on IBM PowerLinux
 
From Database to Strategy - Sandor Klein
EDB & ELOS Technologies - Break Free from Oracle
 
EDB corporate prague_march_2015
Optimizing Open Source for Greater Database Savings & Control
 
Postgres Integrates Effectively in the "Enterprise Sandbox"
 
Best Practices for a Complete Postgres Enterprise Architecture Setup
 
Technical Introduction to PostgreSQL and PPAS
Which postgres is_right_for_me_20130517
 
Reducing Database Pain & Costs with Postgres
 
Postgres survey podcast
Ad

More from Ashnikbiz (20)

PPTX
CloudOps_tool.pptx
PPTX
Webinar_CloudOps final.pptx
PPTX
Autoscaling in Kubernetes (K8s)
PPTX
Why and how to use Kubernetes for scaling of your multi-tier (n-tier) appli...
PDF
Zero trust in a multi tenant environment
PPTX
Deploy and automate ‘Secrets Management’ for a multi-cloud environment
PPTX
Deploy, move and manage Postgres across cloud platforms
PPTX
Deploy, move and manage Postgres across cloud platforms
PPTX
The Best Approach For Multi-cloud Infrastructure Provisioning-2
PPTX
The Best Approach For Multi-cloud Infrastructure Provisioning
PPTX
Which PostgreSQL is right for your multi cloud strategy? P2
PPTX
Which PostgreSQL is right for your multi cloud strategy? P1
PPTX
Reduce the complexities of managing Kubernetes clusters anywhere 2
PPTX
Reduce the complexities of managing Kubernetes clusters anywhere
PPTX
Enhance your multi-cloud application performance using Redis Enterprise P2
PPTX
Enhance your multi-cloud application performance using Redis Enterprise P1
PPTX
Gain multi-cloud versatility with software load balancing designed for cloud-...
PPTX
Gain multi-cloud versatility with software load balancing designed for cloud-...
PPTX
Enterprise-class security with PostgreSQL - 1
PPTX
Securing Your CI Pipeline with HashiCorp Vault - P2
CloudOps_tool.pptx
Webinar_CloudOps final.pptx
Autoscaling in Kubernetes (K8s)
Why and how to use Kubernetes for scaling of your multi-tier (n-tier) appli...
Zero trust in a multi tenant environment
Deploy and automate ‘Secrets Management’ for a multi-cloud environment
Deploy, move and manage Postgres across cloud platforms
Deploy, move and manage Postgres across cloud platforms
The Best Approach For Multi-cloud Infrastructure Provisioning-2
The Best Approach For Multi-cloud Infrastructure Provisioning
Which PostgreSQL is right for your multi cloud strategy? P2
Which PostgreSQL is right for your multi cloud strategy? P1
Reduce the complexities of managing Kubernetes clusters anywhere 2
Reduce the complexities of managing Kubernetes clusters anywhere
Enhance your multi-cloud application performance using Redis Enterprise P2
Enhance your multi-cloud application performance using Redis Enterprise P1
Gain multi-cloud versatility with software load balancing designed for cloud-...
Gain multi-cloud versatility with software load balancing designed for cloud-...
Enterprise-class security with PostgreSQL - 1
Securing Your CI Pipeline with HashiCorp Vault - P2
Ad

Recently uploaded (20)

PPTX
Spectroscopy.pptx food analysis technology
PDF
Unlocking AI with Model Context Protocol (MCP)
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
KodekX | Application Modernization Development
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Encapsulation theory and applications.pdf
PPT
Teaching material agriculture food technology
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Spectroscopy.pptx food analysis technology
Unlocking AI with Model Context Protocol (MCP)
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
The Rise and Fall of 3GPP – Time for a Sabbatical?
KodekX | Application Modernization Development
Building Integrated photovoltaic BIPV_UPV.pdf
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Encapsulation theory and applications.pdf
Teaching material agriculture food technology
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Reach Out and Touch Someone: Haptics and Empathic Computing
MIND Revenue Release Quarter 2 2025 Press Release
NewMind AI Weekly Chronicles - August'25 Week I
20250228 LYD VKU AI Blended-Learning.pptx
Understanding_Digital_Forensics_Presentation.pptx
“AI and Expert System Decision Support & Business Intelligence Systems”
Advanced methodologies resolving dimensionality complications for autism neur...
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx

X-DB Replication Server and MMR

  • 1. EnterpriseDB’s xDB Replication solution Setup and Success stories by Ashnik in ASEAN 25/8/2014 Confidentialinformation,forinternaluseonly
  • 2. Confidentialinformation,forinternaluseonly 2 POSTGRES innovation ENTERPRISE reliability 24/7 support Services & training Enterprise-class features & tools Indemnification Product road-map Control Thousands of developers Fast development cycles Low cost No vendor lock-in Advanced features Get The Best Of Both Worlds
  • 3. • Asynchronous cascading master to multiple replicas • Asynchronous multi-master • Can be used for: • Improved performance for geographically dispersed users • High availability • Load distribution (OLTP vs. reporting) xDB Replication Server 3 CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved.
  • 4. • High Availability uses • Geographic distribution of load • For creation of Testing/staging env using snapshot replication • Segregate OLTP and reporting xDB Replication Use Cases 4 CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved. Replication
  • 5. xDB Replication Server (Single Master) 5 CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved. Supports EDB and Oracle near real-time heterogeneous replication Supports Postgres to Postgres replication now Trigger-based system with less than 10% performance impact Applications • For customers “stuck” on an Oracle database • Offload reporting to EDB • Keep Oracle database running fast for transactions
  • 6. xDB Single-Master Replication (SMR) 6 CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved. Table D Table C Table B Table A Table C Table D Procs Objects ReportsQueries Continuous or Scheduled ---------------- Filtered or All Rows Transaction Replication Improved OLTP Performance Inexpensive Query / Reporting Oracle Server Postgres Plus Advanced Server
  • 7. 7 CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved. xDB Replication – Heterogeneous DB Support Source Target Oracle Microsoft SQL Server 2005/2008 PostgreSQL Postgres Plus Advanced Server (Oracle mode) Postgres Plus Advanced Server (PostgreSQL mode) Oracle Yes Yes Yes Microsoft SQL Server Yes Yes Yes PostgreSQL Yes Yes* Yes Yes* Postgres Plus Advanced Server (Oracle mode) Yes Yes Yes* Postgres Plus Advanced Server (PostgreSQL mode) Yes Yes* Yes Yes* * Supported in Multi-Master mode
  • 8. 8 CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved. Master-to-Master Replication for 2 or more nodes Trigger-based asynchronous implementation • Delay of a couple of seconds to possibly minutes depending on configuration and load Automatic Conflict Detection • Uniqueness • Update • Delete Multiple Conflict Resolution • Earliest or Latest Timestamp • Node priority – one node always wins • Manual – Administrator reviews and actions xDB Replication Server (Multi-Master)
  • 9. 9 CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved. Ideal for Geo-dispersed Servers Each geography updates a local master faster than to a single common master Allows failover of one geography to another geography Provides write availability
  • 10. • Java-based Replication Server and Replication Console • Delta changes recorded in shadow tables via post Insert/Update/Delete triggers • Data Replication through JDBC channel xDB MMR Architecture 10 CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved.
  • 11. • Multi Master Replication – State Farms Insurance, USA • DR Site Replication – ToT, Thailand • Reporting Server Replication- Packet1, Malaysia Production Implementation of xDB 11 CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved.
  • 13. Issues in Environment - Delayed Reports - Additional Oracle Server for reporting = Extra Cost - Extra Add-on component needed for Replication between OLTP and Reporting DB - Reports being pulled from two Databases- ArchiveDB and LiveDB - No Primary Keys in database to implement change data capture Solution Suggested - Migrate Archive DB to Postgres Plus - Do daily snapshot of changes from Oracle to Postgres Plus - Use xDB replication for Snapshot Implementation - Migrated 1.2TB of Archive and 700MB of Live DB - 500MB of Differential data replicated on daily basis - Result – Reports are generated on time! - OLTP Performance improved due to offloading Packet1- A Major Telco in Malaysia improves Reporting Performance with EnterpriseDB 13 CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved.
  • 14. ToT, Thailand plans to replace Oracle Exadata-TimesTen In- memory database with HP-EnterpriseDB stack 14 CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved. Background • Largest public sector company in telecom in Thailand • Has very stringent response time SLA (20ms response time for user requests ~ 3-5 read queries) • Current setup has Oracle Exadata and four TimeTen In-memory databases Current Challenges in Oracle Stack • Issues in sync of Exadata with In-memory databases • Full refresh locks the tables • Current system can go upto 1500 tps • Dynamic Partitioning for huge table • Current system load is 750 TPS with write operations • 5000 user requests (16.5K read queries) per second with 4 servers HP-EnterpriseDB Stack Proposed to be DR for Exadata • HP DL-980 (4 CPU * 10 cores, 256GB RAM) • 1TB VMA Disks for faster access • Simulation tests show 2800 write-TPS achieved • Flexible Partitioning scheme in PPAS (add partition on the fly for each new date, no manual intervention) • Currently this server is being tested as DR for Exadata • Replication using xDB near-relatime replication for 1000 tps • Scalability achieved using cascaded replication and Infinite Cache • Setup can handle 5500 user requests (18K queries per second) with 1.5-2.5ms response time per query
  • 15. PostgreSQL – Postgres Plus Users, Globally 15 CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved.
  • 16. 16 PostgreSQL – Postgres Plus Users, across ASEAN CONFIDENTIAL ©2011EnterpriseDB.Allrightsreserved. Malaysia Philippines Singapore Vietnam Thailand Indonesia