SlideShare a Scribd company logo
Basics : Simple Replicator Installation
Extract from MySQL
Topics
In this short course we will:
• Review the Replicator
• Review prerequisites required
• Discuss installation Methods
– Staging vs INI
• Walkthrough an Installation (Full end to end demo)
• Recap Key Resources and Tools
Course Prerequisite Learning
– Basics: Introduction to Tungsten Replicator
– Visit Continuent website or Tungsten University on YouTube to watch these recordings
2
Tungsten Replicator Architecture
Tungsten Replicator
4
DBMS
Logs
MySQL/Oracle
Master Replicator:
Extractor
THL
Slave Replicator:
Applier
THL
MySQL/Oracle
T
THL
T
Key Decisions and Prerequisites
Pre Installation Environment Decisions
• Which release of MySQL?
– MySQL Community
– Percona
– MariaDB
– Oracle MySQL Enterprise
• Which version?
– 5.0 to 5.7
• What monitoring tools do you have?
• Full or Partial Replication
• What backup tools do you have?
6
Prerequisities
• Review docs
– http://docs.continuent.com/tungsten-replicator-5.3/prerequisite.html
• Host Prerequisites
– OS user
– /etc/hosts
– sudoers and ssh
– Ruby
– Java
• Network Prerequisites
– Review port requirements
• MySQL Prerequisites
– my.cnf settings
– tungsten user accounts
7
Pre Installation Tungsten Decisions
• TAR file or RPM?
• INI-based install or staging install?
• SSL Enabled?
8
Installation Methods: ini vs staging
• INI-based Install
– Install managed via /etc/tungsten/tungsten.ini on EACH host
– PROS
• Control over each node individually
• Easy integration to automation software such as puppet and chef
• Remove dependency on single host for install
– CONS
• Configuration changes must be performed individually
• Risk of misconfiguration between nodes
9
Installation Methods: ini vs staging
• Staging Install
– Install managed from one host
– Could be a source/target node or a separate host outside of replication.
– PROS
• One single place for configuration
• Easy to install/update entire topology in one go
• Configuration applied to all nodes, less risk of misconfiguration
– CONS
• No easy integration to automation software
• Staging host become single point of failure for configuration management
– Especially important if Staging host is a DB Node
10
Installation Demo
DBMS
Logs
Download transactions
via network
Apply using JDBC
THL = Events + Metadata
MySQL
MySQL Binary
Logging
Option 1: Local Install
Extractor reads directly
from the logs, even when
the DBMS service is
down. This is the default.
Option 2: Remote
Extractor gets log data
via MySQL Replication
Slave protocols (which
requires the DBMS
service to be online). This
is how we handle RDS
extraction tasks.
Extractor
Options
Master Replicator:
Extractor
THL
2 1
Slave Replicator:
Applier
THL
MySQL
Command Line Tools
&
Resources
Tools : trepctl
13
• “trepctl status” can be run from any node to view the status of the local replicator
• “trepctl status –r 3” will show status output refreshed every 3 second until CTRL+C
• “trepctl qs” provides a quick summary overview of the local replicator
• “trepctl perf” provides deeper diagnostics of the different stages in the replicators
$ trepctl qs
State: east Online for 21.069s, running for 45.654s
Latency: 0.837s from DB commit time on db1 into THL
21.839s since last database commit
Sequence: 1 last applied, 0 transactions behind (0-1 stored) estimate 0.00s before synchronization
Log Files
14
• The /opt/continuent/service_logs/ directory contains both text files and symbolic links.
• Links in the service_logs directory go to following subdirectory:
– /opt/continuent/tungsten/tungsten-replicator/log/
tungsten@db1:/opt/continuent/service_logs $ ll
total 116
lrwxrwxrwx 1 tungsten tungsten 60 Jan 06 09:52 trepsvc.log -> /opt/continuent/tungsten/tungsten-replicator/log/trepsvc.log
Next Steps
• If you are interested in knowing more about the software and would like to try it out for yourself,
please contact our sales team who will be able to take you through the details and setup a POC
– sales@continuent.com
• Read the documentation at http://docs.continuent.com/tungsten-replicator-5.3/index.html
• Subscribe to our Tungsten University YouTube channel! http://tinyurl.com/TungstenUni
• Visit the events calendar on our website for upcoming Webinars and Training Sessions
15
For more information, contact us:
Eric Stone
COO
eric.stone@continuent.com
MC Brown
VP Products
mc.brown@continuent.com
Chris Parker
Director, Professional Services EMEA & APAC
chris.parker@continuent.com
Eero Teerikorpi
Founder, CEO
eero.teerikorpi@continuent.com
+1 (408) 431-3305

More Related Content

PDF
Training Slides: Basics 104: Simple Tungsten Clustering Deployments
PPTX
Accomplishing redundancy on Lustre based PFS with DRBD
PPT
Building large scale, job processing systems with Scala Akka Actor framework
PPTX
Replication and replica sets
PDF
Streaming Replication (Keynote @ PostgreSQL Conference 2009 Japan)
PDF
Performance Analysis and Troubleshooting Methodologies for Databases
PPTX
Functional? Reactive? Why?
PDF
File Systems: Why, How and Where
Training Slides: Basics 104: Simple Tungsten Clustering Deployments
Accomplishing redundancy on Lustre based PFS with DRBD
Building large scale, job processing systems with Scala Akka Actor framework
Replication and replica sets
Streaming Replication (Keynote @ PostgreSQL Conference 2009 Japan)
Performance Analysis and Troubleshooting Methodologies for Databases
Functional? Reactive? Why?
File Systems: Why, How and Where

What's hot (20)

PPTX
PDF
Logical Replication in PostgreSQL - FLOSSUK 2016
PDF
OpenZFS at LinuxCon
PDF
Gluster Metrics: why they are crucial for running stable deployments of all s...
PPSX
FD.io Vector Packet Processing (VPP)
PPTX
Tuning for Oracle RAC Wait Events
PDF
Demystifying postgres logical replication percona live sc
PDF
PostgreSQL HA
ODP
Firewalld : A New Interface to Your Netfilter Stack
PDF
Evergreen Sysadmin Survival Skills
ODP
Speeding up ps and top
PDF
Let’s Fix Logging Once and for All
PDF
On The Building Of A PostgreSQL Cluster
PPTX
Modern Linux Tracing Landscape
PDF
DB Latency Using DRAM + PMem in App Direct & Memory Modes
PPTX
Db spof(mssql, my sql)
DOC
netapp c-mode terms
PPTX
Tuning Linux for MongoDB
PDF
Architecture for building scalable and highly available Postgres Cluster
PPTX
Geek Sync | Infrastructure for the Data Professional: An Introduction
Logical Replication in PostgreSQL - FLOSSUK 2016
OpenZFS at LinuxCon
Gluster Metrics: why they are crucial for running stable deployments of all s...
FD.io Vector Packet Processing (VPP)
Tuning for Oracle RAC Wait Events
Demystifying postgres logical replication percona live sc
PostgreSQL HA
Firewalld : A New Interface to Your Netfilter Stack
Evergreen Sysadmin Survival Skills
Speeding up ps and top
Let’s Fix Logging Once and for All
On The Building Of A PostgreSQL Cluster
Modern Linux Tracing Landscape
DB Latency Using DRAM + PMem in App Direct & Memory Modes
Db spof(mssql, my sql)
netapp c-mode terms
Tuning Linux for MongoDB
Architecture for building scalable and highly available Postgres Cluster
Geek Sync | Infrastructure for the Data Professional: An Introduction
Ad

Similar to Training Slides: Basics 107: Simple Tungsten Replicator Installation to Extract from MySQL (20)

PPT
Considerations when implementing_ha_in_dmf
PDF
Webinar Slides: Tungsten Connector / Proxy – The Secret Sauce Behind Zero-Dow...
PDF
Training Slides: Intermediate 205: Configuring Tungsten Replicator to Extract...
PDF
Training Slides: Advanced 304: Upgrading From Native MySQL Replication To Tun...
PPT
les_01.ppt of the Oracle course train_1 file
PDF
Training Slides: Basics 102: Introduction to Tungsten Clustering
PPTX
Fastest Servlets in the West
PPTX
Realtime traffic analyser
PDF
les12.pdf
PPT
Extreme Availability using Oracle 12c Features: Your very last system shutdown?
PDF
Training Slides: 103 - Basics - Simple Tungsten Clustering Installation
PDF
PromCon EU 2022 - Centralized vs Decentralized Prometheus Scraping Architectu...
PPTX
Scalable Web Apps
PDF
System Device Tree and Lopper: Concrete Examples - ELC NA 2022
PPTX
Cognos Performance Tuning Tips & Tricks
PPTX
UNIT -5 EMBEDDED DRIVERS AND APPLICATION PORTING.pptx
PPTX
To Build My Own Cloud with Blackjack…
PDF
(ATS6-PLAT06) Maximizing AEP Performance
PPTX
Taking Splunk to the Next Level - Architecture Breakout Session
PDF
Training Slides: Intermediate 202: Performing Cluster Maintenance with Zero-D...
Considerations when implementing_ha_in_dmf
Webinar Slides: Tungsten Connector / Proxy – The Secret Sauce Behind Zero-Dow...
Training Slides: Intermediate 205: Configuring Tungsten Replicator to Extract...
Training Slides: Advanced 304: Upgrading From Native MySQL Replication To Tun...
les_01.ppt of the Oracle course train_1 file
Training Slides: Basics 102: Introduction to Tungsten Clustering
Fastest Servlets in the West
Realtime traffic analyser
les12.pdf
Extreme Availability using Oracle 12c Features: Your very last system shutdown?
Training Slides: 103 - Basics - Simple Tungsten Clustering Installation
PromCon EU 2022 - Centralized vs Decentralized Prometheus Scraping Architectu...
Scalable Web Apps
System Device Tree and Lopper: Concrete Examples - ELC NA 2022
Cognos Performance Tuning Tips & Tricks
UNIT -5 EMBEDDED DRIVERS AND APPLICATION PORTING.pptx
To Build My Own Cloud with Blackjack…
(ATS6-PLAT06) Maximizing AEP Performance
Taking Splunk to the Next Level - Architecture Breakout Session
Training Slides: Intermediate 202: Performing Cluster Maintenance with Zero-D...
Ad

More from Continuent (20)

PDF
Tungsten Webinar: v6 & v7 Release Recap, and Beyond
PDF
Continuent Tungsten Value Proposition Webinar
PDF
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #7: ClusterControl
PDF
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #5: Oracle’s InnoDB Cluster
PDF
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #4: MS Azure Database MySQL
PDF
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #2: Galera Cluster
PDF
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #1: AWS Aurora
PDF
Webinar Slides: AWS Aurora MySQL Replacement: Break Away From Geo-Limitations...
PDF
Webinar Slides: No Data Loss MySQL: Guaranteed Credit Card Transaction Availa...
PDF
Webinar Slides: Intelligent Database Proxies: Routing & Transparent Failover
PPTX
Webinar Slides: High Volume MySQL HA: SaaS Continuous Operations with Terabyt...
PDF
Training Slides: 205 - Installing and Configuring Tungsten Dashboard
PDF
Training Slides: 352 - Tungsten Replicator for MongoDB & Kafka
PDF
Training Slides: 351 - Tungsten Replicator for Data Warehouses
PDF
Training Slides: 303 - Replicating out of a Cluster
PDF
Training Slides: 206 - Using the Tungsten Cluster AMI
PDF
Training Slides: 254 - Using the Tungsten Replicator AMI
PDF
Training Slides: 253 - Filter like a Pro
PDF
Training Slides: 252 - Monitoring & Troubleshooting
PDF
Training Slides: 302 - Securing Your Cluster With SSL
Tungsten Webinar: v6 & v7 Release Recap, and Beyond
Continuent Tungsten Value Proposition Webinar
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #7: ClusterControl
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #5: Oracle’s InnoDB Cluster
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #4: MS Azure Database MySQL
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #2: Galera Cluster
Webinar Slides: MySQL HA/DR/Geo-Scale - High Noon #1: AWS Aurora
Webinar Slides: AWS Aurora MySQL Replacement: Break Away From Geo-Limitations...
Webinar Slides: No Data Loss MySQL: Guaranteed Credit Card Transaction Availa...
Webinar Slides: Intelligent Database Proxies: Routing & Transparent Failover
Webinar Slides: High Volume MySQL HA: SaaS Continuous Operations with Terabyt...
Training Slides: 205 - Installing and Configuring Tungsten Dashboard
Training Slides: 352 - Tungsten Replicator for MongoDB & Kafka
Training Slides: 351 - Tungsten Replicator for Data Warehouses
Training Slides: 303 - Replicating out of a Cluster
Training Slides: 206 - Using the Tungsten Cluster AMI
Training Slides: 254 - Using the Tungsten Replicator AMI
Training Slides: 253 - Filter like a Pro
Training Slides: 252 - Monitoring & Troubleshooting
Training Slides: 302 - Securing Your Cluster With SSL

Recently uploaded (20)

DOCX
Unit-3 cyber security network security of internet system
PPTX
innovation process that make everything different.pptx
PDF
Introduction to the IoT system, how the IoT system works
PPTX
SAP Ariba Sourcing PPT for learning material
PDF
Cloud-Scale Log Monitoring _ Datadog.pdf
PPTX
Power Point - Lesson 3_2.pptx grad school presentation
PPTX
Module 1 - Cyber Law and Ethics 101.pptx
PPTX
INTERNET------BASICS-------UPDATED PPT PRESENTATION
PDF
Tenda Login Guide: Access Your Router in 5 Easy Steps
PDF
Automated vs Manual WooCommerce to Shopify Migration_ Pros & Cons.pdf
PDF
Slides PDF The World Game (s) Eco Economic Epochs.pdf
PPTX
presentation_pfe-universite-molay-seltan.pptx
PPTX
Job_Card_System_Styled_lorem_ipsum_.pptx
PPTX
Slides PPTX World Game (s) Eco Economic Epochs.pptx
PPTX
E -tech empowerment technologies PowerPoint
PPTX
introduction about ICD -10 & ICD-11 ppt.pptx
PDF
WebRTC in SignalWire - troubleshooting media negotiation
PDF
FINAL CALL-6th International Conference on Networks & IOT (NeTIOT 2025)
PDF
How to Ensure Data Integrity During Shopify Migration_ Best Practices for Sec...
PPTX
international classification of diseases ICD-10 review PPT.pptx
Unit-3 cyber security network security of internet system
innovation process that make everything different.pptx
Introduction to the IoT system, how the IoT system works
SAP Ariba Sourcing PPT for learning material
Cloud-Scale Log Monitoring _ Datadog.pdf
Power Point - Lesson 3_2.pptx grad school presentation
Module 1 - Cyber Law and Ethics 101.pptx
INTERNET------BASICS-------UPDATED PPT PRESENTATION
Tenda Login Guide: Access Your Router in 5 Easy Steps
Automated vs Manual WooCommerce to Shopify Migration_ Pros & Cons.pdf
Slides PDF The World Game (s) Eco Economic Epochs.pdf
presentation_pfe-universite-molay-seltan.pptx
Job_Card_System_Styled_lorem_ipsum_.pptx
Slides PPTX World Game (s) Eco Economic Epochs.pptx
E -tech empowerment technologies PowerPoint
introduction about ICD -10 & ICD-11 ppt.pptx
WebRTC in SignalWire - troubleshooting media negotiation
FINAL CALL-6th International Conference on Networks & IOT (NeTIOT 2025)
How to Ensure Data Integrity During Shopify Migration_ Best Practices for Sec...
international classification of diseases ICD-10 review PPT.pptx

Training Slides: Basics 107: Simple Tungsten Replicator Installation to Extract from MySQL

  • 1. Basics : Simple Replicator Installation Extract from MySQL
  • 2. Topics In this short course we will: • Review the Replicator • Review prerequisites required • Discuss installation Methods – Staging vs INI • Walkthrough an Installation (Full end to end demo) • Recap Key Resources and Tools Course Prerequisite Learning – Basics: Introduction to Tungsten Replicator – Visit Continuent website or Tungsten University on YouTube to watch these recordings 2
  • 5. Key Decisions and Prerequisites
  • 6. Pre Installation Environment Decisions • Which release of MySQL? – MySQL Community – Percona – MariaDB – Oracle MySQL Enterprise • Which version? – 5.0 to 5.7 • What monitoring tools do you have? • Full or Partial Replication • What backup tools do you have? 6
  • 7. Prerequisities • Review docs – http://docs.continuent.com/tungsten-replicator-5.3/prerequisite.html • Host Prerequisites – OS user – /etc/hosts – sudoers and ssh – Ruby – Java • Network Prerequisites – Review port requirements • MySQL Prerequisites – my.cnf settings – tungsten user accounts 7
  • 8. Pre Installation Tungsten Decisions • TAR file or RPM? • INI-based install or staging install? • SSL Enabled? 8
  • 9. Installation Methods: ini vs staging • INI-based Install – Install managed via /etc/tungsten/tungsten.ini on EACH host – PROS • Control over each node individually • Easy integration to automation software such as puppet and chef • Remove dependency on single host for install – CONS • Configuration changes must be performed individually • Risk of misconfiguration between nodes 9
  • 10. Installation Methods: ini vs staging • Staging Install – Install managed from one host – Could be a source/target node or a separate host outside of replication. – PROS • One single place for configuration • Easy to install/update entire topology in one go • Configuration applied to all nodes, less risk of misconfiguration – CONS • No easy integration to automation software • Staging host become single point of failure for configuration management – Especially important if Staging host is a DB Node 10
  • 11. Installation Demo DBMS Logs Download transactions via network Apply using JDBC THL = Events + Metadata MySQL MySQL Binary Logging Option 1: Local Install Extractor reads directly from the logs, even when the DBMS service is down. This is the default. Option 2: Remote Extractor gets log data via MySQL Replication Slave protocols (which requires the DBMS service to be online). This is how we handle RDS extraction tasks. Extractor Options Master Replicator: Extractor THL 2 1 Slave Replicator: Applier THL MySQL
  • 13. Tools : trepctl 13 • “trepctl status” can be run from any node to view the status of the local replicator • “trepctl status –r 3” will show status output refreshed every 3 second until CTRL+C • “trepctl qs” provides a quick summary overview of the local replicator • “trepctl perf” provides deeper diagnostics of the different stages in the replicators $ trepctl qs State: east Online for 21.069s, running for 45.654s Latency: 0.837s from DB commit time on db1 into THL 21.839s since last database commit Sequence: 1 last applied, 0 transactions behind (0-1 stored) estimate 0.00s before synchronization
  • 14. Log Files 14 • The /opt/continuent/service_logs/ directory contains both text files and symbolic links. • Links in the service_logs directory go to following subdirectory: – /opt/continuent/tungsten/tungsten-replicator/log/ tungsten@db1:/opt/continuent/service_logs $ ll total 116 lrwxrwxrwx 1 tungsten tungsten 60 Jan 06 09:52 trepsvc.log -> /opt/continuent/tungsten/tungsten-replicator/log/trepsvc.log
  • 15. Next Steps • If you are interested in knowing more about the software and would like to try it out for yourself, please contact our sales team who will be able to take you through the details and setup a POC – sales@continuent.com • Read the documentation at http://docs.continuent.com/tungsten-replicator-5.3/index.html • Subscribe to our Tungsten University YouTube channel! http://tinyurl.com/TungstenUni • Visit the events calendar on our website for upcoming Webinars and Training Sessions 15
  • 16. For more information, contact us: Eric Stone COO eric.stone@continuent.com MC Brown VP Products mc.brown@continuent.com Chris Parker Director, Professional Services EMEA & APAC chris.parker@continuent.com Eero Teerikorpi Founder, CEO eero.teerikorpi@continuent.com +1 (408) 431-3305