MySQL High Availibility Solutions

MySQL HA Solutions
Selecting the best approach to protect access to your data
08/09/2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved

Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.
08/09/2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved 2

Cloud
Web & Enterprise OEM & ISVs
Industry Leaders Rely on MySQL

Focus on driving the business rather than on infrastructure
Driving new Database Requirements
In-Memory
Real-Time
Performance
Extreme
Read &
Write
Scalability
Rock Solid
Availability
Rapid
Service
Innovation

HA Considerations
• SLA requirements to support business objectives
• Operational capabilities
• Service agility & time to market
• Budgetary constraints

• Recovery Time Objective
– Maximum length of downtime before
there is break in “business continuity”
• Recovery Point Objective
– Point in time to which data must be
recovered when service is re-
established
Tier 1
• Mission-critical services
Tier 2
• Business-critical services
Tier 3
• Task-critical services
Tier 4
• Non-critical services
08/09/2015 7
Don’t assume 99.999% HA needed for all apps
Copyright 2015, Oracle and/or its affiliates. All rights reserved

Mapping Uptime to Availability
Replicated
Systems
• SPs & Line of
Business
Clustered &
Virtualized
Systems
• Web & Cloud
Services
Shared
Nothing,
Geo-
Replicated
Clusters
• eCommerce,
Telecoms &
Military
08/09/2015
9 9 . 9 9 9 %
Cost&Complexity
Copyright 2015, Oracle and/or its affiliates. All rights reserved 8

MySQL
Replication
MySQL
Fabric
DRBD
Windows/S
olaris/Clust
erware
Clustering
or Oracle
VM
MySQL
Cluster
MySQL HA Solutions
08/09/2015
9 9 . 9 9 9 %

It’s not just reliably storing the data
Layers of HA
Redundant Access to Data
Data Redundancy
Redundant App Servers
Routing to the Data

Oracle MySQL HA & Scaling Solutions
MySQL
Replication
MySQL
Fabric
Oracle VM
Template
Oracle
Clusterware
Solaris
Cluster
Windows
Cluster
DRBD
MySQL
Cluster
App Auto-Failover ✖ ✔ ✔ ✔ ✔ ✔ ✔ ✔
Data Layer Auto-Failover ✖ ✔ ✔ ✔ ✔ ✔ ✔ ✔
Zero Data Loss MySQL 5.7 MySQL 5.7 ✔ ✔ ✔ ✔ ✔ ✔
Platform Support All All Linux Linux Solaris Windows Linux All
Clustering Mode
Master +
Slaves
Master +
Slaves
Active/Pas
sive
Active/Passi
ve
Active/P
assive
Active/Pas
sive
Active/P
assive
Multi-
Master
Failover Time N/A Secs Secs + Secs + Secs + Secs + Secs + < 1 Sec
Scale-out Reads ✔ ✖ ✖ ✖ ✖ ✖ ✔
Cross-shard operations N/A ✖ N/A N/A N/A N/A N/A ✔
Transparent routing ✖ For HA ✔ ✔ ✔ ✔ ✔ ✔
Shared Nothing ✔ ✔ ✖ ✖ ✖ ✖ ✔ ✔
Storage Engine InnoDB+ InnoDB+ InnoDB+ InnoDB+ InnoDB+ InnoDB+ InnoDB+ NDB
Single Vendor Support ✔ ✔ ✔ ✔ ✔ ✖ ✔ ✔

Why Replicate?
• Duplicates database from a “master” to a “slave”
– Redundant copies of the data provide foundation for High Availability
– Scale out by distributing queries across the replication farm
Master
Slaves
Web / App Servers
Writes & Reads Reads

Company Overview
Twitter’s mission: To give everyone the power to create
and share ideas and information instantly, without
barriers.
Application
A typical day sees over 500 million tweets, which means
about 5,700 per second with MySQL. Twitter achieved in
August 2013 a new World record of 143,199 Tweets Per
Second (TPS).
Why MySQL 5.6?
“Performance, replication, compression improvements,
transportable tablespaces, better monitoring &
diagnostics.” Calvin Sun, Senior Engineering Manager,
Twitter
Twitter

Company Overview
Each day, over 700,000 room nights are reserved on
Booking.com. Part of the Priceline Group.
Application
Booking has relied on MySQL since 2003. Supporting 60-
70% annual growth and an agile development model.
Why MySQL?
Performance and scalability to manage a very large
event volume:
• 60 MByte/sec Event data rate
• 2 Billion Events per day
• 15 TB in MySQL for Events, lookups, monitoring
• 150 TB MySQL Event archive
Booking.com

Slave
Database
• Session thread: processes queries from the
application – writes data to master database &
associated events to binary log
• Dump thread: reads events from binary log and
sends them to a slave
• I/O thread: receives replication events and
stores them in slave’s relay log
• SQL thread: reads replication events from
slave’s relay log and applies them to slave
database
MySQL Replication Workflow
Session
Binary
Log
Master
Database
Dump I/O
Relay
Log
SQL
08/09/2015 15Copyright 2015, Oracle and/or its affiliates. All rights reserved

• Asynchronous
– MySQL Default
– In parallel: Master acks
to app and sends
transaction to slave
• Fast
• Risk of lost changes if
master dies
• Semi-Synchronous
– MySQL 5.5+ - Enhanced
in MySQL 5.7
– Serially: Master waits
for change to be
received by slave then
In parallel ack to app
and apply changes on
slave
• Intermediate latency
• Lossless (MySQL 5.7)
• Synchronous
– Only available with
MySQL Cluster
– Serially: Master waits
for change to be
applied on all slaves
before ack to app
• Higher latency
• If Active/Active, best
suited to small
transactions
• Lossless
Asynchronous vs. Synchronous Replication

MySQL 5.6 Replication
08/09/2015
• 5x Higher slave throughput with MTS (multiple schemas)
• Reduced master impact – Binlog Group Commit
Performance and Scalability
• Global Transaction IDsSimplicity
• MySQL Replication Utilities (including auto-failover)Automation
• Crash safety
• Replication checksums
Robustness
• Time Delayed ReplicationInsurance

MySQL 5.7 Replication – Pre-GA
08/09/2015
• Intra-schema Multi-Threaded Slave
• Faster Master
Performance and Scalability
• Performance SchemaMonitoring
• Dynamic slave filters
• On-line CHANGE MASTER
Operational Simplicity
• Lossless Semi-Synchronous Replication
• Multiple Semi-Synchronous Acks
Resilience
• GTIDs stored in transactional tables
• Automatic slave retries
MORE Resilience

• Consolidate updates from multiple
Masters into one Slave
– Consolidated view of all shards
– More flexible topologies
– Centralized point for backups
• Compatible with Semi-Sync
Replication & enhanced MTS
• Master-specific slave filters
Multi-Source Replication
Binlog
Master 1
Binlog
Master 2
…
…
Binlog
Master N
IO 1
Relay 1
Coordinator
W1 W2 … WX
IO 2
Relay 2
Coordinator
W1 W2 … WX
…
…
Coordinator
W1 W2 … WX
IO N
Relay N
Coordinator
W1 W2 … WX
Slave
labs.mysql.com

• Shared-nothing virtually synchronous database system
• Multi-master update anywhere
– Conflict detection and resolution (transaction rollback)
– Optimistic State Machine Replication
• Automatic group membership management and failure
detection
– No need for server fail-over
– Elastic scale out/in
– No single point of failure
– Automatic reconfiguration
• Well integrated
– InnoDB
– GTID-based replication
– PERFORMANCE_SCHEMA
MySQL Group Replication
Application
MySQL Masters Replication
Plugin
API
MySQL
Server
Group Comms
(Corosync)
labs.mysql.com

MySQL Fabric
An extensible and easy-to-
use framework for
managing a farm of MySQL
server supporting high-
availability and sharding

MySQL Fabric 1.5
• High Availability
– Server monitoring with auto-promotion and
transparent application failover
• Optionally scale-out through sharding
– Application provides shard key
– Range or Hash
– Tools for resharding
– Global updates & tables
• Fabric-aware connectors rather than
proxy: Python, Java, PHP (pre-GA), .NET,
C (labs)
– Lower latency, bottleneck-free
• Server provisioning using OpenStack etc.
High Availability + Sharding-Based Scale-out
MySQL Fabric
Connector
Application
Read-slaves
SQL
HA group
Read-slaves
HA group
Connector
Application

MySQL Replication & MySQL Fabric HA
• MySQL Replication is the initial implementation used in HA Groups
– PRIMARY = Replication Master & receives all writes
– SECONDARY = Replication Slave & receives share of reads
• Failover
– MySQL Fabric detects failure of PRIMARY/Master
– Selects a SECONDARY/Slave and promotes it
– Updates State Store
– Updated state fetched by Fabric-aware connectors
How this effects failover

Extensible Architecture
MySQL Fabric Node
Connector
Connector
Connector
MySQL Fabric
Framework
AMQP? MySQL XML-RPC
Executor
State Store
(persister)
Shard
HA
Prov
State
Store
SQL

• Oracle Clusterware unifies servers
in a server farm to form a cluster
– At the core of Oracle RAC
• Oracle Cluster 12c includes MySQL
Server 5.6 agent
• Planned migration and failover of
MySQL database
– Hidden from the application
08/09/2015
MySQL on Oracle Clusterware
26Copyright 2015, Oracle and/or its affiliates. All rights reserved

• Pre-Installed & Pre-Configured
• Full Integration & QA Testing
• Single Point of Support
Oracle VM Template for MySQL
Oracle VM Servers
Oracle VM Server Pool
ocfs2
Oracle VM
Manager
iSCSI / FC-AL
Oracle VM
Secure Live
Migration (SSL)
Oracle VM
Automatic Fault
Detection &
Recovery

• Native Windows HA clustering with
MySQL
• Quorum (3rd vote), data (InnoDB +
schema) & binaries (optional)
stored in shared storage (iSCSI &
FCAL)
• Loss of service = couple of seconds
+ InnoDB recovery time
• Cluster managed through MS
Failover Cluster Management snap-
in GUI
Windows Server Failover Clustering
App
Virtual IP
Data Bin
Slave App App
Vote

• Kernel based heartbeating and
monitoring
• SPARC and x86. Solaris
Virtualization-aware
• MySQL agent included with Oracle
Solaris Cluster
• Learn more:
http://www.oracle.com/technetwo
rk/server-storage/solaris-
cluster/overview/index.html
Oracle Solaris Clustering

• Based on distributed storage
– NOT physical shared storage
• Synchronous replication at block
device level eliminates risk of data
loss
• Open source, mature & proven
• Certified and supported by Oracle
Oracle Linux and DRBD Stack
Hosts
Oracle Linux Oracle Linux
Active Standby
Corosync
Pacemaker
Cluster s/w
DRBD DRBD
MySQL MySQL
Application
VIP
sync
Services

MySQL Cluster Overview
• Memory optimized tables with durability
• Predictable Low-Latency, Bounded Access Time
REAL-TIME
• Auto-Sharding, Multi-Master
• ACID Compliant, OLTP + Real-Time Analytics
HIGH SCALE, READS +
WRITES
• Shared nothing, no Single Point of Failure
• Self Healing + On-Line Operations
99.999% AVAILABILITY
• Key/Value + Complex, Relational Queries
• SQL + Memcached + JavaScript + Java + HTTP/REST & C++
SQL + NoSQL
• Open Source + Commercial Editions
• Commodity hardware + Management, Monitoring Tools
LOW TCO

Who’s Using MySQL Cluster?

Company Overview
PayPal allows any business or individual with an email
address to securely, conveniently and cost-effectively send
and receive payments online.
Application
PayPal built a cloud-based globally-distributed database
with 100 TB of user-related data based on MySQL Cluster.
“Must NOT lose data” system, delivering 99,999%
availability, transactional, with data available WW
anywhere in < 1 Sec.
Why MySQL Cluster?
“You can achieve high performance and availability
without giving up relational models and read
consistency.” Daniel Austin, Chief Architect, PayPal
PayPal

Company Overview
Global telecommunications equipment company, focuses on
fixed, mobile, and converged networking hardware, IP
technologies, software, and services.
Application
MySQL Cluster CGE is at the heart of Alcatel-Lucent’s
Subscriber Data Manager to deliver converged IMS services
to mobile and fixed line users.
Why MySQL Cluster CGE?
• Delivers the performance, scalability and availability
required by this mission critical real-time application
• Real-time read & write access for tens of millions of
subscribers in a single system
• Always-on service: no offline maintenance window for
services users depend on (voice, SMS, email, Web, social
media…)
• Rapid delivery & low TCO
Alcatel-Lucent

MySQL Cluster Architecture
MySQL Cluster Data Nodes
Clients
Application Layer
Data Layer

MySQL Cluster Scaling
Clients
Application Layer
Data Layer

MySQL Cluster HA
Clients
Application Layer
Data Layer

MySQL Cluster Auto-Installer
• Fast configuration
• Auto-discovery
• Workload optimized
• Repeatable best practices
Specify
Workload
Auto-
Discover
Define
TopologyDeploy

• Asynchronous replication between
MySQL Clusters
• Active-Active
– Update anywhere
– Conflict detection
• Application notified through exception tables
• Can opt to have conflicts resolved
automatically
– Auto-conflict-resolution
• Conflicting transaction and dependent ones
are rolled-back
• No changes to application schema
08/09/2015 39
Active-Active Geo-Replication

MySQL Cluster 7.4 GA

MySQL Cluster 7.4 GA
• 200 Million NoSQL
Reads/Sec
• 2.5M SQL Ops/Sec
• 50% Faster Reads
• 40% Faster Mixed
Performance
• Active-Active
Geographic
Redundancy
• Conflict
Detection/Resolution
Active-Active
• 5X Faster
Maintenance Ops
• Detailed Reporting
Management

• Memory optimized tables
– Durable
– Mix with disk-based tables
• Massively concurrent OLTP
• Distributed Joins for analytics
• Parallel table scans for non-indexed
searches
• MySQL Cluster 7.4 FlexAsych
– 200M NoSQL Reads/Second
08/09/2015 42
MySQL Cluster 7.4 NoSQL Performance
200 Million NoSQL Reads/Second
-
50,000,000
100,000,000
150,000,000
200,000,000
250,000,000
2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32
Readspersecond
Data Nodes
FlexAsync Reads

• Memory optimized tables
– Durable
– Mix with disk-based tables
• Massively concurrent OLTP
• Distributed Joins for analytics
• Parallel table scans for non-indexed
searches
• MySQL Cluster 7.4 DBT2 BM
– 2.5M SQL Statements/Second
08/09/2015 43
MySQL Cluster 7.4 SQL Performance
2.5M SQL Statements/Second
-
500,000
1,000,000
1,500,000
2,000,000
2,500,000
3,000,000
2 4 6 8 10 12 14 16
SQLStatements/sec
Data Nodes
DBT2 SQL Statements per Second

Performance Enhancements
MySQL Cluster 7.4
50% Read-Only Increase
0
1000
2000
3000
4000
5000
6000
7000
8000
9000
64 128 192 256 320 384 448 512
Transaconspersecond
Threads
Sysbench R/W
7.4
7.3
7.2
0
1000
2000
3000
4000
5000
6000
7000
8000
9000
10000
64 128 192 256 320 384 448 512
Transaconpersecond
Threads
Sysbench RO
7.4
7.3
7.2
40% Read/Write Increase

When to Consider MySQL Cluster
 Scalability demands
 Sharding for write performance?
 Latency demands
 Cost of each millisecond?
 Uptime requirements
 Cost per minute of downtime?
 Failure versus maintenance?
 Application agility
 Developer languages and frameworks?
 SQL or NoSQL?

Management ToolsAdvanced Features Support
• Scalability
• High Availability
• Security
• Audit
• Monitoring
• Backup
• Development
• Administration
• Migration
• Technical Support
• Consultative Support
• Oracle Certifications
MySQL Enterprise Edition
46

MySQL Enterprise Monitor
Application
Big Fish Games is a global leader in the online games industry
and distributes more games worldwide than any other online
site.
Key Business Benefit
MySQL Query Analyzer provides a consolidated view of query
activities and execution details, and has enabled Big Fish
Games to quickly identify poorly running queries and tackle
the root causes directly in the SQL code.
Why MySQL?
“With the MySQL Query Analyzer, we were able to identify and
analyze problematic SQL code, and triple our database
performance. More importantly, we were able to accomplish
this in three days, rather than taking weeks.”
Keith Souhrada, Software Development Engineer, Big Fish Games

MySQL Enterprise Monitor
• Start monitoring MySQL in 10 minutes
• Real-time MySQL performance and
availability monitoring
• Visually find & fix problem queries
• Disk monitoring for capacity planning
• Cloud friendly architecture
– No agents required
• Optional agent option provides
advanced Host/OS monitoring

Enterprise Replication Monitor
• Auto-discovers replication topology
• Master/Slave performance
monitoring
• Replication advisor
• Best practice replication advice
"I use the MySQL Enterprise Monitor
every day to monitor and keep tabs on
our MySQL databases. Quick one stop
shopping for keeping tabs on them.”
-Wes Homer,
Sr System and Network Administrator

MySQL Enterprise Backup
• Online, non-locking backup and recovery
– Complete MySQL instance backup (data and config)
– Partial backup and restore
• Direct Cloud storage backups (S3, etc.)
• Incremental backups
• Point-in-time recovery
• Advanced compressed and encryption
• Backup to tape (SBT)
• Backup validation
• Optimistic backups
• Cross-Platform (Windows, Linux, Unix)
51Copyright 2015, Oracle and/or its affiliates. All rights reserved

MySQL Enterprise Monitor + Backup
• Monitor backup results
• Monitor backup performance
• Ensure backups are up to date

Oracle Enterprise Manager for MySQL
Performance
Security
Availability
• Availability monitoring
• Performance monitoring
• Configuration monitoring
• All available metrics collected
– Allowing for custom threshold
based incident reports
• MySQL auto-detection

Oracle Premier Support for MySQL
• Straight from the Source
• Largest Team of MySQL Experts
• Backed by MySQL Developers
• Forward Compatible Hot Fixes
• MySQL Maintenance Releases
• MySQL Support in 29 Languages
• 24/7/365
• Unlimited Incidents
• Knowledge Base
• MySQL Consultative Support
Rely on The Experts - Get Unique Benefits
"The MySQL support service has been essential
in helping us with troubleshooting and
providing recommendations for the production
cluster, Thanks."
-- Carlos Morales – Playfulplay.com
Only From
Oracle

MySQL
Cluster
CGE
MySQL
Cluster
Manager
MySQL
Enterprise
Scalability
MySQL
Enterprise
Audit
MySQL
Enterprise
Security
Oracle
Premier
Lifetime
Support
Oracle
Product
Certifications
MySQL
Enterprise
Mornitor
MySQL
Workbench

Enhancing DevOps Agility,
Reducing Downtime
Automated Management
• Start / Stop node or
whole cluster
• On-Line Scaling
• On-Line Reconfiguration
• On-Line Upgrades
• On-Line Backup &
Restore
• Import Running Cluster
Self-Healing
• Node monitoring
• Auto-recovery extended
to SQL + mgmt nodes
HA Operations
• Cluster-wide
configuration
consistency
• Persistent
configurations
• HA Agents

Without MySQL Cluster Manager
• 1 x preliminary check of cluster state
• 8 x ssh commands per server
• 8 x per-process stop commands
• 4 x scp of config files (2 x mgmd & 2 x mysqld)
• 8 x per-process start commands
• 8 x checks for started and re-joined processes
• 8 x process completion verifications
• 1 x verify completion of the whole cluster.
• Excludes manual editing of each configuration file.
• Total: 46 commands
– 2.5 hours of attended operation
With MySQL Cluster Manager
mcm> upgrade cluster
--package=7.4 mycluster;
• Total: 1 Command -
– Unattended Operation
Software Upgrade – example of benefits of MCM?

MCM: Upgrade Cluster
mcm> upgrade cluster
--package=7.3 mycluster;

Oracle University MySQL Training Services
Prepare Your Organization to Enable Reliable and High-Performance Web-Based Database Applications
“Training and team skill
have the most significant impact on overall performance of
technology and success of technology projects.” - IDC, 2013
Premier Support customers eligible to
save 20% on learning credits.
Benefits
 Expert-led training to support your MySQL learning needs
 Flexibility to train in the classroom or online
 Hands-on experience to gain real world experience
 Key skills needed for database administrators and developers
• MySQL for Beginners
 MySQL for Database Administrators
 MySQL Performance Tuning
 MySQL Cluster – NEW - Register Your Interest!
 MySQL and PHP - Developing Dynamic Web Applications
 MySQL for Developers
 MySQL Developer Techniques
 MySQL 5.6 Database Administrator
 MySQL 5.6 Developer
To find out more about available MySQL Training & Certification
offerings, go to: education.oracle.com/mysql
Top Courses for Administrators and Developers
Top Certifications
RECENTLY RELEASED
!!ALL NEW!! MySQL Cluster Training
To Register your interest to influence the
schedule on this newly released course – go to
education.oracle.com/mysql and click on the
MySQL Cluster Course

White Papers & Webinar Replays
08/09/2015
High Availability
• http://www.mysql.com/why-mysql/white-papers/#en-22-16
• http://www.mysql.com/news-and-events/on-demand-webinars/#en-20-16
MySQL Replication
MySQL Cluster

MySQL High Availibility Solutions

More Related Content

What's hot (20)

Similar to MySQL High Availibility Solutions (20)

More from Mark Swarbrick (20)

Recently uploaded (20)

MySQL High Availibility Solutions