MySQL Cluster

MySQL Server
Architecture and Technology

Pluggable Storage Engines Architecture
MySQL Server
Connectors
Clients and Apps Native C API, JDBC, ODBC, .Net, PHP, Ruby, Python, VB, Perl

Enterprise Management
Services and Utilities Connection Pool
Backup & Recovery Authentication – Thread Reuse – Connection Limits – Check Memory – Caches
Security
Replication
Cluster
Partitioning SQL Interface Parser Optimizer Caches
Instance Manager DDL, DML, Stored Query Translation, Access Paths, Global and Engine
Information_Schema Procedures, Views, Object Privileges Statistics Specific Caches and
MySQL Workbench Triggers, Etc.. Buffers

Pluggable Storage Engines
Memory, Index and Storage Management

InnoDB MyISAM Cluster Etc… Partners Community More..

Filesystems, Files and Logs
Redo, Undo, Data, Index, Binary, Error, Query and Slow

© 2010 Oracle Corporation – Proprietary and Confidential

The most cost-effective open
source database for real-
time, high scale applications
demanding 99.999%
availability

So what is MySQL Cluster

MySQL Cluster – Storage Engine for MySQL

MySQL Server

MySQL Cluster is a storage engine for MySQL – MyISAM or InnoDB – so get ease of use and familiarity of MySQL, with unique capabilities
offered by Cluster

MySQL Cluster – Users & Applications
HA, Transactional Services: Web & Telecoms

• Web
• User profile management

• Session stores

• eCommerce

• On-Line Gaming

• Application Servers

• Telecoms
• Subscriber Databases (HLR/HSS)

• Service Delivery Platforms

• VoIP, IPTV & VoD

• Mobile Content Delivery

• On-Line app stores and portals

• IP Management

• Payment Gateways

Confidential, Oracle Internal Only

Look at types of workload Cluster deployed into and the users

Cluster technology originally developed bu E///, used purely as an in-mem, carrier-grade db embedded in network equpt – typically switches. Acquired by MySQL
in 2003. Acquired not just the technology, but also the engineering team who have contined to develop the product rapidy in subsequent years, ie added disk based
tables, added SQL i/f, automtic node recovery, add Geo-Repl, open sourced.

Very strong in telecoms in Sub DBs (HLR/HSS)– truly mission critical apps, also in app servers, VAS

In web workloads, used a lot for session stores, eCommerce, Mgmt of user profiles

MySQL Cluster Architecture
Parallel Database with no SPOF: High Read & Write Performance &
99.999% uptime

Clients

License /
MySQL Cluster Application Nodes Subscription

JPA

MySQL MySQL
Cluster Cluster
Mgmt Mgmt

License /
MySQL Cluster Data Nodes
Subscription


Here we show the architectire of MySQL Cluster

3 core elements
Data Nodes: handle actual storage and access to data – tables distributed across the data nodes – automatically partitioned, replication,
failover and self healing. Don't need complex logic in the application – data nodes handle all of that
Application Nodes – provide connectors to the data. Most common use case is to connect via MySQL Server for a std SQL i/f. Also have
a series of native interfaces embed directly into apps for direct access– bypasses SQL – gives highest performance, lowest latency: C++
API, Java API and OpenJPA plug-in for Object/Relational Mapping. Can also access via LDAP servers and HTTP with an Apache module
Mgmt Nodes: used at start-up, used to add nodes, to reconﬁgure the cluster, arbitration if there is a network failure – avoid split brain
as determine which side of the cluster assumes ownership of servicing requests

So, its pretty simple – always have at least 2 copies of your data held in the data nodes, and accessed via series of app nodes

MySQL Cluster - Key Advantages

High Throughput Distributed, Parallel architecture
Reads & Writes Transactional, ACID-compliant relational database

Carrier-Grade Shared-nothing design, synchronous data replication
Availability Sub-second failover & self-healing recovery

Real-Time Data structures optimized for RAM. Real-time extensions
Responsiveness Predictable low latency, bounded access times

On-Line, Linear Incrementally scale out, scale up and scale on-line
Scalability Linearly scale with distribution awareness

Low TCO, GPL & Commercial editions, scale on COTS
Open platform Flexible APIs: SQL, C++, Java, JPA, LDAP & HTTP


This slide shows the key capabilities of MySQL Cluster
Very high read/write th/put: Data is distributed across multiple nodes, so you have multi-master db with parallel architecture so
perform multiple write ops concurrently, with any changes instantly available to all clients accessing the cluster. Recent tests on 4
nodes cluster using DBT2 BM – 125k op/s with average latency of 3ms. Telemaque 330k ops per sec across 4 x data nodes

Availability, delivers 99.999% – There are no SPOFs, it is shared nothing arch
Within the Cluster, all updates are syncrhonously replicated so written to at least 2 nodes before TX commited , so if 1 node fails, up to
date copy of data on another node. You can fail over typically in less than 1 sec – as there is no shared disk or lock managers to worry
about. Self healing, node can auto rejoin and resynchronize with the cluster. Developers don't have to care about this in their apps -
which is a massive gain

RT – indexes in memory (also data in memory or on disk) + RT extensions, all CP of in-mem data to disk happens in backround so no
slow down for disk i/o. Typically 2-5 ms latency with sync replication across multiple data nodes – so you get low response time, but
also predictable latency.

Linear scale – scale horizontaly, vertically -also scale on-line with no downtime to app
Core database is open source, multi- platform and multi-access methods

Automated
Management

Monitoring &
Recovery

High-Availability
Operation

Slashes management complexity, increases administrator efficiency
and reduces the risk of downtime


MySQL Cluster Manager simplifies the creation and management of the MySQL Cluster database by automating common management
tasks. As a result, Database Administrators (DBAs) and Systems Administrator are more productiveAt the same time risks of database
downtime, which previously resulted from manual configuration errors, are significantly reduced.

MySQL Cluster 7.1 Momentum
1,000 Downloads per Day

Windows GA

NDBINFO
Pro-active Cluster Monitoring

MySQL Cluster
Manager & Enterprise
Monitor “MySQL Cluster 7.1 gave us
Fully Automated Management the perfect combination of
extreme levels of transaction
MySQL Cluster throughput, low latency &
Connector for Java - carrier-grade availability, while
10x Higher Performance reducing TCO”
Phani Naik, Pyro Group


Announced Cluster 7.1 at MySQL UC April 2010 –

Higher Java perf, automated mgmt, proactive monitoring, GA on Windows
1k downloads per day

Great success with Cluster at FIFA 2010 World Cup – used to support international roaming of visiting supporters - 7m subs every day

How Does MySQL Cluster Manager Help ?

Example: Initiating upgrade from MySQL Cluster 6.3 to 7.1*

Before MySQL Cluster Manager With MySQL Cluster Manager
• 1 x preliminary check of cluster state upgrade cluster --package=7.1 mycluster;
• 8 x ssh commands per server
• 8 x per-process stop commands
• 4 x scp of configuration files (2 x mgmd & 2 x Total: 1 Command -
mysqld)
• 8 x per-process start commands
Unattended Operation
• 8 x checks for started and re-joined processes
• 8 x process completion verifications • Results
• 1 x verify completion of the whole cluster. • Reduces the overhead and complexity of managing
• Excludes manual editing of each configuration database clusters
file. • Reduces the risk of downtime resulting from administrator

Total: 46 commands - error

•
2.5 hours of attended operation Automates best practices in database cluster management

* See Substantiation Slide

Lets look at a real world example to demonstrate the capabilities of MCM

In this example, we want to upgrade Cluster from release 6.3 to the latest 7.0. This operation can be performed on-line without downtime to applications or clients
accessing the cluster
It can be done manually today – however, this would require total of 46 commands, and would require 2.5 hours of attended operation. DBA doesn't have to sit there
doing nothing else for 2.5 hours, but they will have to handhold the process for the duration, by following the steps shown on the slide. Very important they perform each
step in turn, follow correct procedures, restart data nodes in correct sequence – otherwise downtime can result
With MCM, this can be accomplished with 1 command, once issued, admin can walk away and get on with other stuff
•Results
• Reduces the overhead and complexity of managing database clusters
• Reduces the risk of downtime resulting from administrator error
• Automates best practices in database cluster management
•Operation could be scripted, but then it takes time to develop and test the scripts, then maintain them going forward – all of which adds cost, risk and complexity
Example based on a MySQL Cluster configuration comprised of 4 x MySQL Cluster Data Nodes, 2 x MySQL Server SQL Nodes and 2 x MySQL Cluster Management Nodes implemented across individual servers (8 x total).
Based on a DBA restarting 4 x MySQL Cluster Data Nodes, each with 6GB of data, and performing 10,000 operations per second http://www.clusterdb.com/mysql-cluster/mysql-cluster-data-node-restart-times/
Excludes the preparation steps of copying the new software package to each host and defining where it's located: Mysql> add package --basedir=/usr/local/mysql_7_0_7 7.0;

MySQL Enterprise Monitor 2.3


Something very new is the integration of Cluster with MEM – allows users to monitor MySQL Cluster from MEM

this enables us to ensure any issues that could affect application performance or availability are detected quickly, before they become a
problem
Here we are speciﬁcally monitoring data node memory use, and MySQL Server CPU utilization and connections

Alarms generate SNMP traps.

Getting Started
Learn More
Architecture &
New Features
Guide
www.mysql.com/cluster/

Evaluate MySQL Cluster Manager* Attend a Webinar
See MySQL Live or On-
Cluster Manager
for yourself Demand
www.mysql.com/
www.mysql.com/ cluster
cluster/mcm

*From November, 2010

MySQL Enterprise Monitor

A Virtual MySQL DBA Assistant!

Customers of MySQL Enterprise greatly benefit from having instant MySQL database server expertise at their fingertips through the MySQL
Monitoring and Advisory Service. Part of the MySQL Enterprise set of enterprise-ready services, the Monitoring and Advisory Service is
designed with the enterprise database professional in mind. MySQL’s Monitoring and Advisory Service takes the guesswork out of MySQL
performance management, and supplies powerful automated mechanisms for keeping an enterprise-wide deployment of MySQL servers up
and running well at all times.
The MySQL Monitoring and Advisory Service was designed to tackle the tough job of managing the performance of hundreds of MySQL
database servers, regardless of their physical or geographical location. Although the Monitoring and Advisory Service can certainly track
just a handful of MySQL databases, the service is especially designed to greatly curtail the time it takes to get a handle on the availability
and performance levels of many database servers at once.
The Monitoring and Advisory Service differs from traditional database monitors in that it supplies, out of the box, a series of expert best-
practice enforcement advisors that are designed to automatically examine a MySQL server’s configuration, security, and performance
levels, and identify any deviations from best-practice rules that are built by the database experts at MySQL.


Point to make:

MySQL Monitoring & Advisor Service = “Virtual MySQL DBA”

There are 3 main features, each with business rewarding features…


• Improved Performance Monitoring
• MySQL Query Analyzer
• Data from MySQL Connectors
• For Java and .Net apps
• Filter for Specific Query Problems
• Full Table Scans, Bad Indexes
• Faster Problem Resolution
• MySQL Support diagnostic reports
• Improved User/Security Model
• Improved Advisor Rules & Graphs

What is MySQL Enterprise Backup?

A feature of “MySQL Enterprise”
Formerly known as “InnoDB Hot Backup”,
a backup tool for InnoDB
Backs up running databases without
locking InnoDB data
Supports InnoDB and MyISAM
Features:
• Compressed backup
• Partial backup
• Point-in-time recovery

Henrique.Leandro@oracle.com Marcelo.t.Souza@oracle.com


Thank You

• Downloads: http://dev.mysql.com/downloads
• Documentation: http://dev.mysql.com/doc
• Blogs: http://planet.mysql.com
• Forums: http://forums.mysql.com

– Henrique.Leandro@Oracle.com

search.mysql.com


The preceding is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into any
contract. It is not a commitment to deliver any
material, code, or functionality, and should not be
relied upon in making purchasing decisions.
The development, release, and timing of any
features or functionality described for Oracle’s
products remains at the sole discretion of Oracle.

MySQL Cluster

More Related Content

What's hot (17)

Similar to MySQL Cluster (20)

More from MySQL Brasil (20)

MySQL Cluster