MySQL Day Paris 2018 - Introduction & The State of the Dolphin

MySQL Day – Paris
22 Novembre 2018
Introduction &
The State of the Dolphin
Xavier GERARD
MySQL Enterprise Manager
Copyright © 2018, Oracle and/or its affiliates. All rights reserved.

Equipe MySQL France
Enterprise customers
• Xavier Gerard Alexis Bensa Rassol Dia
Embedded/ISV customers
• Jean Francois Houplain Andra Barbu
Presales
• Olivier Dasini Andrea Ciobotaru
Partenaires, Client Success Manager
• Neville Tanzer Nicoleta Militaru

Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.
3

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
Explosive Data Growth
4
4.33 Million
Videos Views
473,400
Tweets
854,166
Logins
97,222
Hours of Video
Streamed
1,389
Rides
120+
New Professionals
Every
60 Seconds
0
20
40
60
80
100
120
140
160
180
2010 2012 2014 2016 2018 2020 2022 2024
Zettabytes
Source: IDC, 2017 Source: Domo, 2018

DB-Engines 2018
Database Ranking
MySQL is the 2nd most popular database

Stack Overflow Developer Survey 2018
Survey Results over 100,000 developers Worldwide
MySQL is the most popular database

JetBrains Survey 2018
The State of Developer Ecosystem
MySQL is the most popular database

What's New in MySQL
NoSQL + SQL = MySQL

MySQL 8.0: One Giant Leap for SQL
“This is a landmark release as MySQL
eventually evolved beyond SQL-92
and the purely relational dogma.
Among a few other standard SQL
features, MySQL now supports window
functions (over) and common table
expressions (with). Without a doubt,
these are the two most important post-
SQL-92 features.”
https://modern-sql.com/blog/2018-04/mysql-8.0
Objectif 1 : extraire de la valeur de vos données

NoSQL
JSON Documents
Schemaless JSON Collections
SQL
Relational Tables
Foreign Keys
X Dev API
SQL
CRUD
MySQL
Document
Store
Objectif 2 : gérer la donnée dans tous les formats

InnoDB Cluster
12
App Servers with
MySQL Router
MySQL Group Replication
MySQL Shell
Setup, Manage,
Orchestrate
• Synchronisation des données
• Routage des données transparent
• Provisionning et orchestration
Objectif 3 : La donnée toujours accessible

Get started in minutes
MySQL Shell 8.0: for the DevOps era
• Rapid prototyping capabilities
– Using JavaScript and Python
• Full SQL and X DevAPI support
– With built in auto-completion
• InnoDB Cluster support
– Setup your HA solution within minutes
• DevOps Tool
– Designed for DevOps operations
Objectif 4 : Automatiser la gestion de vos serveurs MySQL

Authentication,
Encryption, Masking
Monitoring
Firewall
& Auditing
High Availability
& Backup
• Assess
– MySQL Enterprise Monitor
– MySQL Workbench
• Prevent
– MySQL Enterprise Authentication
– MySQL Enterprise Firewall
– MySQL Enterprise Encryption
– New! MySQL Enterprise Data Masking
• Detect
– MySQL Enterprise Audit
• Recover
– MySQL Enterprise HA
– MySQL Enterprise Backup
Objectif 5 : une architecture de sécurité MySQL

0
50 000
100 000
150 000
200 000
250 000
300 000
1 2 4 8 16 32 64 128 256 512 1 024
QueriesperSecond
Users
MySQL 8.0
MySQL 5.7
MySQL 8.0 Performance improvements : so much see DimitriK’s blog
eg : SysBench Read Write (update nokey)
2x Faster than MySQL 5.7
15
OS : Oracle Linux 7.4
CPU : 48cores-HT Intel Skylake 2.7Ghz
(2CPU sockets, Intel(R) Xeon(R) Platinum 8168 CPU)
RAM: 256GB
Storage : x2 Intel Optane flash devices
(Intel (R) Optane (TM) SSD P4800X Series)

Management ToolsAdvanced Features Support
• Data Masking
• High Availability
• Authentification
• Audit
• Encryption + TDE
• Firewall
•Monitoring
•Backup
•Development
•Administration
•Migration
• Technical Support
• Consultative Support
• Oracle Certifications
MySQL Enterprise Edition subscription
16

• Ground breaking technology from Oracle Labs
• Extreme Performance with In-Memory Analytics
• Integrated with MySQL
– Can instantiate a new service or add to a running MySQL service
• Support for Real-Time SQL Analytics
– Analytics provided over the same transactional store
• Architected for Oracle Cloud Infrastructure
– Designed for Massive Elasticity
• Supports data on premise or in the cloud
Confidential – Oracle Internal/Restricted/Highly Restricted
MySQL Analytics Service
Analytics
DEV

Analytics deployment in “Hybrid cloud”
Enables analytics of data which has not been moved to cloud
MySQL/RAPID
(Slave)
RAPID
Server
RAPID
Server
Block/SSD Storage
Object
Storage
(backup)
MySQL
(Master)
MySQL
(Slave)
MySQL MySQL Analytics
(Finance)
MySQL/RAPID
(Slave)
RAPID
Server
MySQL Analytics
(HR)
MySQL DB master instance outside of OCI
RAPID
Server
RAPID
Server

Performance Improvement : Filter
0,04 0,1 0,5 1
SPEEDUP (AVG) 292,628571 252,52459 186,532258 174,065728
RAPID (AVG) 105 122 165,333333 177,5
MYSQL-IN-MEMORY (AVG) 30726 30808 30840 30896,6667
293X
253X
187X
174X
0
50
100
150
200
250
300
350
0
5000
10000
15000
20000
25000
30000
RAPIDtoMySQLAvg.Speedup
ExecutionTime(msecs)
Filter Selectivity %
Filter predicate of TPCH Q1 @ SF=16; 16GB, 96 M rows
on 1 BMC Node
Speed up
95%
1%
0% 4%
Filter Query Time
Breakdown
(1% Selectivity, TPCH 16, 1
Node)
Rapid Execution
Row Callback
End Send
Rapid Network
15%
34%
11%
40%
Filter Query Time
Breakdown
(10% Selectivity, TPCH
16, 1 Node)
Rapid Execution
Row Callback
End Send
Rapid Network
More than 100x

Performance Improvement : Joins
40,013
(0.04%)
633,836
(0.66%)
2,431,528
(2.5%)
SPEEDUP (AVG) 107,6 84,33 65,54
RAPID (AVG) 50 90 650
MySQL-IN-MEMORY (AVG) 5380 7590 42600
107X
84X
65X
0
20
40
60
80
100
120
0
5000
10000
15000
20000
25000
30000
35000
40000
45000
RAPIDtoMySQLAvg.Speedup
PK-FK Join Query @ SF=16 on 1 OCI Node
(with Index on bases tables)
0.16 sec
1070 sec
1
10
100
1000
10000
100000
1000000
10000000
RAPID (AVG) MySQL-IN-MEMORY
(AVG)
Join Query @SF=16 on 1 OCI Node
(without Indexes on base tables)
>6000X
Speedup
Speed up
More than 1000x

MySQL customers presentations
extracts from
Oracle Open World and Oracle Code One

Where do we use MySQL?
● browsing the web looking at hotels
● accessing the site from your mobile phone
● looking at hotel reviews
● making the reservation
● handling credit cards
● managing payments
● analytics
● internal systems
● and lots more...
They all use MySQL as a backend to retrieve or store data
[ We use a few other systems for storing data, including hadoop for complex analytics: everything else uses MySQL ]
The business:
● 1.5 million room nights booked every day
○ That is ~1,000 per minute
● We are still growing...

● Easy scale out of reads using replication to server customer growth
● Increasing better performance with each new MySQL version
● It has allowed us to scale while covering more demanding business needs
● Relational model makes it easier to do more complex queries
● ….
Why we use MySQL? Growth
Scale out

Our MySQL installation?
Where have we come from?
● 11 years ago we had ~40 MySQL servers, ~5 clusters and ran MySQL 5.0
Where are we now?
● thousands of MySQL servers spread over several data centres
● hundreds of MySQL replication clusters ranging in size from 5-10 to over 500 servers
● MySQL versions used are 5.7, 8.0 with a few 5.6 stragglers1
○ 96% of 5.7 servers, 97% of 8.0 servers run the latest GA version
● We are starting to use MySQL NDB Cluster
● individual servers' databases range from 100s of GB to tens of TB
● managed by a team of 7
1 Some external applications prevent these upgrades

MySQL @Twitter - Intro
• 2 versions; Twitter version: 5.6 and
Community: 5.7
• Runs on thousands of production servers
• We support it via automation + 5 Engineers

MySQL @Twitter - How we use it?
5.6 Twitter Version
• Data: ~ PB’s of data
• Servers: Thousands of commodity
servers across 2 DC’s
• QPS: ~ 50M mostly reads

MySQL @Twitter - How we use it?
5.7 MySQL Community Version
• Clusters: Hundred of clusters
(Master/Replica)
• Total QPS: ~ 1M r/w
• Highest # of replicas: ~ 150 on one cluster
• Highest QPS (replica): ~ 20K r/w at peak
• Highest QPS (master): ~ 10K r/w at peak
• Supports most of Twitter internal services

Workloads on MySQL
▪ User Database (UDB)
▪ Social graph workload
▪ Pure flash
▪ Heavily sharded
▪ Automated management
▪ Facebook Messenger
▪ 1B+ people use the application
▪ Petabytes of information

Why migrate to 8.0?
• New features (includes 5.7)
– Atomic DDL
• LOCK TABLE t1 WRITE; RENAME TABLE t1 TO t1_old, t1_new TO t1;
– Parallel Replication
– Group Replication
– Instant Add Column
– Protocol X
• Reduce efforts to backport from 5.7 to 5.6
– 5.7 InnoDB resizable buffer pool
– 5.7 Server sessions
– 8.0 Atomic DDL

Agenda
30

MySQL Day Paris 2018 - Introduction & The State of the Dolphin

More Related Content

What's hot (20)

Similar to MySQL Day Paris 2018 - Introduction & The State of the Dolphin (20)

More from Olivier DASINI (9)

Recently uploaded (20)

MySQL Day Paris 2018 - Introduction & The State of the Dolphin