SlideShare a Scribd company logo

MySQL Query Optimization

Morgan Tocker, profile picture
Morgan Tocker

This document discusses query optimization in MySQL. It provides an introduction to how the MySQL query optimizer works to determine the most efficient execution plan for a SQL query. Several examples are shown using the EXPLAIN statement to analyze queries against sample data in the World Schema. Indexes are added and analyzed to demonstrate how they can improve query performance in different scenarios. The document also discusses some general strategies and rules of thumb used by the query optimizer.

Software
1 of 51
Downloaded 96 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
MySQL Query Optimization
Query Optimization Morgan Tocker MySQL Community Manager October, 2014 Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 3
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 4 Today’s Agenda Introduction World Schema IMDB Schema Advanced Topics 1 2 3 4
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Introduction ‱ SQL is declarative. ‱ You say what you want, not how to process. ‱ Can’t sight check a query to understand how it executes. ‱ Database management chooses the best possible way -­‐ think like a GPS navigator. 5
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | GPS Software 6
MySQL Optimizer Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 7
Diagnostic Commands Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ EXPLAIN (all versions) ‱ EXPLAIN FORMAT=JSON (MySQL 5.6+) ‱ Workbench supports visual format. ‱ OPTIMIZER TRACE (MySQL 5.6+) 8
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 9 Today’s Agenda Introduction World Schema IMDB Schema Advanced Topics 1 2 3 4
The World Schema Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Contains cities, countries and language statistics. ‱ Download From: ‱ http://dev.mysql.com/doc/index-­‐other.html ‱ Very small data set -­‐ good for learning. ‱ Not perfect for explaining performance differences 10
Find Countries in Asia with Population >5M Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 11 mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 5000000G ********************** 1. row ********************** id: 1 select_type: SIMPLE table: Country partitions: NULL type: ALL possible_keys: NULL key: NULL key_len: NULL ref: NULL rows: 239 filtered: 4.76 Extra: Using where 1 row in set, 1 warning (0.00 sec)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 12 EXPLAIN: { "query_block": { "select_id": 1, "cost_info": { "query_cost": "53.80" }, "table": { "table_name": "Country", "access_type": "ALL", "rows_examined_per_scan": 239, "rows_produced_per_join": 11, "filtered": 4.7614, "cost_info": { "read_cost": "51.52", "eval_cost": "2.28", "prefix_cost": "53.80", "data_read_per_join": "2K" }, "used_columns": [ "Code", .. "Capital", "Code2" ], "attached_condition": "((`world`.`country`.`Continent` = 'Asia') and (`world`.`country`.`Population` > 5000000))" } } } FORMAT=JSON Available since MySQL 5.6. Expanded in 5.7 to add cost information.
What indexes will make this query faster? Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Some suggestions: ‱ Index on (population) ‱ Index on (continent) ‱ Index on (population, continent) ‱ Index on (continent, population) 13 SELECT * FROM Country WHERE Continent = 'Asia' AND population > 5000000;
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Next Question ‱ Given so many choices, which is the best choice? ‱ A good GPS navigator understands traffic and finds the fastest route. ‱ A good query optimizer does similar. 14
Query Optimizer Strategy Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Pick the plan that consumes the least amount of resources (CPU, IO). 15
Query Optimizer Strategy (cont.) Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Use statistics available to identify good and bad plans. ‱ Decisions may include: ‱ Which indexes are good/bad. ‱ Which order to join tables in. ‱ If indexes should be read in a particular order to avoid sorting, or if sorting is not expensive. 16
Using single column indexes first
. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ p (population) ‱ c (continent) 17
mysql> ALTER TABLE Country ADD INDEX p (population); Query OK, 0 rows affected (0.04 sec) Records: 0 Duplicates: 0 Warnings: 0 mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 5000000G ************************ 1. row ************************ Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 18 id: 1 select_type: SIMPLE table: Country partitions: NULL type: ALL possible_keys: p key: NULL key_len: NULL ref: NULL rows: 239 filtered: 6.46 Extra: Using where 1 row in set, 1 warning (0.00 sec)
Why would an index not be used? Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 19 mysql> EXPLAIN FORMAT=JSON SELECT * FROM Country FORCE INDEX (p) WHERE Continent = 'Asia' AND population > 5000000G ******* 1. row ******* EXPLAIN: { "query_block": { "select_id": 1, "cost_info": { "query_cost": "152.21" }, "table": { "table_name": "Country", "access_type": "range", "possible_keys": [ "p" ], Using MySQL 5.7+ mysql> EXPLAIN FORMAT=JSON SELECT * FROM Country WHERE Continent = 'Asia' AND population > 5000000G ******* 1. row ******* EXPLAIN: { "query_block": { "select_id": 1, "cost_info": { "query_cost": "53.80" }, "table": { "table_name": "Country", "access_type": "ALL", "possible_keys": [ "p" ],
Modifying the query range: >50M Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 20 mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 50000000G ********************** 1. row ********************** id: 1 select_type: SIMPLE table: Country partitions: NULL type: range possible_keys: p key: p key_len: 4 ref: NULL rows: 24 filtered: 14.29 Extra: Using index condition; Using where 1 row in set, 1 warning (0.00 sec)
mysql> ALTER TABLE Country ADD INDEX c (continent); Query OK, 0 rows affected (0.04 sec) Records: 0 Duplicates: 0 Warnings: 0 mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 5000000G *********************** 1. row *********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 21 id: 1 select_type: SIMPLE table: Country partitions: NULL type: ref possible_keys: p,c key: c key_len: 1 ref: const rows: 51 filtered: 45.19 Extra: Using where 1 row in set, 1 warning (0.00 sec)
Modifying the query range: >500M mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 500000000G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 22 id: 1 select_type: SIMPLE table: Country partitions: NULL type: range possible_keys: p,c key: p key_len: 4 ref: NULL rows: 2 filtered: 21.34 Extra: Using index condition; Using where 1 row in set, 1 warning (0.00 sec)
Composite Indexes Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ On >50M which is better? ‱ (population, continent) ‱ (continent, population) 23
mysql> ALTER TABLE Country ADD INDEX pc (pop..on, co..nt); Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 50000000G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 24 id: 1 select_type: SIMPLE table: Country partitions: NULL type: ref possible_keys: p,c,pc key: c key_len: 1 ref: const rows: 51 filtered: 10.04 Extra: Using where 1 row in set, 1 warning (0.00 sec)
FORCE INDEX mysql> EXPLAIN SELECT * FROM Country FORCE INDEX (pc) WHERE Continent = 'Asia' AND population > 50000000G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 25 id: 1 select_type: SIMPLE table: Country partitions: NULL type: range possible_keys: pc key: pc key_len: 4 ref: NULL rows: 24 filtered: 14.29 Extra: Using index condition 1 row in set, 1 warning (0.00 sec)
mysql> EXPLAIN FORMAT=JSON SELECT * FROM Country FORCE INDEX (pc) WHERE Continent = 'Asia' AND population > 50000000G ********************** 1. row ********************** EXPLAIN: { "query_block": { "select_id": 1, "cost_info": { "query_cost": "34.61" }, "table": { Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 26 .. ], "key": "pc", "used_key_parts": [ "Population" ], .. Easier to see with JSON EXPLAIN
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Rule of Thumb ‱ Index on (const, range) instead of (range, const). ‱ Applies to all databases. 27
mysql> ALTER TABLE Country ADD INDEX cp (co..nt, pop..on); Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 50000000G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 28 id: 1 select_type: SIMPLE table: Country partitions: NULL type: range possible_keys: p,c,pc,cp key: cp key_len: 5 ref: NULL rows: 11 filtered: 100.00 Extra: Using index condition 1 row in set, 1 warning (0.00 sec)
Where Population >N. Lower is better. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Cost Estimates 29 5M 50M 500M Table Scan 53.80 53.80 53.80 (Population) 152.21 34.61 3.81 (Continent) 28.20 28.20 28.20 (Population, 152.21 34.61 3.81 Continent) (Continent, Population) 24.83 16.41 3.81
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 30 Today’s Agenda Introduction World Schema IMDB Schema Advanced Topics 1 2 3 4
Examples Using IMDB Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Larger than world database schema. ‱ Better to understand performance differences. ‱ License requires data to be regenerated: ‱ http://imdbpy.sourceforge.net/ 31
mysql> EXPLAIN SELECT * FROM title WHERE title = 'The Lion King'G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 32 id: 1 select_type: SIMPLE table: title partitions: NULL type: ALL possible_keys: NULL key: NULL key_len: NULL ref: NULL rows: 2387523 filtered: 0.50 Extra: Using where 1 row in set, 1 warning (0.00 sec) Ignore EXPLAIN time Actual run time is 2.9 seconds (Not shown)
mysql> ALTER TABLE title ADD INDEX (title(100)); Query OK, 0 rows affected (4.73 sec) Records: 0 Duplicates: 0 Warnings: 0 mysql> EXPLAIN SELECT * FROM title WHERE title = 'The Lion King'G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 33 id: 1 select_type: SIMPLE table: title partitions: NULL type: ref possible_keys: title key: title key_len: 102 ref: const rows: 4 filtered: 100.00 Extra: Using where 1 row in set, 1 warning (0.01 sec) From 2.9 seconds to 0.0 seconds (!!!)
How does LIKE work? Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 34 mysql> EXPLAIN SELECT * FROM title WHERE title LIKE 'The Lion %'G ********************** 1. row ********************** id: 1 select_type: SIMPLE table: title partitions: NULL type: range possible_keys: title key: title key_len: 102 ref: NULL rows: 109 filtered: 100.00 Extra: Using where 1 row in set, 1 warning (0.01 sec)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | LIKE (cont.) 35 mysql> EXPLAIN SELECT * FROM title WHERE title LIKE 'The%'G ********************** 1. row ********************** id: 1 select_type: SIMPLE table: title partitions: NULL type: range possible_keys: title key: title key_len: 102 ref: NULL rows: 325548 filtered: 100.00 Extra: Using where 1 row in set, 1 warning (0.00 sec) VS Very Close. Estimate is that it is almost as fast to table scan. Run Time is 1.9 sec
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Sorting 36 mysql> EXPLAIN SELECT * FROM title WHERE title = 'The Lion King' ORDER BY production_yearG ********************** 1. row ********************** id: 1 select_type: SIMPLE table: title partitions: NULL type: ref possible_keys: title key: title key_len: 102 ref: const rows: 4 filtered: 100.00 Extra: Using where; Using filesort 1 row in set, 1 warning (0.00 sec)
SELECT movie_info.* FROM title INNER JOIN movie_info ON title.id=movie_info.movie_id WHERE title=‘The Lion King’G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 37 id: 1 select_type: SIMPLE table: movie_info type: ALL possible_keys: NULL key: NULL key_len: NULL ref: NULL rows: 1212187 Extra: NULL ********************** 2. row ********************** id: 1 select_type: SIMPLE table: title type: eq_ref possible_keys: PRIMARY,title key: PRIMARY key_len: 4 ref: imdb.movie_info.movie_id rows: 1 Extra: Using where
mysql> ALTER TABLE movie_info ADD INDEX mi (movie_id); Query OK, 0 rows affected (1.95 sec) Records: 0 Duplicates: 0 Warnings: 0 Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 38
EXPLAIN SELECT movie_info.* FROM title INNER .. WHERE title='The Lion King'G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 39 id: 1 select_type: SIMPLE table: title type: ref possible_keys: PRIMARY,title key: title key_len: 102 ref: const rows: 4 Extra: Using where ********************** 2. row ********************** id: 1 select_type: SIMPLE table: movie_info type: ref possible_keys: mi key: mi key_len: 4 ref: imdb.title.id rows: 7 Extra: NULL
mysql> EXPLAIN SELECT * FROM movie_info WHERE movie_id IN (SELECT id FROM title WHERE title = 'The Lion King')G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 40 id: 1 select_type: SIMPLE table: title type: ref possible_keys: PRIMARY,title key: title key_len: 102 ref: const rows: 4 Extra: Using where ********************** 2. row ********************** id: 1 select_type: SIMPLE table: movie_info type: ref possible_keys: mi key: mi key_len: 4 ref: imdb.title.id rows: 7 Extra: NULL
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 41 Today’s Agenda Introduction World Schema IMDB Schema Advanced Topics 1 2 3 4
Optimizer Hints Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ USE INDEX ‱ FORCE INDEX ‱ IGNORE INDEX ‱ STRAIGHT JOIN 42
Optimizer Hints (cont.) Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 43 Expanded in MySQL 5.6 mysql> select @@optimizer_switchG ********************** 1. row ********************** @@optimizer_switch: index_merge=on,index_merge_union=on,index_merge_sort_union =on,index_merge_intersection=on,engine_condition_pushdown= on,index_condition_pushdown=on,mrr=on,mrr_cost_based=on,bl ock_nested_loop=on,batched_key_access=off,materialization= on,semijoin=on,loosescan=on,firstmatch=on,subquery_materia lization_cost_based=on,use_index_extensions=on,condition_f anout_filter=on 1 row in set (0.00 sec)
Statistics Sampling Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Some decisions based on pre-­‐computed statistics. ‱ For example, which order to join tables. ‱ Accuracy of statistics greatly improved in MySQL 5.6. ‱ Feature is called “InnoDB persistent statistics”. 44
Optimizer Decision Visibility Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Intended for MySQL developer usage, and reporting optimizer bugs. ‱ Yet totally practical for advanced usage :) 45 New to MySQL 5.6 SET optimizer_trace="enabled=on"; SELECT /* query here */; SELECT * FROM INFORMATION_SCHEMA.OPTIMIZER_TRACE;
Optimizer Trace Output ‱ Includes why decisions were not made: Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 46 .. "index": "pc", "ranges": [ "50000000 < Population" ], "index_dives_for_eq_ranges": true, "rowid_ordered": false, "using_mrr": false, "index_only": false, "rows": 24, "cost": 29.81, "chosen": false, "cause": "cost" },
Too many indexes Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Slows down modifications due to maintenance cost. ‱ i.e. Slower INSERT/UPDATE/DELETE ‱ May also lead to worse decisions being made by optimizer. ‱ Too many similar choices. ‱ Only limited time window to evaluate suitability. ‱ Space requirements in memory and storage. 47
MySQL 5.7 and beyond Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ We are working on a new cost model. ‱ Better adapt to new hardware with different costs (i.e. SSDs have cheap random IO). ‱ Memory buffer aware cost estimates. 48
Cost constants configurable per engine in 5.7 Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Previously hard-­‐coded constants. ‱ Better adapts to differences in hardware. 49
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 50
MySQL Query Optimization

More Related Content

PPTX
PostgreSQL Database Slides
metsarin
 
PDF
Open Source 101 2022 - MySQL Indexes and Histograms
Frederic Descamps
 
PPTX
The Basics of MongoDB
valuebound
 
PDF
ProxySQL and the Tricks Up Its Sleeve - Percona Live 2022.pdf
Jesmar Cannao'
 
PDF
The Full MySQL and MariaDB Parallel Replication Tutorial
Jean-François Gagné
 
PDF
How to Manage Scale-Out Environments with MariaDB MaxScale
MariaDB plc
 
ODP
Introduction to Ansible
Knoldus Inc.
 
PDF
Apache Calcite (a tutorial given at BOSS '21)
Julian Hyde
 
PostgreSQL Database Slides
metsarin
 
Open Source 101 2022 - MySQL Indexes and Histograms
Frederic Descamps
 
The Basics of MongoDB
valuebound
 
ProxySQL and the Tricks Up Its Sleeve - Percona Live 2022.pdf
Jesmar Cannao'
 
The Full MySQL and MariaDB Parallel Replication Tutorial
Jean-François Gagné
 
How to Manage Scale-Out Environments with MariaDB MaxScale
MariaDB plc
 
Introduction to Ansible
Knoldus Inc.
 
Apache Calcite (a tutorial given at BOSS '21)
Julian Hyde
 

What's hot (20)

PDF
Streaming Event Time Partitioning with Apache Flink and Apache Iceberg - Juli...
Flink Forward
 
PDF
Maxscale switchover, failover, and auto rejoin
Wagner Bianchi
 
PDF
Room 3 - 1 - Nguyễn XuĂąn Trường LĂąm - Zero touch on-premise storage infrastru...
Vietnam Open Infrastructure User Group
 
PDF
Get to know PostgreSQL!
OddbjĂžrn Steffensen
 
PPTX
Introduction to Apache Kafka
AIMDek Technologies
 
PDF
Apache Kafka Architecture & Fundamentals Explained
confluent
 
PDF
Apache Pinot Case Study: Building Distributed Analytics Systems Using Apache ...
HostedbyConfluent
 
PDF
M|18 Architectural Overview: MariaDB MaxScale
MariaDB plc
 
PDF
ETL With Cassandra Streaming Bulk Loading
alex_araujo
 
PDF
Mysql Explain Explained
Jeremy Coates
 
PDF
Parallel Replication in MySQL and MariaDB
Mydbops
 
PDF
Optimizing MariaDB for maximum performance
MariaDB plc
 
PDF
Spark (Structured) Streaming vs. Kafka Streams
Guido Schmutz
 
PDF
Using Optimizer Hints to Improve MySQL Query Performance
oysteing
 
PPTX
Maria DB Galera Cluster for High Availability
OSSCube
 
PDF
MariaDB Server Performance Tuning & Optimization
MariaDB plc
 
PPTX
Migration to ClickHouse. Practical guide, by Alexander Zaitsev
Altinity Ltd
 
PPTX
MySQL8.0_performance_schema.pptx
NeoClova
 
PPTX
AWS big-data-demystified #1.1 | Big Data Architecture Lessons Learned | English
Omid Vahdaty
 
PDF
HandsOn ProxySQL Tutorial - PLSC18
Derek Downey
 
Streaming Event Time Partitioning with Apache Flink and Apache Iceberg - Juli...
Flink Forward
 
Maxscale switchover, failover, and auto rejoin
Wagner Bianchi
 
Room 3 - 1 - Nguyễn XuĂąn Trường LĂąm - Zero touch on-premise storage infrastru...
Vietnam Open Infrastructure User Group
 
Get to know PostgreSQL!
OddbjĂžrn Steffensen
 
Introduction to Apache Kafka
AIMDek Technologies
 
Apache Kafka Architecture & Fundamentals Explained
confluent
 
Apache Pinot Case Study: Building Distributed Analytics Systems Using Apache ...
HostedbyConfluent
 
M|18 Architectural Overview: MariaDB MaxScale
MariaDB plc
 
ETL With Cassandra Streaming Bulk Loading
alex_araujo
 
Mysql Explain Explained
Jeremy Coates
 
Parallel Replication in MySQL and MariaDB
Mydbops
 
Optimizing MariaDB for maximum performance
MariaDB plc
 
Spark (Structured) Streaming vs. Kafka Streams
Guido Schmutz
 
Using Optimizer Hints to Improve MySQL Query Performance
oysteing
 
Maria DB Galera Cluster for High Availability
OSSCube
 
MariaDB Server Performance Tuning & Optimization
MariaDB plc
 
Migration to ClickHouse. Practical guide, by Alexander Zaitsev
Altinity Ltd
 
MySQL8.0_performance_schema.pptx
NeoClova
 
AWS big-data-demystified #1.1 | Big Data Architecture Lessons Learned | English
Omid Vahdaty
 
HandsOn ProxySQL Tutorial - PLSC18
Derek Downey
 
Ad

Viewers also liked (20)

PPTX
MySQL Architecture and Engine
Abdul Manaf
 
PDF
MariaDB: Connect Storage Engine
Kangaroot
 
PDF
InnoDB Architecture and Performance Optimization, Peter Zaitsev
Fuenteovejuna
 
PPT
Building High Performance MySql Query Systems And Analytic Applications
guest40cda0b
 
PDF
Zurich2007 MySQL Query Optimization
Hiệp LĂȘ Tuáș„n
 
PDF
Advanced MySQL Query Tuning
Alexander Rubin
 
PDF
MySQL Query Tuning for the Squeemish -- Fossetcon Orlando Sep 2014
Dave Stokes
 
PDF
56 Query Optimization
MYXPLAIN
 
PDF
MYSQL Query Anti-Patterns That Can Be Moved to Sphinx
Pythian
 
PDF
Mysql query optimization
Baohua Cai
 
PDF
Query Optimization with MySQL 5.6: Old and New Tricks
MYXPLAIN
 
PDF
Locking and Concurrency Control
Morgan Tocker
 
PPTX
Tunning sql query
vuhaininh88
 
PDF
MySQL Query tuning 101
Sveta Smirnova
 
PDF
ïżŒAdvanced MySQL Query and Schema Tuning
MYXPLAIN
 
PPT
My sql optimization
PrelovacMedia
 
PDF
Optimizing MySQL
Morgan Tocker
 
PDF
Webinar 2013 advanced_query_tuning
晓 摹
 
PDF
MySQL Query Optimization.
Remote MySQL DBA
 
PDF
Query Optimization with MySQL 5.6: Old and New Tricks - Percona Live London 2013
Jaime Crespo
 
MySQL Architecture and Engine
Abdul Manaf
 
MariaDB: Connect Storage Engine
Kangaroot
 
InnoDB Architecture and Performance Optimization, Peter Zaitsev
Fuenteovejuna
 
Building High Performance MySql Query Systems And Analytic Applications
guest40cda0b
 
Zurich2007 MySQL Query Optimization
Hiệp LĂȘ Tuáș„n
 
Advanced MySQL Query Tuning
Alexander Rubin
 
MySQL Query Tuning for the Squeemish -- Fossetcon Orlando Sep 2014
Dave Stokes
 
56 Query Optimization
MYXPLAIN
 
MYSQL Query Anti-Patterns That Can Be Moved to Sphinx
Pythian
 
Mysql query optimization
Baohua Cai
 
Query Optimization with MySQL 5.6: Old and New Tricks
MYXPLAIN
 
Locking and Concurrency Control
Morgan Tocker
 
Tunning sql query
vuhaininh88
 
MySQL Query tuning 101
Sveta Smirnova
 
ïżŒAdvanced MySQL Query and Schema Tuning
MYXPLAIN
 
My sql optimization
PrelovacMedia
 
Optimizing MySQL
Morgan Tocker
 
Webinar 2013 advanced_query_tuning
晓 摹
 
MySQL Query Optimization.
Remote MySQL DBA
 
Query Optimization with MySQL 5.6: Old and New Tricks - Percona Live London 2013
Jaime Crespo
 
Ad

Similar to MySQL Query Optimization (20)

PDF
MySQL 8.0 Optimizer Guide
Morgan Tocker
 
PPTX
MySQL 8.0 Released Update
Keith Hollman
 
PPTX
Five more things about Oracle SQL and PLSQL
Connor McDonald
 
PPTX
Solr JDBC - Lucene/Solr Revolution 2016
Kevin Risden
 
PDF
Histogram Support in MySQL 8.0
oysteing
 
PPTX
Sql and PL/SQL Best Practices I
Carlos Oliveira
 
PDF
Developers’ mDay u Banjoj Luci - Bogdan Kecman, Oracle – MySQL Server 8.0
mCloud
 
PDF
Developers' mDay 2017. - Bogdan Kecman Oracle
mCloud
 
PPTX
Advanced SQL - Quebec 2014
Connor McDonald
 
PPTX
Day 6.pptx
atreesgalaxy
 
PDF
Lessons learned from Isbank - A Story of a DB2 for z/OS Initiative
Cuneyt Goksu
 
PDF
Solr JDBC: Presented by Kevin Risden, Avalon Consulting
Lucidworks
 
PPTX
Top 10 tips for Oracle performance
Guy Harrison
 
PDF
MySQL 5.7: Core Server Changes
Morgan Tocker
 
PDF
How to analyze and tune sql queries for better performance percona15
oysteing
 
PDF
OQL querying and indexes with Apache Geode (incubating)
Jason Huynh
 
PDF
What's New MySQL 8.0?
OracleMySQL
 
PDF
MySQL Troubleshooting with the Performance Schema
Sveta Smirnova
 
PPTX
Confoo 2021 - MySQL Indexes & Histograms
Dave Stokes
 
PDF
How to analyze and tune sql queries for better performance webinar
oysteing
 
MySQL 8.0 Optimizer Guide
Morgan Tocker
 
MySQL 8.0 Released Update
Keith Hollman
 
Five more things about Oracle SQL and PLSQL
Connor McDonald
 
Solr JDBC - Lucene/Solr Revolution 2016
Kevin Risden
 
Histogram Support in MySQL 8.0
oysteing
 
Sql and PL/SQL Best Practices I
Carlos Oliveira
 
Developers’ mDay u Banjoj Luci - Bogdan Kecman, Oracle – MySQL Server 8.0
mCloud
 
Developers' mDay 2017. - Bogdan Kecman Oracle
mCloud
 
Advanced SQL - Quebec 2014
Connor McDonald
 
Day 6.pptx
atreesgalaxy
 
Lessons learned from Isbank - A Story of a DB2 for z/OS Initiative
Cuneyt Goksu
 
Solr JDBC: Presented by Kevin Risden, Avalon Consulting
Lucidworks
 
Top 10 tips for Oracle performance
Guy Harrison
 
MySQL 5.7: Core Server Changes
Morgan Tocker
 
How to analyze and tune sql queries for better performance percona15
oysteing
 
OQL querying and indexes with Apache Geode (incubating)
Jason Huynh
 
What's New MySQL 8.0?
OracleMySQL
 
MySQL Troubleshooting with the Performance Schema
Sveta Smirnova
 
Confoo 2021 - MySQL Indexes & Histograms
Dave Stokes
 
How to analyze and tune sql queries for better performance webinar
oysteing
 

More from Morgan Tocker (20)

PDF
Introducing Spirit - Online Schema Change
Morgan Tocker
 
PDF
MySQL Usability Guidelines
Morgan Tocker
 
PDF
My First 90 days with Vitess
Morgan Tocker
 
PDF
FOSDEM MySQL and Friends Devroom
Morgan Tocker
 
PDF
Introducing TiDB - Percona Live Frankfurt
Morgan Tocker
 
PDF
TiDB Introduction - Boston MySQL Meetup Group
Morgan Tocker
 
PDF
TiDB Introduction - San Francisco MySQL Meetup
Morgan Tocker
 
PDF
TiDB Introduction
Morgan Tocker
 
PDF
MySQL Server Defaults
Morgan Tocker
 
PDF
MySQL Cloud Service Deep Dive
Morgan Tocker
 
PDF
MySQL 5.7 + JSON
Morgan Tocker
 
PDF
Using MySQL in Automated Testing
Morgan Tocker
 
PDF
Upcoming changes in MySQL 5.7
Morgan Tocker
 
PDF
MySQL Performance Metrics that Matter
Morgan Tocker
 
PDF
MySQL For Linux Sysadmins
Morgan Tocker
 
PDF
MySQL: From Single Instance to Big Data
Morgan Tocker
 
PDF
MySQL NoSQL APIs
Morgan Tocker
 
PDF
MySQL 5.6 - Operations and Diagnostics Improvements
Morgan Tocker
 
PDF
The InnoDB Storage Engine for MySQL
Morgan Tocker
 
PDF
My sql 5.7-upcoming-changes-v2
Morgan Tocker
 
Introducing Spirit - Online Schema Change
Morgan Tocker
 
MySQL Usability Guidelines
Morgan Tocker
 
My First 90 days with Vitess
Morgan Tocker
 
FOSDEM MySQL and Friends Devroom
Morgan Tocker
 
Introducing TiDB - Percona Live Frankfurt
Morgan Tocker
 
TiDB Introduction - Boston MySQL Meetup Group
Morgan Tocker
 
TiDB Introduction - San Francisco MySQL Meetup
Morgan Tocker
 
TiDB Introduction
Morgan Tocker
 
MySQL Server Defaults
Morgan Tocker
 
MySQL Cloud Service Deep Dive
Morgan Tocker
 
MySQL 5.7 + JSON
Morgan Tocker
 
Using MySQL in Automated Testing
Morgan Tocker
 
Upcoming changes in MySQL 5.7
Morgan Tocker
 
MySQL Performance Metrics that Matter
Morgan Tocker
 
MySQL For Linux Sysadmins
Morgan Tocker
 
MySQL: From Single Instance to Big Data
Morgan Tocker
 
MySQL NoSQL APIs
Morgan Tocker
 
MySQL 5.6 - Operations and Diagnostics Improvements
Morgan Tocker
 
The InnoDB Storage Engine for MySQL
Morgan Tocker
 
My sql 5.7-upcoming-changes-v2
Morgan Tocker
 

Recently uploaded (20)

PDF
PTS Company Brochure 2025 (1).pdf.......
pts464036
 
PPTX
history of c programming in notes for students .pptx
Vijayakumari829030
 
PDF
How to Migrate SBCGlobal Email to Yahoo Easily
raymondjones7273
 
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 41
ghrom2211g
 
PDF
System and Network Administration Chapter 2
jaramharo
 
PDF
Wondershare Filmora 15 Crack With Activation Key [2025
ghrom2211g
 
PDF
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
TechBuilder
 
PDF
Understanding Forklifts - TECH EHS Solution
TECH EHS Solution
 
PPTX
Transform Your Business with a Software ERP System
Canada Software Company
 
PPT
Introduction Database Management System for Course Database
ReinertYosua
 
PDF
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
William Chong
 
PDF
How Creative Agencies Leverage Project Management Software.pdf
Orangescrum
 
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
itskinga12
 
PPTX
ai tools demonstartion for schools and inter college
harshavardhanreddyka11
 
PPTX
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
IT IDOL Technologies
 
PDF
Digital Strategies for Manufacturing Companies
Virendra Rai, PMP
 
PDF
Odoo Companies in India – Driving Business Transformation.pdf
azhuhardeen1968
 
PDF
Flood Susceptibility Mapping Using Image-Based 2D-CNN Deep Learnin. Overview ...
lawrenceomai2
 
PDF
Design an Analysis of Algorithms II-SECS-1021-03
DilanEscobar1
 
PPTX
Introduction to Artificial Intelligence
lohedi9363
 
PTS Company Brochure 2025 (1).pdf.......
pts464036
 
history of c programming in notes for students .pptx
Vijayakumari829030
 
How to Migrate SBCGlobal Email to Yahoo Easily
raymondjones7273
 
Internet Downloader Manager (IDM) Crack 6.42 Build 41
ghrom2211g
 
System and Network Administration Chapter 2
jaramharo
 
Wondershare Filmora 15 Crack With Activation Key [2025
ghrom2211g
 
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
TechBuilder
 
Understanding Forklifts - TECH EHS Solution
TECH EHS Solution
 
Transform Your Business with a Software ERP System
Canada Software Company
 
Introduction Database Management System for Course Database
ReinertYosua
 
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
William Chong
 
How Creative Agencies Leverage Project Management Software.pdf
Orangescrum
 
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
itskinga12
 
ai tools demonstartion for schools and inter college
harshavardhanreddyka11
 
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
IT IDOL Technologies
 
Digital Strategies for Manufacturing Companies
Virendra Rai, PMP
 
Odoo Companies in India – Driving Business Transformation.pdf
azhuhardeen1968
 
Flood Susceptibility Mapping Using Image-Based 2D-CNN Deep Learnin. Overview ...
lawrenceomai2
 
Design an Analysis of Algorithms II-SECS-1021-03
DilanEscobar1
 
Introduction to Artificial Intelligence
lohedi9363
 

MySQL Query Optimization

  • 2. Query Optimization Morgan Tocker MySQL Community Manager October, 2014 Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
  • 3. Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 3
  • 4. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 4 Today’s Agenda Introduction World Schema IMDB Schema Advanced Topics 1 2 3 4
  • 5. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Introduction ‱ SQL is declarative. ‱ You say what you want, not how to process. ‱ Can’t sight check a query to understand how it executes. ‱ Database management chooses the best possible way -­‐ think like a GPS navigator. 5
  • 6. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | GPS Software 6
  • 7. MySQL Optimizer Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 7
  • 8. Diagnostic Commands Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ EXPLAIN (all versions) ‱ EXPLAIN FORMAT=JSON (MySQL 5.6+) ‱ Workbench supports visual format. ‱ OPTIMIZER TRACE (MySQL 5.6+) 8
  • 9. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 9 Today’s Agenda Introduction World Schema IMDB Schema Advanced Topics 1 2 3 4
  • 10. The World Schema Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Contains cities, countries and language statistics. ‱ Download From: ‱ http://dev.mysql.com/doc/index-­‐other.html ‱ Very small data set -­‐ good for learning. ‱ Not perfect for explaining performance differences 10
  • 11. Find Countries in Asia with Population >5M Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 11 mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 5000000G ********************** 1. row ********************** id: 1 select_type: SIMPLE table: Country partitions: NULL type: ALL possible_keys: NULL key: NULL key_len: NULL ref: NULL rows: 239 filtered: 4.76 Extra: Using where 1 row in set, 1 warning (0.00 sec)
  • 12. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 12 EXPLAIN: { "query_block": { "select_id": 1, "cost_info": { "query_cost": "53.80" }, "table": { "table_name": "Country", "access_type": "ALL", "rows_examined_per_scan": 239, "rows_produced_per_join": 11, "filtered": 4.7614, "cost_info": { "read_cost": "51.52", "eval_cost": "2.28", "prefix_cost": "53.80", "data_read_per_join": "2K" }, "used_columns": [ "Code", .. "Capital", "Code2" ], "attached_condition": "((`world`.`country`.`Continent` = 'Asia') and (`world`.`country`.`Population` > 5000000))" } } } FORMAT=JSON Available since MySQL 5.6. Expanded in 5.7 to add cost information.
  • 13. What indexes will make this query faster? Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Some suggestions: ‱ Index on (population) ‱ Index on (continent) ‱ Index on (population, continent) ‱ Index on (continent, population) 13 SELECT * FROM Country WHERE Continent = 'Asia' AND population > 5000000;
  • 14. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Next Question ‱ Given so many choices, which is the best choice? ‱ A good GPS navigator understands traffic and finds the fastest route. ‱ A good query optimizer does similar. 14
  • 15. Query Optimizer Strategy Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Pick the plan that consumes the least amount of resources (CPU, IO). 15
  • 16. Query Optimizer Strategy (cont.) Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Use statistics available to identify good and bad plans. ‱ Decisions may include: ‱ Which indexes are good/bad. ‱ Which order to join tables in. ‱ If indexes should be read in a particular order to avoid sorting, or if sorting is not expensive. 16
  • 17. Using single column indexes first
. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ p (population) ‱ c (continent) 17
  • 18. mysql> ALTER TABLE Country ADD INDEX p (population); Query OK, 0 rows affected (0.04 sec) Records: 0 Duplicates: 0 Warnings: 0 mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 5000000G ************************ 1. row ************************ Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 18 id: 1 select_type: SIMPLE table: Country partitions: NULL type: ALL possible_keys: p key: NULL key_len: NULL ref: NULL rows: 239 filtered: 6.46 Extra: Using where 1 row in set, 1 warning (0.00 sec)
  • 19. Why would an index not be used? Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 19 mysql> EXPLAIN FORMAT=JSON SELECT * FROM Country FORCE INDEX (p) WHERE Continent = 'Asia' AND population > 5000000G ******* 1. row ******* EXPLAIN: { "query_block": { "select_id": 1, "cost_info": { "query_cost": "152.21" }, "table": { "table_name": "Country", "access_type": "range", "possible_keys": [ "p" ], Using MySQL 5.7+ mysql> EXPLAIN FORMAT=JSON SELECT * FROM Country WHERE Continent = 'Asia' AND population > 5000000G ******* 1. row ******* EXPLAIN: { "query_block": { "select_id": 1, "cost_info": { "query_cost": "53.80" }, "table": { "table_name": "Country", "access_type": "ALL", "possible_keys": [ "p" ],
  • 20. Modifying the query range: >50M Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 20 mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 50000000G ********************** 1. row ********************** id: 1 select_type: SIMPLE table: Country partitions: NULL type: range possible_keys: p key: p key_len: 4 ref: NULL rows: 24 filtered: 14.29 Extra: Using index condition; Using where 1 row in set, 1 warning (0.00 sec)
  • 21. mysql> ALTER TABLE Country ADD INDEX c (continent); Query OK, 0 rows affected (0.04 sec) Records: 0 Duplicates: 0 Warnings: 0 mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 5000000G *********************** 1. row *********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 21 id: 1 select_type: SIMPLE table: Country partitions: NULL type: ref possible_keys: p,c key: c key_len: 1 ref: const rows: 51 filtered: 45.19 Extra: Using where 1 row in set, 1 warning (0.00 sec)
  • 22. Modifying the query range: >500M mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 500000000G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 22 id: 1 select_type: SIMPLE table: Country partitions: NULL type: range possible_keys: p,c key: p key_len: 4 ref: NULL rows: 2 filtered: 21.34 Extra: Using index condition; Using where 1 row in set, 1 warning (0.00 sec)
  • 23. Composite Indexes Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ On >50M which is better? ‱ (population, continent) ‱ (continent, population) 23
  • 24. mysql> ALTER TABLE Country ADD INDEX pc (pop..on, co..nt); Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 50000000G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 24 id: 1 select_type: SIMPLE table: Country partitions: NULL type: ref possible_keys: p,c,pc key: c key_len: 1 ref: const rows: 51 filtered: 10.04 Extra: Using where 1 row in set, 1 warning (0.00 sec)
  • 25. FORCE INDEX mysql> EXPLAIN SELECT * FROM Country FORCE INDEX (pc) WHERE Continent = 'Asia' AND population > 50000000G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 25 id: 1 select_type: SIMPLE table: Country partitions: NULL type: range possible_keys: pc key: pc key_len: 4 ref: NULL rows: 24 filtered: 14.29 Extra: Using index condition 1 row in set, 1 warning (0.00 sec)
  • 26. mysql> EXPLAIN FORMAT=JSON SELECT * FROM Country FORCE INDEX (pc) WHERE Continent = 'Asia' AND population > 50000000G ********************** 1. row ********************** EXPLAIN: { "query_block": { "select_id": 1, "cost_info": { "query_cost": "34.61" }, "table": { Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 26 .. ], "key": "pc", "used_key_parts": [ "Population" ], .. Easier to see with JSON EXPLAIN
  • 27. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Rule of Thumb ‱ Index on (const, range) instead of (range, const). ‱ Applies to all databases. 27
  • 28. mysql> ALTER TABLE Country ADD INDEX cp (co..nt, pop..on); Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 mysql> EXPLAIN SELECT * FROM Country WHERE Continent = 'Asia' AND population > 50000000G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 28 id: 1 select_type: SIMPLE table: Country partitions: NULL type: range possible_keys: p,c,pc,cp key: cp key_len: 5 ref: NULL rows: 11 filtered: 100.00 Extra: Using index condition 1 row in set, 1 warning (0.00 sec)
  • 29. Where Population >N. Lower is better. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Cost Estimates 29 5M 50M 500M Table Scan 53.80 53.80 53.80 (Population) 152.21 34.61 3.81 (Continent) 28.20 28.20 28.20 (Population, 152.21 34.61 3.81 Continent) (Continent, Population) 24.83 16.41 3.81
  • 30. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 30 Today’s Agenda Introduction World Schema IMDB Schema Advanced Topics 1 2 3 4
  • 31. Examples Using IMDB Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Larger than world database schema. ‱ Better to understand performance differences. ‱ License requires data to be regenerated: ‱ http://imdbpy.sourceforge.net/ 31
  • 32. mysql> EXPLAIN SELECT * FROM title WHERE title = 'The Lion King'G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 32 id: 1 select_type: SIMPLE table: title partitions: NULL type: ALL possible_keys: NULL key: NULL key_len: NULL ref: NULL rows: 2387523 filtered: 0.50 Extra: Using where 1 row in set, 1 warning (0.00 sec) Ignore EXPLAIN time Actual run time is 2.9 seconds (Not shown)
  • 33. mysql> ALTER TABLE title ADD INDEX (title(100)); Query OK, 0 rows affected (4.73 sec) Records: 0 Duplicates: 0 Warnings: 0 mysql> EXPLAIN SELECT * FROM title WHERE title = 'The Lion King'G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 33 id: 1 select_type: SIMPLE table: title partitions: NULL type: ref possible_keys: title key: title key_len: 102 ref: const rows: 4 filtered: 100.00 Extra: Using where 1 row in set, 1 warning (0.01 sec) From 2.9 seconds to 0.0 seconds (!!!)
  • 34. How does LIKE work? Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 34 mysql> EXPLAIN SELECT * FROM title WHERE title LIKE 'The Lion %'G ********************** 1. row ********************** id: 1 select_type: SIMPLE table: title partitions: NULL type: range possible_keys: title key: title key_len: 102 ref: NULL rows: 109 filtered: 100.00 Extra: Using where 1 row in set, 1 warning (0.01 sec)
  • 35. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | LIKE (cont.) 35 mysql> EXPLAIN SELECT * FROM title WHERE title LIKE 'The%'G ********************** 1. row ********************** id: 1 select_type: SIMPLE table: title partitions: NULL type: range possible_keys: title key: title key_len: 102 ref: NULL rows: 325548 filtered: 100.00 Extra: Using where 1 row in set, 1 warning (0.00 sec) VS Very Close. Estimate is that it is almost as fast to table scan. Run Time is 1.9 sec
  • 36. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Sorting 36 mysql> EXPLAIN SELECT * FROM title WHERE title = 'The Lion King' ORDER BY production_yearG ********************** 1. row ********************** id: 1 select_type: SIMPLE table: title partitions: NULL type: ref possible_keys: title key: title key_len: 102 ref: const rows: 4 filtered: 100.00 Extra: Using where; Using filesort 1 row in set, 1 warning (0.00 sec)
  • 37. SELECT movie_info.* FROM title INNER JOIN movie_info ON title.id=movie_info.movie_id WHERE title=‘The Lion King’G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 37 id: 1 select_type: SIMPLE table: movie_info type: ALL possible_keys: NULL key: NULL key_len: NULL ref: NULL rows: 1212187 Extra: NULL ********************** 2. row ********************** id: 1 select_type: SIMPLE table: title type: eq_ref possible_keys: PRIMARY,title key: PRIMARY key_len: 4 ref: imdb.movie_info.movie_id rows: 1 Extra: Using where
  • 38. mysql> ALTER TABLE movie_info ADD INDEX mi (movie_id); Query OK, 0 rows affected (1.95 sec) Records: 0 Duplicates: 0 Warnings: 0 Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 38
  • 39. EXPLAIN SELECT movie_info.* FROM title INNER .. WHERE title='The Lion King'G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 39 id: 1 select_type: SIMPLE table: title type: ref possible_keys: PRIMARY,title key: title key_len: 102 ref: const rows: 4 Extra: Using where ********************** 2. row ********************** id: 1 select_type: SIMPLE table: movie_info type: ref possible_keys: mi key: mi key_len: 4 ref: imdb.title.id rows: 7 Extra: NULL
  • 40. mysql> EXPLAIN SELECT * FROM movie_info WHERE movie_id IN (SELECT id FROM title WHERE title = 'The Lion King')G ********************** 1. row ********************** Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 40 id: 1 select_type: SIMPLE table: title type: ref possible_keys: PRIMARY,title key: title key_len: 102 ref: const rows: 4 Extra: Using where ********************** 2. row ********************** id: 1 select_type: SIMPLE table: movie_info type: ref possible_keys: mi key: mi key_len: 4 ref: imdb.title.id rows: 7 Extra: NULL
  • 41. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 41 Today’s Agenda Introduction World Schema IMDB Schema Advanced Topics 1 2 3 4
  • 42. Optimizer Hints Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ USE INDEX ‱ FORCE INDEX ‱ IGNORE INDEX ‱ STRAIGHT JOIN 42
  • 43. Optimizer Hints (cont.) Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 43 Expanded in MySQL 5.6 mysql> select @@optimizer_switchG ********************** 1. row ********************** @@optimizer_switch: index_merge=on,index_merge_union=on,index_merge_sort_union =on,index_merge_intersection=on,engine_condition_pushdown= on,index_condition_pushdown=on,mrr=on,mrr_cost_based=on,bl ock_nested_loop=on,batched_key_access=off,materialization= on,semijoin=on,loosescan=on,firstmatch=on,subquery_materia lization_cost_based=on,use_index_extensions=on,condition_f anout_filter=on 1 row in set (0.00 sec)
  • 44. Statistics Sampling Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Some decisions based on pre-­‐computed statistics. ‱ For example, which order to join tables. ‱ Accuracy of statistics greatly improved in MySQL 5.6. ‱ Feature is called “InnoDB persistent statistics”. 44
  • 45. Optimizer Decision Visibility Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Intended for MySQL developer usage, and reporting optimizer bugs. ‱ Yet totally practical for advanced usage :) 45 New to MySQL 5.6 SET optimizer_trace="enabled=on"; SELECT /* query here */; SELECT * FROM INFORMATION_SCHEMA.OPTIMIZER_TRACE;
  • 46. Optimizer Trace Output ‱ Includes why decisions were not made: Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 46 .. "index": "pc", "ranges": [ "50000000 < Population" ], "index_dives_for_eq_ranges": true, "rowid_ordered": false, "using_mrr": false, "index_only": false, "rows": 24, "cost": 29.81, "chosen": false, "cause": "cost" },
  • 47. Too many indexes Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Slows down modifications due to maintenance cost. ‱ i.e. Slower INSERT/UPDATE/DELETE ‱ May also lead to worse decisions being made by optimizer. ‱ Too many similar choices. ‱ Only limited time window to evaluate suitability. ‱ Space requirements in memory and storage. 47
  • 48. MySQL 5.7 and beyond Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ We are working on a new cost model. ‱ Better adapt to new hardware with different costs (i.e. SSDs have cheap random IO). ‱ Memory buffer aware cost estimates. 48
  • 49. Cost constants configurable per engine in 5.7 Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | ‱ Previously hard-­‐coded constants. ‱ Better adapts to differences in hardware. 49
  • 50. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 50