Harnessing the Power of Optimizer Hints

Copyright © 2017, Oracle and/or its aﬃliates. All rights reserved. |
Harnessing the Power of OpCmizer Hints
Maria Colgan
Master Product Manager
Oracle Database Server Technologies
September 2017

Safe Harbor Statement
The following is intended to outline our general product direcCon. It is intended for
informaCon purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or funcConality, and should not be relied upon
in making purchasing decisions. The development, release, and Cming of any features or
funcConality described for Oracle’s products remains at the sole discreCon of Oracle.
2

Harnessing the power of OpCmizer hints
•  This session will not instantly make you an OpCmizer hint expert!
•  Adding hints won’t magically improve every query you encounter
ExpectaAons
OpCmizer hints should only be used with extreme care

Program Agenda
What are hints?
How to use OpCmizer hints
Useful OpCmizer hints to know
Why are OpCmizer hints ignored?
If you can hint it, baseline it
Managing an exisCng hinted applicaCon
1
2
3
4
5
4
6

What are hints?
•  Hints allow you to inﬂuence the OpCmizer when it has to choose between
several possibiliCes
•  A hint is a direcCve that will be followed when applicable
•  Can inﬂuence everything from the OpCmizer mode used to each operaCon
in the execuCon
•  AutomaCcally means the Cost Based OpCmizer will be used
– Only excepCon is the RULE hint but it must be used alone
Overview

What are hints?
Example - direcAons to the mall

What are hints?
Example - direcAons to the mall but don’t take 6th St

What are hints?
Example - direcAons to the mall if you have insider informaAon

What are hints?
•  Should I walk or drive to the mall?
– Best plan would be to walk
•  Should I go up 4th, 5th, or 6th street?
– Best plan would be to go up 4th street
•  Should I go in the front or the back door of the mall?
– Best plan would be to go in the back door
•  Telling me the cheapest parking is at 5th and Mission garage is irrelevant
since I decided to walk
Hints only evaluated when they apply to a decision that has to be made

Two diﬀerent classes of hints

Non-Optimizer Hints

HINTS

Optimizer Hints

Not all hints influence the OpCmizer
•  The hint mechanism is not exclusively used by the OpCmizer
•  Several other funcConal area use hints too
–  Direct path load can be controlled by APPEND hint
–  Parallel statement queuing can be controlled by STATEMENT_QUEUING hint
–  Data management in buffer cache can be influenced by CACHE hint
–  What SQL statements get monitored by SQL Monitor can be controlled by MONITOR hint
–  Use of In-Memory column store can be controlled by INMEMORY hint
Overview

Checking cardinality esCmates
SELECT /*+ GATHER_PLAN_STATISTICS*/ p.prod_name,
SUM(s.quantity_sold)
FROM Products p, Sales s
WHERE s.prod_id = p.prod_id
GROUP BY p.prod_name;

GATHER_PLAN_STATISTICS hint

SELECT * FROM table(
DBMS_XPLAN.DISPLAY_CURSOR(FORMAT=>'ALLSTATS LAST’));

GATHER_PLAN_STATISTICS hint
•  Compare esCmated rows returned for each operaCon in plan to actual
rows returned
•  A-Time allows you to see where the Cme is spent

SELECT /*+ MONITOR*/ CUST_LASTNAME, SUM(AMOUNT_SOLD)
FROM Customers c, Sales s
WHERE s.cust_id = c.cust_id …

MONITOR hint
•  Compare esCmated rows
returned for each operaCon
in plan to actual rows
returned
•  Timeline allows you to see
where the Cme is spent

Inside the Oracle OpCmizer
Query Transformation
Rewrite query text to allow it to be processed
more efficiently
Plan Generator
Multiple plans are generated for
each SQL, using different access
paths and join types. Each plan is
costed and plan with the lowest
cost is used.
Cost Estimator
Cost is an estimate of the amount of
CPU and the number of disk I/Os, used
to perform an operation
Statistics
Schema definitions

Hints inﬂuencing Query TransformaCons
•  First thing the OpCmizer does is try to transform (rewrite) your statement
– The goal is to allows addiConal access or join methods and join orders to be used
•  Some transformaCons are always done but some are cost-based
•  Hints can be used to inﬂuence the transformaCons the OpCmizer does
•  NO_QUERY_TRANSFORMATION
•  MERGE
•  USE_CONCAT
•  REWRITE

Overview
•  STAR_TRANSFORMATION
•  UNNEST

Hints can also influence all aspects of a plan

•  Most hints have corresponding negaCve hint preceded by word ‘NO_’
•  More informaCon on hints can be found in chapter 3 of SQL Reference Guide &
chapter 19 of the SQL Tuning Guide
Overview
Hints to influence cardinality
DYNAMIC_SAMPLING
CARDINALITY
Hints to influence join methods
USE_NL_WITH_INDEX
USE_HASH
Hints to influence access paths
FULL
INDEX
Hints to influence join order
LEADING
ORDERED

Hints ClassificaCons
•  Single-table - hints that are specified on one table or view
– FULL , INDEX or USE_NL
•  MulA-table - hint that can be specified on one or more tables or views
– LEADING or ORDERED
•  Query block - hints that operate on single query blocks
– STAR_TRANSFORMATION or UNNEST
•  Statement – hints that apply to the enCre SQL statement
– ALL_ROWS or OPTIMIZER_FEATURES_ENABLE
Overview

Program Agenda
What are hints?
1
2
3
4
5
20
6

•  Hints are inserted in a SQL statement in the form of a comment with an
addiConal + sign
•  They go immediately aqer the keyword (SELECT, INSERT, etc)
SELECT /* This is a comment */ count(*) FROM Sales;

SELECT /*+ This is a hint */ count(*) FROM Sales;

Overview
Hint syntax is correct but it is not a valid hint so is treated as comment

•  Hints and comments can be combined
•  But best pracCce is to keep comment and hints in diﬀerent blocks
– Comments can be put anywhere in a SQL statement not just aqer keyword
SELECT /*+ FULL(s) and a comment*/ count(*) FROM Sales s;

SELECT /*+ This_is_a_comment FULL(s) */ count(*) FROM Sales s;
Overview
SELECT /*+ FULL(s)*/ count(*) FROM Sales s /* comment */;

•  Which one of the following hints will trigger the pk_emp index to be used
in this query?

SELECT /*+ index(scott.emp pk_emp)*/ * FROM emp e; 
SELECT /*+ index(emp pk_emp)*/ * FROM emp e; 
SELECT /*+ index(pk_emp)*/ * FROM emp e;

Correctly idenAfying the object in the hint
None of them

•  If you use a table alias in the query than you must specify the table alias
name in the hint
•  Otherwise the hint is not valid
SELECT /*+ index(e pk_emp)*/ * FROM emp e; 

Correctly idenAfying the object in the hint

SELECT /*+ FULL(e) FULL(d) */ e.last_name, e.dept_id
FROM employees e 
WHERE e.dept_id in (SELECT d.dept_id  
FROM departments d 
WHERE d.location_id=51);
Hints only apply to the query block in which they appear
The dept table only appears in
the sub-query, which is treated
as separate query block. Hint has
no eﬀect.

SELECT /*+ FULL(e) */ e.last_name, e.dept_id  
FROM employees e 
WHERE e.dept_id in (SELECT /*+ FULL(d) */ d.dept_id  
Hints only apply to the query block in which they appear
Only excepCon are statement level hints
The hint on dept now has an
eﬀect as it appears in the correct
query block, the sub-query

•  Oracle automaCcally names each query block in a SQL statement
– sel$1, ins$2, upd$3, del$4, cri$5, mrg$6, set$7, misc$8
– Displayed using ‘+alias’ format parameter in DBMS_XPLAN procedures
•  Query block names can be used to specify which block a hint applies to
– /*+ FULL(@SEL$2 D) */
•  The QB_NAME hint can be used to explicitly labels each query block
– /*+ QB_NAME(my_name_for_ block) */

Query block names

SELECT /*+ FULL(e) FULL(@MY_SUBQ d) */  
e.last_name, e.dept_id  
FROM employees e 
WHERE e.dept_id in (SELECT /*+ QB_NAME(MY_SUBQ) */
d.dept_id  
Query block names

•  Any valid hint will be used
•  Can check if a hint is valid in hint secCon of 10053 trace
How do I know if my hints are used or not?
ERR indicates if there is
an error with hint
USED indicates the hint was used during the
evaluaCon of the part of the plan it pertains to
Doesn’t mean the ﬁnal plan will reﬂect it

Example showing how hints are used
•  SQL Statement
SELECT c.cust_name, sum (s.amount_sold) 
FROM customers c, sales s 
WHERE c.cust_id = s.cust_id
AND c.cust_city = ‘Los Angeles’
AND c.cust_province = ‘CA’
AND s.time_id = ‘09-SEP-17’
GROUP BY c.cust_name;

•  Default plan is a hash join between sales and customers
But we want the query to use a nested loops join

•  Hinted SQL statement
SELECT /*+ USE_NL(s) */  
c.cust_name, sum (s.amount_sold) 

•  Even with the hint we sCll get a hash join plan
Why did it not use the hint?

•  Lets look in the 10053 trace ﬁle
•  Hint is valid and was used
•  Why did it not change the plan?
•  We only hinted the join method we didn’t hint the join order
•  Hint only valid when sales is on right side
•  Hint considered ONLY when join order was customers, sales

•  Hinted SQL statement with both join method and join order hints
SELECT /*+ ORDERED USE_NL(s) */  
c.cust_name, sum (s.amount_sold) 

•  Hinted plan

•  ParCal hints can’t guarantee the same plan every Cme
•  Only way to guarantee the same plan every Cme is with a full outline
•  A full outline is a complete set of hints for all aspects of a plan
•  Full outline for a plan can be displayed using ‘+outline’ opCon with FORMAT
parameter in DBMS_XPLAN.DISPLAY_CURSOR
SELECT * FROM
TABLE(DBMS_XPLAN.display_cursor(format=>’+outline'));

Guaranteeing the same plan every Ame

Full outline for the plan

Cut and paste full
outline for the plan
Easier to maintain a full outline using SQL Plan Management

Program Agenda
What are hints?
1
2
3
4
5
40
6

Changing the OpCmizer mode
•  The following hints control the OpCmizer mode
– ALL_ROWS (default mode)
– FIRST_ROWS(n)
– RULE
•  FIRST_ROWS(n) choose plan that returns the ﬁrst n rows most eﬃciently
– Use of old FIRST_ROWS hint is not recommended
•  Not fully cost based
•  RULE hint reverts back to Rule Based OpCmizer (RBO)
– Not recommended as RBO is de-supported and severely limits plan opCons

•  40% of the rows in the employee table have department_id = 50
•  Default plan is a full table scan
•  SELECT e.emp_id, e.last_name, e.salary  
FROM employees e 
WHERE e.dept_id = 50;
Default OpAmizer mode example

SELECT /*+ FIRST_ROWS(10) */  
e.emp_id, e.last_name, e.salary  
FROM employees e 
WHERE e.dept_id = 50;

•  Plan changed because the assumption is you are going to stop
fetching after first 10 rows
FRIST_ROWS(n) hint example

•  RULE hint specifies that the Rule Based OpCmizer (RBO) be used
•  The RULE hint is not applicable if
– Other hints are specified in the stmt
– One or more parCConed tables are used
– One or more IOTs are used
– One or more Materialized views exist
– A SAMPLE clauses is specified
– A spreadsheet clause is specified
RULE hint
– Parallel execuCon is used
– Grouping sets are used
– Group outer-join is used
– A create table with a parallel clause
– A leq or full outer join (ANSI) is specified
– Flashback cursor (AS OF) is used
– ……….

•  RULE hint ignored when parCConed table is used
•  SELECT /*+ RULE */ count(*) 
FROM sales s;
Rule hint
RULE hint is ignored because SALES
is a partitioned table therefore CBO is
used

•  RULE hint prevents bitmap index being used and triggers full scan
•  SELECT /*+ RULE */ count(*) 
FROM non_partitioned_sales s;
RULE hint

Changing iniCalizaCon parameter for a query
•  Allows init.ora OpCmizer parameters to be changed for a speciﬁc query
•  Useful way to prevent sewng non-default parameter value system-wide
•  Only the following OpCmizer inﬂuencing init.ora parameters can be set:
OPT_PARAM hint

-  OPTIMIZER_DYNAMIC_SAMPLING
-  OPTIMIZER_INDEX_CACHING
-  OPTIMIZER_INDEX_COST_ADJ
-  OPTIMIZER_USE_PENDING_STATISTICS
-  OPTIMIZER_USE_INVISIBLE_INDEXES
-  OPTIMIZER_SECURE_VIEW_MERGING
-  OpCmizer related underscore parameters
-  STAR_TRANSFORMATION_ENABLED
-  PARALLEL_DEGREE_POLICY
-  PARALLEL_DEGREE_LIMIT
-  OPTIMIZER_ADAPTIVE_PLANS
-  OPTIMIZER_ADAPTIVE_REPORTING_ONLY
-  OPTIMIZER_ADAPTIVE_STATISTICS
-  OPTIMIZER_INMEMORY_AWARE

OPT_PARAM hint example

Cardinality under-estimated due
to complex expression
Extended statistics would help

OPT_PARAM hint example

Create extended statistics & re-
gather statistics as pending
statistics
OPT_PARAM hint enables
pending statistics for only this
statement

Changing OpCmizer features enable
•  OPTIMIZER_FEATURES_ENABLE parameter allows you to switch
between opCmizer versions
•  Sewng it to previous database version reverts the OpCmizer to that version
– Disables any funcConality that was not present in that version
•  Easy way to work around unexpected behavior in a new release
•  Hint allows you to revert the OpCmizer for just a single statement
This parameter gets it own hint

Example

Example
Hash GROUP BY introduced in
10g not an option for 9.2
Optimizer, so traditional sort
based GROUP BY selected

Program Agenda
What are hints?
1
2
3
4
5
53
6

•  Which one of the following hints will trigger the pk_emp index to be used
in this query?
SELECT /*+ IND(e pk_emp)*/ * FROM employees e; 
SELECT /*+ INDEX(e emp_pk)*/ * FROM employees e;
SELECT /*+ INDEX(e pk_emp)*/ * FROM employees e;
Syntax and Spelling

•  Specifying an index hint on a table with no indexes

SELECT /*+ INDEX(p) */ Count(*)
FROM my_promotions p
WHERE promo_category = 'TV'
AND promo_begin_date = '05-OCT-17’;
Invalid hint
Invalid hint because no indexes
exist on the table

•  Specifying a hash join hint for non-equality join

SELECT /*+ USE_HASH(e s) */ e.first_name, e.last_name
FROM employees e, salary_grade s
WHERE e.salary BETWEEN s.low_sal AND s.high_sal;

Illegal hint
Illegal hint because a hash join
can’t be used for a non-equality
join predicate

•  Specifying a parallel hint for an index range scan
SELECT /*+ index(e empno_pk_ind) parallel(e 8) */
e.empno, e.name
FROM employees e
WHERE e.empno < 7700;

Invalid hint combinaAons
Invalid hint combination
because an index range scan
can’t be parallelized on non-
partitioned table

•  If two hints contradict each other, they will both be ignored
SELECT /*+ full(e) index(e empno_fk_ind) */
e.empno, e.name
FROM employees e
WHERE e.empno < 7700;

Invalid hint combinaAons
Conflicting hints you can’t do a
full table scan and index lookup
on same table

•  Ordered hint dictates the join order as the order of tables in FROM clause
SELECT /*+ ordered */ e1.last_name, j.job_title, e1.salary, v.avg_salary
FROM employees e1, jobs j
( SELECT e2.dept_id, avg(e2.salary) avg_salary
FROM employees e2, departments d
WHERE d.location=1700 AND e2.depet_id=d.dept_id
GROUP BY e2.dept_id)v
WHERE e1.job_id = j.job_id
AND e1.dept_id = v.dept_id
AND e1.salary > a.avg_salary
ORDER BY e1.last_name;
Hint becomes invalid due to transformaAon
Expected join order
1.  Employees
2.  Jobs
3.  V

•  Actual join order used
1
3
2
View merging occurred
Order of tables in FROM clause
(e1,j,v) lost
Optimizer picks join order with
lowest cost
4

•  NO_MERGE hint prevents transformaCon from taking place
SELECT /*+ no_merge(v) ordered */
e1.last_name, j.job_title, e1.salary, v.avg_salary
FROM employees e1, jobs j
( SELECT e2.dept_id, avg(e2.salary) avg_salary
FROM employees e2, departments d
WHERE d.location=1700 AND e2.depet_id=d.dept_id
GROUP BY e2.dept_id)v
WHERE e1.job_id = j.job_id
AND e1.dept_id = v.dept_id
AND e1.salary > a.avg_salary
ORDER BY e1.last_name;
Preserves FROM clause order

•  Actual join order used
Inline View v
1
2
3

Program Agenda
What are hints?
1
2
3
4
5
63
6

•  It is not always possible to add hints to third party applicaCons
•  Hints can be extremely diﬃcult to manage over Cme
•  Once added never removed
AlternaAve approach to hints
Solution
•  Use SQL Plan Management (SPM)
•  Inﬂuence the execuCon plan without adding hints directly to queries
•  SPM available in Enterprise EdiCon*, no addiConal opCons required

Plan history
SQL Plan Management
Users
HJ
HJ
GB
Plan baseline
Parse
HJ
HJ
GB
Execute
Plan Acceptable
NOTE:: Actual execuCon plans stored in
SQL plan baseline in Oracle Database 12c

Plan history
SQL Plan Management
Users
HJ
HJ
GB
Plan baseline
Parse
NL
NL
GB
NL
NL
GB
NOTE:: You do not need to be in auto-
capture mode to have a new plan added
to an exisCng SQL plan baseline
AddiConal ﬁelds such as fetches, row
processed etc. are not populated because
new plan has never executed

Plan history
SQL Plan Management
Users
HJ
HJ
GB
Plan baseline
Parse
NL
NL
GB
HJ
HJ
GB
Execute
Plan Acceptable

Inﬂuence execuCon plan without adding hints
•  Simple two table join between the SALES and PRODUCTS tables

SELECT p.prod_name,SUM(s.amount_sold)
FROM products p, sales s
WHERE p.prod_id = s.prod_id
AND p.supplier_id = :sup_id
Example Overview

Current Plan
GROUP BY
HASH JOIN
TABLE ACCESS
SALES
TABLE ACCESS
PRODUCTS

•  Simple two table join between the SALES and PRODUCTS tables

Example Overview

GROUP BY
HASH JOIN
INDEX RANGE SCAN
PROD_SUPP_ID_INDX
TABLE ACCESS
SALES
Desired Plan

PROD_NAME SUM(S.AMOUNT_SOLD)
--------------------------------------- ------------------
Baseball trouser Kids 91
Short Sleeve Rayon Printed Shirt $8.99 32

Step 1. Execute the non-hinted SQL statement

Default plan uses full table scans followed by a hash join

SELECT sql_id,
       sql_fulltext
FROM   v$sql
WHERE  sql_text LIKE 'SELECT p.prod_name, %';
SQL_ID SQL_FULLTEXT
------------- ----------------------------------------
akuntdurat7yr SELECT p.prod_name, SUM(s.amount_sold)
   FROM   products p , sales s
WHERE  p.prod
Step 2. Find the SQL_ID for the non-hinted statement in V$SQL

VARIABLE cnt NUMBER
EXECUTE :cnt := dbms_spm.load_plans_from_cursor_cache(sql_id=>'akuntdurat7yr');
PL/SQL PROCEDURE successfully completed.
SELECT sql_handle, sql_text, plan_name, enabled
FROM dba_sql_plan_baselines
SQL_HANDLE SQL_TEXT PLAN_NAME ENA
------------------ --------------------------------------- -------------------- ---
SQL_8f876d84821398cf SELECT p.prod_name, sum(s.amount_sold) SQL_PLAN_8z1vdhk1176 YES
FROM products p , sales s g42949306 
Step 3. Create a SQL plan baseline for the non-hinted SQL statement

Step 4. Disable plan in SQL plan baseline for the non-hinted SQL statement

EXECUTE :cnt := dbms_spm.alter_sql_plan_baseline(sql_handle=>'SQL_8f876d84821398cf’,-
plan_name=>'SQL_PLAN_8z1vdhk11766g42949306',-
attribute_name => 'enabled’, -
attribute_value => 'NO');
------------------ ---------------------------------------- --------------------- ---
SQL_8f876d84821398cf SELECT p.prod_name, sum(s.amount_sold) SQL_PLAN_8z1vdhk1176 NO 
FROM products p , sales s g42949306

SELECT /*+ index(p) */ p.prod_name,SUM(s.amount_sold)
GROUP  BY p.prod_name; 
PROD_NAME SUM(S.AMOUNT_SOLD)
--------------------------------------- ------------------
Baseball trouser Kids 91
Short Sleeve Rayon Printed Shirt $8.99 32
Step 5. Manually modify the SQL statement to use the hint(s) & execute it

SELECT sql_id, plan_hash_value,  sql_fulltext
FROM   v$sql
WHERE  sql_text LIKE 'SELECT /*+ index(p) */ p.prod_name, %';
SQL_ID PLAN_HASH_VLAUE SQL_FULLTEXT
------------- --------------- -----------------------------------
avph0nnq5pfc2  2567686925   SELECT /*+ index(p) */ p.prod_name,
SUM( s.amount_sold) FROM products p,
sales
Step 6. Find SQL_ID & PLAN_HASH_VALUE for hinted SQL stmt in V$SQL

VARIABLE cnt NUMBER
EXECUTE :cnt := dbms_spm.load_plans_from_cursor_cache(sql_id=>'avph0nnq5pfc2’,-
plan_hash_value=>'2567686925', - 
sql_handle=>'SQL_8f876d84821398cf‘);
Step 7. Associate hinted plan with original SQL stmt’s SQL HANDLE

SQL_ID & PLAN_HASH_VALUE belong to hinted
statement
SQL_HANDLE is for the non-hinted statement

------------------ --------------------------------------- -------------------- ---
SQL_8f876d84821398cf SELECT p.prod_name, sum(s.amount_sold) SQL_PLAN_8z1vdhk1176 NO
FROM products p , sales s g42949306 
 
SQL_8f876d84821398cf SELECT p.prod_name, sum(s.amount_sold) SQL_PLAN_8z1vdhk1176 YES
FROM products p , sales s 6ge1c67f67 
Step 8. Conﬁrm SQL statement has two plans in its SQL plan baseline

Hinted plan is the only enabled
plan for non-hinted SQL statement

Step 9. Conﬁrm hinted plan is being used

Non-hinted SQL text but it
is using the plan hash
value for the hinted
statement
Note section also confirms
SQL plan baseline used for
statement

Program Agenda
What are hints?
1
2
3
4
5
80
6

SQL Performance Analyzer
Compare SQL
performance
Establish baseline Set underscore parameter
_OPTIMIZER_IGNORE_HINTS
1 2
3
Execute workload

Execute workload

Summary
•  OpCmizer hints should only be used with extreme cauCon
– Exhaust all other tuning mechanisms ﬁrst
•  StaCsCcs, SQL Tuning Advisor, etc
•  To guarantee the same plan every Cme supply a complete outline
– Easier to do this with SQL Plan Management
•  Hints live forever!
– Use _OPTIMIZER_IGNORE_HINTS parameter to test query performance without hints

Harnessing the Power of Optimizer Hints

More Related Content

What's hot (20)

Similar to Harnessing the Power of Optimizer Hints (20)

More from Maria Colgan (15)

Recently uploaded (20)

Harnessing the Power of Optimizer Hints