1 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Download 1 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

Post on 14-Dec-2015

213 views

Category:

Documents

1 download

Embed Size (px)

TRANSCRIPT

<ul><li>Slide 1</li></ul> <p>1 Copyright 2011, Oracle and/or its affiliates. All rights reserved. Slide 2 2 The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracles products remains at the sole discretion of Oracle. Slide 3 3 Copyright 2011, Oracle and/or its affiliates. All rights reserved. Oracle Optimizer One Day Workshop Thomas Kyte http://asktom.oracle.com/ Slide 4 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 4 Quick History of Oracle Optimizer CBO Slide 5 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 5 What happens when a SQL statement is issued? User Library Cache Shared SQL Area Shared Pool CnC1C2 3 Optimizer Oracle Database Code Generator 1 Syntax Check Semantic Check Shared Pool check 2 Parsing 4 SQL Execution Slide 6 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 6 In the beginning there were rules 1979-1991 Slide 7 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 7 Rule Based Optimizer Rule Based Optimizer (RBO) is a heuristic based Optimizer Uses a ranked list of access paths (rules) 17 possible access paths Lower ranked access paths assumed to operate more efficiently Plans chosen based on access paths available and their rank If multiple access paths existed path with the lowest rank chosen Only very simple physical optimizations done automatically OR Expansion: multiple OR predicates rewritten as UNION ALL Oracle Version 6 and earlier Slide 8 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 8 Only way to influence RBO was to change the SQL text Concatenating an empty string to the column prevents the index from being used Famous tricks to work around RBO Got an index access but want a full table scan SELECT count(*) FROM emp WHERE ename || = SMITH ; SELECT count(*) FROM emp WHERE ename || = SMITH ; Slide 9 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 9 Dawn of a new era: .. there is cost.. 1992 Slide 10 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 10 Cost Based Optimizer Database features become more and more complex Partitioning Parallel execution No easy way to extend Rule Based Optimizer to accommodate so many additional access paths Having only one plan per statement regardless of the objects size or structure was no longer the best approach Oracle 7 - dawn of a new era Optimizer must evolve to become cost based Slide 11 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 11 Cost Based Optimizer Initial design based on IBM research paper Access Path Selection in a Relational Database Management System (1979) Access Path Selection in a Relational Database Management System Approach outlined in the paper was Multiple execution plans generated for a statement Estimated cost is computed for each plan Optimizer selects the plan with the lowest estimated cost Oracle 7 - dawn of a new era Slide 12 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 12 Understanding how the Optimizer works Query Transformation Rewrite query text to allow it to be processed more efficiently Query Transformation Rewrite query text to allow it to be processed more efficiently Plan Generator Multiple plans are generated for each SQL, using different access paths and join types. Each plan is costed and plan with the lowest cost is used. Plan Generator Multiple plans are generated for each SQL, using different access paths and join types. Each plan is costed and plan with the lowest cost is used. Cost Estimator Cost is an estimate of the amount of CPU and the number of disk I/Os, used to perform an operation Cost Estimator Cost is an estimate of the amount of CPU and the number of disk I/Os, used to perform an operation Optimizer Statistics Schema definitions Slide 13 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 13 Optimizer Transformations Translate statements into semantically equivalent SQL that can be processed more efficiently Initial transformations were heuristic based Applied to SQL statements based on their structural properties only Predominately cost based now Transformations include Subquery Unnesting View Merging OR Expansion Star transformation Slide 14 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 14 Subquery Unnesting SELECT C.cust_last_name, C.country_id FROM customers C WHERE Exists(SELECT null FROM sales S WHERE C.cust_id=S.cust_id AND s.quantity_sold &gt; 1000); SELECT C.cust_last_name, C.country_id FROM customers C WHERE Exists(SELECT null FROM sales S WHERE C.cust_id=S.cust_id AND s.quantity_sold &gt; 1000); A correlated subquery is one that refers to a column from a table outside the subquery In this case C.cust_id is referenced in the subquery Without subquery unnesting the correlated subquery must be evaluated for each row in the Customers tables Slide 15 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 15 Transformation rewrites the EXISTS subquery to an ANY subquery ANY subquery is no longer correlated Any subquery returns a set of cust_id if any match the predicate will return true Subquery Unnesting SELECT C.cust_last_name, C.country_id FROM customers C WHERE C.cust_id = ANY(SELECT S.cust_id FROM sales S WHERE S.quantity_sold &gt; 1000); SELECT C.cust_last_name, C.country_id FROM customers C WHERE C.cust_id = ANY(SELECT S.cust_id FROM sales S WHERE S.quantity_sold &gt; 1000); Query gets transformed as follows Slide 16 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 16 Transformation allows subquery to be evaluated as a SEMI join Subquery returns a set of cust_id and those cust_id are joined to the customers table via a SEMI Hash Join Subquery Unnesting Slide 17 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 17 Complex view merging refers to the merging of group by and distinct views Allows the optimizer to consider additional join orders and access paths Group-by/distinct operations can be delayed until after the joins have been evaluated Complex View Merging Create View cust_prod_totals_v as Select sum(s.quantity_sold) total, s.cust_id, s.prod_id from sales s group by s.cust_id, s.prod_id; Select c.cust_id, c.cust_first_name, c.cust_last_name from customers c, cust_prod_totals_v v, products p where c.country_id = 'US' and c.cust_id = v.cust_id and v.total &gt; 100 and v.prod_id = p.prod_id and p.prod_name = 'T3 Faux Fur-Trimmed Sweater'; Create View cust_prod_totals_v as Select sum(s.quantity_sold) total, s.cust_id, s.prod_id from sales s group by s.cust_id, s.prod_id; Select c.cust_id, c.cust_first_name, c.cust_last_name from customers c, cust_prod_totals_v v, products p where c.country_id = 'US' and c.cust_id = v.cust_id and v.total &gt; 100 and v.prod_id = p.prod_id and p.prod_name = 'T3 Faux Fur-Trimmed Sweater'; Slide 18 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 18 After transformation group by operation occurs after Sales is joined to Products and Customers Number of rows in group by greatly reduced after join May not always be best to delay the group by / distinct operation so transformation is cost based* *Compare the cost of the best plan with and without the transformation Complex View Merging Query gets transformed as follows select c.cust_id, cust_first_name, cust_last_name from customers c, products p, sales s where c.country_id = 'US' and c.cust_id = s.cust_id and s.prod_id = p.prod_id and p.prod_name = 'T3 Faux Fur-Trimme group by s.cust_id, s.prod_id, p.rowid, c.rowid, c.cust_last_name, c.cust_first_name, c.cust_id having sum(s.quantity_sold) &gt; 100; select c.cust_id, cust_first_name, cust_last_name from customers c, products p, sales s where c.country_id = 'US' and c.cust_id = s.cust_id and s.prod_id = p.prod_id and p.prod_name = 'T3 Faux Fur-Trimme group by s.cust_id, s.prod_id, p.rowid, c.rowid, c.cust_last_name, c.cust_first_name, c.cust_id having sum(s.quantity_sold) &gt; 100; Slide 19 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 19 Transforms queries that contain OR predicates into the form of a UNION ALL query of two or more branches Without the transformation Optimizer treats OR predicates as a single unit Cant use index on either column OR Expansion SELECT * FROM products WHERE prod_category ='Photo' OR prod_subcategory ='Camera Media'; SELECT * FROM products WHERE prod_category ='Photo' OR prod_subcategory ='Camera Media'; Slide 20 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 20 The transformation adds an LNNVL() function to the second branch in order to avoid duplicates being generated across branches The LNNVL function returns TRUE, if the predicate evaluates to FALSE or if the predicate involves NULL; otherwise it will return FALSE Query gets transformed as follows OR Expansion SELECT * FROM products WHERE prod_subcategory ='Camera Media UNION ALL SELECT * FROM products WHERE prod_category ='Photo' AND lnnvl(prod_subcategory = 'Camera Media'); *lnnvl(true) is FALSE, lnnvl(false||null) is TRUE SELECT * FROM products WHERE prod_subcategory ='Camera Media UNION ALL SELECT * FROM products WHERE prod_category ='Photo' AND lnnvl(prod_subcategory = 'Camera Media'); *lnnvl(true) is FALSE, lnnvl(false||null) is TRUE Slide 21 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 21 Transformation allows an index access to be considered for each branch of the UNION ALL OR Expansion Slide 22 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 22 Star Query Transformation Sales Fact Table Products Dimension Time Dimension Geography Dimension Suppliers Dimension Customer s Dimension Cost-based* transformation designed to execute star queries more efficiently Relies on bitmap indexes on foreign key columns to access rows in the fact table Controlled by parameter STAR_TRANSFORMATION_ENABLED Star Schema - one or more large fact table and many smaller dimension tables *Compares the cost of the best plan with and without the transformation Slide 23 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 23 Traditionally a star query only defines predicates on the dimension tables No efficient way to access rows in the fact table By rewriting the query new access paths become available on the fact table Star Query Transformation SELECT * FROM fact, d1, d2, d3 WHERE fact.c1 = d1.c1 AND fact.c2 = d2.c1 AND fact.c3 = d3.c1 AND d1.c2 IN (1, 2, 3, 4) AND d2.c2 &lt; 100 AND d3.c2 = 35; SELECT * FROM fact, d1, d2, d3 WHERE fact.c1 = d1.c1 AND fact.c2 = d2.c1 AND fact.c3 = d3.c1 AND d1.c2 IN (1, 2, 3, 4) AND d2.c2 &lt; 100 AND d3.c2 = 35; Slide 24 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 24 Converts original query to include 3 sub-queries on the fact Fact table accessed first via bitmap index and then joins out to dimension tables Result of sub-queries may be saved in temp tables Star Query Transformation Query gets transformed as follows SELECT * FROM fact, d1, d2, d3 exactly as before AND fact.c1 IN (SELECT d1.c1 FROM d1 WHERE d1.c2 IN (1, 2, 3, 4) ) AND fact.c2 IN (select d2.c1 FROM d2 WHERE d2.c2 &lt; 100) AND fact.c3 IN (SELECT d3.c1 FROM d3 WHERE d3.c2 = 35) SELECT * FROM fact, d1, d2, d3 exactly as before AND fact.c1 IN (SELECT d1.c1 FROM d1 WHERE d1.c2 IN (1, 2, 3, 4) ) AND fact.c2 IN (select d2.c1 FROM d2 WHERE d2.c2 &lt; 100) AND fact.c3 IN (SELECT d3.c1 FROM d3 WHERE d3.c2 = 35) Slide 25 Copyright 2012, Oracle and/or its affiliates. All rights reserved. 25 Understanding how the Optimizer works Query Transformation Rewrite query text to allow it to be processed more efficiently Query Transformation Rewrite query text to allow it to be processed more efficiently Plan Generator Multiple plans are generated for each SQL, using different access paths and join types. Each plan is costed and plan with the lowest cost is used. Plan Generator Multiple plans are generated for each SQL, using different access paths and join types. Each plan is costed and plan with the lowest cost is used. Cost Estimator Cost is an estimate of the amount of CPU and the number of disk I/Os, used to perform an operation Cost Estimator Cost is an estimate of the amount of CPU and the number of disk I/Os, used to perform an operation Optimizer Statistics Schema definitions Controlled by OPTIMIZER_FEATURES_ENABLED Slide 26 26 Copyright 2011, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8 Q&amp;A </p>

Recommended

View more >