Oracle® Database Performance Tuning Guide 11g Release 2 (11.2) Part Number E10821-03 |
|
|
View PDF |
This chapter discusses the automatic SQL tuning features of Oracle Database. Automatic SQL tuning automates the manual process, which is complex, repetitive, and time-consuming.
This chapter contains the following sections:
See Also:
Oracle Database 2 Day + Performance Tuning Guide for information about using the automatic SQL tuning features with Oracle Enterprise Manager (Enterprise Manager)When SQL statements are executed by the Oracle database, the optimizer is used to generate the execution plans of the SQL statements. The optimizer operates in the following modes:
Normal mode
The optimizer compiles the SQL and generates an execution plan. The normal mode generates a reasonable plan for the vast majority of SQL statements. Under normal mode, the optimizer operates with very strict time constraints, usually a fraction of a second, during which it must find a good execution plan.
Tuning mode
The optimizer performs additional analysis to check whether the plan produced in normal mode can be improved further. The optimizer output is not an execution plan, but a series of actions, along with their rationale and expected benefit for producing a significantly better plan. When running in tuning mode, the optimizer is known as the Automatic Tuning Optimizer.
Under tuning mode, the optimizer can take several minutes to tune a single statement. It is both time and resource intensive to invoke Automatic Tuning Optimizer every time a query must be hard-parsed. Automatic Tuning Optimizer is meant for complex and high-load SQL statements that have non-trivial impact on the entire database.
Automatic Database Diagnostic Monitor (ADDM) proactively identifies high-load SQL statements that are good candidates for SQL tuning (see Chapter 6, "Automatic Performance Diagnostics"). The automatic SQL tuning feature also automatically identifies problematic SQL statements and implements tuning recommendations during system maintenance windows as an automated maintenance task.
The Automatic Tuning Optimizer performs the following types of tuning analysis:
The optimizer relies on object statistics to generate execution plans. If these statistics are stale or missing, then the optimizer does not have the necessary information it needs and can generate poor execution plans. The Automatic Tuning Optimizer checks each query object for missing or stale statistics, and produces two types of output:
Recommendations to gather relevant statistics for objects with stale or no statistics.
Because optimizer statistics are automatically collected and refreshed, this problem may be encountered only when automatic optimizer statistics collection has been turned off. See "Managing Automatic Optimizer Statistics Collection".
Auxiliary information in the form of statistics for objects with no statistics, and statistic adjustment factor for objects with stale statistics.
This auxiliary information is stored in an object called a SQL profile.
A SQL profile is a set of auxiliary information specific to a SQL statement. Conceptually, a SQL profile is to a SQL statement what statistics are to a table or index. The database can use the auxiliary information to improve execution plans.
See Also:
"Managing SQL Profiles"An access path is the means by which data is retrieved from a database. For example, a query using an index and a query using a full table scan use different access paths.
Indexes can tremendously enhance performance of a SQL statement by reducing the need for full table scans on large tables. Effective indexing is a common tuning technique. Automatic Tuning Optimizer explores whether a new index can significantly enhance the performance of a query. If such an index is identified, it recommends its creation.
Because the Automatic Tuning Optimizer does not analyze how its index recommendation can affect the entire SQL workload, it also recommends running the SQL Access Advisor utility on the SQL statement along with a representative SQL workload. The SQL Access Advisor looks at the impact of creating an index on the entire SQL workload before making any recommendations. See "Automatic SQL Tuning Features".
Automatic Tuning Optimizer identifies common problems with structure of SQL statements that can lead to poor performance. These could be syntactic, semantic, or design problems with the statement. In each case, Automatic Tuning Optimizer makes relevant suggestions to restructure the SQL statements. The alternative suggested is similar, but not equivalent, to the original statement.
For example, the optimizer may suggest replacing the UNION
operator with UNION
ALL
or NOT
IN
with NOT
EXISTS
. You can then determine if the advice is applicable to your situation. For example, if the schema design is such that there is no possibility of producing duplicates, then the UNION
ALL
operator is much more efficient than the UNION
operator. These changes require a good understanding of the data properties and should be implemented only after careful consideration.
While tuning a SQL statement, SQL Tuning Advisor searches real-time and historical performance data for alternative execution plans for the statement. If plans other than the original plan exist, then SQL Tuning Advisor reports an alternative plan finding.
SQL Tuning Advisor validates the alternative execution plans and notes any plans that are not reproducible. When reproducible alternative plans are found, you can create a SQL plan baseline to instruct the optimizer to choose these plans in the future.
Example 17-1 shows an alternative plan finding for a SELECT
statement.
Example 17-1 Alternative Plan Finding
2- Alternative Plan Finding --------------------------- Some alternative execution plans for this statement were found by searching the system's real-time and historical performance data. The following table lists these plans ranked by their average elapsed time. See section "ALTERNATIVE PLANS SECTION" for detailed information on each plan. id plan hash last seen elapsed (s) origin note -- ---------- -------------------- ------------ --------------- ---------------- 1 1378942017 2009-02-05/23:12:08 0.000 Cursor Cache original plan 2 2842999589 2009-02-05/23:12:08 0.002 STS Information ----------- - The Original Plan appears to have the best performance, based on the elapsed time per execution. However, if you know that one alternative plan is better than the Original Plan, you can create a SQL plan baseline for it. This will instruct the Oracle optimizer to pick it over any other choices in the future. execute dbms_sqltune.create_sql_plan_baseline(task_name => 'TASK_XXXXX', object_id => 2, task_owner => 'SYS', plan_hash => xxxxxxxx);
Example 17-1 shows that SQL Tuning Advisor found two plans, one in the cursor cache and one in a SQL tuning set. The plan in the cursor cache is the same as the original plan.
SQL Tuning Advisor only recommends an alternative plan if the elapsed time of the original plan is worse than alternative plans. In this case, SQL Tuning Advisor recommends that users create a SQL plan baseline on the plan with the best performance. In Example 17-1, the alternative plan did not perform as well as the original plan, so SQL Tuning Advisor did not recommend using the alternative plan.
In Example 17-2, the alternative plans section of the SQL Tuning Advisor output includes both the original and alternative plans and summarizes their performance. The most important statistic is elapsed time. The original plan used an index, whereas the alternative plan used a full table scan, increasing elapsed time by .002 seconds.
Example 17-2 Alternative Plans Section
Plan 1 ------ Plan Origin :Cursor Cache Plan Hash Value :1378942017 Executions :50 Elapsed Time :0.000 sec CPU Time :0.000 sec Buffer Gets :0 Disk Reads :0 Disk Writes :0 Notes: 1. Statistics shown are averaged over multiple executions. 2. The plan matches the original plan. -------------------------------------------- | Id | Operation | Name | -------------------------------------------- | 0 | SELECT STATEMENT | | | 1 | SORT AGGREGATE | | | 2 | MERGE JOIN | | | 3 | INDEX FULL SCAN | TEST1_INDEX | | 4 | SORT JOIN | | | 5 | TABLE ACCESS FULL| TEST | -------------------------------------------- Plan 2 ------ Plan Origin :STS Plan Hash Value :2842999589 Executions :10 Elapsed Time :0.002 sec CPU Time :0.002 sec Buffer Gets :3 Disk Reads :0 Disk Writes :0 Notes: 1. Statistics shown are averaged over multiple executions. ------------------------------------- | Id | Operation | Name | ------------------------------------- | 0 | SELECT STATEMENT | | | 1 | SORT AGGREGATE | | | 2 | HASH JOIN | | | 3 | TABLE ACCESS FULL| TEST | | 4 | TABLE ACCESS FULL| TEST1 | -------------------------------------
To adopt an alternative plan regardless of whether SQL Tuning Advisor recommends it, call DBMS_SQLTUNE.CREATE_SQL_PLAN_BASELINE
. You can use this procedure to create a SQL plan baseline on any existing plan that is reproducible.
SQL Tuning Advisor takes one or more SQL statements as an input and invokes the Automatic Tuning Optimizer to perform SQL tuning on the statements. The output is in the form of an advice or recommendations, along with a rationale for each recommendation and its expected benefit. The recommendation relates to a collection of statistics on objects, creation of new indexes, restructuring of the SQL statement, or creation of a SQL profile. You can choose to accept the recommendation to complete the tuning of the SQL statements.
The database can automatically tune SQL statements by identifying problematic SQL statements and implementing recommendations using SQL Tuning Advisor during system maintenance windows. When run automatically, SQL Tuning Advisor is known as the Automatic SQL Tuning Advisor.
This section explains how to manage the Automatic SQL Tuning Advisor:
See Also:
Oracle Database Administrator's Guide for information about automated maintenance tasksOracle Database automatically runs SQL Tuning Advisor on selected high-load SQL statements from the Automatic Workload Repository (AWR) that qualify as tuning candidates. This task, called Automatic SQL Tuning, runs in the default maintenance windows on a nightly basis. By default, automatic SQL tuning runs for at most one hour. You can customize attributes of the maintenance windows, including start and end time, frequency, and days of the week.
After automatic SQL tuning begins, database performs the following steps:
Identify SQL candidates in the AWR for tuning.
Oracle Database analyzes statistics in AWR and generates a list of potential SQL statements that are eligible for tuning. These statements include repeating high-load statements that have a significant impact on the system.
Only SQL statements that have an execution plan with a high potential for improvement will be tuned. Recursive SQL and statements that have been tuned recently (in the last month) are ignored, as are parallel queries, DML, DDL, and SQL statements with performance problems caused by concurrency issues.
The SQL statements that are selected as candidates are then ordered based on their performance impact. The database calculates the performance impact by summing the CPU time and the I/O times captured in AWR for that SQL statement in the past week.
Tune each SQL statement individually by calling SQL Tuning Advisor.
During the tuning process, all recommendation types are considered and reported, but only SQL profiles can be implemented automatically.
Test SQL profiles by executing the SQL statement.
If a SQL profile is recommended, the database tests the new SQL profile by executing the SQL statement both with and without the SQL profile. If the performance improvement improves at least threefold, then the database accepts the SQL profile, but only if the ACCEPT_SQL_PROFILES
task parameter is set to TRUE
. Otherwise, the automatic SQL tuning reports merely report the recommendation to create a SQL profile.
Optionally, implement the SQL profiles provided they meet the criteria of threefold performance improvement.
The database considers other factors when deciding whether to implement the SQL profile. For example, the database does not implement a SQL profile when the objects referenced in the SQL statement have stale optimizer statistics. You can identify which SQL profiles have been implemented automatically because their type will be set to AUTO
in the DBA_SQL_PROFILES
view.
If SQL plan management is used, and if a SQL plan baseline exists for the SQL statement, then the database adds a new plan baseline when it creating the SQL profile. As a result, the optimizer uses the new and improved SQL execution plan immediately after the SQL profile is created. See Chapter 15, "Using SQL Plan Management".
At any time during or after the automatic SQL tuning process, you can view the results using the automatic SQL tuning report. This report describes in detail all the SQL statements that were analyzed, the recommendations generated, and the SQL profiles that were automatically implemented.
Figure 17-1 illustrates the steps performed by Oracle Database during the automatic SQL tuning process.
Automatic SQL tuning runs as part of the automated maintenance tasks infrastructure.
To enable automatic SQL tuning, use the ENABLE
procedure in the DBMS_AUTO_TASK_ADMIN
package:
BEGIN DBMS_AUTO_TASK_ADMIN.ENABLE( client_name => 'sql tuning advisor', operation => NULL, window_name => NULL); END; /
To disable automatic SQL tuning, use the DISABLE
procedure in the DBMS_AUTO_TASK_ADMIN
package:
BEGIN DBMS_AUTO_TASK_ADMIN.DISABLE( client_name => 'sql tuning advisor', operation => NULL, window_name => NULL); END; /
You can pass a specific window name using the window_name
parameter to enable or disable the task in certain maintenance windows only.
Setting the STATISTICS_LEVEL
parameter to BASIC
will disable automatic statistics gathering by the AWR and, as a result, also disable automatic SQL tuning.
See Also:
Oracle Database Administrator's Guide for information about the AutoTask infrastructure
Oracle Database PL/SQL Packages and Types Reference for information about the DBMS_AUTO_TASK_ADMIN
package
You can configure the behavior of the automatic SQL tuning task using the DBMS_SQLTUNE
package. To use the APIs, you must have at least the ADVISOR
privilege.
Besides configuring the standard behavior of SQL Tuning Advisor, the DBMS_SQLTUNE
package enables you to configure automatic SQL tuning by specifying the task parameters using the SET_TUNING_TASK_PARAMETER
procedure. Because the automatic tuning task is owned by SYS
, only SYS
can set the task parameters.
Table 17-2 lists the parameters that are specific to automatic SQL tuning which can be configured.
Table 17-1 SET_TUNING_TASK_PARAMETER Automatic SQL Tuning Parameters
Parameter | Description |
---|---|
|
Specifies whether to accept SQL profiles automatically. |
|
Specifies the number of days for which to save the task history in the advisor framework schema. By default, the task history is saved for 30 days before it expires. |
|
Specifies the limit of SQL profiles that are accepted for each automatic SQL tuning task. Consider setting the limit of SQL profiles that are accepted for each automatic SQL tuning task based on the acceptable level of changes that can be made to the system on a daily basis. |
|
Specifies the limit of SQL profiles that are accepted in total. |
|
Specifies the execution name of the Compare Performance trial of the SQL Performance Analyzer task. If |
|
Specifies the name of the SQL Performance Analyzer task whose regressions are to be tuned |
|
Specifies the owner of the specified SQL Performance Analyzer task or |
To configure automatic SQL tuning, run the SET_TUNING_TASK_PARAMETER
procedure in the DBMS_SQLTUNE
package:
BEGIN DBMS_SQLTUNE.SET_TUNING_TASK_PARAMETER( task_name => 'SYS_AUTO_SQL_TUNING_TASK', parameter => 'ACCEPT_SQL_PROFILES', value => 'TRUE'); END; /
In this example, the automatic SQL tuning task is configured to automatically accept SQL profiles recommended by the SQL Tuning Advisor.
See Also:
"Configuring a SQL Tuning Task" for information about other parameters that can be configured for a SQL tuning task
Oracle Database PL/SQL Packages and Types Reference for information about the DBMS_SQLTUNE
package
The automatic SQL tuning report is generated using the DBMS_SQLTUNE
.REPORT_AUTO_TUNING_TASK
function. This report contains information about all executions of the automatic SQL tuning task.
To run this report, you need the ADVISOR
privilege and SELECT
privileges on the DBA_ADVISOR
views. Unlike the standard SQL tuning report generated using the DBMS_SQLTUNE
.REPORT_TUNING_TASK
function, which only contains information about a single task execution of SQL Tuning Advisor, the automatic SQL tuning report contains information about multiple executions of the automatic SQL tuning task.
To view the automatic SQL tuning report, run the REPORT_AUTO_TUNING_TASK
function in the DBMS_SQLTUNE
package:
variable my_rept CLOB; BEGIN :my_rept :=DBMS_SQLTUNE.REPORT_AUTO_TUNING_TASK( begin_exec => NULL, end_exec => NULL, type => 'TEXT', level => 'TYPICAL', section => 'ALL', object_id => NULL, result_limit => NULL); END; / print :my_rept
In this example, a text report is generated to display all SQL statements that were analyzed in the most recent execution, including recommendations that were not implemented, and all sections of the report are included.
See Also:
Oracle Database 2 Day + Performance Tuning Guide to learn how to view automatic SQL tuning reports using Enterprise Manager
Oracle Database PL/SQL Packages and Types Reference for information about the DBMS_SQLTUNE
package
Depending on the sections that were included in the report, you can view information about the automatic SQL tuning task in the following sections of the report:
General information
The general information section provides a high-level description of the automatic SQL tuning task, including information about the inputs given for the report, the number of SQL statements tuned during the maintenance, and the number of SQL profiles that were created
Summary
The summary section lists the SQL statements (by their SQL identifiers) that were tuned during the maintenance window and the estimated benefit of each SQL profile, or their actual execution statistics after test executing the SQL statement with the SQL profile
Tuning findings
This section contains the following information about each SQL statement analyzed by the SQL Tuning Advisor:
All findings associated with each SQL statement
Whether the profile was accepted on the system, and why
Whether the SQL profile is currently enabled on the system
Detailed execution statistics captured when testing the SQL profile
Explain plans
This section shows the old and new explain plans used by each SQL statement analyzed by the SQL Tuning Advisor.
Errors
This section lists all errors encountered by the automatic SQL tuning task.
The SQL Tuning Advisor can be invoked manually for on-demand tuning of one or more SQL statements. To tune multiple statements, you need to create a SQL tuning set (STS). A SQL tuning set is a database object that stores SQL statements along with their execution context. You can create a SQL tuning set using command line APIs or Enterprise Manager. See "Managing SQL Tuning Sets".
The input for the SQL Tuning Advisor can come from several sources. These input sources include:
Automatic Database Diagnostic Monitor
The primary input source is the Automatic Database Diagnostic Monitor (ADDM). By default, ADDM runs proactively once every hour and analyzes key statistics gathered by the Automatic Workload Repository (AWR) over the last hour to identify any performance problems including high-load SQL statements. If a high-load SQL is identified, ADDM recommends running SQL Tuning Advisor on the SQL. See "Overview of the Automatic Database Diagnostic Monitor".
Automatic Workload Repository
The second most important input source is the Automatic Workload Repository (AWR). The AWR takes regular snapshots of the system activity, including high-load SQL statements ranked by relevant statistics, such as CPU consumption and wait time.
You can view the AWR and manually identify high-load SQL statements and run the SQL Tuning Advisor on them, though this is done automatically by Oracle Database as part of the automatic SQL tuning process. By default, the AWR retains data for the last eight days. Any high-load SQL that ran within the retention period of the AWR can be located and tuned using this method. See "Overview of the Automatic Workload Repository".
Cursor cache
The third likely source of input is the cursor cache. This source is used for tuning recent SQL statements that are yet to be captured in the AWR. The cursor cache and AWR together provide the capability to identify and tune high-load SQL statements from the current time going as far back as the AWR retention allows, which by default is at least 8 days.
SQL tuning set
Another possible input source for the SQL Tuning Advisor is the SQL tuning set. A SQL tuning set (STS) is a database object that stores SQL statements along with their execution context. An STS can include SQL statements that are yet to be deployed, with the goal of measuring their individual performance, or identifying the ones whose performance falls short of expectation. When a set of SQL statements are used as input, a SQL tuning set (STS) has to be first constructed and stored. See "Managing SQL Tuning Sets".
The SQL Tuning Advisor provides options to manage the scope and duration of a tuning task. The scope of a tuning task can be set to limited or comprehensive.
If the limited option is chosen, the SQL Tuning Advisor produces recommendations based on statistics checks, access path analysis, and SQL structure analysis. SQL profile recommendations are not generated.
If the comprehensive option is selected, the SQL Tuning Advisor carries out all the analysis it performs under limited scope plus SQL Profiling. With the comprehensive option you can also specify a time limit for the tuning task, which by default is 30 minutes.
After analyzing the SQL statements, the SQL Tuning Advisor provides advice on optimizing the execution plan, the rationale for the proposed optimization, the estimated performance benefit, and the command to implement the advice. You simply have to choose whether to accept the recommendations to optimize the SQL statements.
The recommended interface for running the SQL Tuning Advisor is the Enterprise Manager. Whenever possible, you should run the SQL Tuning Advisor using Enterprise Manager, as described in the Oracle Database 2 Day + Performance Tuning Guide. If Enterprise Manager is unavailable, you can run the SQL Tuning Advisor using procedures in the DBMS_SQLTUNE
package. To use the APIs, the user must be granted specific privileges.
See Also:
Oracle Database PL/SQL Packages and Types Reference for information on the security model for theDBMS_SQLTUNE
packageRunning SQL Tuning Advisor using DBMS_SQLTUNE
package is a multi-step process:
Create a SQL tuning set (if tuning multiple SQL statements)
Create a SQL tuning task
Execute a SQL tuning task
Display the results of a SQL tuning task
Implement recommendations as appropriate
A SQL tuning task can be created for a single SQL statement. For tuning multiple statements, a SQL tuning set (STS) has to be first created. An STS is a database object that stores SQL statements along with their execution context. An STS can be created manually using command line APIs or automatically using Enterprise Manager. See "Managing SQL Tuning Sets".
Figure 17-2 shows the steps involved when running the SQL Tuning Advisor using the DBMS_SQLTUNE
package.
This section covers the following topics:
See Also:
Oracle Database 2 Day + Performance Tuning Guide to learn how to run SQL Tuning Advisor manually using Enterprise Manager
Oracle Database PL/SQL Packages and Types Reference for information about the DBMS_SQLTUNE
package
You can create tuning tasks from the text of a single SQL statement, a SQL tuning set containing multiple statements, a SQL statement selected by SQL identifier from the cursor cache, or a SQL statement selected by SQL identifier from the Automatic Workload Repository.
For example, to use the SQL Tuning Advisor to optimize a specified SQL statement text, you need to create a tuning task with the SQL statement passed as a CLOB argument. For the following PL/SQL code, the user HR has been granted the ADVISOR
privilege and the function is run as user HR on the employees
table in the HR schema.
DECLARE my_task_name VARCHAR2(30); my_sqltext CLOB; BEGIN my_sqltext := 'SELECT /*+ ORDERED */ * ' || 'FROM employees e, locations l, departments d ' || 'WHERE e.department_id = d.department_id AND ' || 'l.location_id = d.location_id AND ' || 'e.employee_id < :bnd'; my_task_name := DBMS_SQLTUNE.CREATE_TUNING_TASK( sql_text => my_sqltext, bind_list => sql_binds(anydata.ConvertNumber(100)), user_name => 'HR', scope => 'COMPREHENSIVE', time_limit => 60, task_name => 'my_sql_tuning_task', description => 'Task to tune a query on a specified employee'); END; /
In this example, 100 is the value for bind variable :bnd
passed as function argument of type SQL_BINDS
, HR
is the user under which the CREATE_TUNING_TASK
function analyzes the SQL statement, the scope is set to COMPREHENSIVE
which means that the advisor also performs SQL Profiling analysis, and 60 is the maximum time in seconds that the function can run. In addition, values for task name and description are provided.
The CREATE_TUNING_TASK
function returns the task name that you have provided or generates a unique task name. You can use the task name to specify this task when using other APIs. To view the task names associated with a specific owner, you can run the following:
SELECT task_name FROM DBA_ADVISOR_LOG WHERE owner = 'HR';
You can fine tune a SQL tuning task after it has been created by configuring its parameters using the SET_TUNING_TASK_PARAMETER
procedure in the DBMS_SQLTUNE
package:
BEGIN DBMS_SQLTUNE.SET_TUNING_TASK_PARAMETER( task_name => 'my_sql_tuning_task', parameter => 'TIME_LIMIT', value => 300); END; /
In this example, the maximum time that the SQL tuning task can run is changed to 300 seconds.
Table 17-2 lists the parameters that can be configured using the SET_TUNING_TASK_PARAMETER
procedure.
Table 17-2 SET_TUNING_TASK_PARAMETER Procedure Parameters
Parameter | Description |
---|---|
|
Specifies the scope of the tuning task:
|
|
Username under which the SQL statement will be parsed |
|
Number of days before the task is deleted |
|
Default execution type if not specified by the |
|
Time limit (in number of seconds) before the task times out |
|
Time limit (in number of seconds) for each SQL statement |
|
Determines if the SQL Tuning Advisor will test execute the SQL statements to verify the recommendation benefit:
|
|
Basic filter used for SQL tuning set |
|
Object filter used for SQL tuning set |
|
Plan filter used for SQL tuning set |
|
First ranking measure used for SQL tuning set |
|
Second ranking measure used for SQL tuning set |
|
Third ranking measure used for SQL tuning set |
|
Extra filter used for SQL tuning set (besides |
|
Maximum number of SQL statements to tune |
|
Percentage filter of statements from SQL tuning set |
After you have created a tuning task, you need to execute the task and start the tuning process. For example:
BEGIN DBMS_SQLTUNE.EXECUTE_TUNING_TASK( task_name => 'my_sql_tuning_task' ); END; /
Like any other SQL Tuning Advisor task, you can also execute the automatic tuning task SYS_AUTO_SQL_TUNING_TASK
using the EXECUTE_TUNING_TASK
API. The SQL Tuning Advisor will perform the same analysis and actions as it would when run automatically. You can also pass an execution name to the API to name the new execution.
You can check the status of the task by reviewing the information in the USER_ADVISOR_TASKS view or check execution progress of the task in the V$SESSION_LONGOPS
view. For example:
SELECT status FROM USER_ADVISOR_TASKS WHERE task_name = 'my_sql_tuning_task';
You can check the execution progress of the SQL Tuning Advisor in the V$ADVISOR_PROGRESS
view. For example:
SELECT sofar, totalwork FROM V$ADVISOR_PROGRESS WHERE user_name = 'HR' AND task_name = 'my_sql_tuning_task';
See Also:
Oracle Database Reference for information on the V$ADVISOR_PROGRESS viewAfter a task has been executed, you display a report of the results with the REPORT_TUNING_TASK
function. For example:
SET LONG 1000 SET LONGCHUNKSIZE 1000 SET LINESIZE 100 SELECT DBMS_SQLTUNE.REPORT_TUNING_TASK( 'my_sql_tuning_task') FROM DUAL;
The report contains all the findings and recommendations of the SQL Tuning Advisor. For each proposed recommendation, the rationale and benefit is provided along with the SQL commands needed to implement the recommendation.
Additional information about tuning tasks and results can be found in DBA views. See "SQL Tuning Views".
You can use the following APIs for managing SQL tuning tasks:
INTERRUPT_TUNING_TASK
to interrupt a task while executing, causing a normal exit with intermediate results
RESUME_TUNING_TASK
to resume a previously interrupted task
CANCEL_TUNING_TASK
to cancel a task while executing, removing all results from the task
RESET_TUNING_TASK
to reset a task while executing, removing all results from the task and returning the task to its initial state
DROP_TUNING_TASK
to drop a task, removing all results associated with the task
A SQL tuning set (STS) is a database object that includes one or more SQL statements along with their execution statistics and execution context, and could include a user priority ranking. You can load SQL statements into a SQL tuning set from different SQL sources, such as the Automatic Workload Repository, the cursor cache, or custom SQL provided by the user. An STS includes:
A set of SQL statements
Associated execution context, such as user schema, application module name and action, list of bind values, and the cursor compilation environment
Associated basic execution statistics, such as elapsed time, CPU time, buffer gets, disk reads, rows processed, cursor fetches, the number of executions, the number of complete executions, optimizer cost, and the command type
Associated execution plans and row source statistics for each SQL statement (optional)
You can filter SQL statements using the application module name and action, or any of the execution statistics. In addition, you can rank the SQL statements based on any combination of execution statistics.
You can use an STS as input to SQL Tuning Advisor, which performs automatic tuning of the SQL statements based on other user-specified input parameters. SQL tuning sets are transportable across databases and can be exported from one system to another, allowing for the transfer of SQL workloads between databases for remote performance diagnostics and tuning. When poorly performing SQL statements are encountered on a production system, it may not be desirable for developers to perform their investigation and tuning activities on the production system directly. This feature allows the DBA to transport the problematic SQL statements to a test system where the developers can safely analyze and tune them. To transport SQL tuning sets, use the DBMS_SQLTUNE
package procedures.
The recommended interface for managing SQL tuning sets is the Enterprise Manager. Whenever possible, you should manage SQL tuning sets using Enterprise Manager, as described in the Oracle Database 2 Day + Performance Tuning Guide. If Enterprise Manager is unavailable, you can manage SQL tuning sets using the DBMS_SQLTUNE
package procedures.
Typically, you use STS operations in the following sequence:
Create a new STS
This task is described in "Creating a SQL Tuning Set".
Load the STS
This task is described in "Loading a SQL Tuning Set".
Select the STS to review the contents
This task is described in "Displaying the Contents of a SQL Tuning Set".
Update the STS if necessary
This task is described in "Modifying a SQL Tuning Set".
Create a tuning task with the STS as input
Transport the STS to another system, if necessary
This task is described in "Transporting a SQL Tuning Set".
Drop the STS when finished
This task is described in "Dropping a SQL Tuning Set".
To use the APIs, you need the ADMINISTER SQL TUNING SET
system privilege to manage SQL tuning sets that you own, or the ADMINISTER
ANY
SQL
TUNING
SET
system privilege to manage any SQL tuning sets.
Figure 17-3 shows the steps involved when using SQL tuning sets APIs.
This section covers the following topics:
See Also:
Oracle Database 2 Day + Performance Tuning Guide to learn how to manage SQL tuning sets using Enterprise Manager
Oracle Database PL/SQL Packages and Types Reference for information about the DBMS_SQLTUNE
package
The CREATE_SQLSET
procedure is used to create an empty STS object in the database. For example, the following procedure creates an STS object that could be used to tune I/O intensive SQL statements during a specific period of time:
BEGIN DBMS_SQLTUNE.CREATE_SQLSET( sqlset_name => 'my_sql_tuning_set', description => 'I/O intensive workload'); END; /
In the preceding example, my_sql_tuning_set
is the name of the STS in the database and 'I/O intensive workload'
is the description assigned to the STS.
The LOAD_SQLSET
procedure populates the STS with selected SQL statements. The standard sources for populating an STS are the workload repository, another STS, or the cursor cache. For both the workload repository and STS, predefined table functions can be used to select columns from the source to populate a new STS.
In the following example, procedure calls are used to load my_sql_tuning_set
from an AWR baseline called peak
baseline
. The data has been filtered to select only the top 30 SQL statements ordered by elapsed time. First a ref cursor is opened to select from the specified baseline. Next the statements and their statistics are loaded from the baseline into the STS.
DECLARE baseline_cursor DBMS_SQLTUNE.SQLSET_CURSOR; BEGIN OPEN baseline_cursor FOR SELECT VALUE(p) FROM TABLE (DBMS_SQLTUNE.SELECT_WORKLOAD_REPOSITORY( 'peak baseline', NULL, NULL, 'elapsed_time', NULL, NULL, NULL, 30)) p; DBMS_SQLTUNE.LOAD_SQLSET( sqlset_name => 'my_sql_tuning_set', populate_cursor => baseline_cursor); END; /
The SELECT_SQLSET
table function reads the contents of the STS. After an STS has been created and populated, you can browse the SQL in the STS using different filtering criteria. The SELECT_SQLSET
procedure is provided for this purpose.
In the following example, the SQL statements in the STS are displayed for statements with a disk-reads to buffer-gets ratio greater than or equal to 75%.
SELECT * FROM TABLE(DBMS_SQLTUNE.SELECT_SQLSET( 'my_sql_tuning_set', '(disk_reads/buffer_gets) >= 0.75'));
Additional details of the SQL tuning sets that have been created and loaded can also be displayed with DBA views, such as DBA_SQLSET
, DBA_SQLSET_STATEMENTS
, and DBA_SQLSET_BINDS
.
SQL statements can be updated and deleted from an STS based on a search condition. In the following example, the DELETE_SQLSET
procedure deletes SQL statements from my_sql_tuning_set
that have been executed less than fifty times.
BEGIN DBMS_SQLTUNE.DELETE_SQLSET( sqlset_name => 'my_sql_tuning_set', basic_filter => 'executions < 50'); END; /
You can transport SQL tuning sets. This operation involves exporting the STS from one database to a staging table, and then importing the STS from the staging table into another database.
You can transport a SQL tuning set to any database created in Oracle Database 10g (Release 2) or later. This technique is useful when using SQL Performance Analyzer to tune regressions on a test database. For example, you can transport an STS in the following scenario:
An STS with regressed SQL resides in a production database created in Oracle Database 11g Release 2 (11.2).
You are running SQL Performance Analyzer trials on a remote test database created in Oracle Database 11g Release 1 (11.1) or Oracle Database 10g.
You want to copy the STS from the production database to the test database and tune the regressions from the SQL Performance Analyzer trials.
To transport a SQL tuning set:
Use the CREATE_STGTAB_SQLSET
procedure to create a staging table where the SQL tuning sets will be exported.
The following example creates my_10g_staging_table
in the dba1
schema and specifies the format of the staging table as 10.2:
BEGIN DBMS_SQLTUNE.create_stgtab_sqlset( table_name => 'my_10g_staging_table', schema_name => 'dba1', db_version => DBMS_SQLTUNE.STS_STGTAB_10_2_VERSION ); END; /
Use the PACK_STGTAB_SQLSET
procedure to export SQL tuning sets into the staging table.
The following example populates dba1.my_10g_staging_table
with the STS my_sts
owned by hr
:
BEGIN DBMS_SQLTUNE.pack_stgtab_sqlset( sqlset_name => 'my_sts', sqlset_owner => 'hr', staging_table_name => 'my_10g_staging_table', staging_table_owner => 'dba1', db_version => DBMS_SQLTUNE.STS_STGTAB_10_2_VERSION ); END; /
Move the staging table to the database where the SQL tuning sets will be imported using the mechanism of choice (such as Oracle Data Pump or database link).
On the database where the SQL tuning sets will be imported, use the UNPACK_STGTAB_SQLSET
procedure to import SQL tuning sets from the staging table.
The following example shows how to import SQL tuning sets contained in the staging table:
BEGIN DBMS_SQLTUNE.UNPACK_STGTAB_SQLSET( sqlset_name => '%', replace => TRUE, staging_table_name => 'my_10g_staging_table'); END; /
The DROP_SQLSET
procedure drops an STS that is no longer needed. For example:
BEGIN DBMS_SQLTUNE.DROP_SQLSET( sqlset_name => 'my_sql_tuning_set' ); END; /
You can use the following APIs to manage an STS:
Updating the attributes of SQL statements in an STS
The UPDATE_SQLSET
procedure updates the attributes of SQL statements (such as PRIORITY
or OTHER
) in an existing STS identified by STS name and SQL ID.
Capturing the full system workload
The CAPTURE_CURSOR_CACHE_SQLSET
function enables the capture of the full system workload by repeatedly polling the cursor cache over a specified interval. This function is a lot more efficient than repeatedly using the SELECT_CURSOR_CACHE
and LOAD_SQLSET
procedures to capture the cursor cache over an extended period of time. This function effectively captures the entire workload, as opposed to the AWR—which only captures the workload of high-load SQL statements—or the LOAD_SQLSET
procedure, which accesses the data source only once.
Adding and removing a reference to an STS
The ADD_SQLSET_REFERENCE
function adds a new reference to an existing STS to indicate its use by a client. The function returns the identifier of the added reference. The REMOVE_SQLSET_REFERENCE
procedure is used to deactivate an STS to indicate it is no longer used by the client.
A SQL profile is a set of auxiliary information specific to a SQL statement.
This section contains the following topics:
See Also:
Oracle Database 2 Day + Performance Tuning Guide to learn how to manage SQL profiles using Enterprise ManagerA SQL profile contains corrections for poor optimizer estimates discovered during Automatic SQL Tuning. This information can improve optimizer cardinality and selectivity estimates, which in turn leads the optimizer to select better plans.
The SQL profile does not contain information about individual execution plans. Rather, the optimizer has the following sources of information when choosing plans:
The environment, which contains the database configuration, bind variable values, optimizer statistics, data set, and so on
The supplemental statistics in the SQL profile
If the environment or SQL profile change, then the optimizer can create a new plan.
You can use SQL profiles with or without SQL plan management. If you use SQL plan management, then the plan chosen by the optimizer must be an enabled plan baseline. If the statement has multiple plans in the baseline, then the profile remains useful because it enables the optimizer to chose the lowest-cost plan in the baseline.
Figure 17-4 illustrates the relationship between a SQL statement and the SQL profile for this statement. The optimizer uses the profile and the environment to generate a query plan. In this example, the plan is in the SQL plan baseline for the statement.
SQL profiles provide the following benefits:
Unlike hints and stored outlines, profiles do not tie the optimizer to a specific plan or subplan. Profiles fix incorrect estimates while giving the optimizer the flexibility to pick the best plan in different situations.
Unlike hints, no changes to application source code are necessary when using profiles.
The use of SQL profiles by the database is transparent to the user.
During SQL tuning, you select a statement for automatic tuning and run SQL Tuning Advisor. The database can profile the following types of statement:
DML statements (SELECT
, INSERT
with a SELECT
clause, UPDATE
, and DELETE
)
CREATE
TABLE
statements (only with the AS
SELECT
clause)
MERGE
statements (the update or insert operations)
SQL Tuning Advisor invokes Automatic Tuning Optimizer to generate recommendations. Recommendations to accept SQL profiles occur in a finding.
Example 17-3 shows that the database found a better plan for a SELECT
statement that uses several expensive joins. The recommendation is to run DBMS_SQLTUNE.ACCEPT_SQL_PROFILE
to accept the profile, which should enable the statement to run 98.53% faster.
Example 17-3 Sample SQL Profile Finding
------------------------------------------------------------------------------- FINDINGS SECTION (2 findings) ------------------------------------------------------------------------------- 1- SQL Profile Finding (see explain plans section below) -------------------------------------------------------- A potentially better execution plan was found for this statement. Choose one of the following SQL profiles to implement. Recommendation (estimated benefit: 99.45%) ------------------------------------------ - Consider accepting the recommended SQL profile. execute dbms_sqltune.accept_sql_profile(task_name => 'my_task', object_id => 3, task_owner => 'SH', replace => TRUE); Validation results ------------------ The SQL profile was tested by executing both its plan and the original plan and measuring their respective execution statistics. A plan may have been only partially executed if the other could be run to completion in less time. Original Plan With SQL Profile % Improved ------------- ---------------- ---------- Completion Status: PARTIAL COMPLETE Elapsed Time(us): 15467783 226902 98.53 % CPU Time(us): 15336668 226965 98.52 % User I/O Time(us): 0 0 Buffer Gets: 3375243 18227 99.45 % Disk Reads: 0 0 Direct Writes: 0 0 Rows Processed: 0 109 Fetches: 0 109 Executions: 0 1 Notes ----- 1. The SQL profile plan was first executed to warm the buffer cache. 2. Statistics for the SQL profile plan were averaged over next 3 executions.
Sometimes SQL Tuning Advisor may recommend accepting a profile that uses the Automatic Degree of Parallelism (Auto DOP) feature. A parallel query profile is only recommended when the original plan is serial and when parallel execution can significantly reduce the elapsed time for a long-running query. When it recommends a profile that uses Auto DOP, SQL Tuning Advisor gives details about the performance overhead of using parallel execution for the SQL statement in the report. For parallel execution recommendations, SQL Tuning Advisor may provide two SQL profile recommendations, one using serial execution and one using parallel.
Example 17-4 shows a parallel query recommendation. In this example, a degree of parallelism of 7 improves response time significantly at the cost of increasing resource consumption by almost 25%. You must decide whether the reduction in database throughput is worth the increase in response time.
Example 17-4 Parallel Query Recommendation
Recommendation (estimated benefit: 99.99%) ------------------------------------------ - Consider accepting the recommended SQL profile to use parallel execution for this statement. execute dbms_sqltune.accept_sql_profile(task_name => 'gfk_task', object_id => 3, task_owner => 'SH', replace => TRUE, profile_type => DBMS_SQLTUNE.PX_PROFILE); Executing this query parallel with DOP 7 will improve its response time 82.22% over the SQL profile plan. However, there is some cost in enabling parallel execution. It will increase the statement's resource consumption by an estimated 24.43% which may result in a reduction of system throughput. Also, because these resources are consumed over a much smaller duration, the response time of concurrent statements might be negatively impacted if sufficient hardware capacity is not available. The following data shows some sampled statistics for this SQL from the past week and projected weekly values when parallel execution is enabled. Past week sampled statistics for this SQL ----------------------------------------- Number of executions 0 Percent of total activity .29 Percent of samples with #Active Sessions > 2*CPU 0 Weekly DB time (in sec) 76.51 Projected statistics with Parallel Execution -------------------------------------------- Weekly DB time (in sec) 95.21
When you accept a profile, the database creates the profile and stores it persistently in the data dictionary. If a user issues a statement for which a profile has been built, then the query optimizer (in normal mode) uses both the environment and the SQL profile to build a well-tuned plan.
If SQL plan management is used, and if a SQL plan baseline exists for the SQL statement, then the database adds a new plan to the baseline when a SQL profile is created. Otherwise, the database does not add a new plan baseline.
No strict relationship exists between the SQL profile and the plan baseline. When hard parsing, the optimizer uses the SQL profile to select the best plan baseline from the available plans. In some conditions, the SQL profile may cause the optimizer to select different plan baselines.
See Also:
Chapter 15, "Using SQL Plan Management"While SQL profiles are usually handled by Enterprise Manager as part of Automatic SQL tuning, you can manage SQL profiles with the DBMS_SQLTUNE
package. To use the APIs, you must have the ADMINISTER SQL MANAGEMENT OBJECT
privilege.
Table 17-3 shows the main procedures and functions for managing SQL profiles.
Table 17-3 DBMS_SQLTUNE APIs for SQL Profiles
Procedure or Function | Description | Section |
---|---|---|
|
Creates a SQL Profile for the specified tuning task |
|
|
Alters specific attributes of an existing SQL Profile object |
|
|
Drops the named SQL Profile from the database |
|
|
Creates the staging table used for copying SQL profiles from one system to another |
|
|
Moves profile data out of the |
|
|
Uses the profile data stored in the staging table to create profiles on this system |
Figure 17-5 shows the possible actions when using SQL profile APIs.
As tables grow or indexes are created or dropped, the plan for a profile can change. The profile continues to be relevant even if the data distribution or access path of the corresponding statement changes. In general, you do not need to refresh SQL profiles.
Over a long period of time, profile content can become outdated. In this case, the performance of the corresponding SQL statement may degrade. The poorly performing statement may appear as high-load or top SQL. In this situation, the Automatic SQL Tuning task again captures the statement as high-load SQL. You can create a new profile for the statement.
See Also:
Oracle Database PL/SQL Packages and Types Reference for information about theDBMS_SQLTUNE
packageYou can use the DBMS_SQLTUNE.ACCEPT_SQL_PROFILE
procedure or function to accept a SQL profile recommended by the SQL Tuning Advisor. This procedure creates and stores a SQL profile in the database.
As a rule of thumb, accept a SQL profile recommended by SQL Tuning Advisor. If both an index and a SQL profile are recommended, then either use both or use the SQL profile only. If you create an index, then the optimizer may need the profile to pick the new index.
In some situations, SQL Tuning Advisor may find an improved serial plan in addition to an even better parallel plan. In this case, the advisor recommends both a standard and a parallel SQL profile, enabling you to choose between the best serial and best parallel plan for the statement. Accept a parallel plan only if the increase in response time is worth the decrease in throughput (see Example 17-4).
To accept a SQL profile:
Call the DBMS_SQLTUNE.ALTER_SQL_PROFILE
procedure.
In following example, my_sql_tuning_task
is the name of the SQL tuning task and my_sql_profile
is the name of the SQL profile. The PL/SQL block accepts a profile that uses parallel execution (profile_type
):
DECLARE my_sqlprofile_name VARCHAR2(30); BEGIN my_sqlprofile_name := DBMS_SQLTUNE.ACCEPT_SQL_PROFILE ( task_name => 'my_sql_tuning_task', name => 'my_sql_profile', profile_type => DBMS_SQLTUNE.PX_PROFILE, force_match => TRUE ); END; /
The force_match
setting controls statement matching. Typically, an accepted SQL profile is associated with the SQL statement through a SQL signature that is generated using a hash function. This hash function changes the SQL statement to upper case and removes all extra whites spaces before generating the signature. Thus, the same SQL profile works for all SQL statements in which the only difference is case and white spaces.
By setting force_match
to TRUE
, the SQL profile additionally targets all SQL statements that have the same text after normalizing literal values to bind variables. This setting may be useful for applications that use only literal values because it allows SQL with text differing only in its literal values to share a SQL profile. If both literal values and bind variables are in the SQL text, or if force_match
is set to FALSE
(default), then literal values are not normalized.
You can view information about a SQL profile in the DBA_SQL_PROFILES
view.
You can alter attributes of an existing SQL profile with the ALTER_SQL_PROFILE
procedure. Modifiable attributes are STATUS
, NAME
, DESCRIPTION
, and CATEGORY
.
The CATEGORY
attribute determines which sessions can apply a profile. You can view the CATEGORY
attribute by querying DBA_SQL_PROFILES.CATEGORY
. By default, all profiles are in the DEFAULT
category, which means that all sessions in which the SQLTUNE_CATEGORY
initialization parameter is set to DEFAULT
can use the profile.
By altering the category of a SQL profile, you can determine which sessions are affected by profile creation. For example, by setting the category to DEV
, only sessions in which the SQLTUNE_CATEGORY
initialization parameter is set to DEV
can use the profile. Other sessions do not have access to the SQL profile and execution plans for SQL statements are not impacted by the SQL profile. This technique enables you to test a profile in a restricted environment before making it available to other sessions.
To alter a SQL profile:
Call the DBMS_SQLTUNE.ALTER_SQL_PROFILE
procedure.
In the following example, the STATUS
attribute of my_sql_profile
is changed to DISABLED
, which means the SQL profile is not used during SQL compilation:
BEGIN DBMS_SQLTUNE.ALTER_SQL_PROFILE( name => 'my_sql_profile', attribute_name => 'STATUS', value => 'DISABLED'); END; /
See Also:
Oracle Database Reference for information on theSQLTUNE_CATEGORY
initialization parameterYou can drop a SQL profile with the DROP_SQL_PROFILE
procedure. You can specify whether to ignore errors raised if the name does not exist. For this example, the default value of FALSE
is accepted
To drop a SQL profile:
Call the DBMS_SQLTUNE.DROP_SQL_PROFILE
procedure.
The following example drops the profile named my_sql_profile
:
BEGIN DBMS_SQLTUNE.DROP_SQL_PROFILE( name => 'my_sql_profile' ); END; /
You can transport SQL profiles. This operation involves exporting the SQL profile from the SYS
schema in one database to a staging table, and then importing the SQL profile from the staging table into another database. You can transport a SQL profile to any Oracle database created in the same release or later.
To transport a SQL profile:
Use the CREATE_STGTAB_SQLPROF
procedure to create a staging table where the SQL profiles will be exported.
The following example creates my_staging_table
in the DBA1
schema:
BEGIN DBMS_SQLTUNE.create_stgtab_sqlprof( table_name => 'my_staging_table', schema_name => 'DBA1' ); END; /
Use the PACK_STGTAB_SQLPROF
procedure to export SQL profiles into the staging table.
The following example populates dba1.my_staging_table
with the SQL profile my_profile
:
BEGIN DBMS_SQLTUNE.pack_stgtab_sqlprof( profile_name => 'my_profile', staging_table_name => 'my_staging_table', staging_schema_owner => 'dba1' ); END; /
Move the staging table to the database where the SQL profiles will be imported using the mechanism of choice (such as Oracle Data Pump or database link).
On the database where the SQL profiles will be imported, use the UNPACK_STGTAB_SQLPROF
procedure to import SQL profiles from the staging table.
The following example shows how to import SQL profiles contained in the staging table:
BEGIN DBMS_SQLTUNE.UNPACK_STGTAB_SQLPROF( replace => TRUE, staging_table_name => 'my_staging_table'); END; /
This section summarizes views that shows information gathered for tuning the SQL statements. You need DBA privileges to access these views.
Advisor information views, such as DBA_ADVISOR_TASKS
, DBA_ADVISOR_EXECUTIONS
, DBA_ADVISOR_FINDINGS
, DBA_ADVISOR_RECOMMENDATIONS
, and DBA_ADVISOR_RATIONALE
views.
SQL tuning information views, such as DBA_SQLTUNE_STATISTICS
, DBA_SQLTUNE_BINDS
, and DBA_SQLTUNE_PLANS
views.
SQL tuning set views, such as DBA_SQLSET
, DBA_SQLSET_BINDS
, DBA_SQLSET_STATEMENTS
, and DBA_SQLSET_REFERENCES
views.
Information on captured execution plans for statements in SQL tuning sets are displayed in the DBA_SQLSET_PLANS
and USER_SQLSET_PLANS
views.
SQL profile information is displayed in the DBA_SQL_PROFILES
view.
If TYPE
= MANUAL
, then the SQL profile was created manually by the SQL Tuning Advisor. If TYPE
= MANUAL
, then the profile was created by automatic SQL tuning.
Advisor execution progress information is displayed in the V$ADVISOR_PROGRESS
view.
Dynamic views containing information relevant to the SQL tuning, such as V$SQL
, V$SQLAREA
, V$SQLSTATS
, and V$SQL_BINDS
views.
See Also:
Oracle Database Reference for information on static data dictionary and dynamic views