E CRSCTL Utility Reference

CRSCTL Overview

CRSCTL is an interface between you and Oracle Clusterware, parsing and calling Oracle Clusterware APIs for Oracle Clusterware objects.

Oracle Clusterware 11g release 2 (11.2) introduces cluster-aware commands with which you can perform check, start, and stop operations on the cluster. You can run these commands from any node in the cluster on another node in the cluster, or on all nodes in the cluster, depending on the operation.

You can use CRSCTL commands to perform several operations on Oracle Clusterware, such as:

• Starting and stopping Oracle Clusterware resources

• Enabling and disabling Oracle Clusterware daemons

• Checking the health of the cluster

• Managing resources that represent third-party applications

• Integrating Intelligent Platform Management Interface (IPMI) with Oracle Clusterware to provide failure isolation support and to ensure cluster integrity

• Debugging Oracle Clusterware components

Clusterized (Cluster Aware) Commands

You can run clusterized commands on one node to perform operations on another node in the cluster. These are referred to as remote operations. This simplifies administration because, for example, you no longer have to log in to each node to check the status of the Oracle Clusterware on all of your nodes.

Clusterized commands are completely operating system independent; they rely on the OHASD (Oracle High Availability Service Daemon). If this daemon is running, then you can perform remote operations, such as the starting, stopping, and checking the status of remote nodes.

Clusterized commands include the following:

• crsctl check cluster

• crsctl start cluster

• crsctl stop cluster

Operational Notes

Usage Information

• The CRSCTL utility is located in the Grid_home/bin directory. To run CRSCTL commands, type in crsctl at the operating system prompt followed by the command and arguments, as shown in the following example:

  crsctl stop crs
  

• There are three categories of CRSCTL commands:

  • Those that you use in either the Oracle Real Application Clusters (Oracle RAC) environment or in the Oracle Restart environment

  • Those that you use in the Oracle RAC environment, only

  • Those that you use in the Oracle Restart environment, only

• Many CRSCTL commands use the -f option to force the command to run and ignore any checks.

  For example, if you specify the force option for the crsctl stop resource command on a resource that is running and has dependent resources that are also running, then the force option omits the error message and instead stops or relocates all the dependent resources before stopping the resource you reference in the command.

• Do not use versions of CRSCTL earlier than 11g release 2 (11.2) to manage Oracle Clusterware 11g release 2 (11.2).

Using CRSCTL Help

To print the help information for CRSCTL, use the following command:

crsctl -help

If you want help for a specific command, such as start, then enter the command and append -help to the end, as shown in the following example:

crsctl start -help

You can also use the abbreviations -h or -? (this option functions in Linux, UNIX, and Windows environments) instead of -help.

Deprecated Subprograms or Commands

The following commands are deprecated in Oracle Clusterware 11g release 2 (11.2):

• crs_stat

• crs_register

• crs_unregister

• crs_start

• crs_stop

• crs_getperm

• crs_profile

• crs_relocate

• crs_setperm

• crsctl check crsd

• crsctl check cssd

• crsctl check evmd

• crsctl debug log

• crsctl set css votedisk

• crsctl start resources

• crsctl stop resources

CRSCTL Command Reference

This section is separated into three categories of CRSCTL commands:

• Dual Environment CRSCTL Commands

• Oracle RAC Environment CRSCTL Commands

• Oracle Restart Environment CRSCTL Commands

Dual Environment CRSCTL Commands

You can use the following commands in either the Oracle RAC or the Oracle Restart environments:

• crsctl add resource

• crsctl add type

• crsctl check css

• crsctl delete resource

• crsctl delete type

• crsctl get hostname

• crsctl getperm resource

• crsctl getperm type

• crsctl modify resource

• crsctl modify type

• crsctl setperm resource

• crsctl setperm type

• crsctl start resource

• crsctl status resource

• crsctl status type

• crsctl stop resource

crsctl add resource

Use the crsctl add resource command to register a resource to be managed by Oracle Clusterware. A resource could be an application process, a database, a service, a listener, and so on.

Syntax

crsctl add resource resource_name -type resource_type [-file file_path |
-attr "attribute_name=attribute_value,attribute_name=attribute_value,..."]
[-i] [-f]

Parameters

resource_name

-type resource_type

-file file_path

-attr "attribute_name=
attribute_value

-i

-f

Usage Notes

• Both the resource_name and -type resource_type parameters are required. You can create an associated resource type using the crsctl add type command.

• Any user can create a resource but only clusterware administrators can create resources of type local_resource or resources of type cluster_resource that have SERVER_POOLS=*.

  Once a resource is defined, its ACL controls who can perform particular operations with it. The Oracle Clusterware administrator list is no longer relevant.

  On Windows, a Windows administrator has full control over everything.

  See Also:

  "crsctl setperm resource" for more information about setting ACLs

• If an attribute value for an attribute name-value pair contains commas, then the value must be enclosed in single quotation marks ('').

• Following is an example of an attribute file:

  PLACEMENT=favored
  HOSTING_MEMBERS=node1 node2 node3
  RESTART_ATTEMPTS@CARDINALITYID(1)=0
  RESTART_ATTEMPTS@CARDINALITYID(2)=0
  FAILURE_THRESHOLD@CARDINALITYID(1)=2
  FAILURE_THRESHOLD@CARDINALITYID(2)=4
  FAILURE_INTERVAL@CARDINALITYID(1)=300
  FAILURE_INTERVAL@CARDINALITYID(2)=500
  CHECK_INTERVAL=2
  CARDINALITY=2
  

• Do not use this command for any resources with names that begin with ora because these resources are Oracle resources.

Example

Example 1

To register a VIP as a resource with Oracle Clusterware:

$ crsctl add resource app.appvip -type app.appvip.type \
-attr "RESTART_ATTEMPTS=2,\
START_TIMEOUT=100,STOP_TIMEOUT=100,CHECK_INTERVAL=10,\
USR_ORA_VIP=172.16.0.0,\
START_DEPENDENCIES=hard(ora.net1.network)pullup(ora.net1.network),\
STOP_DEPENDENCIES=hard(ora.net1.network)"

Example 2

To register a resources based on the test_type1 resource type:

$ crsctl add resource r1 -type test_type1 -attr "PATH_NAME=/tmp/r1.txt"
$ crsctl add resource r1 -type test_type1 -attr "PATH_NAME=/tmp/r2.txt"

crsctl add type

Use the crsctl add type command to create a resource type in Oracle Clusterware.

Syntax

crsctl add type type_name -basetype base_type_name {-file file_path | 
 -attr "ATTRIBUTE=attribute_name,TYPE={string | int}
 [,DEFAULT_VALUE=default_value][,FLAGS=[READONLY][|REQUIRED]]” 
 [-attr ...]}

Parameters

type_name

-basetype base_type_name

-file file_path

-attr

Usage Notes

• Both the type_name and base_type_name parameters are required

• You can either specify a file containing the type information or you can specify the type information on the command line

• Do not use this command for any resource types with names that begin with ora because these resource types are Oracle resource types

• You must have read permissions on the base type

Example

To create a resource type for demoActionScript:

# crsctl add type test_type1 -basetype cluster_resource \
 -attr "ATTRIBUTE=PATH_NAME,TYPE=string,DEFAULT_VALUE=default.txt"\
 -attr "ATTRIBUTE=ACTION_SCRIPT,TYPE=string,DEFAULT_VALUE=/u01/grid/crs/demo
/demoActionScript"

crsctl check css

Use the crsctl check css command to check the status of Cluster Synchronization Services. This command is most often used when Oracle Automatic Storage Management (Oracle ASM) is installed on the local server.

Syntax

crsctl check css

Usage Notes

Example

The crsctl check css command returns output similar to the following:

CRS-4529: Cluster Synchronization Services is online

crsctl delete resource

Use the crsctl delete resource command to remove resources from the Oracle Clusterware configuration.

Syntax

crsctl delete resource resource_name [-i] [-f]

Parameters

resource_name

-i

-f

Usage Notes

• The resource_name parameter is required

• You must have read and write permissions to delete the specified resources

• Do not use this command for any resources with names that begin with ora because these resources are Oracle resources

Example

To delete a resource from Oracle Clusterware:

# crsctl delete resource myResource

crsctl delete type

Use the crsctl delete type command to remove a resource type from the Oracle Clusterware configuration.

Syntax

crsctl delete type type_name [-i]

Usage Notes

• The type_name parameter is required

• If you specify -i, then the command fails if Oracle Clusterware cannot process the request immediately

• Do not use this command for any resource types with names that begin with ora because these resource types are Oracle resource types

Example

To delete a resource type, run the following command as who has write permissions on the resource type:

$ crsctl delete type app.appvip.type

crsctl get hostname

Use the crsctl get hostname command to retrieve the host name of the local server.

Syntax

crsctl get hostname

Example

Oracle Clusterware returns the host name of the local server:

$ crsctl get hostname
node2

crsctl getperm resource

Use the crsctl getperm resource command to display the user and group permissions for the specified resource.

Syntax

crsctl getperm resource resource_name [ {-u user_name | -g group_name} ]

Parameters

resource_name

-u user_name

-g group_name

Usage Notes

• The resource_name parameter is required

• You must have read permission on the specified resources to obtain their permissions

• Do not use this command for any resources with names that begin with ora because these resources are Oracle resources

Example

The crsctl getperm resource command returns output similar to the following, depending on the command option you choose:

$ crsctl getperm resource app.appvip

Name: app.appvip
owner:root:rwx,pgrp:oinstall:rwx,other::r--

$ crsctl getperm resource app.appvip -u oracle

Name: app.appvip
rwx

$ crsctl getperm resource app.appvip -g dba

Name: app.appvip
r--

crsctl getperm type

Use the crsctl getperm type command to obtain permissions for a particular resource type.

Syntax

crsctl getperm type resource_type  [-u user_name] | [-g group_name]

Parameters

resource_type

-u user_name

-g group_name

Usage Notes

• The resource_type parameter is required

• Do not use this command for any resource types with names that begin with ora because these resource types are Oracle resource types

Example

The crsctl getperm type command returns output similar to the following:

$ crsctl getperm type app.appvip.type

Name: app.appvip.type
owner:root:rwx,pgrp:oinstall:rwx,other::r--

crsctl modify resource

Use the crsctl modify resource command to modify the attributes of a particular resource in Oracle Clusterware.

Syntax

crsctl modify resource resource_name -attr "attribute_name=attribute_value"
[-i] [-f] [-delete]

Parameters

resource_name

-attr "attribute_name=
attribute_value"

-i

-f

-delete

Usage Notes

• The resource_name parameter is required

• If an attribute value for an attribute name-value pair contains commas, then the value must be enclosed in single quotation marks (''). For example:

  "START_DEPENDENCIES='hard(res1,res2,res3)'"
  

• You must have read and write permissions on the specified resources to modify them

• Do not use this command for any resources with names that begin with ora because these resources are Oracle resources

Example

To modify the attributes of the appsvip resource:

$ crsctl modify resource appsvip -attr USR_ORA_VIP=10.1.220.17 -i

crsctl modify type

Use the crsctl modify type command to modify an existing resource type.

Syntax

crsctl modify type type_name -attr "ATTRIBUTE=attribute_name,
TYPE={string | int} [,DEFAULT_VALUE=default_value]
[,FLAGS=[READONLY][| REQUIRED]]" [-i] [-f]

Parameters

type_name

-attr

-i

Usage Notes

• The type_name parameter is required

• Do not use this command for any resource types with names that begin with ora because these resource types are Oracle resource types

Example

To modify an existing resource type:

$ crsctl modify type myType.type -attr "ATTRIBUTE=myAttrName,TYPE='string',
DEFAULT_VALUE='myDefault'"

crsctl setperm resource

Use the crsctl setperm resource command to set permissions for a particular resource.

Syntax

crsctl setperm resource resource_name {-u acl_string | -x acl_string |
-o user_name | -g group_name}

Parameters

resource_name

{-u | -x | -o | -g}

user:user_name[:readPermwritePermexecPerm] |
group:group_name[:readPermwritePermexecPerm] |
other[::readPermwritePermexecPerm]

Usage Notes

• Do not use this command for any resources with names that begin with ora because these resources are Oracle resources.

• You must have read and write permissions on the specified resources to set their permissions

Example

To grant read, write, and execute permissions on a resource for user Scott:

$ crsctl setperm resource myResource -u user:scott:rwx

crsctl setperm type

Use the crsctl setperm type command to set permissions resources of a particular resource type.

Syntax

crsctl setperm type resource_type_name {-u acl_string | -x acl_string |
-o user_name | -g group_name}

Parameters

resource_type_name

{-u | -x | -o | -g}

user:user_name[:readPermwritePermexecPerm] |
group:group_name[:readPermwritePermexecPerm] |
other[::readPermwritePermexecPerm]

Usage Notes

• The resource_type_name parameter is required

• You must have read and write permissions on the specified resources to set their permissions

• Do not use this command for any resource types with names that begin with ora because these resource types are Oracle resource types

Example

To grant read, write, and execute permissions on a resource type for user Scott:

$ crsctl setperm type resType -u user:scott:rwx

crsctl start resource

Use the crsctl start resource command to start many idle resources on a particular server in the cluster.

Syntax

crsctl start resource {resource_name [...] | -w filter | -all} [-n server_name]
[-k cid] [-d did] [-env "env1=val1,env2=val2,..."] [-i] [-f]

Parameters

resource_name [...]

-w filter

-all

-n server_name

-k cid

-d did

-env "env1=val1,
env2=val2,..."

-i

-f

Usage Notes

• Any one of the three following options is required to specify which resources you want to start:

  • You can specify one or more resources to start

  • You can specify a resource filter that Oracle Clusterware uses to match resources to start

  • You can specify the -all option to start all resources on the specified server

• You must have read and execute permissions on the specified resources to start them

• Do not use this command for any resources with names that begin with ora because these resources are Oracle resources.

Example

To start a resource:

# crsctl start resource myResource -n server1

crsctl status resource

Use the crsctl status resource command to obtain the status and configuration information of many particular resources.

Syntax

crsctl status resource {resource_name [...] | -w "filter"}  [-p | -v [-e]] |
[-f | -l | -g] [[-k cid | -n server_name] [-d did]] | [-s -k cid [-d did]] [-t]

Parameters

resource_name [...] |
-w "filter"

[-p | -v [-e]] | [-f | -l | -g]

[-k cid | 
-n server_name] [-d did |
[-s -k cid [-d did]]]

-t

Usage Notes

• Either a space-delimited list of resources or a resource filter is required

• You must have read permissions on the specified resources to obtain their status

• Do not use this command for any resources with names that begin with ora because these resources are Oracle resources

Example

The crsctl status resource command returns output similar to the following:

$ crsctl status resource ora.staii14.vip

NAME=ora.staii14.vip
TYPE=ora.cluster_vip_net1.type
TARGET=ONLINE
STATE=ONLINE on staii14

crsctl status type

Use the crsctl status type command to obtain the configuration information of one or more particular resource types.

Syntax

crsctl status type resource_type_name [...]] [-g] [-p] [-f]

Parameters

[resource_type_name [...]

-g] [-p] [-f

Usage Notes

• The resource_type_name parameter or a filter is required

Example

The crsctl status type command returns output similar to the following:

$ crsctl status type ora.network.type

TYPE_NAME=ora.network.type
BASE_TYPE=ora.local_resource.type

crsctl stop resource

Use the crsctl stop resource command to stop running resources.

Syntax

crsctl stop resource {resource_name [...] | -w "filter" | -all} [-n server_name]
[-k cid] [-d did] [-env "env1=val1,env2=val2,..."] [-i] [-f]

Parameters

resource_name [...]

-w "filter"

-all

-n server_name

-k cid

-d did

-env "env1=val1,
env2=val2,..."

-i

-f

Usage Notes

• Any one of the three following options is required to specify which resources you want to stop:

  • You can specify one or more resources to stop

  • You can specify a resource filter that Oracle Clusterware uses to match resources to stop

  • You can specify the -all option with the -n server_name option to stop all resources on a particular server

• You must have read and execute permissions on the specified resources to stop them

• Do not use this command for any resources with names that begin with ora because these resources are Oracle resources.

Example

To stop a resource:

$ crsctl stop resource -n node1 -k 2

Oracle RAC Environment CRSCTL Commands

The commands listed in this section manage the Oracle Clusterware stack in an Oracle RAC environment, which consists of the following:

• Oracle Clusterware, the member nodes and server pools

• Oracle ASM (if installed)

• Cluster Synchronization Services

• Cluster Time Synchronization Services

You can use the following commands only in an Oracle RAC environment:

• crsctl add crs administrator

• crsctl add css votedisk

• crsctl add serverpool

• crsctl check cluster

• crsctl check crs

• crsctl check resource

• crsctl check ctss

• crsctl config crs

• crsctl delete crs administrator

• crsctl delete css votedisk

• crsctl delete node

• crsctl delete serverpool

• crsctl disable crs

• crsctl enable crs

• crsctl get css

• crsctl get css ipmiaddr

• crsctl get nodename

• crsctl getperm serverpool

• crsctl lsmodules

• crsctl modify serverpool

• crsctl pin css

• crsctl query crs administrator

• crsctl query crs activeversion

• crsctl query crs releaseversion

• crsctl query crs softwareversion

• crsctl query css ipmidevice

• crsctl query css votedisk

• crsctl relocate resource

• crsctl relocate server

• crsctl replace discoverystring

• crsctl replace votedisk

• crsctl set css

• crsctl set css ipmiaddr

• crsctl set css ipmiadmin

• crsctl setperm serverpool

• crsctl start cluster

• crsctl start crs

• crsctl status server

• crsctl status serverpool

• crsctl stop cluster

• crsctl stop crs

• crsctl unpin css

• crsctl unset css

crsctl add crs administrator

Use the crsctl add crs administrator command to add a user to the list of cluster administrators.

Syntax

crsctl add crs administrator -u user_name [-f]

Parameters

-u user_name

-f

Usage Notes

• You must run this command as root or a cluster administrator, or an administrator on Windows systems

• By default, root, the user that installed Oracle Clusterware, and the * wildcard are members of the list of users who have Oracle Clusterware administrative privileges. Run the crsctl delete crs administrator command to remove the wildcard and enable role-separated management of Oracle Clusterware.

  See Also:

  "Role-separated Management" for more information

Example

To add a user to the list of Oracle Clusterware administrators:

# crsctl add crs administrator -u scott

crsctl add css votedisk

Use the crsctl add css votedisk command to add one or more voting disks to the cluster on storage devices or to ASM diskgroup with redundancy normal or high.

Use the crsctl add css votedisk command to add one or more voting disks to the cluster on storage devices or to an Oracle ASM disk group with normal or high redundancy.

Syntax

crsctl add css votedisk path_to_voting_disk [path_to_voting_disk ...] [-purge]

Parameters

path_to_voting_disk

-purge

Usage Notes

• You should have at least three voting disks, unless you have a storage device, such as a disk array, that provides external redundancy. Oracle recommends that you do not use more than 5 voting disks. The maximum number of voting disks that is supported is 15.

Example

To add a voting disk to the cluster:

$ crsctl add css votedisk /stor/grid/ -purge

crsctl add serverpool

Use the crsctl add serverpool command to add a server pool to Oracle Clusterware.

Syntax

crsctl add serverpool server_pool_name {-file file_path | 
                  -attr "attr_name=attr_value[,attr_name=attr_value[,...]]"}
                  [-i] [-f]

Parameters

server_pool_name

-file file_path

attribute_name

attribute_value

-attr "MAX_SIZE=30, IMPORTANCE=3"

-i

-f

Usage Notes

• The server_pool_name parameter is required

• If an attribute value for an attribute name-value pair contains commas, then the value must be enclosed in single quotation marks ('')

• Do not use this command for any server pools with names that begin with ora because these server pools are Oracle server pools

• Running this command may result in Oracle Clusterware relocating other servers between server pools to comply with the new configuration

• You must run this command as root or a cluster administrator

Example

Example 1

To add a server pool named testsp with a maximum size of 5 servers, run the following command as root or the Oracle Clusterware installation owner:

# crsctl add serverpool testsp -attr "MAX_SIZE=5"

Example 2

Create the sp1_attr file with the attribute values for the sp1 serverpool, each on its own line, as shown in the following example:

IMPORTANCE=1
MIN_SIZE=1
MAX_SIZE=2
SERVER_NAMES=node3 node4 node5
PARENT_POOLS=Generic
EXCLUSIVE_POOLS=testsp
ACL=owner:oracle:rwx,pgrp:oinstall:rwx,other::r--

Use the following command to create the sp1 server pool using the sp1_attr file as input:

$ crsctl add serverpool sp1 -file /tmp/sp1_attr

crsctl check cluster

Use the crsctl check cluster command on any node in the cluster to check the status of the Oracle Clusterware stack.

Syntax

crsctl check cluster [-all | [-n server_name [...]]

Usage Notes

• You can check the status of the Oracle Clusterware stack on all nodes in the cluster with the -all option or you can specify one or more space-delimited nodes. If you do not specify either option, Oracle Clusterware checks the status of the Oracle Clusterware stack on the local server.

• You can use this cluster-aware command on any node in the cluster.

Example

The crsctl check cluster command returns output similar to the following:

$ crsctl check cluster -all
*****************************************************************
node1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
*****************************************************************
node2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
*****************************************************************

crsctl check crs

Use the crsctl check crs command to check the status of Oracle High Availability Services and the Oracle Clusterware stack on the local server.

Syntax

crsctl check crs

Example

To check the health of Oracle Clusterware on the local server:

$ crsctl check crs
CRS-4638: Oracle High Availablity Services is online
CRS-4537: Cluster Ready Services is onlin
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online

crsctl check resource

Use the crsctl check resource command to initiate the check action inside the application-specific agent of a particular resource. Oracle Clusterware only provides output if something prevents the system from issuing the check request, such as a bad resource name.

Syntax

crsctl check resource {resource_name [...] | -w "filter" }
      [-n node_name] [-k cardinality_id] [-d degree_id] }

Parameters

resource_name

-w "filter"

-n node_name

-k cardinality_id

-d degree_id

Usage Notes

• You must have read and execute permissions on the specified resources to check them

• Do not use this command for any resources with names that begin with ora because these resources are Oracle resources

• If this command is successful, it only means that a check was issued; it does not mean the CHECK action has been completed

Example

To initiate the check action inside the application-specific agent of a particular resource:

$ crsctl check resource appsvip

crsctl check ctss

Use the crsctl check ctss command to check the status of the Cluster Time Synchronization services.

Syntax

crsctl check ctss

Example

The crsctl check ctss command returns output similar to the following:

CRS-4700: The Cluster Time Synchronization Service is in Observer mode.

or

CRS-4701: The Cluster Time Synchronization Service is in Active mode.
CRS-4702: Offset from the reference node (in msec): 100

crsctl config crs

Use the crsctl config crs command to display Oracle High Availability Services automatic startup configuration.

Syntax

crsctl config crs

Example

The crsctl config crs command returns output similar to the following:

CRS-4622: Oracle High Availability Services autostart is enabled.

crsctl delete crs administrator

Use the crsctl delete crs administrator command to remove a user from the Oracle Clusterware administrator list.

Syntax

crsctl delete crs administrator -u user_name [-f]

Parameters

-u user_name

-f

Usage Notes

• The user_name parameter is required

• You must run this command as root or a cluster administrator, or an administrator on Windows systems

• To enable role-separated management, you must remove the * value enclosed in double quotation marks ("")

Example

To remove a user from the list of cluster administrators:

# crsctl delete crs administrator -u scott

crsctl delete css votedisk

Use the crsctl delete css votedisk to remove a voting disk from the Oracle Clusterware configuration.

Syntax

crsctl delete css votedisk voting_disk_GUID [voting_disk_GUID [...]]

Parameters

voting_disk_GUID

Usage Notes

• You can use this command only to remove voting disks from non-Oracle ASM storage devices

• You can obtain the file universal identifiers of each current voting disk by running the crsctl query css votedisk command

Example

To remove a voting disk:

$ crsctl delete css votedisk 26f7271ca8b34fd0bfcdc2031805581e

crsctl delete node

Use the crsctl delete node to remove a node from the cluster.

Syntax

crsctl delete node -n node_name

Usage Notes

• The node_name parameter is required

Example

To delete the node named node06 from the cluster, run the following command as root or the Oracle Clusterware installation owner:

# crsctl delete node -n node06

crsctl delete serverpool

Use the crsctl delete serverpool command to remove a server pool from the Oracle Clusterware configuration.

Syntax

crsctl delete serverpool server_pool_name [server_pool_name [...]] [-i]

Usage Notes

• The server_pool_name parameter is required

• If you specify -i, then the command fails if Oracle Clusterware cannot process the request immediately

• Do not use this command for any server pools with names that begin with ora because these server pools are Oracle server pools

• While you can use this command in either environment, it is only useful in the Oracle RAC environment

Example

To delete a server pool, run the following command as root or the Oracle Clusterware installation owner:

# crsctl delete serverpool sp1

crsctl disable crs

Use the crsctl disable crs command to prevent the automatic startup of Oracle High Availability Services when the server boots.

Syntax

crsctl disable crs

Usage Notes

• This command only affects the local server

• If you disable Oracle High Availability Services automatic startup, you must use the crsctl start crs command to start Oracle High Availability Services

Example

The crsctl disable crs command returns output similar to the following:

CRS-4621: Oracle High Availability Services autostart is disabled.

crsctl enable crs

Use the crsctl enable crs command to enable automatic startup of Oracle High Availability Services when the server boots.

Syntax

crsctl enable crs

Usage Notes

• This command only affects the local server

Example

The crsctl enable crs command returns output similar to the following:

CRS-4622: Oracle High Availability Services autostart is enabled.

crsctl get css

Use the crsctl get css command to obtain the value of a specific Cluster Synchronization Services parameter.

Syntax

crsctl get css parameter

Usage Notes

• Cluster Synchronization Services parameters include:

  clusterguid
  diagwait
  disktimeout
  misscount
  reboottime
  priority
  logfilesize
  

• This command only affects the local server

Example

To display the value of the disktimeout parameter for CSS, use the following command:

$ crsctl get css disktimeout
200

crsctl get css ipmiaddr

Use the crsctl get css ipmiaddr command to get the address of the local Intelligent Platform Management Interface (IPMI) device, or the Baseboard Management Controller (BMC), as specified in the Oracle Cluster Registry.

Syntax

crsctl get css ipmiaddr

Usage Notes

• This command only obtains the BMC IP address for the local server

Example

To obtain the IPMI device IP address:

$ crsctl get css ipmiaddr

crsctl get nodename

Use the crsctl get nodename command to obtain the name of the local node.

Syntax

crsctl get nodename

Example

The crsctl get nodename command returns output similar to the following:

node2

crsctl getperm serverpool

Use the crsctl getperm serverpool command to obtain permissions for a particular server pool.

Syntax

crsctl getperm serverpool server_pool_name  [-u user_name | -g group_name]

Parameters

server_pool_name

-u user_name

-g group_name

Usage Notes

• The server_pool_name parameter is required

• Do not use this command for any server pools with names that begin with ora because these server pools are Oracle server pools

• While you can use this command in either environment, it is only useful in the Oracle RAC environment

Example

The crsctl getperm serverpool command returns output similar to the following:

$ crsctl getperm serverpool sp1
NAME: sp1
owner:root:rwx,pgrp:root:r-x,other::r--

crsctl lsmodules

Use the crsctl lsmodules command to list the components of the modules that you can debug.

Syntax

crsctl lsmodules { crs | css | evm }

Usage Notes

• You can specify either crs (Oracle Clusterware), css (Cluster Synchronization Services), or evm (Event Manager)

Example

The crsctl lsmodules command returns output similar to the following:

$ crsctl lsmodules evm
List EVMD Debug Module: CLSVER
List EVMD Debug Module: CLUCLS
List EVMD Debug Module: COMMCRS
List EVMD Debug Module: COMMNS
List EVMD Debug Module: CRSOCR
List EVMD Debug Module: CSSCLNT
List EVMD Debug Module: EVMAGENT
List EVMD Debug Module: EVMAPP
...

crsctl modify serverpool

Use the crsctl modify serverpool command to modify an existing server pool.

Syntax

crsctl modify serverpool server_pool_name -attr "attr_name=attr_value
                      [,attr_name=attr_value[, ...]]" [-i] [-f]

Parameters

server_pool_name

attr_name

attr_value

-attr "CHECK_INTERVAL=30,START_TIMEOUT=25"

-i

-f

Usage Notes

• The server_pool_name parameter is required

• If an attribute value for an attribute name-value pair contains commas, then the value must be enclosed in single quotation marks (''). For example:

  "START_DEPENDENCIES='hard(res1,res2,res3)'"
  

• Running this command may result in Oracle Clusterware relocating other servers between server pools to comply with the new configuration

• Do not use this command for any server pools with names that begin with ora because these server pools are Oracle server pools

• While you can use this command in either environment, it is only useful in the Oracle RAC environment

Example

To modify an existing server pool, run the following command as root or the Oracle Clusterware installation owner:

# crsctl modify serverpool sp1 -attr "MAX_SIZE=7"

crsctl pin css

Use the crsctl pin css command to pin many specific nodes. Pinning a node means that the association of a node name with a node number is fixed. If a node is not pinned, its node number may change if the lease expires while it is down. The lease of a pinned node never expires.

Syntax

crsctl pin css -n node_name [ node_name [..]]

Usage Notes

• You can specify a space-delimited list of servers

• Any pre-11g release 2 (11.2) Oracle software must reside on a pinned server.

• A node may be unpinned with crsctl unpin css.

• Deleting a node with the crsctl delete node command implicitly unpins the node.

Example

To pin the node named node2:

# crsctl pin css -n node2

crsctl query crs administrator

Use the crsctl query crs administrator command to display the list of users with Oracle Clusterware administrative privileges.

Syntax

crsctl query crs administrator

Example

The crsctl query crs administrator command returns output similar to the following:

CRS Administrator List: scott

crsctl query crs activeversion

Use the crsctl query crs activeversion command to display the active version, or the binary version, of the Oracle Clusterware software on the local node.

Syntax

crsctl query crs activeversion

Example

The crsctl query crs activeversion command returns output similar to the following:

Oracle Clusterware active version on the cluster is [11.2.0.1.0]"

crsctl query crs releaseversion

Use the crsctl query crs releaseversion command to display the release version of the Oracle Clusterware software.

Syntax

crsctl query crs releaseversion

Example

The crsctl query crs releaseversion command returns output similar to the following:

Oracle High Availablity Services release version on the local node is [11.2.0.1.0]

crsctl query crs softwareversion

Use the crsctl query crs softwareversion command to display the software version, or the lowest Oracle Clusterware software version running on a particular server in the cluster.

Syntax

crsctl query crs softwareversion node_name

Usage Notes

• If you do not provide a node name, then Oracle Clusterware displays the version of Oracle Clusterware running on the local server.

Example

The crsctl query crs softwareversion command returns output similar to the following:

Oracle Clusterware version on node [node1] is [11.2.0.1.0]

crsctl query css ipmidevice

Use the crsctl query css ipmidevice command to determine the presence of the Intelligent Platform Management Interface (IPMI) driver on the local system.

Syntax

crsctl query css ipmidevice

Usage Notes

• This command was implemented to perform a pre-check during installation, and is normally issued only by the installer.

• There are no special privileges required to run this command.

• This command performs a perfunctory check and a success return code from the command does not guarantee that the baseboard management controller (BMC) hardware is fully configured for use.

Example

The crsctl query crs ipmidevice command returns output similar to the following:

CRS-4231: IPMI device successfully found and is configured

or

CRS-4128: IPMI device not found

crsctl query css votedisk

Use the crsctl query css votedisk command to display the voting disks used by Cluster Synchronization Services, the status of the voting disks, and the location of the disks, whether they are stored on Oracle ASM or elsewhere.

Syntax

crsctl query css votedisk

Usage Notes

Example

The crsctl query css votedisk command returns output similar to the following:

$ crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
1. ONLINE   296641fd201f4f3fbf3452156d3b5881 (/ocfs2/host09_vd3) []
2. ONLINE   8c4a552bdd9a4fd9bf93e444223146f2 (/netapp/ocrvf/newvd) []
3. ONLINE   8afeee6ae3ed4fe6bfbb556996ca4da5 (/ocfs2/host09_vd1) []
Located 3 voting disk(s).

crsctl relocate resource

Use the crsctl relocate resource command to relocate resources to another server in the cluster.

Syntax

crsctl relocate resource {resource_name | resource_name | -all -s source_server |
-w "filter"} [-n destination_server] [-k cid] [-env "env1=val1,env2=val2,..."]
[-i] [-f]

Parameters

resource_name

resource_name | -all
-s source_server

-w "filter"

-n destination_server

-k cid

-env "env1=val1,
env2=val2,..."

-i

-f

Usage Notes

• Any one of the three following options is required to specify which resources you want to relocate:

  • You can specify one particular resource to relocate.

  • Or you can specify one particular or all the resources to relocate from a particular source server.

  • Thirdly, you can specify a resource filter that Oracle Clusterware uses to match resources to relocate.

• If a resource has a degree ID greater than 1, then Oracle Clusterware relocates all instances of the resource.

• You must have read and execute permissions on the specified resources to relocate them

• Do not use this command for any resources with names that begin with ora because these resources are Oracle resources.

Example

To relocate one particular resource from one server to another:

# crsctl relocate resource myResource1 -s node1 -n node3

crsctl relocate server

Use the crsctl relocate server command to relocate a server to a different server pool.

Syntax

crsctl relocate server server_name [...] -c server_pool_name [-i] [-f]

Parameters

server_name

-c server_pool_name

-i

-f

Usage Notes

• The server_name and -c server_pool_name parameters are required

Example

 To move the node6 and node7 servers into the sp1 server pool without disrupting any active resources on those nodes, use the following command:

$ crsctl relocate server node6 node7 -c sp1

crsctl replace discoverystring

Use the crsctl replace discoverystring command to replace the existing discovery string used to locate voting disk files.

Syntax

crsctl replace discoverystring 'absolute_path[,...]'

Parameters

absolute_path

Usage Notes

• You must be root, the Oracle Clusterware installation owner, or a Windows administrator to run this command.

• You can run this command on any node in the cluster.

Example

Assume the current discovery string is /oracle/css1/*. To also use voting disk files in the /oracle/css2/ directory, replace the current discovery string using the following command:

# crsctl replace discoverystring "/oracle/css1/*,/oracle/css2/*"

crsctl replace votedisk

Use the crsctl replace votedisk command to move or replace the existing voting disks. This command creates voting disks in the specified locations, either in Oracle ASM or some other storage option. Oracle Clusterware copies existing voting disk information into the new locations and removes the voting disks from the former locations.

Syntax

crsctl replace votedisk [+asm_disk_group | path_to_voting_disk [...]]

Parameters

Usage Notes

• You must be root, the Oracle Clusterware installation owner, or a Windows administrator to run this command.

• Specify to replace a voting disk in either an Oracle ASM disk group or in some other storage device.

• You can run this command on any node in the cluster.

Example

Example 1

To replace a voting disk that is located within Oracle ASM:

$ crsctl replace votedisk +diskgroup1

Example 2

To replace a voting disk that is located on a shared file system:

$ crsctl replace votedisk /mnt/nfs/disk1 /mnt/nfs/disk2

crsctl set css

Use the crsctl set css command to set the value of a Cluster Synchronization Services parameter.

Syntax

crsctl set css parameter value

Usage Notes

• Cluster Synchronization Services parameters include:

  diagwait
  disktimeout
  misscount
  reboottime
  

Example

To set the value of a Cluster Synchronization Services parameter:

$ crsctl set css diagwait 30

crsctl set css ipmiaddr

Use the crsctl set css ipmiaddr command to store the address of the local Intelligent Platform Management Interface (IPMI) device, or the Baseboard Management Controller (BMC), in the Oracle Cluster Registry.

Syntax

crsctl set css ipmiaddr ip_address

Usage Notes

• Run the command under the user account used to install Oracle Clusterware

• Obtain the BMC IP address for the local server with the crsctl get css ipmiaddr command, or using the appropriate management utility for the local server (ipmiutil, ipmitool)

• Oracle Clusterware stores IP address for the local BMC in the configuration store, and distributes the address as required

• This command only stores the BMC IP address on the server from which you run it

Example

To store the BMC IP address on a local server and distribute it to other cluster nodes:

$ crsctl set css ipmiaddr 192.0.2.244

crsctl set css ipmiadmin

Use the crsctl set css ipmiadmin command to store in the Oracle Registry the login information of an Intelligent Platform Management Interface (IPMI) administrator configured on the resident baseboard management controller (BMC) of the local server.

Syntax

crsctl set css ipmiadmin ipmi_administrator_name

Usage Notes

• This command must be run under the user account that installed Oracle Clusterware.

• When prompted, provide the new password to associate with the new administrator account name. Oracle Clusterware stores the name and password for the local baseboard management controller (BMC) in the configuration store, and distributes the new credentials as required.

• This command only modifies the IPMI administrator on the server from which you run it.

• This command fails if another server cannot access the local BMC at the supplied address.

Example

To modify the IPMI administrator scott:

$ crsctl set css ipmiadmin scott

crsctl setperm serverpool

Use the crsctl setperm serverpool command to set permissions for a particular server pool.

Syntax

crsctl setperm serverpool server_pool_name {-u acl_string | -x acl_string |
-o user_name | -g group_name}

Parameters

server_pool_name

{-u | -x | -o | -g}

user:user_name[:readPermwritePermexecPerm] |
group:group_name[:readPermwritePermexecPerm] |
other[::readPermwritePermexecPerm]

Usage Notes

• The server_pool_name parameter is required

• Do not use this command for any server pools with names that begin with ora because these server pools are Oracle server pools

• While you can use this command in either environment, it is only useful in the Oracle RAC environment

Example

To grant read, write, and execute permissions on a server pool for user Scott Tiger:

crsctl setperm serverpool sp3 -u user:scott.tiger:rwx

crsctl start cluster

Use the crsctl start cluster command on any node in the cluster to start the Oracle Clusterware stack.

Syntax

crsctl start cluster [-all | -n server_name [...]]

Usage Notes

• You can choose to start the Oracle Clusterware stack on all servers in the cluster, on one or more named servers in the cluster (separate multiple server names by a space), or the local server, if you do not specify either -all or -n.

• You can use this cluster-aware command on any node in the cluster.

Example

To start the Oracle Clusterware stack on two named servers run the following command as root or the owner of the Oracle Clusterware installation:

# crsctl start cluster -n node1 node2

crsctl start crs

Use the crsctl start crs command to start Oracle High Availability Services on the local server.

Syntax

crsctl start crs

Usage Notes

• This command starts Oracle High Availability Services only on the local server

Example

To start Oracle High Availability Services on the local server, run the following command as root or the owner of the Oracle Clusterware installation:

# crsctl start crs

crsctl status server

Use the crsctl status server command to obtain the status and configuration information of one or more particular servers.

Syntax

crsctl status server [-p | -v | -f]

crsctl status server { server_name [...] | -w "filter"} [-g | -p | -v | -f]

Parameters

server_name [...]

-g | -p | -v | -f

Example

Example 1

The crsctl status server command returns output similar to the following:

NAME=node1
STATE=ONLINE

NAME=node2
STATE=ONLINE

Example 2

To display the full configuration of a specific server, enter a command similar to the following:

$ crsctl status server node2 -f
NAME=node2
STATE=ONLINE
ACTIVE_POOLS=ora.orcl Generic
STATE_DETAILS=

crsctl status serverpool

Use the crsctl status serverpool command to obtain the status and configuration information of one or more particular server pools.

Syntax

crsctl status serverpool [-p | -v | -f]

crsctl status serverpool [server_pool_name [...]] [-g | -p | -v | -f]

Parameters

[server_pool_name [...]

[-g | -p | -v | -f]

Usage Notes

• The server_pool_name parameter or a filter is required

• Do not use this command for any server pools with names that begin with ora because these server pools are Oracle server pools

• While you can use this command in either environment, it is only useful in the Oracle RAC environment

Example

Example 1

To display the full configuration of the server pool sp1:

$ crsctl status serverpool sp1 -f 
NAME=spl
IMPORTANCE=1
MIN_SIZE=0
MAX_SIZE=-1
SERVER_NAMES=node3 node4 node5
PARENT_POOLS=Generic
EXCLUSIVE_POOLS=
ACL=owner:oracle:rwx,pgrp:oinstall:rwx,other::r--
ACTIVE_SERVERS=node3 node4

Example 2

To display all the server pools and the servers associated with them, use the following command:

$ crsctl status serverpool
NAME=Free
ACTIVE_SERVERS=

NAME=Generic
ACTIVE_SERVERS=node1 node2

NAME=ora.orcl
ACTIVE_SERVERS=node1 node2

NAME=sp1
ACTIVE_SERVERS=node3 node4

crsctl stop cluster

Use the crsctl stop cluster command on any node in the cluster to stop the Oracle Clusterware stack on all servers in the cluster or specific servers.

Syntax

crsctl stop cluster [-all | -n server_name [...]] [-f]

Usage Notes

• If you do not specify -all or one or more space-delimited server names, then Oracle Clusterware stops the Oracle Clusterware stack on the local server.

• You can use this cluster-aware command on any node in the cluster.

• This command attempts to gracefully stop resources managed by Oracle Clusterware while attempting to stop the Oracle Clusterware stack.

  If any resources that Oracle Clusterware manages are still running after you run the crsctl stop cluster command, then the command fails. Use the -f option to unconditionally stop all resources and stop the Oracle Clusterware stack.

Example

To stop the Oracle Clusterware stack on a particular server:

# crsctl stop cluster -n node1

crsctl stop crs

Use the crsctl stop crs command to stop Oracle High Availability Services on the local server.

Syntax

crsctl stop crs [-f]

Usage Notes

• This command attempts to gracefully stop resources managed by Oracle Clusterware while attempting to stop Oracle High Availability Services on the local server.

  If any resources that Oracle Clusterware manages are still running after you run the crsctl stop crs command, then the command fails. Use the -f option to unconditionally stop all resources and stop Oracle High Availability Services on the local server.

Example

To stop Oracle High Availability Services on the local server:

# crsctl stop crs

crsctl unpin css

Use the crsctl unpin css command to unpin many servers. If a node is not pinned, its node number may change if the lease expires while it is down.

Syntax

crsctl unpin css -n node_name [ node_name [..]]

Usage Notes

• You can specify a space-delimited list of nodes.

• Unpinned servers that stop for longer than a week are no longer reported by olsnodes. These servers are dynamic when they leave the cluster, so you do not need to explicitly remove them from the cluster.

• Deleting a node with the crsctl delete node command implicitly unpins the node.

• During upgrade of Oracle Clusterware, all servers are pinned, whereas after a fresh installation of Oracle Clusterware 11g release 2 (11.2), all servers you add to the cluster are unpinned.

• You cannot unpin a server that has an instance of Oracle RAC that is older than 11g release 2 (11.2) if you installed Oracle Clusterware 11g release 2 (11.2) on that server.

Example

To unpin two nodes:

$ crsctl unpin css node1 node4

crsctl unset css

Use the crsctl unset css command to restore the value of a Cluster Synchronization Services parameter to its default value.

Syntax

crsctl unset css parameter

Usage Notes

• There are four Cluster Synchronization Services parameters you can specify:

  • diagwait:

  • disktimeout:

  • misscount:

  • reboottime:

Example

To restore the reboottime Cluster Synchronization Services parameter to its default value:

$ crsctl unset css reboottime

Oracle Restart Environment CRSCTL Commands

The commands listed in this section control Oracle High Availability Services. These commands manage the Oracle High Availability Services stack in the Oracle Restart environment, which consists of the Oracle High Availability Services daemon (ohasd), Oracle ASM (if installed), and Cluster Synchronization Services (if Oracle ASM is installed). These commands only affect the local server on which you run them.

Each server in the cluster is in one of two possible states:

• The whole stack is up, which means that Oracle High Availability Services is active

• The whole stack is down, which means that Oracle High Availability Services is inactive

You can use the following commands in the Oracle Restart environment, only:

• crsctl check has

• crsctl config has

• crsctl disable has

• crsctl enable has

• crsctl query has releaseversion

• crsctl query has softwareversion

• crsctl start has

• crsctl stop has

crsctl check has

Use the crsctl check has command to check the status of ohasd.

Syntax

crsctl check has

Usage Notes

Example

The crsctl check has command returns output similar to the following:

CRS-4638: Oracle High Availability Services is online

crsctl config has

Use the crsctl check has command to display the automatic startup configuration of the Oracle High Availability Services stack on the server.

Syntax

crsctl config has

Usage Notes

Example

The crsctl config has command returns output similar to the following:

CRS-4622 Oracle High Availability Services autostart is enabled.

crsctl disable has

Use the crsctl disable has command to disable automatic startup of the Oracle High Availability Services stack when the server boots up.

Syntax

crsctl disable has

Usage Notes

Example

The crsctl disable has command returns output similar to the following:

CRS-4621 Oracle High Availability Services autostart is disabled.

crsctl enable has

Use the crsctl enable has command to enable automatic startup of the Oracle High Availability Services stack when the server boots up.

Syntax

crsctl enable has

Usage Notes

Example

The crsctl enable has command returns output similar to the following:

CRS-4622 Oracle High Availability Services autostart is enabled.

crsctl query has releaseversion

Use the crsctl query crs releaseversion command to display the release version of the Oracle Clusterware software on the local node.

Syntax

crsctl query has releaseversion

Usage Notes

Example

The crsctl query has releaseversion command returns output similar to the following:

Oracle High Availability Services release version on the local node is [11.2.0.0.2]

crsctl query has softwareversion

Use the crsctl query crs softwareversion command to display the software version on the local node.

Syntax

crsctl query has softwareversion server_name

Usage Notes

• If you do not provide a server name, then Oracle Clusterware displays the version of Oracle Clusterware running on the local server.

Example

The crsctl query has softwareversion command returns output similar to the following:

Oracle High Availability Services version on the local node is [11.2.0.0.2]

crsctl start has

Use the crsctl start has command to start Oracle High Availability Services on the local server.

Syntax

crsctl start has

Usage Notes

Example

To start Oracle High Availability Services on the local server:

# crsctl start has

crsctl stop has

Use the crsctl stop has command to stop Oracle High Availability Services on the local server.

Syntax

crsctl stop has [-f]

Usage Notes

• This command attempts to gracefully stop resources managed by Oracle Clusterware while attempting to stop Oracle High Availability Services.

  If any resources that Oracle Clusterware manages are still running after you run the crsctl stop has command, then the command fails. Use the -f option to unconditionally stop all resources and stop Oracle High Availability Services.

Example

To stop Oracle High Availability Services on the local server:

# crsctl stop has

Troubleshooting and Diagnostic Output

You can use crsctl set log commands as the root user to enable dynamic debugging for Cluster Ready Services (CRS), Cluster Synchronization Services (CSS), and the Event Manager (EVM), and the clusterware subcomponents. You can dynamically change debugging levels using crsctl debug commands. Debugging information remains in the Oracle Cluster Registry for use during the next startup. You can also enable debugging for resources.

This section covers the following topics:

• Dynamic Debugging

• Component Level Debugging

• Enabling Debugging for Oracle Clusterware Resources

• Enabling Additional Tracing for Oracle Clusterware High Availability

Dynamic Debugging

This section includes the following CRSCTL commands that aid in debugging:

• crsctl set log

• crsctl set trace

crsctl set log

Use the crsctl set log command to set log levels for Oracle Clusterware.

Syntax

crsctl set log {[crs | css | evm "component_name=log_level, [...]"] | 
[all=log_level]}

You can also set log levels for the agents of specific resources, as follows:

crsctl set log res "resource_name=log_level, [...]"

Usage Notes

• You can set log levels for various components of the three modules, CRS, CSS, and EVM. If you choose the all option, then you can set log levels for all components of one module with one command. Use the crsctl lsmodules command to obtain a list of components for each module.

• Enter a comma-delimited list of component name-log level pairs enclosed in double quotation marks ("").

  Note:

  Separate component name-log level pairs with an equals sign (=) in Oracle Clusterware 11g release 2 (11.2). Previous Oracle Clusterware versions used a colon (:).

• The log_level is a number from 1 to 5 that sets the log level for the component or resource, where 1 is the least amount of log output and 5 provides the most detailed log output.

• To set log levels for resources, specify the name of a particular resource, or a comma-delimited list of resource name-log level pairs enclosed in double quotation marks ("").

Examples

To set log levels for the CRSRTI and CRSCOMM components of the CRS module:

$ crsctl set log crs "CRSRTI=1,CRSCOMM=2"

To set log levels for all components of the EVM module:

$ crsctl set log evm all=2

To set a log level for a resource:

$ crsctl set log res "myResource1=3"

crsctl set trace

Use the crsctl set trace command to set tracing levels for Oracle Clusterware.

Syntax

crsctl set trace {[crs | evm "component_name=tracing_level, [...]"] | 
["all=tracing_level"]

Usage Notes

• You can set tracing levels for the components of two modules: CRS and EVM. Use the crsctl lsmodules command to obtain a list of components for each module. If you choose the all option, then you can set tracing levels for all components of one module with one command.

• Enter a comma-delimited list of component name-tracing level pairs enclosed in double quotation marks ("").

  Note:

  Separate component name-tracing level pairs with an equals sign (=) in Oracle Clusterware 11g release 2 (11.2). Previous Oracle Clusterware versions used a colon (:).

• The tracing-level is a number from 1 to 5 that sets the tracing level for the component, where 1 is the least amount of tracing output and 5 provides the most detailed tracing output.

Examples

To set tracing levels for the CRSCCL and CRSEVT components of the CRS module:

$ crsctl set trace crs "CRSCCL=1,CRSEVT=2"

Component Level Debugging

You can use crsctl set log and crsctl set trace commands as the root user to enable dynamic debugging for the Oracle Clusterware Cluster Ready Services (CRS), Cluster Synchronization Services (CSS), and the Event Manager (EVM).

This section includes the following topics:

• Enabling Debugging for CRS, CSS, and EVM Modules

• Creating an Initialization File to Contain the Debugging Level

Enabling Debugging for CRS, CSS, and EVM Modules

You can enable debugging for the CRS, CSS, and EVM modules and their components, and for resources, by setting environment variables or by issuing crsctl set log commands, using the following syntax:

crsctl set {log | trace} module_name 
 “component:debugging_level[,component:debugging_level][...]”

Run the crsctl set command as the root user, and supply the following information:

• module_name—The name of the module: CRS, CSS, or EVM.

• component—The name of a component for the CRS, CSS, or EVM module. See Table E-29 for a list of all of the components.

• debugging_level—A number from 1 to 5 to indicate the level of detail you want the debug command to return, where 1 is the least amount of debugging output and 5 provides the most detailed debugging output.

  You can dynamically change the debugging level in the crsctl command or you can configure an initialization file for changing the debugging level, as described in "Creating an Initialization File to Contain the Debugging Level".

The following commands show examples of how to enable debugging for the various modules:

• To enable debugging for Oracle Clusterware:

  crsctl set log crs "CRSRTI:1,CRSCOMM:2"
  

• To enable debugging for OCR:

  crsctl set log crs "CRSRTI:1,CRSCOMM:2,OCRSRV:4"
  

• To enable debugging for EVM:

  crsctl set log evm "EVMCOMM:1"
  

• To enable debugging for resources

  crsctl debug log res "resname:1"
  

To obtain a list of components that can be used for debugging, run the crsctl lsmodules command, as follows:

crsctl lsmodules {crs | css | evm}

Table E-29 shows the components for the CRS, CSS, and EVM modules, respectively. Note that some component names are common between the CRS, EVM, and CSS daemons and may be enabled on that specific daemon. For example, COMMNS is the NS layer and because each daemon uses the NS layer, you can enable this specific module component on any of the daemons to get specific debugging information.

CRSUI
CRSCOMM
CRSRTI
CRSMAIN
CRSPLACE
CRSAPP
CRSRES
CRSCOMM
CRSOCR
CRSTIMER
CRSEVT
CRSD
CLUCLS
CSSCLNT
COMMCRS
COMMNS

CSSD
COMMCRS
COMMNS

EVMD
EVMDMAIN
EVMCOMM
EVMEVT
EVMAPP
EVMAGENT
CRSOCR
CLUCLS
CSSCLNT
COMMCRS
COMMNS

^Footnote 1 Obtain the list of CRS components using the crsctl lsmodules crs command.

^Footnote 2 Obtain the list of CSS components using the crsctl lsmodules css command.

^Footnote 3 Obtain the list of EVM components using the crsctl lsmodules evm command.

Example 1    

To set debugging levels on all cluster nodes, include the -all keyword, as follows:

crsctl debug log crs "CRSRTI:1,CRSCOMM:2" -all

Example 2    

To set debugging levels on specific cluster nodes, include the -nodelist keyword and the names of the nodes, as follows:

crsctl debug log crs "CRSRTI:1,CRSCOMM:2" -nodelist node1,node2

Table E-30 describes the Cluster Synchronization Services modules.

Table E-31 describes the function of each communication (COMM) module.

Table E-32 describes the functions performed by each CRS module.

Using the crsctl set log crs command, you can debug the OCR components listed in Table E-33. The components listed in Table E-33 can also be used for the Oracle Local Registry (OLR) except for OCRMAS and OCRASM. You can also use them for the OCR and OLR clients, except for OCRMAS and OCRSRV. Some of the OCR/OLR clients are OCRCONFIG, OCRDUMP, and so on.

Table E-34 describes the OCR tool modules.

Creating an Initialization File to Contain the Debugging Level

This section describes how to specify the debugging level in an initialization file. This debugging information is stored for use during the next startup.

For each process to debug, you can create an initialization file that contains the debugging level.

The initialization file name includes the name of the process that you are debugging (process_name.ini). The file is located in the Grid_home/log/host_name/admin/ directory. For example, the name for the CLSCFG debugging initialization file on node1 would be:

Grid_home/log/node1/admin/clscfg.ini

You can also use an initialization file when using OCR utilities. The initialization file for ocrconfig, ocrdump, and ocrcheck is:

Grid_home/srvm/admin/ocrlog.ini

The format of the initialization file is as follows:

mesg_logging_level=2
comploglvl=”OCRAPI:0;OCRSRV:0”
comptrclvl=”OCRAPI:0;OCRSRV:0”

You can specify component names, logging, and tracing levels.

Enabling Additional Tracing for Oracle Clusterware High Availability

Oracle Support may ask you to enable tracing to capture additional information. Because the procedures described in this section may affect performance, only perform these activities with the assistance of Oracle Support.

Enabling Debugging for Oracle Clusterware Resources

You can enable debugging for Oracle Clusterware resources by issuing crsctl set log and crsctl set trace commands, using the following syntax:

crsctl set {log | trace} resource “resource_name=debugging_level” 

Run the crsctl set command as the root user, and supply the following information:

• resource_name—The name of the resource to debug.

• debugging_level—A number from 1 to 5 to indicate the level of detail you want the debug command to return, where 1 is the least amount of debugging output and 5 provides the most detailed debugging output.

  You can dynamically change the debugging level in the crsctl command or you can configure an initialization file for changing the debugging level, as described in "Creating an Initialization File to Contain the Debugging Level".

To obtain a list of resources that can be used for debugging, run the crsctl status resource command.

Example 1    

To generate a debugging log for the VIP resource on node1, issue the following command:

crsctl set log resource "ora.node1.vip:1"

Example 2    

To generate a trace file for a SCAN listener, use the following command:

crsctl set trace resource "ora.LISTENER_SCAN1.lsnr=3”