In Oracle database 11.2 and above it is recommended to place the OCR and voting disks in ASM disk group. In my case the OCR, Voting disk and SPFILE are stored in +DBFS_DG disk group. I would like to move them to +DATA disk group. The ASM disk groups are configured using ASM Normal redundancy for protection.
In this article I will demonstrate how move/replace OCR, Voting disk and SPFILE from one disk group to another ASM disk group.
Environment
- Oracle Exadata X2-2
- ASM Disk Groups +DATA, +RECO, +DBFS_DG
- Oracle GI/RDBMS version 11.2.0.4
Steps to move/replacec OCR/Voting disk/SPFILE to new disk group.
- Locate the current OCR, Voting disk and SPFILE locations
OCR file location:
[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 4808
Available space (kbytes) : 257312
ID : 1556021409
Device/File Name : +DBFS_DG
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
Voting Disk location:
dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/crsctl query css votedisk
## STATE File Universal Id File Name Disk group
— —– —————– ——— ———
1. ONLINE 8f84a639c9ac4fbabf581bb6972f3f8f (o/192.168.1.9/DBFS_DG_CD_02_dm01cel01) [DBFS_DG]
2. ONLINE 3b079cf1cba24f42bfda7a8b18f0e22f (o/192.168.1.10/DBFS_DG_CD_02_dm01cel02) [DBFS_DG]
3. ONLINE ad837de087dd4f6bbf72800ecd028573 (o/192.168.1.11/DBFS_DG_CD_07_dm01cel03) [DBFS_DG]
ASM SPFILE location:
SQL> show parameter spfile
NAME TYPE VALUE
———————————— ———– ——————————
spfile string +DBFS_DG/dm01-cluster/asmparameterfile/registry.253.790181847
- Create New ASM diskgroup with suitable redundancy for OCR and Voting files.
Here I am moving OCR/Voting disks from +DBFS_DG to +DATA with NORMAL redundancy
The disk group +DATA already exists.
- Ensure that the new diskgroup is mounted on all cluster nodes.
ASMCMD> lsdg
State Type Rebal Sector Block AU Total_MB Free_MB Req_mir_free_MB Usable_file_MB
Offline_disks Voting_files Name
MOUNTED NORMAL N 512 4096 4194304 71470080 58440508 433152 29003678
0 N DATA/
MOUNTED NORMAL N 512 4096 4194304 4085888 4068444 29824 2019310
0 Y DBFS_DG/
MOUNTED NORMAL N 512 4096 4194304 9460160 7874420 108224 3883098
0 N RECO/
SQL> select name, state, type from v$asm_diskgroup;
NAME STATE TYPE
—————————— ———– ——
DATA MOUNTED NORMAL
DBFS_DG MOUNTED NORMAL
RECO MOUNTED NORMAL
- Move OCR and Vote file from +DBFS_DG to +DATA
dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/ocrconfig -add +DATA
PROT-20: Insufficient permission to proceed. Require privileged user
Switch to root user and execute the command again.
[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrconfig -add +DATA
[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 4808
Available space (kbytes) : 257312
ID : 1556021409
Device/File Name : +DBFS_DG
Device/File integrity check succeeded
Device/File Name : +DATA
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrconfig -delete +DBFS_DG
[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 4808
Available space (kbytes) : 257312
ID : 1556021409
Device/File Name : +DATA
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/crsctl replace votedisk +DATA
Successful addition of voting disk 560494cd61f64fd3bfeca18aa876e5bc.
Successful addition of voting disk 15b8c8b5b80c4f7cbf3eadd516af60bc.
Successful addition of voting disk 7cff6119f09b4f99bfd0d6a1fd399a00.
Successful deletion of voting disk 8f84a639c9ac4fbabf581bb6972f3f8f.
Successful deletion of voting disk 3b079cf1cba24f42bfda7a8b18f0e22f.
Successful deletion of voting disk ad837de087dd4f6bbf72800ecd028573.
Successfully replaced voting disk group with +DATA.
CRS-4266: Voting file(s) successfully replaced
[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/crsctl query css votedisk
## STATE File Universal Id File Name Disk group
— —– —————– ——— ———
1. ONLINE 560494cd61f64fd3bfeca18aa876e5bc (o/192.168.3.10/DATA_CD_00_dm01cel02) [DATA]
2. ONLINE 15b8c8b5b80c4f7cbf3eadd516af60bc (o/192.168.3.11/DATA_CD_10_dm01cel03) [DATA]
3. ONLINE 7cff6119f09b4f99bfd0d6a1fd399a00 (o/192.168.3.12/DATA_CD_00_dm01cel04) [DATA]
Located 3 voting disk(s).
- Change ASM SPFILE location from +DBFS_DG to +DATA Diskgroup.
SQL> show parameter spfile
NAME TYPE VALUE
———————————— ———– ——————————
spfile string +DBFS_DG/dm01-cluster/asmparameterfile/registry.253.790181847
SQL> create pfile=’/tmp/initasm.ora’ from spfile;
File created.
SQL> create spfile=’+DATA’ from pfile=’/tmp/initasm.ora’;
File created.
Now GPNPTOOL will get updated with new ASM SPFILE location.
That can be verified by below command :
dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/gpnptool get
Warning: some command line parameters were defaulted. Resulting command line:
/u01/app/11.2.0.4/grid/bin/gpnptool.bin get -o-<?xml version=”1.0″ encoding=”UTF-8″?><gpnp:GPnP-Profile Version=”1.0″ xmlns=”http://www.grid-pnp.org/2005/11/gpnp-profile” xmlns:gpnp=”http://www.grid-pnp.org/2005/11/gpnp-profile”xmlns:orcl=”http://www.oracle.com/gpnp/2005/11/gpnp-profile” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xsi:schemaLocation=”http://www.grid-pnp.org/2005/11/gpnp-profile gpnp-profile.xsd” ProfileSequence=”5″
ClusterUId=”154e3eadf63effb1bf594bae93566a45″ ClusterName=”dm01-cluster” PALocation=””><gpnp:Network-Profile><gpnp:HostNetwork id=”gen” HostName=”*”><gpnp:Network id=”net1″ IP=”10.204.26.1″ Adapter=”bondeth0″ Use=”public”/><gpnp:Network id=”net2″ IP=”192.168.0.0″ Adapter=”bondib0″ Use=”cluster_interconnect”/></gpnp:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profile id=”css” DiscoveryString=”+asm” LeaseDuration=”400″/><orcl:ASM-Profile id=”asm” DiscoveryString=”o/*/*” SPFile=”+DATA/dm01-cluster/asmparameterfile/registry.253.934093287″/><ds:Signature xmlns:ds=”http://www.w3.org/2000/09/xmldsig#”><ds:SignedInfo><ds:CanonicalizationMethod
Algorithm=”http://www.w3.org/2001/10/xml-exc-c14n#”/><ds:SignatureMethod Algorithm=”http://www.w3.org/2000/09/xmldsig#rsa-sha1″/><ds:Reference URI=””><ds:Transforms><ds:Transform Algorithm=”http://www.w3.org/2000/09/xmldsig#enveloped-signature”/><ds:Transform Algorithm=”http://www.w3.org/2001/10/xml-exc-c14n#”> <InclusiveNamespaces xmlns=”http://www.w3.org/2001/10/xml-exc-c14n#” PrefixList=”gpnp orcl xsi”/></ds:Transform></ds:Transforms><ds:DigestMethod Algorithm=”http://www.w3.org/2000/09/xmldsig#sha1″/>ds:DigestValue>SEdtgDVCAmvafpr2sb2YbZh0NvE=</ds:DigestValue></ds:Reference></ds:SignedInfo> ds:SignatureValue>AcWa+ZnR6F+qAoCAy3uqZPSdxPbYnXpMbaTozjfeQb0HEtQsK7nT3r
+jO8AZkFUXqvSZa77D9d18/mYPXiPdQKJndpr+4cIM1Yg8K+fSC4HgD8hUgh5vl7YYJ2T9YoYVyfSbX6EQFOKZMKHM5IGZk0d8ls+4AD/1OO+LhijtEM4=</ds:SignatureValue></ds:Signature></gpnp:GPnP-Profile>
Success.
- Shutdown and Start the CRS on all the nodes
[root@dm01db01 ~]# dcli -g dbs_group -l root ‘/u01/app/11.2.0.4/grid/bin/crsctl stop crs’
dm01db01: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db01’
dm01db01: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.dm01db01.vip’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ttsrv_dm01db01’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ttsrv_dm01db01’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ttrmi_dm01db01’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.dm01db01-ibvip.vip’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ttrmi_dm01db01’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.dm01db01.vip’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.dm01db01-ibvip.vip’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db01’ succeeded
dm01db01: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db01’
dm01db01: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db01’ succeeded
dm01db01: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db01’ has completed
dm01db01: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db01’ has completed
dm01db01: CRS-4133: Oracle High Availability Services has been stopped.
dm01db02: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db02’
dm01db02: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ttsrv_dm01db02’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.LISTENER_SCAN1.lsnr’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ttsrv_dm01db02’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ttrmi_dm01db02’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ttrmi_dm01db02’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.dm01db02-ibvip.vip’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.dm01db02.vip’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.LISTENER_SCAN1.lsnr’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.scan1.vip’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.dm01db02.vip’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.scan1.vip’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.dm01db02-ibvip.vip’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db02’ succeeded
dm01db02: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db02’
dm01db02: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db02’ succeeded
dm01db02: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db02’ has completed
dm01db02: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db02’ has completed
dm01db02: CRS-4133: Oracle High Availability Services has been stopped.
dm01db03: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db03’
dm01db03: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ttrmi_dm01db03’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ttrmi_dm01db03’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.dm01db03.vip’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.dm01db03-ibvip.vip’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.dm01db03-ibvip.vip’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.dm01db03.vip’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db03’ succeeded
dm01db03: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db03’
dm01db03: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db03’ succeeded
dm01db03: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db03’ has completed
dm01db03: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db03’ has completed
dm01db03: CRS-4133: Oracle High Availability Services has been stopped.
dm01db04: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db04’
dm01db04: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ttrmi_dm01db04’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.dm01db04-ibvip.vip’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ttrmi_dm01db04’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.dm01db04-ibvip.vip’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.dm01db04.vip’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.dm01db07-ibvip.vip’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.dm01db04.vip’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.dm01db07-ibvip.vip’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db04’ succeeded
dm01db04: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db04’
dm01db04: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db04’ succeeded
dm01db04: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db04’ has completed
dm01db04: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db04’ has completed
dm01db04: CRS-4133: Oracle High Availability Services has been stopped.
dm01db05: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db05’
dm01db05: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.cvu’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ttrmi_dm01db05’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.LISTENER_SCAN3.lsnr’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ttrmi_dm01db05’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.cvu’ on ‘dm01db05’ succeeded
dm01db05: CRS-2672: Attempting to start ‘ora.cvu’ on ‘dm01db08’
dm01db05: CRS-2677: Stop of ‘ora.LISTENER_SCAN3.lsnr’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.scan3.vip’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.dm01db05-ibvip.vip’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.dm01db05.vip’ on ‘dm01db05’
dm01db05: CRS-2676: Start of ‘ora.cvu’ on ‘dm01db08’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.scan3.vip’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.dm01db05-ibvip.vip’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.dm01db05.vip’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db05’ succeeded
dm01db05: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db05’
dm01db05: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db05’ succeeded
dm01db05: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db05’ has completed
dm01db05: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db05’ has completed
dm01db05: CRS-4133: Oracle High Availability Services has been stopped.
dm01db06: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db06’
dm01db06: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ttrmi_dm01db06’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ttrmi_dm01db06’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.dm01db06-ibvip.vip’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.dm01db06.vip’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.dm01db06.vip’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.dm01db06-ibvip.vip’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db06’ succeeded
dm01db06: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db06’
dm01db06: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db06’ succeeded
dm01db06: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db06’ has completed
dm01db06: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db06’ has completed
dm01db06: CRS-4133: Oracle High Availability Services has been stopped.
dm01db08: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db08’
dm01db08: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.dm01db08.vip’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ttrmi_dm01db08’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.oc4j’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.LISTENER_SCAN2.lsnr’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ttrmi_dm01db08’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.dm01db08.vip’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.dm01db08-ibvip.vip’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.LISTENER_SCAN2.lsnr’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.scan2.vip’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.dm01db07.vip’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.cvu’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.cvu’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.dm01db08-ibvip.vip’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.dm01db07.vip’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.scan2.vip’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.oc4j’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db08’ succeeded
dm01db08: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db08’
dm01db08: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db08’ succeeded
dm01db08: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db08’ has completed
dm01db08: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db08’ has completed
dm01db08: CRS-4133: Oracle High Availability Services has been stopped.
[root@dm01db01 ~]# dcli -g dbs_group -l root ‘/u01/app/11.2.0.4/grid/bin/crsctl start crs’
dm01db01: CRS-4123: Oracle High Availability Services has been started.
dm01db02: CRS-4123: Oracle High Availability Services has been started.
dm01db03: CRS-4123: Oracle High Availability Services has been started.
dm01db04: CRS-4123: Oracle High Availability Services has been started.
dm01db05: CRS-4123: Oracle High Availability Services has been started.
dm01db06: CRS-4123: Oracle High Availability Services has been started.
dm01db08: CRS-4123: Oracle High Availability Services has been started.
- Ensure ALL Cluster resources are started successfully using below sample commands :
dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/crsctl stat res -init -t
——————————————————————————–
NAME TARGET STATE SERVER STATE_DETAILS
——————————————————————————–
Cluster Resources
——————————————————————————–
ora.asm
1 ONLINE ONLINE dm01db01 Started
ora.cluster_interconnect.haip
1 ONLINE ONLINE dm01db01
ora.crf
1 ONLINE ONLINE dm01db01
ora.crsd
1 ONLINE ONLINE dm01db01
ora.cssd
1 ONLINE ONLINE dm01db01
ora.cssdmonitor
1 ONLINE ONLINE dm01db01
ora.ctssd
1 ONLINE ONLINE dm01db01 OBSERVER
ora.diskmon
1 ONLINE ONLINE dm01db01
ora.drivers.acfs
1 ONLINE ONLINE dm01db01
ora.evmd
1 ONLINE ONLINE dm01db01
ora.gipcd
1 ONLINE ONLINE dm01db01
ora.gpnpd
1 ONLINE ONLINE dm01db01
ora.mdnsd
1 ONLINE ONLINE dm01db01
dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/crsctl check cluster -all
**************************************************************
dm01db01:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db02:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db03:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db04:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db05:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db06:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db07:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db01-+ASM1 {/home/oracle}:
dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/crsctl stat res -t
——————————————————————————–
NAME TARGET STATE SERVER STATE_DETAILS
——————————————————————————–
Local Resources
——————————————————————————–
ora.DATA_dm01.dg
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ONLINE ONLINE dm01db03
ONLINE ONLINE dm01db04
ONLINE ONLINE dm01db05
ONLINE ONLINE dm01db06
ONLINE ONLINE dm01db07
ONLINE ONLINE dm01db08
ora.DBFS_DG.dg
ONLINE OFFLINE dm01db01
ONLINE OFFLINE dm01db02
ONLINE OFFLINE dm01db03
ONLINE OFFLINE dm01db04
ONLINE OFFLINE dm01db05
ONLINE OFFLINE dm01db06
ONLINE ONLINE dm01db07
ONLINE OFFLINE dm01db08
ora.LISTENER.lsnr
OFFLINE OFFLINE dm01db01
ONLINE ONLINE dm01db02
ONLINE ONLINE dm01db03
ONLINE ONLINE dm01db04
ONLINE ONLINE dm01db05
ONLINE ONLINE dm01db06
ONLINE ONLINE dm01db07
ONLINE ONLINE dm01db08
ora.LISTENER_IB.lsnr
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ONLINE ONLINE dm01db03
ONLINE ONLINE dm01db04
ONLINE ONLINE dm01db05
ONLINE ONLINE dm01db06
ONLINE ONLINE dm01db07
ONLINE ONLINE dm01db08
ora.RECO_dm01.dg
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ONLINE ONLINE dm01db03
ONLINE ONLINE dm01db04
ONLINE ONLINE dm01db05
ONLINE ONLINE dm01db06
ONLINE ONLINE dm01db07
ONLINE ONLINE dm01db08
ora.asm
ONLINE ONLINE dm01db01 Started
ONLINE ONLINE dm01db02 Started
ONLINE ONLINE dm01db03 Started
ONLINE ONLINE dm01db04 Started
ONLINE ONLINE dm01db05 Started
ONLINE ONLINE dm01db06 Started
ONLINE ONLINE dm01db07 Started
ONLINE ONLINE dm01db08 Started
ora.gsd
OFFLINE OFFLINE dm01db01
OFFLINE OFFLINE dm01db02
OFFLINE OFFLINE dm01db03
OFFLINE OFFLINE dm01db04
OFFLINE OFFLINE dm01db05
OFFLINE OFFLINE dm01db06
OFFLINE OFFLINE dm01db07
OFFLINE OFFLINE dm01db08
ora.net1.network
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ONLINE ONLINE dm01db03
ONLINE ONLINE dm01db04
ONLINE ONLINE dm01db05
ONLINE ONLINE dm01db06
OFFLINE OFFLINE dm01db07
ONLINE ONLINE dm01db08
ora.net2.network
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ONLINE ONLINE dm01db03
ONLINE ONLINE dm01db04
ONLINE ONLINE dm01db05
ONLINE ONLINE dm01db06
OFFLINE OFFLINE dm01db07
ONLINE ONLINE dm01db08
ora.ons
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ONLINE ONLINE dm01db03
ONLINE ONLINE dm01db04
ONLINE ONLINE dm01db05
ONLINE ONLINE dm01db06
OFFLINE OFFLINE dm01db07
ONLINE ONLINE dm01db08
ora.registry.acfs
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ONLINE ONLINE dm01db03
ONLINE ONLINE dm01db04
ONLINE ONLINE dm01db05
ONLINE ONLINE dm01db06
OFFLINE OFFLINE dm01db07
ONLINE ONLINE dm01db08
——————————————————————————–
Cluster Resources
——————————————————————————–
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE dm01db08
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE dm01db06
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE dm01db05
ora.dm01db01-ibvip.vip
1 ONLINE ONLINE dm01db01
ora.dm01db01.vip
1 ONLINE ONLINE dm01db01
ora.dm01db02-ibvip.vip
1 ONLINE ONLINE dm01db02
ora.dm01db02.vip
1 ONLINE ONLINE dm01db02
ora.dm01db03-ibvip.vip
1 ONLINE ONLINE dm01db03
ora.dm01db03.vip
1 ONLINE ONLINE dm01db03
ora.dm01db04-ibvip.vip
1 ONLINE ONLINE dm01db04
ora.dm01db04.vip
1 ONLINE ONLINE dm01db04
ora.dm01db05-ibvip.vip
1 ONLINE ONLINE dm01db05
ora.dm01db05.vip
1 ONLINE ONLINE dm01db05
ora.dm01db06-ibvip.vip
1 ONLINE ONLINE dm01db06
ora.dm01db06.vip
1 ONLINE ONLINE dm01db06
ora.dm01db08-ibvip.vip
1 ONLINE ONLINE dm01db08
ora.dm01db08.vip
1 ONLINE ONLINE dm01db08
ora.cvu
1 ONLINE ONLINE dm01db03
ora.oc4j
1 ONLINE ONLINE dm01db03
ora.scan1.vip
1 ONLINE ONLINE dm01db08
ora.scan2.vip
1 ONLINE ONLINE dm01db06
ora.scan3.vip
1 ONLINE ONLINE dm01db05
SQL> show parameter spfile
NAME TYPE VALUE
———————————— ———– ——————————
spfile string +DATA/dm01-cluster/asmpar
ameterfile/registry.253.934093
287
Conclusion
In this article we have learned how to move/replace OCR, Voting disks and ASM SPFILE from one ASM disk group to another.