Good Contents Are Everywhere, But Here, We Deliver The Best of The Best.Please Hold on!
Uncategorized
While creating a tablespace on Oracle Database 11g I ran into a issue related to DB_CREATE_FILE_DEST (OMF parameter).  The DB_CREATE_FILE_DEST parameter was pointing to incorrect ASM Disk Group name which doesn’t existing. The issues was fixed by correcting the DB_CREATE_FILE_DEST parameter to point to the correct ASM Disk Group name.

In this article I would like to demonstrate how to fix create tablespace error which is to incorrect DB_CREATE_FILE_DEST parameter.

Create Tablespace ran the into the issue as below:


The create tablespace failed as the ASM Disk Group +DATA doesn’t existing.

ORA Errors:
 
ORA-01119: error in creating database file ‘+DATA’
ORA-17502: ksfdcre:4 Failed to create file +DATA
ORA-15001: diskgroup “DATA” does not exist or is not mounted
 
Reason for above error:

The above error is due to initialization parameter DB_CREATE_FILE_DEST pointing to incorrect value. Change/Modify the parameter to fix the issue. 
 

Check  parameter db_create_file_dest Value:



About DB_CREATE_FILE_DEST

DB_CREATE_FILE_DEST specifies the default location for Oracle-managed datafiles.

DB_CREATE_FILE_DEST : directory or disk group
Default value : NO Default value.
Modifiable :  ALTER SESSION, ALTER SYSTEM

Identify the ASM Disk Group


Here the Data Disk Group name is +DATA_DM01

 

Modify the parameter DB_CREATE_FILE_DEST parameter to point it to correct ASM Disk Group name. You can use ALTER SYSTEM SET command to make it permanent as well.



 

Now you can Create a Tablespace again as follows:



This time the tablespace was created successfully without errors as the default OMF datafile location is pointing to correct ASM Disk Group

Conclusion:

In this article we have demonstrated how to fix ORA errors “ORA-15001”, “ORA-17502″,”ORA-01119” which due to incorrect defualt ASM Diskgroup set at Database using parameter DB_CREATE_FILE_DEST. 


eBook - Oracle Exadata X8M Patching Recipes | Netsoftmate
0

When Oracle ACS build Exadata Database Machine, they use the OEDA file that you sent them over for Exadata Install. The Exadata is built with default ASM Disk Group name DATAC1, RECOC1 & DBFS_DG. If you want to rename the DATAC1 and RECOC1 to something different to match your Organization standards you can do that by using the Oracle renamedg utility. The number Database version required to rename an ASM Disk Group is 11.2.

In this article we will demonstrate how to rename ASM Disk Group on Exadata Database Machine running Oracle Database 11.2

Here we want to change the following ASM Disk Group Names:
DATAC1 to DATA
RECOC1 to RECO

Steps to rename ASM Disk Group


  • Get the Database version

ORACLE_SID = [+ASM1] ? dbm011
The Oracle base remains unchanged with value /u01/app/oracle

[oracle@dm01db01 ~]$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.4.0 Production on Thu May 24 16:36:34 2018
Copyright (c) 1982, 2013, Oracle.  All rights reserved.

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 – 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options

SQL> select * from v$version;

BANNER
——————————————————————————–
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 – 64bit Production
PL/SQL Release 11.2.0.4.0 – Production
CORE    11.2.0.4.0      Production
TNS for Linux: Version 11.2.0.4.0 – Production
NLSRTL Version 11.2.0.4.0 – Production

  • Connect to asmcmd and make a note of the Disk Group Names

[oracle@dm01db01 ~]$ . oraenv

ORACLE_SID = [oracle] ? +ASM1
The Oracle base has been set to /u01/app/oracle

[oracle@dm01db01 ~]$ asmcmd -p

ASMCMD [+] > lsdg
State    Type    Rebal  Sector  Block       AU   Total_MB    Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  HIGH    N         512   4096  4194304  272154624  271558968          6479872        88359698              0             N  DATAC1/
MOUNTED  HIGH    N         512   4096  4194304    2404640    2402468            68704          777921              0             Y  DBFS_DG/
MOUNTED  NORMAL  N         512   4096  4194304   45389568   45386648           540352        22423148              0             N  RECOC1/

  • Check the versions

ASMCMD [+] > lsct
DB_Name  Status     Software_Version  Compatible_version  Instance_Name  Disk_Group
+ASM     CONNECTED        11.2.0.4.0          11.2.0.4.0  +ASM1          DBFS_DG
DBM01    CONNECTED        11.2.0.4.0          11.2.0.4.0  dbm011         DATAC1

  • Check the database status

[oracle@dm01db01 ~]$ srvctl status database -d dbm01
Instance dbm011 is running on node dm01db01
Instance dbm012 is running on node dm01db02
Instance dbm013 is running on node dm01db03
Instance dbm014 is running on node dm01db04

  • Make a note of the control files, Datafiles, Redo logfiles before stopping the database.

SQL> select name from v$controlfile;
SQL> select name from v$datafile;
SQL> select member from v$logfile;
SQL> select * from v$block_change_tracking;

  • Stop database database

[oracle@dm01db01 ~]$ srvctl stop database -d dbm01

[oracle@dm01db01 ~]$ srvctl status database -d dbm01
Instance dbm011 is not running on node dm01db01
Instance dbm012 is not running on node dm01db02
Instance dbm013 is not running on node dm01db03
Instance dbm014 is not running on node dm01db04

  • Umount the ASM disk group(s) that you want to rename. Connect to ASM command prompt and umount the disk group. umount the disk group from all nodes.

ASMCMD [+] > umount DATAC1

ASMCMD [+] > umount RECOC1

ASMCMD [+] > lsdg
State    Type  Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  HIGH  N         512   4096  4194304   2404640  2402468            68704          777921              0             Y  DBFS_DG/

Note: If you don’t stop the databases using ASM disk group you will get the following error message:

ASMCMD [+] > umount DATAC1
ORA-15032: not all alterations performed
ORA-15027: active use of diskgroup “DATAC1” precludes its dismount (DBD ERROR: OCIStmtExecute)

*** Repeat the above steps on all the remaining nodes in the Cluster***

[oracle@dm01db01 ~]$ ssh dm01db02
Last login: Thu May 17 15:23:31 2018 from dm01db01

[oracle@dm01db02 ~]$ . oraenv
ORACLE_SID = [oracle] ? +ASM2
The Oracle base has been set to /u01/app/oracle

[oracle@dm01db02 ~]$ asmcmd lsdg
State    Type    Rebal  Sector  Block       AU   Total_MB    Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  HIGH    N         512   4096  4194304  272154624  271558968          6479872        88359698              0             N  DATAC1/
MOUNTED  HIGH    N         512   4096  4194304    2404640    2402468            68704          777921              0             Y  DBFS_DG/
MOUNTED  NORMAL  N         512   4096  4194304   45389568   45385040           540352        22422344              0             N  RECOC1/

[oracle@dm01db02 ~]$ asmcmd umount DATAC1

[oracle@dm01db02 ~]$ asmcmd umount RECOC1

[oracle@dm01db02 ~]$ asmcmd lsdg
State    Type  Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  HIGH  N         512   4096  4194304   2404640  2402468            68704          777921              0             Y  DBFS_DG/

[oracle@dm01db01 ~]$ ssh dm01db03
Last login: Thu May 17 15:23:31 2018 from dm01db01

[oracle@dm01db03 ~]$ . oraenv
ORACLE_SID = [oracle] ? +ASM3
The Oracle base has been set to /u01/app/oracle

[oracle@dm01db03 ~]$ asmcmd umount DATAC1

[oracle@dm01db03 ~]$ asmcmd umount RECOC1

[oracle@dm01db03 ~]$ asmcmd lsdg
State    Type  Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  HIGH  N         512   4096  4194304   2404640  2402468            68704          777921              0             Y  DBFS_DG/

[oracle@dm01db01 ~]$ ssh dm01db04
Last login: Thu May 17 15:23:31 2018 from dm01db01

[oracle@dm01db04 ~]$ . oraenv
ORACLE_SID = [oracle] ? +ASM4
The Oracle base has been set to /u01/app/oracle

[oracle@dm01db04 ~]$ asmcmd umount DATAC1

[oracle@dm01db04 ~]$ asmcmd umount RECOC1

[oracle@dm01db04 ~]$ asmcmd lsdg
State    Type  Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  HIGH  N         512   4096  4194304   2404640  2402468            68704          777921              0             Y  DBFS_DG/

  • Verify that renamedg is in PATH

[oracle@dm01db01 ~]$ which renamedg
/u01/app/11.2.0.4/grid/bin/renamedg

  • As owner of the Grid Infrastruture software execute the renamdg command. Here the owner of GI home is ‘oracle’ user. First I am renaming DATAC1 disk group to DATA

[oracle@dm01db01 ~]$ renamedg phase=both dgname=DATAC1 newdgname=DATA verbose=true

NOTE: No asm libraries found in the system
Parsing parameters..
Parameters in effect:

         Old DG name       : DATAC1
         New DG name       : DATA
         Phases            :
                 Phase 1
                 Phase 2
         Discovery str      : (null)
         Clean              : TRUE
         Raw only           : TRUE
renamedg operation: phase=both dgname=DATAC1 newdgname=DATA verbose=true
Executing phase 1
Discovering the group
Performing discovery with string:
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_02_dm01cel01 with disk number:74 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_11_dm01cel01 with disk number:83 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_07_dm01cel01 with disk number:79 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_04_dm01cel01 with disk number:76 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_05_dm01cel01 with disk number:77 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_10_dm01cel01 with disk number:82 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_06_dm01cel01 with disk number:78 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_03_dm01cel01 with disk number:75 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_00_dm01cel01 with disk number:72 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_08_dm01cel01 with disk number:80 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_01_dm01cel01 with disk number:73 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_09_dm01cel01 with disk number:81 and timestamp (33068591 612262912)



Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_09_dm01cel07 with disk number:69 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_03_dm01cel07 with disk number:63 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_06_dm01cel07 with disk number:66 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_08_dm01cel07 with disk number:68 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_04_dm01cel07 with disk number:64 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_07_dm01cel07 with disk number:67 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_01_dm01cel07 with disk number:61 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_05_dm01cel07 with disk number:65 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_02_dm01cel07 with disk number:62 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_00_dm01cel07 with disk number:60 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_11_dm01cel07 with disk number:71 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_10_dm01cel07 with disk number:70 and timestamp (33068591 612262912)
Checking for hearbeat…
Re-discovering the group
Performing discovery with string:
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_02_dm01cel01 with disk number:74 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_11_dm01cel01 with disk number:83 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_07_dm01cel01 with disk number:79 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_04_dm01cel01 with disk number:76 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_05_dm01cel01 with disk number:77 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_10_dm01cel01 with disk number:82 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_06_dm01cel01 with disk number:78 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_03_dm01cel01 with disk number:75 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_00_dm01cel01 with disk number:72 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_08_dm01cel01 with disk number:80 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_01_dm01cel01 with disk number:73 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_09_dm01cel01 with disk number:81 and timestamp (33068591 612262912)



Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_09_dm01cel07 with disk number:69 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_03_dm01cel07 with disk number:63 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_06_dm01cel07 with disk number:66 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_08_dm01cel07 with disk number:68 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_04_dm01cel07 with disk number:64 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_07_dm01cel07 with disk number:67 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_01_dm01cel07 with disk number:61 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_05_dm01cel07 with disk number:65 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_02_dm01cel07 with disk number:62 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_00_dm01cel07 with disk number:60 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_11_dm01cel07 with disk number:71 and timestamp (33068591 612262912)
Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_10_dm01cel07 with disk number:70 and timestamp (33068591 612262912)
Checking if the diskgroup is mounted or used by CSS
Checking disk number:74
Checking disk number:83
Checking disk number:79
Checking disk number:76
Checking disk number:77
Checking disk number:82
Checking disk number:78
Checking disk number:75
Checking disk number:72
Checking disk number:80
Checking disk number:73
Checking disk number:81
Checking disk number:69
Checking disk number:63
Checking disk number:66
Checking disk number:68
Checking disk number:64
Checking disk number:67
Checking disk number:61
Checking disk number:65
Checking disk number:62
Checking disk number:60


Generating configuration file..
Completed phase 1
Executing phase 2
Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_02_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_11_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_07_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_04_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_05_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_10_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_06_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_03_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_00_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_08_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_01_dm01cel01
Modifying the header


Modifying the header
Completed phase 2
Terminating kgfd context 0x7f9d346240a0

  • Now rename RECOC1 ASM disk group to RECO using renamdg command

[oracle@dm01db01 ~]$ renamedg phase=both dgname=RECOC1 newdgname=RECO verbose=true

NOTE: No asm libraries found in the system
Parsing parameters..
Parameters in effect:

         Old DG name       : RECOC1
         New DG name       : RECO
         Phases            :
                 Phase 1
                 Phase 2
         Discovery str      : (null)
         Clean              : TRUE
         Raw only           : TRUE
renamedg operation: phase=both dgname=RECOC1 newdgname=RECO verbose=true
Executing phase 1
Discovering the group
Performing discovery with string:
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_03_dm01cel01 with disk number:75 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_04_dm01cel01 with disk number:76 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_05_dm01cel01 with disk number:77 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_00_dm01cel01 with disk number:72 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_10_dm01cel01 with disk number:82 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_07_dm01cel01 with disk number:79 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_02_dm01cel01 with disk number:74 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_01_dm01cel01 with disk number:73 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_11_dm01cel01 with disk number:83 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_08_dm01cel01 with disk number:80 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_09_dm01cel01 with disk number:81 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_06_dm01cel01 with disk number:78 and timestamp (33068591 628813824)


Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_01_dm01cel07 with disk number:61 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_08_dm01cel07 with disk number:68 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_06_dm01cel07 with disk number:66 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_11_dm01cel07 with disk number:71 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_10_dm01cel07 with disk number:70 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_05_dm01cel07 with disk number:65 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_00_dm01cel07 with disk number:60 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_03_dm01cel07 with disk number:63 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_09_dm01cel07 with disk number:69 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_07_dm01cel07 with disk number:67 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_02_dm01cel07 with disk number:62 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_04_dm01cel07 with disk number:64 and timestamp (33068591 628813824)
Checking for hearbeat…
Re-discovering the group
Performing discovery with string:
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_03_dm01cel01 with disk number:75 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_04_dm01cel01 with disk number:76 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_05_dm01cel01 with disk number:77 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_00_dm01cel01 with disk number:72 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_10_dm01cel01 with disk number:82 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_07_dm01cel01 with disk number:79 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_02_dm01cel01 with disk number:74 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_01_dm01cel01 with disk number:73 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_11_dm01cel01 with disk number:83 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_08_dm01cel01 with disk number:80 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_09_dm01cel01 with disk number:81 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_06_dm01cel01 with disk number:78 and timestamp (33068591 628813824)


Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_01_dm01cel07 with disk number:61 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_08_dm01cel07 with disk number:68 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_06_dm01cel07 with disk number:66 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_11_dm01cel07 with disk number:71 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_10_dm01cel07 with disk number:70 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_05_dm01cel07 with disk number:65 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_00_dm01cel07 with disk number:60 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_03_dm01cel07 with disk number:63 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_09_dm01cel07 with disk number:69 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_07_dm01cel07 with disk number:67 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_02_dm01cel07 with disk number:62 and timestamp (33068591 628813824)
Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_04_dm01cel07 with disk number:64 and timestamp (33068591 628813824)


Checking if the diskgroup is mounted or used by CSS
Checking disk number:75
Checking disk number:76
Checking disk number:77
Checking disk number:72
Checking disk number:82
Checking disk number:79
Checking disk number:74
Checking disk number:73
Checking disk number:83
Checking disk number:80
Checking disk number:81
Checking disk number:78
Checking disk number:61
Checking disk number:68
Checking disk number:66
Checking disk number:71
Checking disk number:70
Checking disk number:65
Checking disk number:60
Checking disk number:63
Checking disk number:69
Checking disk number:67
Checking disk number:62
Checking disk number:64
Checking disk number:49


Generating configuration file..
Completed phase 1
Executing phase 2
Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_03_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_04_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_05_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_00_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_10_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_07_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_02_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_01_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_11_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_08_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_09_dm01cel01
Modifying the header
Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_06_dm01cel01
Modifying the header


Modifying the header
Completed phase 2
Terminating kgfd context 0x7f8d42f6c0a0

  • Mount the DATA and RECO ASM disk groups on all the nodes.

[oracle@dm01db01 ~]$ asmcmd -p

ASMCMD [+] > lsdg
State    Type  Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  HIGH  N         512   4096  4194304   2404640  2402468            68704          777921              0             Y  DBFS_DG/

ASMCMD [+] > mount DATA

ASMCMD [+] > mount RECO

ASMCMD [+] > lsdg
State    Type    Rebal  Sector  Block       AU   Total_MB    Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  HIGH    N         512   4096  4194304  272154624  271558968          6479872        88359698              0             N  DATA/
MOUNTED  HIGH    N         512   4096  4194304    2404640    2402468            68704          777921              0             Y  DBFS_DG/
MOUNTED  NORMAL  N         512   4096  4194304   45389568   45385040           540352        22422344              0             N  RECO/

*** Repeat the above steps on all the remaning compute nodes in the Cluster***

Note: 

  • renamedg utility cannot rename the associated ASM/Grid disk disk name
  • renamedg utility cannot rename/update the control files, datafiles, redo log files and any other files that reference ASM DG for all databases


Steps to rename control files, datafiles, redo log files and other database files


  • Update SPFILE location

[oracle@dm01db01 ~]$ cd $ORACLE_HOME/dbs

[oracle@dm01db01 dbs]$ cat initdbm011.ora
SPFILE=’+DATAC1/dbm01/spfiledbm01.ora’

[oracle@dm01db01 dbs]$ vi initdbm011.ora

[oracle@dm01db01 dbs]$ cat initdbm011.ora
SPFILE=’+DATA/dbm01/spfiledbm01.ora’

[oracle@dm01db01 dbs]$ scp initdbm011.ora dm01db02:/u01/app/oracle/product/11.2.0.4/dbhome/dbs/initdbm012.ora
initdbm011.ora                                                                                                                                             100%   42     0.0KB/s   00:00

[oracle@dm01db01 dbs]$ scp initdbm011.ora dm01db03:/u01/app/oracle/product/11.2.0.4/dbhome/dbs/initdbm013.ora
initdbm011.ora                                                                                                                                             100%   42     0.0KB/s   00:00

[oracle@dm01db01 dbs]$ scp initdbm011.ora dm01db04:/u01/app/oracle/product/11.2.0.4/dbhome/dbs/initdbm014.ora
initdbm011.ora                                                                                                                                             100%   42     0.0KB/s   00:00

  • Update control file location

[oracle@dm01db01 dbs]$ . oraenv
ORACLE_SID = [dbm011] ?
The Oracle base remains unchanged with value /u01/app/oracle

[oracle@dm01db01 dbs]$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.4.0 Production on Fri May 25 10:17:49 2018
Copyright (c) 1982, 2013, Oracle.  All rights reserved.
Connected to an idle instance.

SQL> startup nomount;
ORACLE instance started.

Total System Global Area 2.5655E+10 bytes
Fixed Size                  2265224 bytes
Variable Size            4160753528 bytes
Database Buffers         2.1341E+10 bytes
Redo Buffers              151113728 bytes

SQL> show parameter control_files

NAME                                 TYPE        VALUE
———————————— ———– ——————————
control_files                        string      +DATAC1/dbm01/controlfile/current.256.976374731

SQL> alter system set control_files=’+DATA/dbm01/controlfile/current.256.976374731′ scope=spfile;

System altered.

SQL> shutdown immediate;
ORA-01507: database not mounted


ORACLE instance shut down.
SQL> startup mount
ORACLE instance started.

Total System Global Area 2.5655E+10 bytes
Fixed Size                  2265224 bytes
Variable Size            4160753528 bytes
Database Buffers         2.1341E+10 bytes
Redo Buffers              151113728 bytes
Database mounted.

SQL> select name from v$controlfile;

NAME
——————————————————————————–
+DATA/dbm01/controlfile/current.256.976374731

  • Update datafile and redo log file locations

SQL> select name from v$datafile;

NAME
——————————————————————————–
+DATAC1/dbm01/datafile/system.259.976374739
+DATAC1/dbm01/datafile/sysaux.260.976374743
+DATAC1/dbm01/datafile/undotbs1.261.976374745
+DATAC1/dbm01/datafile/undotbs2.263.976374753
+DATAC1/dbm01/datafile/undotbs3.264.976374755
+DATAC1/dbm01/datafile/undotbs4.265.976374757
+DATAC1/dbm01/datafile/users.266.976374757

7 rows selected.

SQL> select member from v$logfile;

MEMBER
——————————————————————————–
+DATAC1/dbm01/onlinelog/group_1.257.976374733
+DATAC1/dbm01/onlinelog/group_2.258.976374735
+DATAC1/dbm01/onlinelog/group_7.267.976375073
+DATAC1/dbm01/onlinelog/group_8.268.976375075
+DATAC1/dbm01/onlinelog/group_5.269.976375079
+DATAC1/dbm01/onlinelog/group_6.270.976375083
+DATAC1/dbm01/onlinelog/group_3.271.976375085
+DATAC1/dbm01/onlinelog/group_4.272.976375087
+DATAC1/dbm01/onlinelog/group_9.274.976375205
+DATAC1/dbm01/onlinelog/group_10.275.976375209
+DATAC1/dbm01/onlinelog/group_11.276.976375211
+DATAC1/dbm01/onlinelog/group_12.277.976375215
+DATAC1/dbm01/onlinelog/group_13.278.976375217
+DATAC1/dbm01/onlinelog/group_14.279.976375219
+DATAC1/dbm01/onlinelog/group_15.280.976375223
+DATAC1/dbm01/onlinelog/group_16.281.976375225

16 rows selected.

SQL> alter database rename file ‘+DATAC1/dbm01/datafile/system.259.976374739’ to ‘+DATA/dbm01/datafile/system.259.976374739’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/datafile/sysaux.260.976374743’ to ‘+DATA/dbm01/datafile/sysaux.260.976374743’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/datafile/undotbs1.261.976374745’ to ‘+DATA/dbm01/datafile/undotbs1.261.976374745’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/datafile/undotbs2.263.976374753’ to ‘+DATA/dbm01/datafile/undotbs2.263.976374753’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/datafile/undotbs3.264.976374755’ to ‘+DATA/dbm01/datafile/undotbs3.264.976374755’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/datafile/undotbs4.265.976374757’ to ‘+DATA/dbm01/datafile/undotbs4.265.976374757’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/datafile/users.266.976374757’ to ‘+DATA/dbm01/datafile/users.266.976374757’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_1.257.976374733’  to ‘+DATA/dbm01/onlinelog/group_1.257.976374733’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_2.258.976374735’  to ‘+DATA/dbm01/onlinelog/group_2.258.976374735’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_7.267.976375073’  to ‘+DATA/dbm01/onlinelog/group_7.267.976375073’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_8.268.976375075’  to ‘+DATA/dbm01/onlinelog/group_8.268.976375075’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_5.269.976375079’  to ‘+DATA/dbm01/onlinelog/group_5.269.976375079’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_6.270.976375083’  to ‘+DATA/dbm01/onlinelog/group_6.270.976375083’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_3.271.976375085’  to ‘+DATA/dbm01/onlinelog/group_3.271.976375085’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_4.272.976375087’  to ‘+DATA/dbm01/onlinelog/group_4.272.976375087’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_9.274.976375205’  to ‘+DATA/dbm01/onlinelog/group_9.274.976375205’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_10.275.976375209’ to ‘+DATA/dbm01/onlinelog/group_10.275.976375209’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_11.276.976375211’ to ‘+DATA/dbm01/onlinelog/group_11.276.976375211’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_12.277.976375215’ to ‘+DATA/dbm01/onlinelog/group_12.277.976375215’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_13.278.976375217’ to ‘+DATA/dbm01/onlinelog/group_13.278.976375217’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_14.279.976375219’ to ‘+DATA/dbm01/onlinelog/group_14.279.976375219’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_15.280.976375223’ to ‘+DATA/dbm01/onlinelog/group_15.280.976375223’;

Database altered.

SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_16.281.976375225’ to ‘+DATA/dbm01/onlinelog/group_16.281.976375225’;

Database altered.

  • Verify the datafiles and redo log files names

SQL> select name from v$datafile;

NAME
——————————————————————————–
+DATA/dbm01/datafile/system.259.976374739
+DATA/dbm01/datafile/sysaux.260.976374743
+DATA/dbm01/datafile/undotbs1.261.976374745
+DATA/dbm01/datafile/undotbs2.263.976374753
+DATA/dbm01/datafile/undotbs3.264.976374755
+DATA/dbm01/datafile/undotbs4.265.976374757
+DATA/dbm01/datafile/users.266.976374757

7 rows selected.

SQL> select member from v$logfile;

MEMBER
——————————————————————————–
+DATA/dbm01/onlinelog/group_1.257.976374733
+DATA/dbm01/onlinelog/group_2.258.976374735
+DATA/dbm01/onlinelog/group_7.267.976375073
+DATA/dbm01/onlinelog/group_8.268.976375075
+DATA/dbm01/onlinelog/group_5.269.976375079
+DATA/dbm01/onlinelog/group_6.270.976375083
+DATA/dbm01/onlinelog/group_3.271.976375085
+DATA/dbm01/onlinelog/group_4.272.976375087
+DATA/dbm01/onlinelog/group_9.274.976375205
+DATA/dbm01/onlinelog/group_10.275.976375209
+DATA/dbm01/onlinelog/group_11.276.976375211
+DATA/dbm01/onlinelog/group_12.277.976375215
+DATA/dbm01/onlinelog/group_13.278.976375217
+DATA/dbm01/onlinelog/group_14.279.976375219
+DATA/dbm01/onlinelog/group_15.280.976375223
+DATA/dbm01/onlinelog/group_16.281.976375225

16 rows selected.

  • Update block change tracking file location

SQL> alter database rename file ‘+DATAC1/dbm01/changetracking/ctf.282.976375227’ to ‘+DATA/dbm01/changetracking/ctf.282.976375227’;

Database altered.

SQL> select * from v$block_change_tracking;

STATUS
———-
FILENAME
——————————————————————————–
     BYTES
———-
ENABLED
+DATA/dbm01/changetracking/ctf.282.976375227
  11599872

  • Update OMF related parameters

SQL> show parameter db_create_online_log_dest_1

NAME                                 TYPE        VALUE
———————————— ———– ——————————
db_create_online_log_dest_1          string      +DATAC1

SQL> alter system set db_create_online_log_dest_1=’+DATA’;

System altered.

SQL> show parameter db_create_online_log_dest_1

NAME                                 TYPE        VALUE
———————————— ———– ——————————
db_create_online_log_dest_1          string      +DATA

  • Update Fast Recovery Area location

SQL> show parameter db_recovery_file_dest

NAME                                 TYPE        VALUE
———————————— ———– ——————————
db_recovery_file_dest                string      +RECOC1
db_recovery_file_dest_size           big integer 20425000M

SQL> alter system set db_recovery_file_dest=’+RECO’;

System altered.

SQL> show parameter db_recovery_file_dest

NAME                                 TYPE        VALUE
———————————— ———– ——————————
db_recovery_file_dest                string      +RECO
db_recovery_file_dest_size           big integer 20425000M

  • Shutdown the database

SQL> shutdown immediate;
Database closed.
Database dismounted.
ORACLE instance shut down.
SQL> exit

  • Update the database configuration

[oracle@dm01db01 dbs]$ srvctl config database -d dbm01
Database unique name: dbm01
Database name: dbm01
Oracle home: /u01/app/oracle/product/11.2.0.4/dbhome
Oracle user: oracle
Spfile: +DATAC1/dbm01/spfiledbm01.ora
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: dbm01
Database instances: dbm011,dbm012,dbm013,dbm014
Disk Groups: DATAC1,RECOC1,DATA
Mount point paths:
Services:
Type: RAC
Database is administrator managed

[oracle@dm01db01 dbs]$ srvctl modify database -p +DATA/dbm01/spfiledbm01.ora -a DATA,RECO -d dbm01

[oracle@dm01db01 dbs]$ srvctl config database -d dbm01
Database unique name: dbm01
Database name: dbm01
Oracle home: /u01/app/oracle/product/11.2.0.4/dbhome
Oracle user: oracle
Spfile: +DATA/dbm01/spfiledbm01.ora
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: dbm01
Database instances: dbm011,dbm012,dbm013,dbm014
Disk Groups: DATA,RECO
Mount point paths:
Services:
Type: RAC
Database is administrator managed

  • Start the database and verify

[oracle@dm01db01 dbs]$ srvctl start database -d dbm01

[oracle@dm01db01 dbs]$ srvctl status database -d dbm01
Instance dbm011 is running on node dm01db01
Instance dbm012 is running on node dm01db02
Instance dbm013 is running on node dm01db03
Instance dbm014 is running on node dm01db04

[oracle@dm01db01 dbs]$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.4.0 Production on Fri May 25 10:40:34 2018
Copyright (c) 1982, 2013, Oracle.  All rights reserved.

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 – 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options

SQL> select name, open_mode,database_role from gv$database;

NAME      OPEN_MODE            DATABASE_ROLE
——— ——————– —————-
DBM01     READ WRITE           PRIMARY
DBM01     READ WRITE           PRIMARY
DBM01     READ WRITE           PRIMARY
DBM01     READ WRITE           PRIMARY

ORACLE_SID = [+ASM1] ? dbm011
The Oracle base remains unchanged with value /u01/app/oracle

[oracle@dm01db01 ~]$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.4.0 Production on Thu May 24 16:36:34 2018
Copyright (c) 1982, 2013, Oracle.  All rights reserved.

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 – 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options

SQL> select * from v$version;

BANNER
——————————————————————————–
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 – 64bit Production
PL/SQL Release 11.2.0.4.0 – Production
CORE    11.2.0.4.0      Production
TNS for Linux: Version 11.2.0.4.0 – Production
NLSRTL Version 11.2.0.4.0 – Production


[oracle@dm01db01 ~]$ . oraenv

ORACLE_SID = [oracle] ? +ASM1
The Oracle base has been set to /u01/app/oracle

[oracle@dm01db01 ~]$ asmcmd -p

ASMCMD [+] > lsdg
State    Type    Rebal  Sector  Block       AU   Total_MB    Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  HIGH    N         512   4096  4194304  272154624  271558968          6479872        88359698              0             N  DATAC1/
MOUNTED  HIGH    N         512   4096  4194304    2404640    2402468            68704          777921              0             Y  DBFS_DG/
MOUNTED  NORMAL  N         512   4096  4194304   45389568   45386648           540352        22423148              0             N  RECOC1/

ASMCMD [+] > lsct
DB_Name  Status     Software_Version  Compatible_version  Instance_Name  Disk_Group
+ASM     CONNECTED        11.2.0.4.0          11.2.0.4.0  +ASM1          DBFS_DG
DBM01    CONNECTED        11.2.0.4.0          11.2.0.4.0  dbm011         DATAC1

[oracle@dm01db01 ~]$ srvctl status database -d dbm01
Instance dbm011 is running on node dm01db01
Instance dbm012 is running on node dm01db02
Instance dbm013 is running on node dm01db03
Instance dbm014 is running on node dm01db04


Conclusion

In this article we have learned how to rename an ASM Disk group on Exadata running Oracle Database 11.2. Starting with Oracle Database 11.2 you can use the renamedg command to rename an ASM Disk Group. renamedg utility cannot rename the associated ASM/Grid disk disk name. Also renamedg cannot rename/update the control files, datafiles, redo log files and any other files that reference ASM DG for all databases. You must update database files manually after renaming ASM disk groups.

0

We had a failed hard disk on a Exadata Storage cell X6-2. So we scheduled the Oracle Field Engineer to replace the bad disk. Oracle Field Engineer came onsite and replaced the faulty hard disk. Post hard disk replacement we found that the physical disk and luns are created successfully but the Cell disk and Grid disks were not created automatically. When a hard disk is replaced, the lun, cell disk and grid disks are created automatically and grid disks are added to ASM disk group for you without any manual intervention. In some odd cases, the Cell disk and grid disks are not created automatically, in those cases you must manually create the Cell disk, create the Grid disks with proper sizes and add them to the ASM disk group.

In this article we will demonstrate how to create the Cell disk, Grid disks manually and add them to the respective ASM Disk Group.

Environment

  • Exadata X6-2 Elastic Configuration
  • 4 Compute nodes and 6 Storage cells
  • Hard Disk Size: 8TB
  • 3 ASM Disk Group: DATA, RECO & DBFS_DG
  • Total Number of Grid disks: DATA – 72, RECO – 72 & DBFS_DG – 60

Here the disk in the location 8:5 was back and replaced.

Before Replacing Hard Disk:

CellCLI> list physicaldisk
         8:0             PYJZKV                  normal
         8:1             PMU3LV                  normal
         8:2             P1Y2KV                  normal
         8:3             PYH48V                  normal
         8:4             PY7MAV                  normal
         8:5             PPZ47V                  not present
         8:6             PEJKHR                  normal
         8:7             PY4XSV                  normal
         8:8             PYL00V                  normal
         8:9             PV5RGV                  normal
         8:10            PSU26V                  normal
         8:11            PY522V                  normal
         FLASH_1_1       CVMD522500AG1P6NGN      normal
         FLASH_2_1       CVMD522401AC1P6NGN      normal
         FLASH_4_1       CVMD522500AC1P6NGN      normal
         FLASH_5_1       CVMD5230000Y1P6NGN      normal

CellCLI> list lun
         0_0     0_0     normal
         0_1     0_1     normal
         0_2     0_2     normal
         0_3     0_3     normal
         0_4     0_4     normal
         0_5     0_5     not present
         0_6     0_6     normal
         0_7     0_7     normal
         0_8     0_8     normal
         0_9     0_9     normal
         0_10    0_10    normal
         0_11    0_11    normal
         1_1     1_1     normal
         2_1     2_1     normal
         4_1     4_1     normal
         5_1     5_1     normal

After replacing Hard Disk:

CellCLI> list physicaldisk
         8:0             PYJZKV                  normal
         8:1             PMU3LV                  normal
         8:2             P1Y2KV                  normal
         8:3             PYH48V                  normal
         8:4             PY7MAV                  normal
         8:5             PPZ47V                  normal
         8:6             PEJKHR                  normal
         8:7             PY4XSV                  normal
         8:8             PYL00V                  normal
         8:9             PV5RGV                  normal
         8:10            PSU26V                  normal
         8:11            PY522V                  normal
         FLASH_1_1       CVMD522500AG1P6NGN      normal
         FLASH_2_1       CVMD522401AC1P6NGN      normal
         FLASH_4_1       CVMD522500AC1P6NGN      normal
         FLASH_5_1       CVMD5230000Y1P6NGN      normal

CellCLI> list lun
         0_0     0_0     normal
         0_1     0_1     normal
         0_2     0_2     normal
         0_3     0_3     normal
         0_4     0_4     normal
         0_5     0_5     normal
         0_6     0_6     normal
         0_7     0_7     normal
         0_8     0_8     normal
         0_9     0_9     normal
         0_10    0_10    normal
         0_11    0_11    normal
         1_1     1_1     normal
         2_1     2_1     normal
         4_1     4_1     normal
         5_1     5_1     normal

[root@dm01cel03 ~]# cellcli -e list physicaldisk 8:5 detail
         name:                   8:5
         deviceId:               21
         deviceName:             /dev/sdf
         diskType:               HardDisk
         enclosureDeviceId:      8
         errOtherCount:          0
         luns:                   0_5
         makeModel:              “HGST    H7280A520SUN8.0T”
         physicalFirmware:       PD51
         physicalInsertTime:     2018-05-18T10:52:29-05:00
         physicalInterface:      sas
         physicalSerial:         PPZ47V
         physicalSize:           7.1536639072000980377197265625T
         slotNumber:             5
         status:                 normal

[root@dm01cel03 ~]# cellcli -e list celldisk where lun=0_5 detail


[root@dm01cel03 ~]# cellcli -e list griddisk where cellDisk=CD_05_cm01cel01 attributes name,status
DATA_CD_05_dm01cel03 not present
DBFS_DG_CD_05_dm01cel03 not present
RECO_CD_05_dm01cel03 not present

[root@dm01cel03 ~]# cellcli -e list griddisk where celldisk=CD_05_dm01cel03 detail
         name:                   DATA_CD_05_dm01cel03
         availableTo:
         cachingPolicy:          default
         cellDisk:               CD_05_dm01cel03
         comment:                “Cluster dm01-cluster diskgroup DATA”
         creationTime:           2016-03-29T20:25:56-05:00
         diskType:               HardDisk
         errorCount:             0
         id:                     db221d77-25b0-4f9e-af6f-95e1c3134af5
         size:                   5.6953125T
         status:                 not present

         name:                   DBFS_DG_CD_05_dm01cel03
         availableTo:
         cachingPolicy:          default
         cellDisk:               CD_05_dm01cel03
         comment:                “Cluster dm01-cluster diskgroup DBFS_DG”
         creationTime:           2016-03-29T20:25:53-05:00
         diskType:               HardDisk
         errorCount:             0
         id:                     216fbec9-6ed4-4ef6-a0d4-d09517906fd5
         size:                   33.796875G
         status:                 not present

         name:                   RECO_CD_05_dm01cel03
         availableTo:
         cachingPolicy:          none
         cellDisk:               CD_05_dm01cel03
         comment:                “Cluster dm01-cluster diskgroup RECO”
         creationTime:           2016-03-29T20:25:58-05:00
         diskType:               HardDisk
         errorCount:             0
         id:                     e8ca6943-0ddd-48ab-b890-e14bbf4e591c
         size:                   1.42388916015625T
         status:                 not present

We can clearly see that the GRID DISKs are not present. So we have to create the GRID DISKs Manually.

Steps to create Celldisk, Griddisks and add them to ASM Disk Group


  • List Cell Disks

[root@dm01cel03 ~]# cellcli -e list celldisk
         CD_00_dm01cel03         normal
         CD_01_dm01cel03         normal
         CD_02_dm01cel03         normal
         CD_03_dm01cel03         normal
         CD_04_dm01cel03         normal
         CD_05_dm01cel03         not present
         CD_06_dm01cel03         normal
         CD_07_dm01cel03         normal
         CD_08_dm01cel03         normal
         CD_09_dm01cel03         normal
         CD_10_dm01cel03         normal
         CD_11_dm01cel03         normal
         FD_00_dm01cel03         normal
         FD_01_dm01cel03         normal
         FD_02_dm01cel03         normal
         FD_03_dm01cel03         normal

  • List Grid Disks

[root@dm01cel03 ~]# cellcli -e list griddisk
         DATA_CD_00_dm01cel03       active
         DATA_CD_01_dm01cel03       active
         DATA_CD_02_dm01cel03       active
         DATA_CD_03_dm01cel03       active
         DATA_CD_04_dm01cel03       active
         DATA_CD_05_dm01cel03       not present
         DATA_CD_06_dm01cel03       active
         DATA_CD_07_dm01cel03       active
         DATA_CD_08_dm01cel03       active
         DATA_CD_09_dm01cel03       active
         DATA_CD_10_dm01cel03       active
         DATA_CD_11_dm01cel03       active
         DBFS_DG_CD_02_dm01cel03    active
         DBFS_DG_CD_03_dm01cel03    active
         DBFS_DG_CD_04_dm01cel03    active
         DBFS_DG_CD_05_dm01cel03    not present
         DBFS_DG_CD_06_dm01cel03    active
         DBFS_DG_CD_07_dm01cel03    active
         DBFS_DG_CD_08_dm01cel03    active
         DBFS_DG_CD_09_dm01cel03    active
         DBFS_DG_CD_10_dm01cel03    active
         DBFS_DG_CD_11_dm01cel03    active
         RECO_CD_00_dm01cel03       active
         RECO_CD_01_dm01cel03       active
         RECO_CD_02_dm01cel03       active
         RECO_CD_03_dm01cel03       active
         RECO_CD_04_dm01cel03       active
         RECO_CD_05_dm01cel03       not present
         RECO_CD_06_dm01cel03       active
         RECO_CD_07_dm01cel03       active
         RECO_CD_08_dm01cel03       active
         RECO_CD_09_dm01cel03       active
         RECO_CD_10_dm01cel03       active
         RECO_CD_11_dm01cel03       active

  • List Physical Disk details

[root@dm01cel03 ~]# cellcli -e list physicaldisk where physicalSerial=PPZ47V detail
         name:                   8:5
         deviceId:               21
         deviceName:             /dev/sdf
         diskType:               HardDisk
         enclosureDeviceId:      8
         errOtherCount:          0
         luns:                   0_5
         makeModel:              “HGST    H7280A520SUN8.0T”
         physicalFirmware:       PD51
         physicalInsertTime:     2018-05-18T10:52:29-05:00
         physicalInterface:      sas
         physicalSerial:         PPZ47V
         physicalSize:           7.1536639072000980377197265625T
         slotNumber:             5
         status:                 normal

  • Let’s try to create the Cell Disk

[root@dm01cel03 ~]# cellcli -e create celldisk CD_09_dm01cel03 lun=0_5

CELL-02526: Pre-existing cell disk: CD_09_dm01cel03

It says the Cell Disk already exists.

  • Let’s try to create the Grid Disk. To create the Grid Disk with proper size, get the Grid Disk size from a good Cell Disk as shown below.

[root@dm01cel03 ~]# cellcli -e list griddisk where celldisk=CD_07_dm01cel03 attributes name,size,offset
         DATA_CD_07_dm01cel03       5.6953125T              32M
         DBFS_DG_CD_07_dm01cel03         33.796875G         7.1192474365234375T
         RECO_CD_07_dm01cel03       1.42388916015625T       5.6953582763671875T

  • Now create the Grid Disk

[root@dm01cel03 ~]# cellcli -e create griddisk DATA_CD_05_dm01cel03 celldisk=CD_05_dm01cel03,size=5.6953125T

CELL-02701: Cannot create grid disk on cell disk CD_05_dm01cel03 because its status is not normal.

Looks like we can’t create the Grid Disk. We will now drop the Cell Disk and recreate it.

  • Drop Cell Disk

CellCLI> drop celldisk CD_05_dm01cel03 force
CellDisk CD_05_dm01cel03 successfully dropped

  • Create Cell Disk

CellCLI> create celldisk CD_05_dm01cel03 lun=0_5
CellDisk CD_05_dm01cel03 successfully created

  • Create Grid Disks with proper sizes

CellCLI> create griddisk DATA_CD_05_dm01cel03 celldisk=CD_05_dm01cel03,size=5.6953125T
GridDisk DATA_CD_05_dm01cel03 successfully created

CellCLI> create griddisk RECO_CD_05_dm01cel03 celldisk=CD_05_dm01cel03,size=1.42388916015625T
GridDisk RECO_CD_05_dm01cel03 successfully created

CellCLI> create griddisk DBFS_DG_CD_05_dm01cel03 celldisk=CD_05_dm01cel03,size=33.796875G
GridDisk DBFS_DG_CD_05_dm01cel03 successfully created

  • List Grid Disks

CellCLI> list griddisk where celldisk=CD_05_dm01cel03 attributes name,size,offset
         DATA_CD_05_dm01cel03       5.6953125T              32M
         DBFS_DG_CD_05_dm01cel03         33.796875G              7.1192474365234375T
         RECO_CD_05_dm01cel03       1.42388916015625T       5.6953582763671875T

CellCLI> list griddisk
         DATA_CD_00_dm01cel03       active
         DATA_CD_01_dm01cel03       active
         DATA_CD_02_dm01cel03       active
         DATA_CD_03_dm01cel03       active
         DATA_CD_04_dm01cel03       active
         DATA_CD_05_dm01cel03       active
         DATA_CD_06_dm01cel03       active
         DATA_CD_07_dm01cel03       active
         DATA_CD_08_dm01cel03       active
         DATA_CD_09_dm01cel03       active
         DATA_CD_10_dm01cel03       active
         DATA_CD_11_dm01cel03       active
         DBFS_DG_CD_02_dm01cel03    active
         DBFS_DG_CD_03_dm01cel03    active
         DBFS_DG_CD_04_dm01cel03    active
         DBFS_DG_CD_05_dm01cel03    active
         DBFS_DG_CD_06_dm01cel03    active
         DBFS_DG_CD_07_dm01cel03    active
         DBFS_DG_CD_08_dm01cel03    active
         DBFS_DG_CD_09_dm01cel03    active
         DBFS_DG_CD_10_dm01cel03    active
         DBFS_DG_CD_11_dm01cel03    active
         RECO_CD_00_dm01cel03       active
         RECO_CD_01_dm01cel03       active
         RECO_CD_02_dm01cel03       active
         RECO_CD_03_dm01cel03       active
         RECO_CD_04_dm01cel03       active
         RECO_CD_05_dm01cel03       active
         RECO_CD_06_dm01cel03       active
         RECO_CD_07_dm01cel03       active
         RECO_CD_08_dm01cel03       active
         RECO_CD_09_dm01cel03       active
         RECO_CD_10_dm01cel03       active
         RECO_CD_11_dm01cel03       active

The Grid Disks show active now. We can go ahead and add them to ASM disk Group Manually by connecting to ASM instance.


  • Log into +ASM1 instance and add the new disk.  Set the rebalance power higher (11) to perform faster rebalance operation.

dm01db01-orcldb1 {/home/oracle}:. oraenv
ORACLE_SID = [orcldb1] ? +ASM1
The Oracle base remains unchanged with value /u01/app/oracle
dm01db01-+ASM1 {/home/oracle}:sqlplus / as sysasm

SQL*Plus: Release 11.2.0.4.0 Production on Wed May 23 09:30:13 2018
Copyright (c) 1982, 2013, Oracle.  All rights reserved.

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 – 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> alter diskgroup DATA add failgroup dm01CEL03 disk ‘o/192.168.10.1;192.168.10.2/DATA_CD_05_dm01cel03’ name DATA_CD_05_dm01cel03 rebalance power 11;

Diskgroup altered.

SQL> alter diskgroup RECO add failgroup dm01CEL03 disk ‘o/192.168.10.1;192.168.10.2/RECO_CD_05_dm01cel03’ name RECO_CD_05_dm01cel03 rebalance power 11;

Diskgroup altered.

SQL> alter diskgroup DBFS_DG add failgroup dm01CEL03 disk ‘o/192.168.10.1;192.168.10.2/DBFS_DG_CD_05_dm01cel03’ name DBFS_DG_CD_05_dm01cel03 rebalance power 11;

Diskgroup altered.

SQL> select a.name,a.total_mb,a.free_mb,a.type,
    decode(a.type,’NORMAL’,a.total_mb/2,’HIGH’,a.total_mb/3) avail_mb,
    decode(a.type,’NORMAL’,a.free_mb/2,’HIGH’,a.free_mb/3) usable_mb,
    count(b.path) cell_disks  from v$asm_diskgroup a, v$asm_disk b
    where a.group_number=b.group_number group by a.name,a.total_mb,a.free_mb,a.type,
    decode(a.type,’NORMAL’,a.total_mb/2,’HIGH’,a.total_mb/3) ,
    decode(a.type,’NORMAL’,a.free_mb/2,’HIGH’,a.free_mb/3)
   order by 2,1;

               Total MB    Free MB          Total MB    Free MB
Disk Group          Raw        Raw TYPE       Usable     Usable     CELL_DISKS
———— ———- ———- —— ———- ———- ———-
DBFS_DG    2076480    2074688 NORMAL    1038240    1037344         60
RECO     107500032   57573496 HIGH     35833344   19191165         72
DATA     429981696  282905064 HIGH    143327232   94301688         72

SQL> select * from v$asm_operation;

GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE EST_MINUTES ERROR_CODE
———— —– —- ———- ———- ———- ———- ———- ———– ——————————————–
           1 REBAL RUN          11         11      85992    6697959      11260         587
           3 REBAL WAIT         11


SQL> select * from gv$asm_operation;

no rows selected


Conclusion

In this article we have learned how to create the Celldisk, Griddisks and add the newly created Griddisks to ASM Disk Group. When a hard disk is replaced, the lun, celldisk and griddisks are created automatically and griddisks are added to ASM disk group for you without any manual intervention. In some cases, if the Celldisk and grid disks are not created automatically, then you must manually create them and add them to the ASM disk group.

1


Overview

Oracle ASM disk groups are built on a set of Exadata grid disks. Exadata uses ASM disk groups store database files. 


ASM Provides 3 Types of Redundancy:

External: ASM doesn’t provide redundancy. External redundancy is not an option on Exadata. You must either use normal or high redundancy.

Normal: It provides two-way data mirroring. It maintains two copies of data blocks in separate failure groups

High: It provides three-way data mirroring. It maintains three copies of data blocks in separate failure groups


In this article I will demonstrate how to created ASM Disk Groups on Exadata database machine using ASMCA.

Environment

Exadata Database machine X2-2
8 Compute nodes, 14 Storage cells and 2 IB Switch

Steps to create ASM disk Group using ASMCA utility.


Set the environment variable to Grid Home and start asmca


dm01db01-orcldb1 {/home/oracle}:. oraenv

ORACLE_SID = [orcldb1] ? +ASM1

The Oracle base has been changed from /u01/app/oracle to /u01/app/grid

dm01db01-+ASM1 {/home/oracle}:which asmca
/u01/app/12.2.0.1/grid/bin/asmca

dm01db01-+ASM1 {/home/oracle}:asmca

1. Create ASM Disk Group using Normal Redundancy (3 failure groups)

First we will create an ASM disk group using Normal Redundancy using 3 storage cells.

ASMCA starting

Click on ASM Instances on left pane

Here we are running Flex ASM and current ASM instance is running on Nodes 1, 2 and 4

Click on Disk Groups. We can see currently there 2 disk groups one for OCR/Voting disks and another one for MGMT database repository. To create a new disk group click on “Create” button.

Click on “Change Disk Discovery Path”

Enter the following path to discover the grid disks.

Select desired grid disks to create ASM Disk Group. 
Here I am creating DATA disk group by selecting DATA grid disks from 3 storage cells

Click on “Show Advanced Options” and select the ASM/Database/ADVM compatibility. Finally click Ok to create DATA disk group

DATA disk group creation in progress

We can now see that the DATA disk group is created

Let’s verify the newly created DATA disk group. Right click on the DATA disk group and select “view status details”

We can see that the DATA disk group is mounted on node 1, 2 and 4

2. Creaet ASM Disk Group Using High Redundancy (5 failure groups)


Now let’s create another ASM disk group using High Redundancy using grid disks from 5 storage cells.

Click Create button to create new ASM disk group


Enter the Disk Group name, select the desired grid disks and ASM/Database/ADVM attributes and click ok

DATA1 disk group creation is in process

We can see that DATA1 disk group created



3. Add disks to ASM Disk Group (add grid disks from one storage cell)

Now let’s Add disks to DATA1 disk group. I am going to add DATA grid disks from a storage to DATA1.


Right click on the DATA1 disk group and select Add Disks


Select the desired grid disks from storage cell and click ok

Disks are being added to DATA1

We can see the size of DATA1 disk group has increased


 4. Drop disks from ASM Disk Group (remove grid disks from one storage cell)



This time let’s Drop disks from DATA1 disk group. I am going to remove DATA grid disks from a storage used by DATA1.


Right click on DATA1 disk group and select Drop Disks

Process started

Select the desired Grid disks to be dropped from DATA1 disk group and click ok

Disks are being dropped from DATA1

We can see that the DATA1 disk group size is dropped




Conclusion:


In this article we have learned different ASM disk group redundancy levels and how to create ASM disk group on Exadata using a set of Exadata grid disks. We have created different ASM disk group using different redundancy levels and performed few disk operations like adding and dropping.

1

Overview
In Oracle database 11.2 and above it is recommended to place the OCR and voting disks in ASM disk group. In my case the OCR, Voting disk and SPFILE are stored in +DBFS_DG disk group. I would like to move them to +DATA disk group. The ASM disk groups are configured using ASM Normal redundancy for protection.

In this article I will demonstrate how move/replace OCR, Voting disk and SPFILE from one disk group to another ASM disk group.

Environment

  • Oracle Exadata X2-2
  • ASM Disk Groups +DATA, +RECO, +DBFS_DG
  • Oracle GI/RDBMS version 11.2.0.4

Steps to move/replacec OCR/Voting disk/SPFILE to new disk group.

  • Locate the current OCR, Voting disk  and SPFILE locations

OCR file location:

[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       4808
         Available space (kbytes) :     257312
         ID                       : 1556021409
         Device/File Name         :   +DBFS_DG
                                    Device/File integrity check succeeded

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

         Cluster registry integrity check succeeded

         Logical corruption check succeeded

Voting Disk location:

dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
—  —–    —————–                ——— ———
 1. ONLINE   8f84a639c9ac4fbabf581bb6972f3f8f (o/192.168.1.9/DBFS_DG_CD_02_dm01cel01) [DBFS_DG]
 2. ONLINE   3b079cf1cba24f42bfda7a8b18f0e22f (o/192.168.1.10/DBFS_DG_CD_02_dm01cel02) [DBFS_DG]
 3. ONLINE   ad837de087dd4f6bbf72800ecd028573 (o/192.168.1.11/DBFS_DG_CD_07_dm01cel03) [DBFS_DG]

ASM SPFILE location:

SQL> show parameter spfile

NAME                                 TYPE        VALUE
———————————— ———– ——————————
spfile                               string      +DBFS_DG/dm01-cluster/asmparameterfile/registry.253.790181847

  • Create New ASM diskgroup with suitable redundancy for OCR and Voting files.

Here I am moving OCR/Voting disks from +DBFS_DG to +DATA with NORMAL redundancy
The disk group +DATA already exists.

  • Ensure that the new diskgroup is mounted on all cluster nodes.

ASMCMD> lsdg
State    Type    Rebal  Sector  Block       AU  Total_MB   Free_MB  Req_mir_free_MB  Usable_file_MB  
Offline_disks  Voting_files  Name
MOUNTED  NORMAL  N         512   4096  4194304  71470080  58440508           433152        29003678              
0             N  DATA/
MOUNTED  NORMAL  N         512   4096  4194304   4085888   4068444            29824         2019310              
0             Y  DBFS_DG/
MOUNTED  NORMAL  N         512   4096  4194304   9460160   7874420           108224         3883098              
0             N  RECO/

SQL> select name, state, type from v$asm_diskgroup;

NAME                           STATE       TYPE
—————————— ———– ——
DATA                           MOUNTED     NORMAL
DBFS_DG                        MOUNTED     NORMAL
RECO                           MOUNTED     NORMAL

  • Move OCR and Vote file from +DBFS_DG to +DATA

dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/ocrconfig -add +DATA
PROT-20: Insufficient permission to proceed. Require privileged user

Switch to root user and execute the command again.

[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrconfig -add +DATA

[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       4808
         Available space (kbytes) :     257312
         ID                       : 1556021409
         Device/File Name         :   +DBFS_DG
                                    Device/File integrity check succeeded
         Device/File Name         : +DATA
                                    Device/File integrity check succeeded

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

         Cluster registry integrity check succeeded

         Logical corruption check succeeded

[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrconfig -delete +DBFS_DG

[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       4808
         Available space (kbytes) :     257312
         ID                       : 1556021409
         Device/File Name         : +DATA
                                    Device/File integrity check succeeded

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

         Cluster registry integrity check succeeded

         Logical corruption check succeeded

[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/crsctl replace votedisk +DATA
Successful addition of voting disk 560494cd61f64fd3bfeca18aa876e5bc.
Successful addition of voting disk 15b8c8b5b80c4f7cbf3eadd516af60bc.
Successful addition of voting disk 7cff6119f09b4f99bfd0d6a1fd399a00.
Successful deletion of voting disk 8f84a639c9ac4fbabf581bb6972f3f8f.
Successful deletion of voting disk 3b079cf1cba24f42bfda7a8b18f0e22f.
Successful deletion of voting disk ad837de087dd4f6bbf72800ecd028573.
Successfully replaced voting disk group with +DATA.
CRS-4266: Voting file(s) successfully replaced

[root@dm01db01 ~]# /u01/app/11.2.0.4/grid/bin/crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
—  —–    —————–                ——— ———
 1. ONLINE   560494cd61f64fd3bfeca18aa876e5bc (o/192.168.3.10/DATA_CD_00_dm01cel02) [DATA]
 2. ONLINE   15b8c8b5b80c4f7cbf3eadd516af60bc (o/192.168.3.11/DATA_CD_10_dm01cel03) [DATA]
 3. ONLINE   7cff6119f09b4f99bfd0d6a1fd399a00 (o/192.168.3.12/DATA_CD_00_dm01cel04) [DATA]
Located 3 voting disk(s).

  • Change ASM SPFILE location from +DBFS_DG to +DATA Diskgroup.

SQL> show parameter spfile

NAME                                 TYPE        VALUE
———————————— ———– ——————————
spfile                               string      +DBFS_DG/dm01-cluster/asmparameterfile/registry.253.790181847

SQL> create pfile=’/tmp/initasm.ora’ from spfile;

File created.

SQL> create spfile=’+DATA’ from pfile=’/tmp/initasm.ora’;

File created.

Now GPNPTOOL will get updated with new ASM SPFILE location.

That can be verified by below command :

dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/gpnptool get
Warning: some command line parameters were defaulted. Resulting command line:
         /u01/app/11.2.0.4/grid/bin/gpnptool.bin get -o-<?xml version=”1.0″ encoding=”UTF-8″?><gpnp:GPnP-Profile Version=”1.0″ xmlns=”http://www.grid-pnp.org/2005/11/gpnp-profile” xmlns:gpnp=”http://www.grid-pnp.org/2005/11/gpnp-profile”xmlns:orcl=”http://www.oracle.com/gpnp/2005/11/gpnp-profile” xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance” xsi:schemaLocation=”http://www.grid-pnp.org/2005/11/gpnp-profile gpnp-profile.xsd” ProfileSequence=”5″ 
ClusterUId=”154e3eadf63effb1bf594bae93566a45″ ClusterName=”dm01-cluster” PALocation=””><gpnp:Network-Profile><gpnp:HostNetwork id=”gen” HostName=”*”><gpnp:Network id=”net1″ IP=”10.204.26.1″ Adapter=”bondeth0″ Use=”public”/><gpnp:Network id=”net2″ IP=”192.168.0.0″ Adapter=”bondib0″ Use=”cluster_interconnect”/></gpnp:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profile id=”css” DiscoveryString=”+asm” LeaseDuration=”400″/><orcl:ASM-Profile id=”asm” DiscoveryString=”o/*/*” SPFile=”+DATA/dm01-cluster/asmparameterfile/registry.253.934093287″/><ds:Signature xmlns:ds=”http://www.w3.org/2000/09/xmldsig#”><ds:SignedInfo><ds:CanonicalizationMethod 
Algorithm=”http://www.w3.org/2001/10/xml-exc-c14n#”/><ds:SignatureMethod Algorithm=”http://www.w3.org/2000/09/xmldsig#rsa-sha1″/><ds:Reference URI=””><ds:Transforms><ds:Transform Algorithm=”http://www.w3.org/2000/09/xmldsig#enveloped-signature”/><ds:Transform Algorithm=”http://www.w3.org/2001/10/xml-exc-c14n#”> <InclusiveNamespaces xmlns=”http://www.w3.org/2001/10/xml-exc-c14n#” PrefixList=”gpnp orcl xsi”/></ds:Transform></ds:Transforms><ds:DigestMethod Algorithm=”http://www.w3.org/2000/09/xmldsig#sha1″/>ds:DigestValue>SEdtgDVCAmvafpr2sb2YbZh0NvE=</ds:DigestValue></ds:Reference></ds:SignedInfo> ds:SignatureValue>AcWa+ZnR6F+qAoCAy3uqZPSdxPbYnXpMbaTozjfeQb0HEtQsK7nT3r
+jO8AZkFUXqvSZa77D9d18/mYPXiPdQKJndpr+4cIM1Yg8K+fSC4HgD8hUgh5vl7YYJ2T9YoYVyfSbX6EQFOKZMKHM5IGZk0d8ls+4AD/1OO+LhijtEM4=</ds:SignatureValue></ds:Signature></gpnp:GPnP-Profile>
Success.

  • Shutdown and Start the CRS on all the nodes

[root@dm01db01 ~]# dcli -g dbs_group -l root ‘/u01/app/11.2.0.4/grid/bin/crsctl stop crs’
dm01db01: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db01’
dm01db01: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.dm01db01.vip’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ttsrv_dm01db01’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ttsrv_dm01db01’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ttrmi_dm01db01’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.dm01db01-ibvip.vip’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ttrmi_dm01db01’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.dm01db01.vip’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.dm01db01-ibvip.vip’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db01’ succeeded
dm01db01: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db01’
dm01db01: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db01’ succeeded
dm01db01: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db01’ has completed
dm01db01: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db01’
dm01db01: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db01’ succeeded
dm01db01: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db01’
dm01db01: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db01’ succeeded
dm01db01: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db01’ has completed
dm01db01: CRS-4133: Oracle High Availability Services has been stopped.
dm01db02: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db02’
dm01db02: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ttsrv_dm01db02’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.LISTENER_SCAN1.lsnr’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ttsrv_dm01db02’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ttrmi_dm01db02’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ttrmi_dm01db02’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.dm01db02-ibvip.vip’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.dm01db02.vip’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.LISTENER_SCAN1.lsnr’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.scan1.vip’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.dm01db02.vip’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.scan1.vip’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.dm01db02-ibvip.vip’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db02’ succeeded
dm01db02: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db02’
dm01db02: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db02’ succeeded
dm01db02: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db02’ has completed
dm01db02: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db02’
dm01db02: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db02’ succeeded
dm01db02: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db02’
dm01db02: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db02’ succeeded
dm01db02: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db02’ has completed
dm01db02: CRS-4133: Oracle High Availability Services has been stopped.
dm01db03: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db03’
dm01db03: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ttrmi_dm01db03’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ttrmi_dm01db03’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.dm01db03.vip’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.dm01db03-ibvip.vip’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.dm01db03-ibvip.vip’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.dm01db03.vip’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db03’ succeeded
dm01db03: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db03’
dm01db03: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db03’ succeeded
dm01db03: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db03’ has completed
dm01db03: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db03’
dm01db03: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db03’ succeeded
dm01db03: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db03’
dm01db03: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db03’ succeeded
dm01db03: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db03’ has completed
dm01db03: CRS-4133: Oracle High Availability Services has been stopped.
dm01db04: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db04’
dm01db04: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ttrmi_dm01db04’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.dm01db04-ibvip.vip’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ttrmi_dm01db04’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.dm01db04-ibvip.vip’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.dm01db04.vip’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.dm01db07-ibvip.vip’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.dm01db04.vip’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.dm01db07-ibvip.vip’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db04’ succeeded
dm01db04: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db04’
dm01db04: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db04’ succeeded
dm01db04: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db04’ has completed
dm01db04: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db04’
dm01db04: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db04’
dm01db04: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db04’ succeeded
dm01db04: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db04’ succeeded
dm01db04: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db04’ has completed
dm01db04: CRS-4133: Oracle High Availability Services has been stopped.
dm01db05: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db05’
dm01db05: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.cvu’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ttrmi_dm01db05’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.LISTENER_SCAN3.lsnr’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ttrmi_dm01db05’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.cvu’ on ‘dm01db05’ succeeded
dm01db05: CRS-2672: Attempting to start ‘ora.cvu’ on ‘dm01db08’
dm01db05: CRS-2677: Stop of ‘ora.LISTENER_SCAN3.lsnr’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.scan3.vip’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.dm01db05-ibvip.vip’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.dm01db05.vip’ on ‘dm01db05’
dm01db05: CRS-2676: Start of ‘ora.cvu’ on ‘dm01db08’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.scan3.vip’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.dm01db05-ibvip.vip’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.dm01db05.vip’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db05’ succeeded
dm01db05: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db05’
dm01db05: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db05’ succeeded
dm01db05: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db05’ has completed
dm01db05: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db05’
dm01db05: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db05’
dm01db05: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db05’ succeeded
dm01db05: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db05’ succeeded
dm01db05: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db05’ has completed
dm01db05: CRS-4133: Oracle High Availability Services has been stopped.
dm01db06: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db06’
dm01db06: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ttrmi_dm01db06’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ttrmi_dm01db06’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.dm01db06-ibvip.vip’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.dm01db06.vip’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.dm01db06.vip’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.dm01db06-ibvip.vip’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db06’ succeeded
dm01db06: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db06’
dm01db06: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db06’ succeeded
dm01db06: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db06’ has completed
dm01db06: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db06’
dm01db06: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db06’ succeeded
dm01db06: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db06’
dm01db06: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db06’ succeeded
dm01db06: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db06’ has completed
dm01db06: CRS-4133: Oracle High Availability Services has been stopped.
dm01db08: CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db08’
dm01db08: CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.dm01db08.vip’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ttrmi_dm01db08’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.LISTENER_IB.lsnr’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.oc4j’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.DATA_dm01.dg’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.DBFS_DG.dg’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.RECO_dm01.dg’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.registry.acfs’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.LISTENER_SCAN2.lsnr’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ttrmi_dm01db08’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.dm01db08.vip’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.RECO_dm01.dg’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.LISTENER_IB.lsnr’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.dm01db08-ibvip.vip’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.LISTENER_SCAN2.lsnr’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.scan2.vip’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.dm01db07.vip’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.cvu’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.cvu’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.dm01db08-ibvip.vip’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.dm01db07.vip’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.registry.acfs’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.scan2.vip’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.oc4j’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.DATA_dm01.dg’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.DBFS_DG.dg’ on ‘dm01db08’ succeeded
dm01db08: CRS-2679: Attempting to clean ‘ora.DBFS_DG.dg’ on ‘dm01db08’
dm01db08: CRS-2681: Clean of ‘ora.DBFS_DG.dg’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.net2.network’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.net2.network’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.ons’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db08’ succeeded
dm01db08: CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db08’ has completed
dm01db08: CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.mdnsd’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.drivers.acfs’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.mdnsd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.asm’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.drivers.acfs’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db08’
dm01db08: CRS-2673: Attempting to stop ‘ora.crf’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.crf’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.gipcd’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db08’ succeeded
dm01db08: CRS-2677: Stop of ‘ora.gipcd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2673: Attempting to stop ‘ora.gpnpd’ on ‘dm01db08’
dm01db08: CRS-2677: Stop of ‘ora.gpnpd’ on ‘dm01db08’ succeeded
dm01db08: CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘dm01db08’ has completed
dm01db08: CRS-4133: Oracle High Availability Services has been stopped.

[root@dm01db01 ~]# dcli -g dbs_group -l root ‘/u01/app/11.2.0.4/grid/bin/crsctl start crs’
dm01db01: CRS-4123: Oracle High Availability Services has been started.
dm01db02: CRS-4123: Oracle High Availability Services has been started.
dm01db03: CRS-4123: Oracle High Availability Services has been started.
dm01db04: CRS-4123: Oracle High Availability Services has been started.
dm01db05: CRS-4123: Oracle High Availability Services has been started.
dm01db06: CRS-4123: Oracle High Availability Services has been started.
dm01db08: CRS-4123: Oracle High Availability Services has been started.

  • Ensure ALL Cluster resources are started successfully using below sample commands :

dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/crsctl stat res -init -t
——————————————————————————–
NAME           TARGET  STATE        SERVER                   STATE_DETAILS
——————————————————————————–
Cluster Resources
——————————————————————————–
ora.asm
      1        ONLINE  ONLINE       dm01db01                 Started
ora.cluster_interconnect.haip
      1        ONLINE  ONLINE       dm01db01
ora.crf
      1        ONLINE  ONLINE       dm01db01
ora.crsd
      1        ONLINE  ONLINE       dm01db01
ora.cssd
      1        ONLINE  ONLINE       dm01db01
ora.cssdmonitor
      1        ONLINE  ONLINE       dm01db01
ora.ctssd
      1        ONLINE  ONLINE       dm01db01                 OBSERVER
ora.diskmon
      1        ONLINE  ONLINE       dm01db01
ora.drivers.acfs
      1        ONLINE  ONLINE       dm01db01
ora.evmd
      1        ONLINE  ONLINE       dm01db01
ora.gipcd
      1        ONLINE  ONLINE       dm01db01
ora.gpnpd
      1        ONLINE  ONLINE       dm01db01
ora.mdnsd
      1        ONLINE  ONLINE       dm01db01

dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/crsctl check cluster -all
**************************************************************
dm01db01:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db02:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db03:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db04:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db05:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db06:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db07:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db08:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
dm01db01-+ASM1 {/home/oracle}:

dm01db01-+ASM1 {/home/oracle}:$ORACLE_HOME/bin/crsctl stat res -t
——————————————————————————–
NAME           TARGET  STATE        SERVER                   STATE_DETAILS
——————————————————————————–
Local Resources
——————————————————————————–
ora.DATA_dm01.dg
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               ONLINE  ONLINE       dm01db07
               ONLINE  ONLINE       dm01db08
ora.DBFS_DG.dg
               ONLINE  OFFLINE      dm01db01
               ONLINE  OFFLINE      dm01db02
               ONLINE  OFFLINE      dm01db03
               ONLINE  OFFLINE      dm01db04
               ONLINE  OFFLINE      dm01db05
               ONLINE  OFFLINE      dm01db06
               ONLINE  ONLINE       dm01db07
               ONLINE  OFFLINE      dm01db08
ora.LISTENER.lsnr
               OFFLINE OFFLINE      dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               ONLINE  ONLINE       dm01db07
               ONLINE  ONLINE       dm01db08
ora.LISTENER_IB.lsnr
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               ONLINE  ONLINE       dm01db07
               ONLINE  ONLINE       dm01db08
ora.RECO_dm01.dg
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               ONLINE  ONLINE       dm01db07
               ONLINE  ONLINE       dm01db08
ora.asm
               ONLINE  ONLINE       dm01db01                 Started
               ONLINE  ONLINE       dm01db02                 Started
               ONLINE  ONLINE       dm01db03                 Started
               ONLINE  ONLINE       dm01db04                 Started
               ONLINE  ONLINE       dm01db05                 Started
               ONLINE  ONLINE       dm01db06                 Started
               ONLINE  ONLINE       dm01db07                Started
               ONLINE  ONLINE       dm01db08                 Started
ora.gsd
               OFFLINE OFFLINE      dm01db01
               OFFLINE OFFLINE      dm01db02
               OFFLINE OFFLINE      dm01db03
               OFFLINE OFFLINE      dm01db04
               OFFLINE OFFLINE      dm01db05
               OFFLINE OFFLINE      dm01db06
               OFFLINE OFFLINE      dm01db07
               OFFLINE OFFLINE      dm01db08
ora.net1.network
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               OFFLINE OFFLINE      dm01db07
               ONLINE  ONLINE       dm01db08
ora.net2.network
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               OFFLINE OFFLINE      dm01db07
               ONLINE  ONLINE       dm01db08
ora.ons
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               OFFLINE OFFLINE      dm01db07
               ONLINE  ONLINE       dm01db08
ora.registry.acfs
               ONLINE  ONLINE       dm01db01
               ONLINE  ONLINE       dm01db02
               ONLINE  ONLINE       dm01db03
               ONLINE  ONLINE       dm01db04
               ONLINE  ONLINE       dm01db05
               ONLINE  ONLINE       dm01db06
               OFFLINE OFFLINE      dm01db07
               ONLINE  ONLINE       dm01db08
——————————————————————————–
Cluster Resources
——————————————————————————–
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       dm01db08
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       dm01db06
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       dm01db05
ora.dm01db01-ibvip.vip
      1        ONLINE  ONLINE       dm01db01
ora.dm01db01.vip
      1        ONLINE  ONLINE       dm01db01
ora.dm01db02-ibvip.vip
      1        ONLINE  ONLINE       dm01db02
ora.dm01db02.vip
      1        ONLINE  ONLINE       dm01db02
ora.dm01db03-ibvip.vip
      1        ONLINE  ONLINE       dm01db03
ora.dm01db03.vip
      1        ONLINE  ONLINE       dm01db03
ora.dm01db04-ibvip.vip
      1        ONLINE  ONLINE       dm01db04
ora.dm01db04.vip
      1        ONLINE  ONLINE       dm01db04
ora.dm01db05-ibvip.vip
      1        ONLINE  ONLINE       dm01db05
ora.dm01db05.vip
      1        ONLINE  ONLINE       dm01db05
ora.dm01db06-ibvip.vip
      1        ONLINE  ONLINE       dm01db06
ora.dm01db06.vip
      1        ONLINE  ONLINE       dm01db06
ora.dm01db08-ibvip.vip
      1        ONLINE  ONLINE       dm01db08
ora.dm01db08.vip
      1        ONLINE  ONLINE       dm01db08
ora.cvu
      1        ONLINE  ONLINE       dm01db03
ora.oc4j
      1        ONLINE  ONLINE       dm01db03
ora.scan1.vip
      1        ONLINE  ONLINE       dm01db08
ora.scan2.vip
      1        ONLINE  ONLINE       dm01db06
ora.scan3.vip
      1        ONLINE  ONLINE       dm01db05

SQL> show parameter spfile

NAME                                 TYPE        VALUE
———————————— ———– ——————————
spfile                               string      +DATA/dm01-cluster/asmpar
                                                 ameterfile/registry.253.934093
                                                 287

Conclusion
In this article we have learned how to move/replace OCR, Voting disks and ASM SPFILE from one ASM disk group to another.

0