Netsoftmate

Tag: Exadata Cell

  • Rename Oracle ASM Disk Group On Exadata

    When Oracle ACS build Exadata Database Machine, they use the OEDA file that you sent them over for Exadata Install. The Exadata is built with default ASM Disk Group name DATAC1, RECOC1 & DBFS_DG. If you want to rename the DATAC1 and RECOC1 to something different to match your Organization standards you can do that by using the Oracle renamedg utility. The number Database version required to rename an ASM Disk Group is 11.2.


    In this article we will demonstrate how to rename ASM Disk Group on Exadata Database Machine running Oracle Database 11.2


    Here we want to change the following ASM Disk Group Names:
    DATAC1 to DATA
    RECOC1 to RECO


    Steps to rename ASM Disk Group


    • Get the Database version

    ORACLE_SID = [+ASM1] ? dbm011
    The Oracle base remains unchanged with value /u01/app/oracle


    [oracle@dm01db01 ~]$ sqlplus / as sysdba


    SQL*Plus: Release 11.2.0.4.0 Production on Thu May 24 16:36:34 2018
    Copyright (c) 1982, 2013, Oracle.  All rights reserved.


    Connected to:
    Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 – 64bit Production
    With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
    Data Mining and Real Application Testing options


    SQL> select * from v$version;


    BANNER
    ——————————————————————————–
    Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 – 64bit Production
    PL/SQL Release 11.2.0.4.0 – Production
    CORE    11.2.0.4.0      Production
    TNS for Linux: Version 11.2.0.4.0 – Production
    NLSRTL Version 11.2.0.4.0 – Production

    • Connect to asmcmd and make a note of the Disk Group Names

    [oracle@dm01db01 ~]$ . oraenv


    ORACLE_SID = [oracle] ? +ASM1
    The Oracle base has been set to /u01/app/oracle


    [oracle@dm01db01 ~]$ asmcmd -p


    ASMCMD [+] > lsdg
    State    Type    Rebal  Sector  Block       AU   Total_MB    Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
    MOUNTED  HIGH    N         512   4096  4194304  272154624  271558968          6479872        88359698              0             N  DATAC1/
    MOUNTED  HIGH    N         512   4096  4194304    2404640    2402468            68704          777921              0             Y  DBFS_DG/
    MOUNTED  NORMAL  N         512   4096  4194304   45389568   45386648           540352        22423148              0             N  RECOC1/

    • Check the versions

    ASMCMD [+] > lsct
    DB_Name  Status     Software_Version  Compatible_version  Instance_Name  Disk_Group
    +ASM     CONNECTED        11.2.0.4.0          11.2.0.4.0  +ASM1          DBFS_DG
    DBM01    CONNECTED        11.2.0.4.0          11.2.0.4.0  dbm011         DATAC1

    • Check the database status

    [oracle@dm01db01 ~]$ srvctl status database -d dbm01
    Instance dbm011 is running on node dm01db01
    Instance dbm012 is running on node dm01db02
    Instance dbm013 is running on node dm01db03
    Instance dbm014 is running on node dm01db04

    • Make a note of the control files, Datafiles, Redo logfiles before stopping the database.

    SQL> select name from v$controlfile;
    SQL> select name from v$datafile;
    SQL> select member from v$logfile;
    SQL> select * from v$block_change_tracking;

    • Stop database database

    [oracle@dm01db01 ~]$ srvctl stop database -d dbm01


    [oracle@dm01db01 ~]$ srvctl status database -d dbm01
    Instance dbm011 is not running on node dm01db01
    Instance dbm012 is not running on node dm01db02
    Instance dbm013 is not running on node dm01db03
    Instance dbm014 is not running on node dm01db04

    • Umount the ASM disk group(s) that you want to rename. Connect to ASM command prompt and umount the disk group. umount the disk group from all nodes.

    ASMCMD [+] > umount DATAC1


    ASMCMD [+] > umount RECOC1


    ASMCMD [+] > lsdg
    State    Type  Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
    MOUNTED  HIGH  N         512   4096  4194304   2404640  2402468            68704          777921              0             Y  DBFS_DG/


    Note: If you don’t stop the databases using ASM disk group you will get the following error message:


    ASMCMD [+] > umount DATAC1
    ORA-15032: not all alterations performed
    ORA-15027: active use of diskgroup “DATAC1” precludes its dismount (DBD ERROR: OCIStmtExecute)


    *** Repeat the above steps on all the remaining nodes in the Cluster***


    [oracle@dm01db01 ~]$ ssh dm01db02
    Last login: Thu May 17 15:23:31 2018 from dm01db01


    [oracle@dm01db02 ~]$ . oraenv
    ORACLE_SID = [oracle] ? +ASM2
    The Oracle base has been set to /u01/app/oracle


    [oracle@dm01db02 ~]$ asmcmd lsdg
    State    Type    Rebal  Sector  Block       AU   Total_MB    Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
    MOUNTED  HIGH    N         512   4096  4194304  272154624  271558968          6479872        88359698              0             N  DATAC1/
    MOUNTED  HIGH    N         512   4096  4194304    2404640    2402468            68704          777921              0             Y  DBFS_DG/
    MOUNTED  NORMAL  N         512   4096  4194304   45389568   45385040           540352        22422344              0             N  RECOC1/


    [oracle@dm01db02 ~]$ asmcmd umount DATAC1


    [oracle@dm01db02 ~]$ asmcmd umount RECOC1


    [oracle@dm01db02 ~]$ asmcmd lsdg
    State    Type  Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
    MOUNTED  HIGH  N         512   4096  4194304   2404640  2402468            68704          777921              0             Y  DBFS_DG/


    [oracle@dm01db01 ~]$ ssh dm01db03
    Last login: Thu May 17 15:23:31 2018 from dm01db01


    [oracle@dm01db03 ~]$ . oraenv
    ORACLE_SID = [oracle] ? +ASM3
    The Oracle base has been set to /u01/app/oracle


    [oracle@dm01db03 ~]$ asmcmd umount DATAC1


    [oracle@dm01db03 ~]$ asmcmd umount RECOC1


    [oracle@dm01db03 ~]$ asmcmd lsdg
    State    Type  Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
    MOUNTED  HIGH  N         512   4096  4194304   2404640  2402468            68704          777921              0             Y  DBFS_DG/


    [oracle@dm01db01 ~]$ ssh dm01db04
    Last login: Thu May 17 15:23:31 2018 from dm01db01


    [oracle@dm01db04 ~]$ . oraenv
    ORACLE_SID = [oracle] ? +ASM4
    The Oracle base has been set to /u01/app/oracle


    [oracle@dm01db04 ~]$ asmcmd umount DATAC1


    [oracle@dm01db04 ~]$ asmcmd umount RECOC1


    [oracle@dm01db04 ~]$ asmcmd lsdg
    State    Type  Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
    MOUNTED  HIGH  N         512   4096  4194304   2404640  2402468            68704          777921              0             Y  DBFS_DG/

    • Verify that renamedg is in PATH

    [oracle@dm01db01 ~]$ which renamedg
    /u01/app/11.2.0.4/grid/bin/renamedg

    • As owner of the Grid Infrastruture software execute the renamdg command. Here the owner of GI home is ‘oracle’ user. First I am renaming DATAC1 disk group to DATA

    [oracle@dm01db01 ~]$ renamedg phase=both dgname=DATAC1 newdgname=DATA verbose=true


    NOTE: No asm libraries found in the system
    Parsing parameters..
    Parameters in effect:


             Old DG name       : DATAC1
             New DG name       : DATA
             Phases            :
                     Phase 1
                     Phase 2
             Discovery str      : (null)
             Clean              : TRUE
             Raw only           : TRUE
    renamedg operation: phase=both dgname=DATAC1 newdgname=DATA verbose=true
    Executing phase 1
    Discovering the group
    Performing discovery with string:
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_02_dm01cel01 with disk number:74 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_11_dm01cel01 with disk number:83 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_07_dm01cel01 with disk number:79 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_04_dm01cel01 with disk number:76 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_05_dm01cel01 with disk number:77 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_10_dm01cel01 with disk number:82 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_06_dm01cel01 with disk number:78 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_03_dm01cel01 with disk number:75 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_00_dm01cel01 with disk number:72 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_08_dm01cel01 with disk number:80 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_01_dm01cel01 with disk number:73 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_09_dm01cel01 with disk number:81 and timestamp (33068591 612262912)
    …
    …
    …
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_09_dm01cel07 with disk number:69 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_03_dm01cel07 with disk number:63 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_06_dm01cel07 with disk number:66 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_08_dm01cel07 with disk number:68 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_04_dm01cel07 with disk number:64 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_07_dm01cel07 with disk number:67 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_01_dm01cel07 with disk number:61 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_05_dm01cel07 with disk number:65 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_02_dm01cel07 with disk number:62 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_00_dm01cel07 with disk number:60 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_11_dm01cel07 with disk number:71 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_10_dm01cel07 with disk number:70 and timestamp (33068591 612262912)
    Checking for hearbeat…
    Re-discovering the group
    Performing discovery with string:
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_02_dm01cel01 with disk number:74 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_11_dm01cel01 with disk number:83 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_07_dm01cel01 with disk number:79 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_04_dm01cel01 with disk number:76 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_05_dm01cel01 with disk number:77 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_10_dm01cel01 with disk number:82 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_06_dm01cel01 with disk number:78 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_03_dm01cel01 with disk number:75 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_00_dm01cel01 with disk number:72 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_08_dm01cel01 with disk number:80 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_01_dm01cel01 with disk number:73 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/DATAC1_CD_09_dm01cel01 with disk number:81 and timestamp (33068591 612262912)
    …
    …
    …
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_09_dm01cel07 with disk number:69 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_03_dm01cel07 with disk number:63 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_06_dm01cel07 with disk number:66 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_08_dm01cel07 with disk number:68 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_04_dm01cel07 with disk number:64 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_07_dm01cel07 with disk number:67 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_01_dm01cel07 with disk number:61 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_05_dm01cel07 with disk number:65 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_02_dm01cel07 with disk number:62 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_00_dm01cel07 with disk number:60 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_11_dm01cel07 with disk number:71 and timestamp (33068591 612262912)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/DATAC1_CD_10_dm01cel07 with disk number:70 and timestamp (33068591 612262912)
    Checking if the diskgroup is mounted or used by CSS
    Checking disk number:74
    Checking disk number:83
    Checking disk number:79
    Checking disk number:76
    Checking disk number:77
    Checking disk number:82
    Checking disk number:78
    Checking disk number:75
    Checking disk number:72
    Checking disk number:80
    Checking disk number:73
    Checking disk number:81
    Checking disk number:69
    Checking disk number:63
    Checking disk number:66
    Checking disk number:68
    Checking disk number:64
    Checking disk number:67
    Checking disk number:61
    Checking disk number:65
    Checking disk number:62
    Checking disk number:60
    …
    …
    Generating configuration file..
    Completed phase 1
    Executing phase 2
    Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_02_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_11_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_07_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_04_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_05_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_10_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_06_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_03_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_00_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_08_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/DATAC1_CD_01_dm01cel01
    Modifying the header
    …
    …
    Modifying the header
    Completed phase 2
    Terminating kgfd context 0x7f9d346240a0

    • Now rename RECOC1 ASM disk group to RECO using renamdg command

    [oracle@dm01db01 ~]$ renamedg phase=both dgname=RECOC1 newdgname=RECO verbose=true


    NOTE: No asm libraries found in the system
    Parsing parameters..
    Parameters in effect:


             Old DG name       : RECOC1
             New DG name       : RECO
             Phases            :
                     Phase 1
                     Phase 2
             Discovery str      : (null)
             Clean              : TRUE
             Raw only           : TRUE
    renamedg operation: phase=both dgname=RECOC1 newdgname=RECO verbose=true
    Executing phase 1
    Discovering the group
    Performing discovery with string:
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_03_dm01cel01 with disk number:75 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_04_dm01cel01 with disk number:76 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_05_dm01cel01 with disk number:77 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_00_dm01cel01 with disk number:72 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_10_dm01cel01 with disk number:82 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_07_dm01cel01 with disk number:79 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_02_dm01cel01 with disk number:74 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_01_dm01cel01 with disk number:73 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_11_dm01cel01 with disk number:83 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_08_dm01cel01 with disk number:80 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_09_dm01cel01 with disk number:81 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_06_dm01cel01 with disk number:78 and timestamp (33068591 628813824)
    …
    …
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_01_dm01cel07 with disk number:61 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_08_dm01cel07 with disk number:68 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_06_dm01cel07 with disk number:66 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_11_dm01cel07 with disk number:71 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_10_dm01cel07 with disk number:70 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_05_dm01cel07 with disk number:65 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_00_dm01cel07 with disk number:60 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_03_dm01cel07 with disk number:63 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_09_dm01cel07 with disk number:69 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_07_dm01cel07 with disk number:67 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_02_dm01cel07 with disk number:62 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_04_dm01cel07 with disk number:64 and timestamp (33068591 628813824)
    Checking for hearbeat…
    Re-discovering the group
    Performing discovery with string:
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_03_dm01cel01 with disk number:75 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_04_dm01cel01 with disk number:76 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_05_dm01cel01 with disk number:77 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_00_dm01cel01 with disk number:72 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_10_dm01cel01 with disk number:82 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_07_dm01cel01 with disk number:79 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_02_dm01cel01 with disk number:74 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_01_dm01cel01 with disk number:73 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_11_dm01cel01 with disk number:83 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_08_dm01cel01 with disk number:80 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_09_dm01cel01 with disk number:81 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.9;192.168.10.10/RECOC1_CD_06_dm01cel01 with disk number:78 and timestamp (33068591 628813824)
    …
    …
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_01_dm01cel07 with disk number:61 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_08_dm01cel07 with disk number:68 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_06_dm01cel07 with disk number:66 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_11_dm01cel07 with disk number:71 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_10_dm01cel07 with disk number:70 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_05_dm01cel07 with disk number:65 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_00_dm01cel07 with disk number:60 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_03_dm01cel07 with disk number:63 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_09_dm01cel07 with disk number:69 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_07_dm01cel07 with disk number:67 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_02_dm01cel07 with disk number:62 and timestamp (33068591 628813824)
    Identified disk OSS::o/192.168.10.21;192.168.10.22/RECOC1_CD_04_dm01cel07 with disk number:64 and timestamp (33068591 628813824)
    …
    …
    Checking if the diskgroup is mounted or used by CSS
    Checking disk number:75
    Checking disk number:76
    Checking disk number:77
    Checking disk number:72
    Checking disk number:82
    Checking disk number:79
    Checking disk number:74
    Checking disk number:73
    Checking disk number:83
    Checking disk number:80
    Checking disk number:81
    Checking disk number:78
    Checking disk number:61
    Checking disk number:68
    Checking disk number:66
    Checking disk number:71
    Checking disk number:70
    Checking disk number:65
    Checking disk number:60
    Checking disk number:63
    Checking disk number:69
    Checking disk number:67
    Checking disk number:62
    Checking disk number:64
    Checking disk number:49
    …
    …
    Generating configuration file..
    Completed phase 1
    Executing phase 2
    Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_03_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_04_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_05_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_00_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_10_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_07_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_02_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_01_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_11_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_08_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_09_dm01cel01
    Modifying the header
    Looking for o/192.168.10.9;192.168.10.10/RECOC1_CD_06_dm01cel01
    Modifying the header
    …
    …
    Modifying the header
    Completed phase 2
    Terminating kgfd context 0x7f8d42f6c0a0

    • Mount the DATA and RECO ASM disk groups on all the nodes.

    [oracle@dm01db01 ~]$ asmcmd -p


    ASMCMD [+] > lsdg
    State    Type  Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
    MOUNTED  HIGH  N         512   4096  4194304   2404640  2402468            68704          777921              0             Y  DBFS_DG/


    ASMCMD [+] > mount DATA


    ASMCMD [+] > mount RECO


    ASMCMD [+] > lsdg
    State    Type    Rebal  Sector  Block       AU   Total_MB    Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
    MOUNTED  HIGH    N         512   4096  4194304  272154624  271558968          6479872        88359698              0             N  DATA/
    MOUNTED  HIGH    N         512   4096  4194304    2404640    2402468            68704          777921              0             Y  DBFS_DG/
    MOUNTED  NORMAL  N         512   4096  4194304   45389568   45385040           540352        22422344              0             N  RECO/


    *** Repeat the above steps on all the remaning compute nodes in the Cluster***


    Note: 

    • renamedg utility cannot rename the associated ASM/Grid disk disk name
    • renamedg utility cannot rename/update the control files, datafiles, redo log files and any other files that reference ASM DG for all databases



    Steps to rename control files, datafiles, redo log files and other database files


    • Update SPFILE location

    [oracle@dm01db01 ~]$ cd $ORACLE_HOME/dbs


    [oracle@dm01db01 dbs]$ cat initdbm011.ora
    SPFILE=’+DATAC1/dbm01/spfiledbm01.ora’


    [oracle@dm01db01 dbs]$ vi initdbm011.ora


    [oracle@dm01db01 dbs]$ cat initdbm011.ora
    SPFILE=’+DATA/dbm01/spfiledbm01.ora’


    [oracle@dm01db01 dbs]$ scp initdbm011.ora dm01db02:/u01/app/oracle/product/11.2.0.4/dbhome/dbs/initdbm012.ora
    initdbm011.ora                                                                                                                                             100%   42     0.0KB/s   00:00


    [oracle@dm01db01 dbs]$ scp initdbm011.ora dm01db03:/u01/app/oracle/product/11.2.0.4/dbhome/dbs/initdbm013.ora
    initdbm011.ora                                                                                                                                             100%   42     0.0KB/s   00:00


    [oracle@dm01db01 dbs]$ scp initdbm011.ora dm01db04:/u01/app/oracle/product/11.2.0.4/dbhome/dbs/initdbm014.ora
    initdbm011.ora                                                                                                                                             100%   42     0.0KB/s   00:00

    • Update control file location

    [oracle@dm01db01 dbs]$ . oraenv
    ORACLE_SID = [dbm011] ?
    The Oracle base remains unchanged with value /u01/app/oracle


    [oracle@dm01db01 dbs]$ sqlplus / as sysdba


    SQL*Plus: Release 11.2.0.4.0 Production on Fri May 25 10:17:49 2018
    Copyright (c) 1982, 2013, Oracle.  All rights reserved.
    Connected to an idle instance.


    SQL> startup nomount;
    ORACLE instance started.


    Total System Global Area 2.5655E+10 bytes
    Fixed Size                  2265224 bytes
    Variable Size            4160753528 bytes
    Database Buffers         2.1341E+10 bytes
    Redo Buffers              151113728 bytes


    SQL> show parameter control_files


    NAME                                 TYPE        VALUE
    ———————————— ———– ——————————
    control_files                        string      +DATAC1/dbm01/controlfile/current.256.976374731


    SQL> alter system set control_files=’+DATA/dbm01/controlfile/current.256.976374731′ scope=spfile;


    System altered.


    SQL> shutdown immediate;
    ORA-01507: database not mounted




    ORACLE instance shut down.
    SQL> startup mount
    ORACLE instance started.


    Total System Global Area 2.5655E+10 bytes
    Fixed Size                  2265224 bytes
    Variable Size            4160753528 bytes
    Database Buffers         2.1341E+10 bytes
    Redo Buffers              151113728 bytes
    Database mounted.


    SQL> select name from v$controlfile;


    NAME
    ——————————————————————————–
    +DATA/dbm01/controlfile/current.256.976374731

    • Update datafile and redo log file locations

    SQL> select name from v$datafile;


    NAME
    ——————————————————————————–
    +DATAC1/dbm01/datafile/system.259.976374739
    +DATAC1/dbm01/datafile/sysaux.260.976374743
    +DATAC1/dbm01/datafile/undotbs1.261.976374745
    +DATAC1/dbm01/datafile/undotbs2.263.976374753
    +DATAC1/dbm01/datafile/undotbs3.264.976374755
    +DATAC1/dbm01/datafile/undotbs4.265.976374757
    +DATAC1/dbm01/datafile/users.266.976374757


    7 rows selected.


    SQL> select member from v$logfile;


    MEMBER
    ——————————————————————————–
    +DATAC1/dbm01/onlinelog/group_1.257.976374733
    +DATAC1/dbm01/onlinelog/group_2.258.976374735
    +DATAC1/dbm01/onlinelog/group_7.267.976375073
    +DATAC1/dbm01/onlinelog/group_8.268.976375075
    +DATAC1/dbm01/onlinelog/group_5.269.976375079
    +DATAC1/dbm01/onlinelog/group_6.270.976375083
    +DATAC1/dbm01/onlinelog/group_3.271.976375085
    +DATAC1/dbm01/onlinelog/group_4.272.976375087
    +DATAC1/dbm01/onlinelog/group_9.274.976375205
    +DATAC1/dbm01/onlinelog/group_10.275.976375209
    +DATAC1/dbm01/onlinelog/group_11.276.976375211
    +DATAC1/dbm01/onlinelog/group_12.277.976375215
    +DATAC1/dbm01/onlinelog/group_13.278.976375217
    +DATAC1/dbm01/onlinelog/group_14.279.976375219
    +DATAC1/dbm01/onlinelog/group_15.280.976375223
    +DATAC1/dbm01/onlinelog/group_16.281.976375225


    16 rows selected.


    SQL> alter database rename file ‘+DATAC1/dbm01/datafile/system.259.976374739’ to ‘+DATA/dbm01/datafile/system.259.976374739’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/datafile/sysaux.260.976374743’ to ‘+DATA/dbm01/datafile/sysaux.260.976374743’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/datafile/undotbs1.261.976374745’ to ‘+DATA/dbm01/datafile/undotbs1.261.976374745’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/datafile/undotbs2.263.976374753’ to ‘+DATA/dbm01/datafile/undotbs2.263.976374753’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/datafile/undotbs3.264.976374755’ to ‘+DATA/dbm01/datafile/undotbs3.264.976374755’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/datafile/undotbs4.265.976374757’ to ‘+DATA/dbm01/datafile/undotbs4.265.976374757’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/datafile/users.266.976374757’ to ‘+DATA/dbm01/datafile/users.266.976374757’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_1.257.976374733’  to ‘+DATA/dbm01/onlinelog/group_1.257.976374733’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_2.258.976374735’  to ‘+DATA/dbm01/onlinelog/group_2.258.976374735’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_7.267.976375073’  to ‘+DATA/dbm01/onlinelog/group_7.267.976375073’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_8.268.976375075’  to ‘+DATA/dbm01/onlinelog/group_8.268.976375075’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_5.269.976375079’  to ‘+DATA/dbm01/onlinelog/group_5.269.976375079’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_6.270.976375083’  to ‘+DATA/dbm01/onlinelog/group_6.270.976375083’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_3.271.976375085’  to ‘+DATA/dbm01/onlinelog/group_3.271.976375085’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_4.272.976375087’  to ‘+DATA/dbm01/onlinelog/group_4.272.976375087’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_9.274.976375205’  to ‘+DATA/dbm01/onlinelog/group_9.274.976375205’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_10.275.976375209’ to ‘+DATA/dbm01/onlinelog/group_10.275.976375209’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_11.276.976375211’ to ‘+DATA/dbm01/onlinelog/group_11.276.976375211’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_12.277.976375215’ to ‘+DATA/dbm01/onlinelog/group_12.277.976375215’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_13.278.976375217’ to ‘+DATA/dbm01/onlinelog/group_13.278.976375217’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_14.279.976375219’ to ‘+DATA/dbm01/onlinelog/group_14.279.976375219’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_15.280.976375223’ to ‘+DATA/dbm01/onlinelog/group_15.280.976375223’;


    Database altered.


    SQL> alter database rename file ‘+DATAC1/dbm01/onlinelog/group_16.281.976375225’ to ‘+DATA/dbm01/onlinelog/group_16.281.976375225’;


    Database altered.

    • Verify the datafiles and redo log files names

    SQL> select name from v$datafile;


    NAME
    ——————————————————————————–
    +DATA/dbm01/datafile/system.259.976374739
    +DATA/dbm01/datafile/sysaux.260.976374743
    +DATA/dbm01/datafile/undotbs1.261.976374745
    +DATA/dbm01/datafile/undotbs2.263.976374753
    +DATA/dbm01/datafile/undotbs3.264.976374755
    +DATA/dbm01/datafile/undotbs4.265.976374757
    +DATA/dbm01/datafile/users.266.976374757


    7 rows selected.


    SQL> select member from v$logfile;


    MEMBER
    ——————————————————————————–
    +DATA/dbm01/onlinelog/group_1.257.976374733
    +DATA/dbm01/onlinelog/group_2.258.976374735
    +DATA/dbm01/onlinelog/group_7.267.976375073
    +DATA/dbm01/onlinelog/group_8.268.976375075
    +DATA/dbm01/onlinelog/group_5.269.976375079
    +DATA/dbm01/onlinelog/group_6.270.976375083
    +DATA/dbm01/onlinelog/group_3.271.976375085
    +DATA/dbm01/onlinelog/group_4.272.976375087
    +DATA/dbm01/onlinelog/group_9.274.976375205
    +DATA/dbm01/onlinelog/group_10.275.976375209
    +DATA/dbm01/onlinelog/group_11.276.976375211
    +DATA/dbm01/onlinelog/group_12.277.976375215
    +DATA/dbm01/onlinelog/group_13.278.976375217
    +DATA/dbm01/onlinelog/group_14.279.976375219
    +DATA/dbm01/onlinelog/group_15.280.976375223
    +DATA/dbm01/onlinelog/group_16.281.976375225


    16 rows selected.

    • Update block change tracking file location

    SQL> alter database rename file ‘+DATAC1/dbm01/changetracking/ctf.282.976375227’ to ‘+DATA/dbm01/changetracking/ctf.282.976375227’;


    Database altered.


    SQL> select * from v$block_change_tracking;


    STATUS
    ———-
    FILENAME
    ——————————————————————————–
         BYTES
    ———-
    ENABLED
    +DATA/dbm01/changetracking/ctf.282.976375227
      11599872

    • Update OMF related parameters

    SQL> show parameter db_create_online_log_dest_1


    NAME                                 TYPE        VALUE
    ———————————— ———– ——————————
    db_create_online_log_dest_1          string      +DATAC1


    SQL> alter system set db_create_online_log_dest_1=’+DATA’;


    System altered.


    SQL> show parameter db_create_online_log_dest_1


    NAME                                 TYPE        VALUE
    ———————————— ———– ——————————
    db_create_online_log_dest_1          string      +DATA

    • Update Fast Recovery Area location

    SQL> show parameter db_recovery_file_dest


    NAME                                 TYPE        VALUE
    ———————————— ———– ——————————
    db_recovery_file_dest                string      +RECOC1
    db_recovery_file_dest_size           big integer 20425000M


    SQL> alter system set db_recovery_file_dest=’+RECO’;


    System altered.


    SQL> show parameter db_recovery_file_dest


    NAME                                 TYPE        VALUE
    ———————————— ———– ——————————
    db_recovery_file_dest                string      +RECO
    db_recovery_file_dest_size           big integer 20425000M

    • Shutdown the database

    SQL> shutdown immediate;
    Database closed.
    Database dismounted.
    ORACLE instance shut down.
    SQL> exit

    • Update the database configuration

    [oracle@dm01db01 dbs]$ srvctl config database -d dbm01
    Database unique name: dbm01
    Database name: dbm01
    Oracle home: /u01/app/oracle/product/11.2.0.4/dbhome
    Oracle user: oracle
    Spfile: +DATAC1/dbm01/spfiledbm01.ora
    Domain:
    Start options: open
    Stop options: immediate
    Database role: PRIMARY
    Management policy: AUTOMATIC
    Server pools: dbm01
    Database instances: dbm011,dbm012,dbm013,dbm014
    Disk Groups: DATAC1,RECOC1,DATA
    Mount point paths:
    Services:
    Type: RAC
    Database is administrator managed


    [oracle@dm01db01 dbs]$ srvctl modify database -p +DATA/dbm01/spfiledbm01.ora -a DATA,RECO -d dbm01


    [oracle@dm01db01 dbs]$ srvctl config database -d dbm01
    Database unique name: dbm01
    Database name: dbm01
    Oracle home: /u01/app/oracle/product/11.2.0.4/dbhome
    Oracle user: oracle
    Spfile: +DATA/dbm01/spfiledbm01.ora
    Domain:
    Start options: open
    Stop options: immediate
    Database role: PRIMARY
    Management policy: AUTOMATIC
    Server pools: dbm01
    Database instances: dbm011,dbm012,dbm013,dbm014
    Disk Groups: DATA,RECO
    Mount point paths:
    Services:
    Type: RAC
    Database is administrator managed

    • Start the database and verify

    [oracle@dm01db01 dbs]$ srvctl start database -d dbm01


    [oracle@dm01db01 dbs]$ srvctl status database -d dbm01
    Instance dbm011 is running on node dm01db01
    Instance dbm012 is running on node dm01db02
    Instance dbm013 is running on node dm01db03
    Instance dbm014 is running on node dm01db04


    [oracle@dm01db01 dbs]$ sqlplus / as sysdba


    SQL*Plus: Release 11.2.0.4.0 Production on Fri May 25 10:40:34 2018
    Copyright (c) 1982, 2013, Oracle.  All rights reserved.


    Connected to:
    Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 – 64bit Production
    With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
    Data Mining and Real Application Testing options


    SQL> select name, open_mode,database_role from gv$database;


    NAME      OPEN_MODE            DATABASE_ROLE
    ——— ——————– —————-
    DBM01     READ WRITE           PRIMARY
    DBM01     READ WRITE           PRIMARY
    DBM01     READ WRITE           PRIMARY
    DBM01     READ WRITE           PRIMARY


    ORACLE_SID = [+ASM1] ? dbm011
    The Oracle base remains unchanged with value /u01/app/oracle


    [oracle@dm01db01 ~]$ sqlplus / as sysdba


    SQL*Plus: Release 11.2.0.4.0 Production on Thu May 24 16:36:34 2018
    Copyright (c) 1982, 2013, Oracle.  All rights reserved.


    Connected to:
    Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 – 64bit Production
    With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
    Data Mining and Real Application Testing options


    SQL> select * from v$version;


    BANNER
    ——————————————————————————–
    Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 – 64bit Production
    PL/SQL Release 11.2.0.4.0 – Production
    CORE    11.2.0.4.0      Production
    TNS for Linux: Version 11.2.0.4.0 – Production
    NLSRTL Version 11.2.0.4.0 – Production




    [oracle@dm01db01 ~]$ . oraenv


    ORACLE_SID = [oracle] ? +ASM1
    The Oracle base has been set to /u01/app/oracle


    [oracle@dm01db01 ~]$ asmcmd -p


    ASMCMD [+] > lsdg
    State    Type    Rebal  Sector  Block       AU   Total_MB    Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
    MOUNTED  HIGH    N         512   4096  4194304  272154624  271558968          6479872        88359698              0             N  DATAC1/
    MOUNTED  HIGH    N         512   4096  4194304    2404640    2402468            68704          777921              0             Y  DBFS_DG/
    MOUNTED  NORMAL  N         512   4096  4194304   45389568   45386648           540352        22423148              0             N  RECOC1/


    ASMCMD [+] > lsct
    DB_Name  Status     Software_Version  Compatible_version  Instance_Name  Disk_Group
    +ASM     CONNECTED        11.2.0.4.0          11.2.0.4.0  +ASM1          DBFS_DG
    DBM01    CONNECTED        11.2.0.4.0          11.2.0.4.0  dbm011         DATAC1


    [oracle@dm01db01 ~]$ srvctl status database -d dbm01
    Instance dbm011 is running on node dm01db01
    Instance dbm012 is running on node dm01db02
    Instance dbm013 is running on node dm01db03
    Instance dbm014 is running on node dm01db04




    Conclusion


    In this article we have learned how to rename an ASM Disk group on Exadata running Oracle Database 11.2. Starting with Oracle Database 11.2 you can use the renamedg command to rename an ASM Disk Group. renamedg utility cannot rename the associated ASM/Grid disk disk name. Also renamedg cannot rename/update the control files, datafiles, redo log files and any other files that reference ASM DG for all databases. You must update database files manually after renaming ASM disk groups.

  • Create Cell Disk and Grid Disk Manually on Exadata

    We had a failed hard disk on a Exadata Storage cell X6-2. So we scheduled the Oracle Field Engineer to replace the bad disk. Oracle Field Engineer came onsite and replaced the faulty hard disk. Post hard disk replacement we found that the physical disk and luns are created successfully but the Cell disk and Grid disks were not created automatically. When a hard disk is replaced, the lun, cell disk and grid disks are created automatically and grid disks are added to ASM disk group for you without any manual intervention. In some odd cases, the Cell disk and grid disks are not created automatically, in those cases you must manually create the Cell disk, create the Grid disks with proper sizes and add them to the ASM disk group.


    In this article we will demonstrate how to create the Cell disk, Grid disks manually and add them to the respective ASM Disk Group.


    Environment

    • Exadata X6-2 Elastic Configuration
    • 4 Compute nodes and 6 Storage cells
    • Hard Disk Size: 8TB
    • 3 ASM Disk Group: DATA, RECO & DBFS_DG
    • Total Number of Grid disks: DATA – 72, RECO – 72 & DBFS_DG – 60

    Here the disk in the location 8:5 was back and replaced.


    Before Replacing Hard Disk:


    CellCLI> list physicaldisk
             8:0             PYJZKV                  normal
             8:1             PMU3LV                  normal
             8:2             P1Y2KV                  normal
             8:3             PYH48V                  normal
             8:4             PY7MAV                  normal
             8:5             PPZ47V                  not present
             8:6             PEJKHR                  normal
             8:7             PY4XSV                  normal
             8:8             PYL00V                  normal
             8:9             PV5RGV                  normal
             8:10            PSU26V                  normal
             8:11            PY522V                  normal
             FLASH_1_1       CVMD522500AG1P6NGN      normal
             FLASH_2_1       CVMD522401AC1P6NGN      normal
             FLASH_4_1       CVMD522500AC1P6NGN      normal
             FLASH_5_1       CVMD5230000Y1P6NGN      normal


    CellCLI> list lun
             0_0     0_0     normal
             0_1     0_1     normal
             0_2     0_2     normal
             0_3     0_3     normal
             0_4     0_4     normal
             0_5     0_5     not present
             0_6     0_6     normal
             0_7     0_7     normal
             0_8     0_8     normal
             0_9     0_9     normal
             0_10    0_10    normal
             0_11    0_11    normal
             1_1     1_1     normal
             2_1     2_1     normal
             4_1     4_1     normal
             5_1     5_1     normal


    After replacing Hard Disk:


    CellCLI> list physicaldisk
             8:0             PYJZKV                  normal
             8:1             PMU3LV                  normal
             8:2             P1Y2KV                  normal
             8:3             PYH48V                  normal
             8:4             PY7MAV                  normal
             8:5             PPZ47V                  normal
             8:6             PEJKHR                  normal
             8:7             PY4XSV                  normal
             8:8             PYL00V                  normal
             8:9             PV5RGV                  normal
             8:10            PSU26V                  normal
             8:11            PY522V                  normal
             FLASH_1_1       CVMD522500AG1P6NGN      normal
             FLASH_2_1       CVMD522401AC1P6NGN      normal
             FLASH_4_1       CVMD522500AC1P6NGN      normal
             FLASH_5_1       CVMD5230000Y1P6NGN      normal


    CellCLI> list lun
             0_0     0_0     normal
             0_1     0_1     normal
             0_2     0_2     normal
             0_3     0_3     normal
             0_4     0_4     normal
             0_5     0_5     normal
             0_6     0_6     normal
             0_7     0_7     normal
             0_8     0_8     normal
             0_9     0_9     normal
             0_10    0_10    normal
             0_11    0_11    normal
             1_1     1_1     normal
             2_1     2_1     normal
             4_1     4_1     normal
             5_1     5_1     normal


    [root@dm01cel03 ~]# cellcli -e list physicaldisk 8:5 detail
             name:                   8:5
             deviceId:               21
             deviceName:             /dev/sdf
             diskType:               HardDisk
             enclosureDeviceId:      8
             errOtherCount:          0
             luns:                   0_5
             makeModel:              “HGST    H7280A520SUN8.0T”
             physicalFirmware:       PD51
             physicalInsertTime:     2018-05-18T10:52:29-05:00
             physicalInterface:      sas
             physicalSerial:         PPZ47V
             physicalSize:           7.1536639072000980377197265625T
             slotNumber:             5
             status:                 normal


    [root@dm01cel03 ~]# cellcli -e list celldisk where lun=0_5 detail




    [root@dm01cel03 ~]# cellcli -e list griddisk where cellDisk=CD_05_cm01cel01 attributes name,status
    DATA_CD_05_dm01cel03 not present
    DBFS_DG_CD_05_dm01cel03 not present
    RECO_CD_05_dm01cel03 not present


    [root@dm01cel03 ~]# cellcli -e list griddisk where celldisk=CD_05_dm01cel03 detail
             name:                   DATA_CD_05_dm01cel03
             availableTo:
             cachingPolicy:          default
             cellDisk:               CD_05_dm01cel03
             comment:                “Cluster dm01-cluster diskgroup DATA”
             creationTime:           2016-03-29T20:25:56-05:00
             diskType:               HardDisk
             errorCount:             0
             id:                     db221d77-25b0-4f9e-af6f-95e1c3134af5
             size:                   5.6953125T
             status:                 not present


             name:                   DBFS_DG_CD_05_dm01cel03
             availableTo:
             cachingPolicy:          default
             cellDisk:               CD_05_dm01cel03
             comment:                “Cluster dm01-cluster diskgroup DBFS_DG”
             creationTime:           2016-03-29T20:25:53-05:00
             diskType:               HardDisk
             errorCount:             0
             id:                     216fbec9-6ed4-4ef6-a0d4-d09517906fd5
             size:                   33.796875G
             status:                 not present


             name:                   RECO_CD_05_dm01cel03
             availableTo:
             cachingPolicy:          none
             cellDisk:               CD_05_dm01cel03
             comment:                “Cluster dm01-cluster diskgroup RECO”
             creationTime:           2016-03-29T20:25:58-05:00
             diskType:               HardDisk
             errorCount:             0
             id:                     e8ca6943-0ddd-48ab-b890-e14bbf4e591c
             size:                   1.42388916015625T
             status:                 not present


    We can clearly see that the GRID DISKs are not present. So we have to create the GRID DISKs Manually.


    Steps to create Celldisk, Griddisks and add them to ASM Disk Group


    • List Cell Disks

    [root@dm01cel03 ~]# cellcli -e list celldisk
             CD_00_dm01cel03         normal
             CD_01_dm01cel03         normal
             CD_02_dm01cel03         normal
             CD_03_dm01cel03         normal
             CD_04_dm01cel03         normal
             CD_05_dm01cel03         not present
             CD_06_dm01cel03         normal
             CD_07_dm01cel03         normal
             CD_08_dm01cel03         normal
             CD_09_dm01cel03         normal
             CD_10_dm01cel03         normal
             CD_11_dm01cel03         normal
             FD_00_dm01cel03         normal
             FD_01_dm01cel03         normal
             FD_02_dm01cel03         normal
             FD_03_dm01cel03         normal

    • List Grid Disks

    [root@dm01cel03 ~]# cellcli -e list griddisk
             DATA_CD_00_dm01cel03       active
             DATA_CD_01_dm01cel03       active
             DATA_CD_02_dm01cel03       active
             DATA_CD_03_dm01cel03       active
             DATA_CD_04_dm01cel03       active
             DATA_CD_05_dm01cel03       not present
             DATA_CD_06_dm01cel03       active
             DATA_CD_07_dm01cel03       active
             DATA_CD_08_dm01cel03       active
             DATA_CD_09_dm01cel03       active
             DATA_CD_10_dm01cel03       active
             DATA_CD_11_dm01cel03       active
             DBFS_DG_CD_02_dm01cel03    active
             DBFS_DG_CD_03_dm01cel03    active
             DBFS_DG_CD_04_dm01cel03    active
             DBFS_DG_CD_05_dm01cel03    not present
             DBFS_DG_CD_06_dm01cel03    active
             DBFS_DG_CD_07_dm01cel03    active
             DBFS_DG_CD_08_dm01cel03    active
             DBFS_DG_CD_09_dm01cel03    active
             DBFS_DG_CD_10_dm01cel03    active
             DBFS_DG_CD_11_dm01cel03    active
             RECO_CD_00_dm01cel03       active
             RECO_CD_01_dm01cel03       active
             RECO_CD_02_dm01cel03       active
             RECO_CD_03_dm01cel03       active
             RECO_CD_04_dm01cel03       active
             RECO_CD_05_dm01cel03       not present
             RECO_CD_06_dm01cel03       active
             RECO_CD_07_dm01cel03       active
             RECO_CD_08_dm01cel03       active
             RECO_CD_09_dm01cel03       active
             RECO_CD_10_dm01cel03       active
             RECO_CD_11_dm01cel03       active

    • List Physical Disk details

    [root@dm01cel03 ~]# cellcli -e list physicaldisk where physicalSerial=PPZ47V detail
             name:                   8:5
             deviceId:               21
             deviceName:             /dev/sdf
             diskType:               HardDisk
             enclosureDeviceId:      8
             errOtherCount:          0
             luns:                   0_5
             makeModel:              “HGST    H7280A520SUN8.0T”
             physicalFirmware:       PD51
             physicalInsertTime:     2018-05-18T10:52:29-05:00
             physicalInterface:      sas
             physicalSerial:         PPZ47V
             physicalSize:           7.1536639072000980377197265625T
             slotNumber:             5
             status:                 normal

    • Let’s try to create the Cell Disk

    [root@dm01cel03 ~]# cellcli -e create celldisk CD_09_dm01cel03 lun=0_5


    CELL-02526: Pre-existing cell disk: CD_09_dm01cel03


    It says the Cell Disk already exists.

    • Let’s try to create the Grid Disk. To create the Grid Disk with proper size, get the Grid Disk size from a good Cell Disk as shown below.

    [root@dm01cel03 ~]# cellcli -e list griddisk where celldisk=CD_07_dm01cel03 attributes name,size,offset
             DATA_CD_07_dm01cel03       5.6953125T              32M
             DBFS_DG_CD_07_dm01cel03         33.796875G         7.1192474365234375T
             RECO_CD_07_dm01cel03       1.42388916015625T       5.6953582763671875T

    • Now create the Grid Disk

    [root@dm01cel03 ~]# cellcli -e create griddisk DATA_CD_05_dm01cel03 celldisk=CD_05_dm01cel03,size=5.6953125T


    CELL-02701: Cannot create grid disk on cell disk CD_05_dm01cel03 because its status is not normal.


    Looks like we can’t create the Grid Disk. We will now drop the Cell Disk and recreate it.

    • Drop Cell Disk

    CellCLI> drop celldisk CD_05_dm01cel03 force
    CellDisk CD_05_dm01cel03 successfully dropped

    • Create Cell Disk

    CellCLI> create celldisk CD_05_dm01cel03 lun=0_5
    CellDisk CD_05_dm01cel03 successfully created

    • Create Grid Disks with proper sizes

    CellCLI> create griddisk DATA_CD_05_dm01cel03 celldisk=CD_05_dm01cel03,size=5.6953125T
    GridDisk DATA_CD_05_dm01cel03 successfully created


    CellCLI> create griddisk RECO_CD_05_dm01cel03 celldisk=CD_05_dm01cel03,size=1.42388916015625T
    GridDisk RECO_CD_05_dm01cel03 successfully created


    CellCLI> create griddisk DBFS_DG_CD_05_dm01cel03 celldisk=CD_05_dm01cel03,size=33.796875G
    GridDisk DBFS_DG_CD_05_dm01cel03 successfully created

    • List Grid Disks

    CellCLI> list griddisk where celldisk=CD_05_dm01cel03 attributes name,size,offset
             DATA_CD_05_dm01cel03       5.6953125T              32M
             DBFS_DG_CD_05_dm01cel03         33.796875G              7.1192474365234375T
             RECO_CD_05_dm01cel03       1.42388916015625T       5.6953582763671875T


    CellCLI> list griddisk
             DATA_CD_00_dm01cel03       active
             DATA_CD_01_dm01cel03       active
             DATA_CD_02_dm01cel03       active
             DATA_CD_03_dm01cel03       active
             DATA_CD_04_dm01cel03       active
             DATA_CD_05_dm01cel03       active
             DATA_CD_06_dm01cel03       active
             DATA_CD_07_dm01cel03       active
             DATA_CD_08_dm01cel03       active
             DATA_CD_09_dm01cel03       active
             DATA_CD_10_dm01cel03       active
             DATA_CD_11_dm01cel03       active
             DBFS_DG_CD_02_dm01cel03    active
             DBFS_DG_CD_03_dm01cel03    active
             DBFS_DG_CD_04_dm01cel03    active
             DBFS_DG_CD_05_dm01cel03    active
             DBFS_DG_CD_06_dm01cel03    active
             DBFS_DG_CD_07_dm01cel03    active
             DBFS_DG_CD_08_dm01cel03    active
             DBFS_DG_CD_09_dm01cel03    active
             DBFS_DG_CD_10_dm01cel03    active
             DBFS_DG_CD_11_dm01cel03    active
             RECO_CD_00_dm01cel03       active
             RECO_CD_01_dm01cel03       active
             RECO_CD_02_dm01cel03       active
             RECO_CD_03_dm01cel03       active
             RECO_CD_04_dm01cel03       active
             RECO_CD_05_dm01cel03       active
             RECO_CD_06_dm01cel03       active
             RECO_CD_07_dm01cel03       active
             RECO_CD_08_dm01cel03       active
             RECO_CD_09_dm01cel03       active
             RECO_CD_10_dm01cel03       active
             RECO_CD_11_dm01cel03       active


    The Grid Disks show active now. We can go ahead and add them to ASM disk Group Manually by connecting to ASM instance.


    • Log into +ASM1 instance and add the new disk.  Set the rebalance power higher (11) to perform faster rebalance operation.

    dm01db01-orcldb1 {/home/oracle}:. oraenv
    ORACLE_SID = [orcldb1] ? +ASM1
    The Oracle base remains unchanged with value /u01/app/oracle
    dm01db01-+ASM1 {/home/oracle}:sqlplus / as sysasm


    SQL*Plus: Release 11.2.0.4.0 Production on Wed May 23 09:30:13 2018
    Copyright (c) 1982, 2013, Oracle.  All rights reserved.


    Connected to:
    Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 – 64bit Production
    With the Real Application Clusters and Automatic Storage Management options


    SQL> alter diskgroup DATA add failgroup dm01CEL03 disk ‘o/192.168.10.1;192.168.10.2/DATA_CD_05_dm01cel03’ name DATA_CD_05_dm01cel03 rebalance power 11;


    Diskgroup altered.


    SQL> alter diskgroup RECO add failgroup dm01CEL03 disk ‘o/192.168.10.1;192.168.10.2/RECO_CD_05_dm01cel03’ name RECO_CD_05_dm01cel03 rebalance power 11;


    Diskgroup altered.


    SQL> alter diskgroup DBFS_DG add failgroup dm01CEL03 disk ‘o/192.168.10.1;192.168.10.2/DBFS_DG_CD_05_dm01cel03’ name DBFS_DG_CD_05_dm01cel03 rebalance power 11;


    Diskgroup altered.


    SQL> select a.name,a.total_mb,a.free_mb,a.type,
        decode(a.type,’NORMAL’,a.total_mb/2,’HIGH’,a.total_mb/3) avail_mb,
        decode(a.type,’NORMAL’,a.free_mb/2,’HIGH’,a.free_mb/3) usable_mb,
        count(b.path) cell_disks  from v$asm_diskgroup a, v$asm_disk b
        where a.group_number=b.group_number group by a.name,a.total_mb,a.free_mb,a.type,
        decode(a.type,’NORMAL’,a.total_mb/2,’HIGH’,a.total_mb/3) ,
        decode(a.type,’NORMAL’,a.free_mb/2,’HIGH’,a.free_mb/3)
       order by 2,1;


                   Total MB    Free MB          Total MB    Free MB
    Disk Group          Raw        Raw TYPE       Usable     Usable     CELL_DISKS
    ———— ———- ———- —— ———- ———- ———-
    DBFS_DG    2076480    2074688 NORMAL    1038240    1037344         60
    RECO     107500032   57573496 HIGH     35833344   19191165         72
    DATA     429981696  282905064 HIGH    143327232   94301688         72


    SQL> select * from v$asm_operation;


    GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE EST_MINUTES ERROR_CODE
    ———— —– —- ———- ———- ———- ———- ———- ———– ——————————————–
               1 REBAL RUN          11         11      85992    6697959      11260         587
               3 REBAL WAIT         11




    SQL> select * from gv$asm_operation;


    no rows selected




    Conclusion


    In this article we have learned how to create the Celldisk, Griddisks and add the newly created Griddisks to ASM Disk Group. When a hard disk is replaced, the lun, celldisk and griddisks are created automatically and griddisks are added to ASM disk group for you without any manual intervention. In some cases, if the Celldisk and grid disks are not created automatically, then you must manually create them and add them to the ASM disk group.

  • Exadata – Replace Failed Internal USB Drive on Exadata Storage Cell

    While working on Exadata Storage cell patching, the patching failed due to failed internal USB drive on a storage cell.
    Oracle uses internal USB drive to backup Exadata Storage cell automatically. We don’t have to backup Storage cell manually.
    In this article I will demonstrate how to replace a failed USB drive an Exadata Storage cell



    • You will receive an automated smtp alert (if configured) similar to below.
    • You can also use the following command to check for USB drive failure
    [root@dm01cel01 ~]# cellcli -e list alerthistory
             1_1     2018-04-10T18:25:42-05:00       warning         “Internal USB status is not present.  Affected USB Slots : 0”
    • You can also use the following ILOM command to check for USB drive failure
    [root@dm01cel01 ~]# ssh dm01cel01-ilom
    Password: *******
    Oracle(R) Integrated Lights Out Manager



    Version 3.2.10.22.a r121524



    Copyright (c) 2017, Oracle and/or its affiliates. All rights reserved.

    Warning: HTTPS certificate is set to factory default.



    Hostname: dm01cel01-ilom



    -> show /SYS/MB/USB0



    • Open an SR with Oracle if an ASR is already generated
    • Upload sundgia.sh and ILOM Snapshot to the SR for investigation
    • Oracle confirms the that USB drive is faulted
    • Oracle opens a Field task
    • Oracle dispatch team contacts the SR owner with the hardware dispatch details
    • Confirm the Hardware replacement schedule over email and/or SR
    • Schedule the Hardware replacement
    • Oracle FE arrives at the data center with the new USB drive
    • Shutdown the storage cell by following the steps from the MOS below
    Steps to shut down or reboot an Exadata storage cell without affecting ASM (Doc ID 1188080.1)
    • Oracle FE replaces the faulty USB drive and power up the storage cell
    • Confirm that the USB drive is good
    -> show /SYS/MB/USB0
     /SYS/MB/USB0



        Targets:
        Properties:



            type = USB Port
            fault_state = OK
            clear_fault_action = (none)
        Commands:



            cd
            set
            show
    ->



    [root@dm01cel01 ~]# cellcli -e list alerthistory



             1_2     2018-04-11T02:45:49-05:00       clear           “Internal USB status is back to normal.  Affected USB Slots : 0”
    • You will receive an automated smtp alert (if configured) similar to below that the USB status is back to normal



    Conclusion
    In this article we have learned how to replace a faulty USB drive in Exadata Storage cell. Oracle uses USB drive to backup Exadata Storage cell automatically. We don’t have to backup Storage cell manually.