Netsoftmate

Tag: Flex ASM

  • Configure ACFS on Exadata running Oracle 12.2.0.1 on Flex ASM Architecture

    Overview

    In one of previous article I have demonstrated how to configure ACFS on Exadata database running Oracle database 12.1.0.2 using standard ASM. Now I have an opportunity to configure Oracle GoldenGate on Exadata running Oracle database 12.2.0.1. So I have decides to configure ACFS on Exadata running Oracle database 12.2.0.1 using ASM Flex Architecture.

    In this article I will demostrate how to configure Oracle ACFS on Exadata Database machine running Oracle  Database 12.2.0.1 using Flex ASM.

    For details on ACFS and how to configure ACFS on Standard ASM look at my previous article at:
    http://netsoftmate.blogspot.in/2017/02/configure-acfs-on-exadata-database.html

    Prerequisites

    • Verify ASM configuration on Standard Cluster (8 nodes)

    Here the owner of the Grid Home is oracle user.

    dm01db01-+ASM1 {/home/oracle}:id oracle
    uid=1000(oracle) gid=1001(oinstall) groups=1001(oinstall),101(fuse),1002(dba),1003(oper),1004(asmdba)

    • Determine the ASM architecture

    Here it is an ASM Flex configuration using the default cardinally=3 and the ASM instances are running on node 1, 2 and 4 out of 8 nodes:

    dm01db01-+ASM1 {/home/oracle}:asmcmd showclustermode
    ASM cluster : Flex mode enabled

    dm01db01-orp258c1 {/home/oracle}:srvctl config asm -detail
    ASM home: <CRS home>
    Password file: +DBFS_DG/orapwASM
    Backup of Password file:
    ASM listener: LISTENER
    ASM is enabled.
    ASM is individually enabled on nodes:
    ASM is individually disabled on nodes:
    ASM instance count: 3
    Cluster ASM listener: ASMNET1LSNR_ASM

    dm01db01-+ASM1 {/home/oracle}:srvctl status asm
    ASM is running on dm01db04,dm01db02,dm01db01
    ASM is enabled.

    • Verify if ACFS/ADVM modules is enabled/loaded on every node in a standard cluster or every Hub Node in a Flex Cluster.

    [root@dm01db01 ~]# dcli -g dbs_group -l root ‘lsmod | grep oracle’
    dm01db01: oracleacfs           4609822  3
    dm01db01: oracleadvm            803161  17
    dm01db01: oracleoks             660948  2 oracleacfs,oracleadvm
    dm01db02: oracleacfs           4609822  3
    dm01db02: oracleadvm            803161  17
    dm01db02: oracleoks             660948  2 oracleacfs,oracleadvm
    dm01db03: oracleacfs           4609822  3
    dm01db03: oracleadvm            803161  17
    dm01db03: oracleoks             660948  2 oracleacfs,oracleadvm
    dm01db04: oracleacfs           4609822  3
    dm01db04: oracleadvm            803161  17
    dm01db04: oracleoks             660948  2 oracleacfs,oracleadvm
    dm01db05: oracleacfs           4609822  3
    dm01db05: oracleadvm            803161  17
    dm01db05: oracleoks             660948  2 oracleacfs,oracleadvm
    dm01db06: oracleacfs           4609822  3
    dm01db06: oracleadvm            803161  17
    dm01db06: oracleoks             660948  2 oracleacfs,oracleadvm
    dm01db07: oracleacfs           4609822  3
    dm01db07: oracleadvm            803161  17
    dm01db07: oracleoks             660948  2 oracleacfs,oracleadvm
    dm01db08: oracleacfs           4609822  3
    dm01db08: oracleadvm            803161  17
    dm01db08: oracleoks             660948  2 oracleacfs,oracleadvm

    • Check if ASM ADVM proxy is running on every node in a standard cluster or every Hub Node in a Flex Cluster.

    dm01db01-+ASM1 {/home/oracle}:srvctl status asm -proxy
    ADVM proxy is running on node dm01db06,dm01db05,dm01db04,dm01db03,dm01db02,dm01db01,dm01db08,dm01db07

    dm01db01-+ASM1 {/home/oracle}:srvctl config asm -proxy -detail
    ASM home: <CRS home>
    ADVM proxy is enabled
    ADVM proxy is individually enabled on nodes:
    ADVM proxy is individually disabled on nodes:

    dm01db01-orp258c1 {/home/oracle}:/u01/app/12.2.0.1/grid/bin/crsctl stat res ora.proxy_advm -t
    ——————————————————————————–
    Name           Target  State        Server                   State details
    ——————————————————————————–
    Local Resources
    ——————————————————————————–
    ora.proxy_advm
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ——————————————————————————–

    Step I – Create ASM Disk Group for ACFS

    • Login as Oracle Grid Infrastructure software owner and start asmca.

    dm01db01-orcldb1 {/home/oracle}: id oracle
    uid=1000(oracle) gid=1001(oinstall) groups=1001(oinstall),1002(dba),1003(oper),1004(asmdba)

    • Set the ORACLE HOME and SID to ASM

    dm01db01-orcldb1 {/home/oracle}:. oraenv
    ORACLE_SID = [orcldb1] ? +ASM1
    The Oracle base remains unchanged with value /u01/app/oracle

    dm01db01-+ASM1 {/home/oracle}:env | grep ORA
    ORACLE_SID=+ASM1
    ORACLE_BASE=/u01/app/oracle
    ORACLE_HOME=/u01/app/12.2.0.1/grid

    • Set DISPLAY

    dm01db01-+ASM1 {/home/oracle}:export DISPLAY=10.30.20.13:0.0

    • Start asmca utility

    dm01db01-+ASM1 {/home/oracle}:which asmca
    /u01/app/12.1.0.2/grid/bin/asmca
    dm01db01-+ASM1 {/home/oracle}:asmca
     
    ASMCA warming up

    ASMCA Home page  appears

    Click on ASM Instances to view the ASM configuration. We can see that it a Flex ASM Configuration

    Click on “Dis Groups”  and click on “Create” button to create a new ASM Disk Group to be used for ACFS

    On Create Disk Group page, specify:
        – Disk Group Name: ACFS_DG
        – Redundancy: Normal
        – Select Member Disk: Show Eligible
            – Select all candidate disks to be part of ACFS_DG disk group
            – In Exadata each Storage cell is a failure Group
        – Click on Show Advanced Options, specify:
           – Specify the ASM/DB/ADVM Compatibilty
        – Click Ok

    ACFS_DG ASM Disk Group creation in progress

    We can see our ACFS_DG Disk Group created 

    • Verify newly created ACFS_DG Disk Group as follows:

    SQL> select inst_id, name, total_mb, group_number from gv$asm_diskgroup where name like ‘ACFS_DG’;

       INST_ID NAME                             TOTAL_MB GROUP_NUMBER
    ———- —————————— ———- ————
             1 ACFS_DG                          10407936            5
             3 ACFS_DG                          10407936            5
             2 ACFS_DG                          10407936            5

    SQL> col value for a30
    SQL> col name for a30
    SQL> select name, value from v$asm_attribute where GROUP_NUMBER=5 and name like ‘compatible%’;

    NAME                           VALUE
    —————————— ——————————
    compatible.asm                 12.2.0.1.0
    compatible.rdbms               11.2.0.4.0
    compatible.advm                12.2.0.1.0

    dm01db01-+ASM1 {/home/oracle}:/u01/app/12.2.0.1/grid/bin/crsctl stat res ora.ACFS_DG.dg -t
    ——————————————————————————–
    Name           Target  State        Server                   State details
    ——————————————————————————–
    Local Resources
    ——————————————————————————–
    ora.ACFS_DG.dg
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  OFFLINE      dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  OFFLINE      dm01db05                 STABLE
                   ONLINE  OFFLINE      dm01db06                 STABLE
                   ONLINE  OFFLINE      dm01db07                 STABLE
                   ONLINE  OFFLINE      dm01db08                 STABLE
    ——————————————————————————–

    Step II – Create ASM Volume
    Click on Volumes

    On Volumes page click on “Create”

    On Create Volume page, specify:
        – Volumn name: acfsvol
        – Disk Group name: ACFS_DG
        – Size: 4927.56 (it can be anything based on your requirement from usable space avaialble.)
        – Click Ok

    acfsvol creation is in progress

    We can see our Volume created

    •  Verify newly created Volume as follows:

    ASMCMD> volinfo –all
    Diskgroup Name: ACFS_DG

             Volume Name: ACFSVOL
             Volume Device: /dev/asm/acfsvol-223
             State: ENABLED
             Size (MB): 5045824
             Resize Unit (MB): 64
             Redundancy: MIRROR
             Stripe Columns: 8
             Stripe Width (K): 1024
             Usage: ACFS
             Mountpath: /acfs_ogg

    dm01db01-+ASM1 {/home/oracle}:/u01/app/12.2.0.1/grid/bin/crsctl stat res ora.ACFS_DG.ACFSVOL.advm -t
    ——————————————————————————–
    Name           Target  State        Server                   State details
    ——————————————————————————–
    Local Resources
    ——————————————————————————–
    ora.ACFS_DG.ACFSVOL.advm
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ——————————————————————————–

    dm01db01-+ASM1 {/home/oracle}:dcli -g ~/dbs_group -l oracle ‘ls -l /dev/asm/*’
    dm01db01: brwxrwx— 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
    dm01db02: brwxrwx— 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
    dm01db03: brwxrwx— 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
    dm01db04: brwxrwx— 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
    dm01db05: brwxrwx— 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
    dm01db06: brwxrwx— 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
    dm01db07: brwxrwx— 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
    dm01db08: brwxrwx— 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223

    III – Create ASM Cluster File system

    Click on “ASM Cluster File Systems” on left pane

    On ASM Cluster File Systems page click on “Create”


    On Create ASM Cluster File System page, specify:
        – Type of ACFS: Cluster File System
        – Mount point: /acfs_ogg
        – Auto Mount: check
        – User Name: oracle
        – Group Name: oinstall
        – Description: acfs for OGG
        – Select Volume: ACFSVOL – /dev/asm/acfsvol-223 – 4927.5625G
        – Click Ok

    ACFS creation in progress

    Run the ACFS script on Node 1 only to register ACFS with Grid Infrastructure and to mount the ACFS file system.

    • Contents of ACFS script looks like this:

    [root@dm01db01 ~]# cat /u01/app/grid/cfgtoollogs/asmca/scripts/acfs_script.sh | more
    #!/bin/sh
    /u01/app/12.2.0.1/grid/bin/srvctl add filesystem -d /dev/asm/acfsvol-223 -m /acfs_ogg -u oracle -fstype ACFS –

    description ‘acfs for OGG’ -autostart ALWAYS
    if [ $? = “0” -o $? = “2” ]; then
       /u01/app/12.2.0.1/grid/bin/srvctl start filesystem -d /dev/asm/acfsvol-223
       if [ $? = “0” ]; then
          chown oracle:oinstall /acfs_ogg
          chmod 775 /acfs_ogg
          /u01/app/12.2.0.1/grid/bin/srvctl status filesystem -d /dev/asm/acfsvol-223
          exit 0
       else
          exit $?
       fi
       /u01/app/12.2.0.1/grid/bin/srvctl status filesystem -d /dev/asm/acfsvol-223
    fi

    • Execute the script

    [root@dm01db01 ~]# /u01/app/grid/cfgtoollogs/asmca/scripts/acfs_script.sh
    ACFS file system /acfs_ogg is mounted on nodes
    dm01db01,dm01db02,dm01db03,dm01db04,dm01db05,dm01db06,dm01db07,dm01db08

    Click Close on the Run ACFS script window

    We can see our Volume created

    •  Verify newly created Volume as follows:

    dm01db01-+ASM1 {/home/oracle}:/u01/app/12.2.0.1/grid/bin/crsctl stat res ora.acfs_dg.acfsvol.acfs -t
    ——————————————————————————–
    Name           Target  State        Server                   State details
    ——————————————————————————–
    Local Resources
    ——————————————————————————–
    ora.acfs_dg.acfsvol.acfs
                   ONLINE  ONLINE       dm01db01                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db02                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db03                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db04                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db05                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db06                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db07                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db08                 mounted on /acfs_ogg
                                                                 ,STABLE
    ——————————————————————————–

    dm01db01-+ASM1 {/home/oracle}:dcli -g ~/dbs_group -l oracle ‘df -h /acfs_ogg’
    dm01db01: Filesystem            Size  Used Avail Use% Mounted on
    dm01db01: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
    dm01db02: Filesystem            Size  Used Avail Use% Mounted on
    dm01db02: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
    dm01db03: Filesystem            Size  Used Avail Use% Mounted on
    dm01db03: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
    dm01db04: Filesystem            Size  Used Avail Use% Mounted on
    dm01db04: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
    dm01db05: Filesystem            Size  Used Avail Use% Mounted on
    dm01db05: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
    dm01db06: Filesystem            Size  Used Avail Use% Mounted on
    dm01db06: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
    dm01db07: Filesystem            Size  Used Avail Use% Mounted on
    dm01db07: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
    dm01db08: Filesystem            Size  Used Avail Use% Mounted on
    dm01db08: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg

    dm01db01-orp258c1 {/home/oracle}:/u01/app/12.2.0.1/grid/bin/crsctl stat res -t
    ——————————————————————————–
    Name           Target  State        Server                   State details
    ——————————————————————————–
    Local Resources
    ——————————————————————————–
    ora.ACFS_DG.ACFSVOL.advm
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ora.ACFS_DG.dg
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  OFFLINE      dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  OFFLINE      dm01db05                 STABLE
                   ONLINE  OFFLINE      dm01db06                 STABLE
                   ONLINE  OFFLINE      dm01db07                 STABLE
                   ONLINE  OFFLINE      dm01db08                 STABLE
    ora.ASMNET1LSNR_ASM.lsnr
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ora.DATA.ACFSVOL1.advm
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ora.DATA.dg
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  OFFLINE      dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  OFFLINE      dm01db05                 STABLE
                   ONLINE  OFFLINE      dm01db06                 STABLE
                   ONLINE  OFFLINE      dm01db07                 STABLE
                   ONLINE  OFFLINE      dm01db08                 STABLE
    ora.DATA1.dg
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  OFFLINE      dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  OFFLINE      dm01db05                 STABLE
                   ONLINE  OFFLINE      dm01db06                 STABLE
                   ONLINE  OFFLINE      dm01db07                 STABLE
                   ONLINE  OFFLINE      dm01db08                 STABLE
    ora.DBFS_DG.dg
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   OFFLINE OFFLINE      dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   OFFLINE OFFLINE      dm01db05                 STABLE
                   OFFLINE OFFLINE      dm01db06                 STABLE
                   OFFLINE OFFLINE      dm01db07                 STABLE
                   OFFLINE OFFLINE      dm01db08                 STABLE
    ora.LISTENER.lsnr
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ora.MGMT_DG.dg
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   OFFLINE OFFLINE      dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   OFFLINE OFFLINE      dm01db05                 STABLE
                   OFFLINE OFFLINE      dm01db06                 STABLE
                   OFFLINE OFFLINE      dm01db07                 STABLE
                   OFFLINE OFFLINE      dm01db08                 STABLE
    ora.acfs_dg.acfsvol.acfs
                   ONLINE  ONLINE       dm01db01                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db02                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db03                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db04                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db05                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db06                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db07                 mounted on /acfs_ogg
                                                                 ,STABLE
                   ONLINE  ONLINE       dm01db08                 mounted on /acfs_ogg
                                                                 ,STABLE
    ora.chad
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ora.data.acfsvol1.acfs
                   ONLINE  ONLINE       dm01db01                 mounted on /acfs_ogg
                                                                 1,STABLE
                   ONLINE  ONLINE       dm01db02                 mounted on /acfs_ogg
                                                                 1,STABLE
                   ONLINE  ONLINE       dm01db03                 mounted on /acfs_ogg
                                                                 1,STABLE
                   ONLINE  ONLINE       dm01db04                 mounted on /acfs_ogg
                                                                 1,STABLE
                   ONLINE  ONLINE       dm01db05                 mounted on /acfs_ogg
                                                                 1,STABLE
                   ONLINE  ONLINE       dm01db06                 mounted on /acfs_ogg
                                                                 1,STABLE
                   ONLINE  ONLINE       dm01db07                 mounted on /acfs_ogg
                                                                 1,STABLE
                   ONLINE  ONLINE       dm01db08                 mounted on /acfs_ogg
                                                                 1,STABLE
    ora.net1.network
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ora.ons
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ora.proxy_advm
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ——————————————————————————–
    Cluster Resources
    ——————————————————————————–
    ora.LISTENER_SCAN1.lsnr
          1        ONLINE  ONLINE       dm01db02                 STABLE
    ora.LISTENER_SCAN2.lsnr
          1        ONLINE  ONLINE       dm01db04                 STABLE
    ora.LISTENER_SCAN3.lsnr
          1        ONLINE  ONLINE       dm01db01                 STABLE
    ora.MGMTLSNR
          1        ONLINE  ONLINE       dm01db01                 192.168.2.1,STABLE
    ora.asm
          1        ONLINE  ONLINE       dm01db01                 Started,STABLE
          2        ONLINE  ONLINE       dm01db02                 Started,STABLE
          3        ONLINE  ONLINE       dm01db04                 Started,STABLE
    ora.dm01db01.vip
          1        ONLINE  ONLINE       dm01db01                 STABLE
    ora.dm01db02.vip
          1        ONLINE  ONLINE       dm01db02                 STABLE
    ora.dm01db03.vip
          1        ONLINE  ONLINE       dm01db03                 STABLE
    ora.dm01db04.vip
          1        ONLINE  ONLINE       dm01db04                 STABLE
    ora.dm01db05.vip
          1        ONLINE  ONLINE       dm01db05                 STABLE
    ora.dm01db06.vip
          1        ONLINE  ONLINE       dm01db06                 STABLE
    ora.dm01db07.vip
          1        ONLINE  ONLINE       dm01db07                 STABLE
    ora.dm01db08.vip
          1        ONLINE  ONLINE       dm01db08                 STABLE
    ora.cvu
          1        ONLINE  ONLINE       dm01db01                 STABLE
    ora.mgmtdb
          1        ONLINE  ONLINE       dm01db01                 Open,STABLE
    ora.orcldb.db
          1        ONLINE  ONLINE       dm01db01                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          2        ONLINE  ONLINE       dm01db02                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          3        ONLINE  ONLINE       dm01db04                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          4        ONLINE  ONLINE       dm01db05                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          5        ONLINE  ONLINE       dm01db07                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          6        ONLINE  ONLINE       dm01db06                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          7        ONLINE  ONLINE       dm01db03                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          8        ONLINE  ONLINE       dm01db08                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
    ora.prod.db
          1        ONLINE  ONLINE       dm01db01                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          2        ONLINE  ONLINE       dm01db02                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          3        ONLINE  ONLINE       dm01db04                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          4        ONLINE  ONLINE       dm01db05                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          5        ONLINE  ONLINE       dm01db07                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          6        ONLINE  ONLINE       dm01db06                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          7        ONLINE  ONLINE       dm01db03                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
          8        ONLINE  ONLINE       dm01db08                 Open,HOME=/u01/app/o
                                                                 racle/product/12.2.0
                                                                 .1/dbhome,STABLE
    ora.qosmserver
          1        ONLINE  ONLINE       dm01db01                 STABLE
    ora.scan1.vip
          1        ONLINE  ONLINE       dm01db02                 STABLE
    ora.scan2.vip
          1        ONLINE  ONLINE       dm01db04                 STABLE
    ora.scan3.vip
          1        ONLINE  ONLINE       dm01db01                 STABLE
    ——————————————————————————–

    Conclusion:
    In this article we have learned how to quickly configure ACFS on Exadata Database machine running Oracle 12.2.0.1 on ASM Flex Architecture.

  • Convert Standard ASM to Flex ASM on Exadata

    About Flex ASM

    • In earlier Oracle database release, ASM will be running on each node in the cluster and ASM clients such as database and ACFS can only access ASM by using an ASM on the same host.
    • Oracle Database 12c introduced a new feature called Oracle Flex ASM which provides remote storage access.
    • Oracle Flex ASM is an ASM instance which will be running in the cluster based on cardinality defined.
    • The default cardinality is 3, but this can be modified using srvctl modify asm command.
    • ASM is not required to run on each node in the cluster.
    • With Oracle Flex ASM,the clients can connect to remote ASM using network connection (ie ASM network ).
    • If a server running an ASM instance fails, Oracle Clusterware will start a new ASM instance on a different server to maintain the cardinality. If a 12c database instance is using a particular ASM instance, and that instance is lost because of a server crash or ASM instance failure, then the Oracle 12c database instance will reconnect to an existing ASM instance on another node.These features are collectively called Oracle Flex ASM.



    Steps to Convert Standard ASM to Flex ASM

    • You can convert an Oracle ASM configuration to an Oracle Flex ASM using ASMCA. This functionality is only available in an Oracle Grid Infrastructure 12c configuration.

    Before you convert an Oracle ASM configuration to an Oracle Flex ASM, you must ensure the following:

    • Oracle Cluster Registry (OCR) is stored in a disk group

    [root@dm01db01 ~]# /u01/app/12.1.0.2/grid/bin/ocrcheck
    Status of Oracle Cluster Registry is as follows :
             Version                  :          4
             Total space (kbytes)     :     409568
             Used space (kbytes)      :      10684
             Available space (kbytes) :     398884
             ID                       : 1119121028
             Device/File Name         :      +DATA
                                        Device/File integrity check succeeded


                                        Device/File not configured


                                        Device/File not configured


                                        Device/File not configured


                                        Device/File not configured


             Cluster registry integrity check succeeded


             Logical corruption check succeeded

    • The server parameter file (SPFILE) is stored in a disk group.

    SQL> show parameter spfile


    NAME                                 TYPE        VALUE
    ———————————— ———– ——————————
    spfile                               string      +DATA/dm01-cluster/ASMPARAMETE
                                                     RFILE/registry.253.934096549

    SQL> show parameter spfile


    NAME                                 TYPE        VALUE
    ———————————— ———– ——————————
    spfile                               string      +DATA/orcl/spfileorcl.ora

    • The password file (ORAPWD file) is stored in a disk group.

    dm01db01-orcldb1 {/home/oracle}:dcli -g ~/dbs_group -l oracle ‘ls -ltr
    dm01db01: -rw-r—– 1 oracle oinstall 8192 Jan 17 03:45 /u01/app/oracle/product/12.1.0.2/dbhome/dbs/orapworcl1
    dm01db01: -rw-r—– 1 oracle oinstall 8192 Jan 17 03:45 /u01/app/oracle/product/12.1.0.2/dbhome/dbs/orapworcl2
    dm01db01: -rw-r—– 1 oracle oinstall 8192 Jan 17 03:45 /u01/app/oracle/product/12.1.0.2/dbhome/dbs/orapworcl3
    dm01db01: -rw-r—– 1 oracle oinstall 8192 Jan 17 03:45 /u01/app/oracle/product/12.1.0.2/dbhome/dbs/orapworcl4
    dm01db01: -rw-r—– 1 oracle oinstall 8192 Jan 17 03:45 /u01/app/oracle/product/12.1.0.2/dbhome/dbs/orapworcl5
    dm01db01: -rw-r—– 1 oracle oinstall 8192 Jan 17 03:45 /u01/app/oracle/product/12.1.0.2/dbhome/dbs/orapworcl7
    dm01db01: -rw-r—– 1 oracle oinstall 8192 Jan 17 03:45 /u01/app/oracle/product/12.1.0.2/dbhome/dbs/orapworcl6
    dm01db01: -rw-r—– 1 oracle oinstall 8192 Jan 17 03:45 /u01/app/oracle/product/12.1.0.2/dbhome/dbs/orapworcl8


    dm01db01-orcl1 {/home/oracle}:orapwd file=’+DATA/orcl/orapworcl’ entries=10 dbuniquename=’orcl’ format=12


    Enter password for SYS:


    ASMCMD> ls -l +DATA/ORCL/orapworcl
    Type      Redund  Striped  Time             Sys  Name
    PASSWORD  HIGH    COARSE   JAN 26 06:00:00  N    orapworcl => +DATA/ORCL/PASSWORD/pwdorcl.272.934265865


    dm01db01-+ASM1 {/home/oracle}:orapwd file=’+DATA/orapwASM’ entries=10 dbuniquename=’ASM’ format=12


    Enter password for SYS:


    OPW-00019: Failed to update the CRS resource with DB password file location


    dm01db01-+ASM1 {/home/oracle}:srvctl modify asm -pwfile +DATA/orapwASM


    dm01db01-+ASM1 {/home/oracle}:srvctl config asm -detail
    ASM home: <CRS home>
    Password file: +DATA/orapwASM
    ASM listener: LISTENER
    ASM is enabled.
    ASM is individually enabled on nodes:
    ASM is individually disabled on nodes:

    ASMCMD [+DATA] > ls -l orapwasm
    Type      Redund  Striped  Time             Sys  Name
    PASSWORD  HIGH    COARSE   JAN 27 04:00:00  N    orapwasm => +DATA/ASM/PASSWORD/pwdasm.399.934344779

    • The disk group where the OCR, SPFILE, and ORAPWD files are stored has Oracle ASM compatibility (COMPATIBLE.ASM) set to 12.1 or higher.

    SQL> col name for a40
    SQL> col value for a40
    SQL> set lines 200
    SQL> set pages 200
    SQL> select a.group_number,b.name dgname,a.name,a.value from v$asm_attribute a, v$asm_diskgroup b where a.name in (‘au_size’,’disk_repair_time’,’compatible.rdbms’,’compatible.asm’) and a.group_number=b.group_number order by b.name,a.name;


    GROUP_NUMBER DGNAME                         NAME                                     VALUE
    ———— —————————— ————————–               ————————
               3 ACFS_DG                        au_size                                  4194304
               3 ACFS_DG                        compatible.asm                           12.1.0.0.0
               3 ACFS_DG                        compatible.rdbms                         12.1.0.0.0
               3 ACFS_DG                        disk_repair_time                         3.6h
               1 DATA                           au_size                                  4194304
               1 DATA                           compatible.asm                           12.1.0.2.0
               1 DATA                           compatible.rdbms                         11.2.0.4.0
               1 DATA                           disk_repair_time                         3.6h
               2 RECO                           au_size                                  4194304
               2 RECO                           compatible.asm                           12.1.0.2.0
               2 RECO                           compatible.rdbms                         11.2.0.4.0
               2 RECO                           disk_repair_time                         3.6h


    dm01db01-+ASM1 {/home/oracle}:/u01/app/12.1.0.2/grid/bin/crsctl stat res -t
    ——————————————————————————–
    Name           Target  State        Server                   State details
    ——————————————————————————–
    Local Resources
    ——————————————————————————–
    ora.ACFS_DG.ACFSVOL.advm
                   ONLINE  ONLINE       dm01db01                 Volume device /dev/a
                                                                 sm/acfsvol-228 is online,STABLE
                   ONLINE  ONLINE       dm01db02                 Volume device /dev/a
                                                                 sm/acfsvol-228 is online,STABLE
                   ONLINE  ONLINE       dm01db03                 Volume device /dev/a
                                                                 sm/acfsvol-228 is online,STABLE
                   ONLINE  ONLINE       dm01db04                 Volume device /dev/a
                                                                 sm/acfsvol-228 is online,STABLE
                   ONLINE  ONLINE       dm01db05                 Volume device /dev/a
                                                                 sm/acfsvol-228 is online,STABLE
                   ONLINE  ONLINE       dm01db06                 Volume device /dev/a
                                                                 sm/acfsvol-228 is online,STABLE
                   ONLINE  ONLINE       dm01db07                 Volume device /dev/a
                                                                 sm/acfsvol-228 is online,STABLE
                   ONLINE  ONLINE       dm01db08                 Volume device /dev/a
                                                                 sm/acfsvol-228 is online,STABLE
    ora.ACFS_DG.dg
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ora.DATA.dg
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ora.LISTENER.lsnr
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ora.RECO.dg
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ora.acfs_dg.acfsvol.acfs
                   ONLINE  ONLINE       dm01db01                 mounted on /acfs,STABLE
                   ONLINE  ONLINE       dm01db02                 mounted on /acfs,STABLE
                   ONLINE  ONLINE       dm01db03                 mounted on /acfs,STABLE
                   ONLINE  ONLINE       dm01db04                 mounted on /acfs,STABLE
                   ONLINE  ONLINE       dm01db05                 mounted on /acfs,STABLE
                   ONLINE  ONLINE       dm01db06                 mounted on /acfs,STABLE
                   ONLINE  ONLINE       dm01db07                 mounted on /acfs,STABLE
                   ONLINE  ONLINE       dm01db08                 mounted on /acfs,STABLE
    ora.asm
                   ONLINE  ONLINE       dm01db01                 Started,STABLE
                   ONLINE  ONLINE       dm01db02                 Started,STABLE
                   ONLINE  ONLINE       dm01db03                 Started,STABLE
                   ONLINE  ONLINE       dm01db04                 Started,STABLE
                   ONLINE  ONLINE       dm01db05                 Started,STABLE
                   ONLINE  ONLINE       dm01db06                 Started,STABLE
                   ONLINE  ONLINE       dm01db07                 Started,STABLE
                   ONLINE  ONLINE       dm01db08                 Started,STABLE
    ora.net1.network
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ora.ons
                   ONLINE  ONLINE       dm01db01                 STABLE
                   ONLINE  ONLINE       dm01db02                 STABLE
                   ONLINE  ONLINE       dm01db03                 STABLE
                   ONLINE  ONLINE       dm01db04                 STABLE
                   ONLINE  ONLINE       dm01db05                 STABLE
                   ONLINE  ONLINE       dm01db06                 STABLE
                   ONLINE  ONLINE       dm01db07                 STABLE
                   ONLINE  ONLINE       dm01db08                 STABLE
    ——————————————————————————–
    Cluster Resources
    ——————————————————————————–
    ora.LISTENER_SCAN1.lsnr
          1        ONLINE  ONLINE       dm01db08                 STABLE
    ora.LISTENER_SCAN2.lsnr
          1        ONLINE  ONLINE       dm01db07                 STABLE
    ora.LISTENER_SCAN3.lsnr
          1        ONLINE  ONLINE       dm01db05                 STABLE
    ora.dm01db01.vip
          1        ONLINE  ONLINE       dm01db01                 STABLE
    ora.dm01db02.vip
          1        ONLINE  ONLINE       dm01db02                 STABLE
    ora.dm01db03.vip
          1        ONLINE  ONLINE       dm01db03                 STABLE
    ora.dm01db04.vip
          1        ONLINE  ONLINE       dm01db04                 STABLE
    ora.dm01db05.vip
          1        ONLINE  ONLINE       dm01db05                 STABLE
    ora.dm01db06.vip
          1        ONLINE  ONLINE       dm01db06                 STABLE
    ora.dm01db07.vip
          1        ONLINE  ONLINE       dm01db07                 STABLE
    ora.dm01db08.vip
          1        ONLINE  ONLINE       dm01db08                 STABLE
    ora.cvu
          1        ONLINE  ONLINE       dm01db06                 STABLE
    ora.oc4j
          1        OFFLINE OFFLINE                               STABLE
    ora.orcl.db
          1        ONLINE  ONLINE       dm01db03                 Open,STABLE
          2        ONLINE  ONLINE       dm01db04                 Open,STABLE
          3        ONLINE  ONLINE       dm01db01                 Open,STABLE
          4        ONLINE  ONLINE       dm01db05                 Open,STABLE
          5        ONLINE  ONLINE       dm01db06                 Open,STABLE
          6        ONLINE  ONLINE       dm01db02                 Open,STABLE
          7        ONLINE  ONLINE       dm01db07                 Open,STABLE
          8        ONLINE  ONLINE       dm01db08                 Open,STABLE
    ora.scan1.vip
          1        ONLINE  ONLINE       dm01db08                 STABLE
    ora.scan2.vip
          1        ONLINE  ONLINE       dm01db07                 STABLE
    ora.scan3.vip
          1        ONLINE  ONLINE       dm01db05                 STABLE




    ASMCMD> showclustermode
    ASM cluster : Flex mode disabled


    dm01db01-+ASM1 {/home/oracle}:srvctl status asm -detail
    ASM is running on dm01db01,dm01db03,dm01db02,dm01db05,dm01db04,dm01db07,dm01db06,dm01db08
    ASM is enabled.


    Conversion Steps

    • Set the display and Start ASMCA



    • Click on “ASM Instances” and then “Convert to Oracle Flex ASM”



    • On Convert to Oracle Flex ASM page, specify:
      • ASM Listener Port number: 1521
      • Select network to be used for ASM: bond0 (cluster_interconnect)
      • Check the box if you plan on using ASM for pre 12c databases.
      • Click Ok



    • Click Yes



    • The processing page will be displayed.





    • Open the script and view the script contents.

    [root@dm01db01 ~]# cat /u01/app/oracle/cfgtoollogs/asmca/scripts/converttoFlexASM.sh  | more
    #!/bin/sh


    cd /u01/app/oracle/cfgtoollogs/asmca/scripts
    su oracle -c “/u01/app/12.1.0.2/grid/bin/srvctl add asm -proxy”
    if [ “$?” != “0” ]; then
            echo “Error adding ASM Proxy”
            exit 1
    fi
    /u01/app/12.1.0.2/grid/srvm/admin/srvmhelper -updateDepASM
    if [ “$?” != “0” ]; then
            echo “Error updating ASM resource dependencies”
            exit 1
    fi
    for node in dm01db01 dm01db02 dm01db03 dm01db04 dm01db05 dm01db06 dm01db07 dm01db08
    do
            /u01/app/12.1.0.2/grid/bin/crsctl stop cluster -n $node
            if [ “$?” != “0” ]; then
                    echo “Error stopping Oracle Grid Infrastructure in node $node”
                    exit 1
            fi
            /u01/app/12.1.0.2/grid/bin/crsctl start cluster -n $node


            stat=1
            cmd=”/u01/app/12.1.0.2/grid/bin/crsctl status server $node”
            while [ $stat = 1 ]
            do
                    sleep 5
                    op=`$cmd`
                    op=`echo $op | /bin/cut -d’ ‘ -f2  | /bin/cut -d’=’ -f2`
                    if [ “$op” = “ONLINE” ]
                    then
                            stat=0
                            echo “Oracle Grid Infrastructure restarted in node $node”
                    fi
            done
            if [ “$node” = dm01db01 ]; then
                    for lsnr in ASMNET1LSNR_ASM
                    do
                            /u01/app/12.1.0.2/grid/bin/srvctl start listener -listener $lsnr
                            lsnrret=$?
                            if [ “$lsnrret” = “2” ]; then
                                    echo “ASM listener $lsnr running already”
                            elif [ “$lsnrret” != “0” ]; then
                                    echo “Error starting ASM listener $lsnr”
                                    exit 1
                            fi
                    done
            fi
    done


    • Execute the script on node 1 as root user as follows:

    dm01db01-+ASM1 {/dev/asm}:df -k | grep asm
    /dev/asm/acfsvol-228


    Stop the ACFS file system before executing the script.


    dm01db01-+ASM1 {/dev/asm}:srvctl status filesystem -device /dev/asm/acfsvol-228
    ACFS file system /acfs is mounted on nodes


    dm01db01,dm01db02,dm01db03,dm01db04,dm01db05,dm01db06,dm01db07,dm01db08


    dm01db01-+ASM1 {/home/oracle}:srvctl stop filesystem -d /dev/asm/acfsvol-228 -f


    dm01db01-+ASM1 {/home/oracle}:srvctl status filesystem -d /dev/asm/acfsvol-228
    ACFS file system /acfs is not mounted


    dm01db01-+ASM1 {/dev/asm}:df -k | grep asm


    Finally execute the script


    [root@dm01db01 ~]# /u01/app/oracle/cfgtoollogs/asmca/scripts/converttoFlexASM.sh
    CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db01’
    CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db01’
    CRS-2673: Attempting to stop ‘ora.orcldb.db’ on ‘dm01db01’
    CRS-2673: Attempting to stop ‘ttsrv_dm01db01’ on ‘dm01db01’
    CRS-2673: Attempting to stop ‘ora.acfs_dg.acfsvol.acfs’ on ‘dm01db01’
    CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr’ on ‘dm01db01’
    CRS-2673: Attempting to stop ‘ora.RECO.dg’ on ‘dm01db01’
    CRS-2673: Attempting to stop ‘ora.DATA.dg’ on ‘dm01db01’
    CRS-2673: Attempting to stop ‘ora.orcl.db’ on ‘dm01db01’
    CRS-2673: Attempting to stop ‘ora.ACFS_DG.dg’ on ‘dm01db01’
    CRS-2677: Stop of ‘ora.ACFS_DG.dg’ on ‘dm01db01’ succeeded
    CRS-2677: Stop of ‘ora.RECO.dg’ on ‘dm01db01’ succeeded
    CRS-2677: Stop of ‘ora.DATA.dg’ on ‘dm01db01’ succeeded
    CRS-2677: Stop of ‘ora.LISTENER.lsnr’ on ‘dm01db01’ succeeded
    CRS-2673: Attempting to stop ‘ora.dm01db01.vip’ on ‘dm01db01’
    CRS-2677: Stop of ‘ora.dm01db01.vip’ on ‘dm01db01’ succeeded
    CRS-2672: Attempting to start ‘ora.dm01db01.vip’ on ‘dm01db05’
    CRS-2677: Stop of ‘ora.orcldb.db’ on ‘dm01db01’ succeeded
    CRS-2677: Stop of ‘ora.orcl.db’ on ‘dm01db01’ succeeded
    CRS-2676: Start of ‘ora.dm01db01.vip’ on ‘dm01db05’ succeeded
    CRS-2673: Attempting to stop ‘ora.ons’ on ‘dm01db01’
    CRS-2677: Stop of ‘ora.ons’ on ‘dm01db01’ succeeded
    CRS-2673: Attempting to stop ‘ora.net1.network’ on ‘dm01db01’
    CRS-2677: Stop of ‘ora.net1.network’ on ‘dm01db01’ succeeded
    CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘dm01db01’ has completed
    CRS-2677: Stop of ‘ora.crsd’ on ‘dm01db01’ succeeded
    CRS-2673: Attempting to stop ‘ora.ctssd’ on ‘dm01db01’
    CRS-2673: Attempting to stop ‘ora.evmd’ on ‘dm01db01’
    CRS-2673: Attempting to stop ‘ora.storage’ on ‘dm01db01’
    CRS-2677: Stop of ‘ora.storage’ on ‘dm01db01’ succeeded
    CRS-2673: Attempting to stop ‘ora.asm’ on ‘dm01db01’
    CRS-2677: Stop of ‘ora.ctssd’ on ‘dm01db01’ succeeded
    CRS-2677: Stop of ‘ora.evmd’ on ‘dm01db01’ succeeded
    CRS-2677: Stop of ‘ora.asm’ on ‘dm01db01’ succeeded
    CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip’ on ‘dm01db01’
    CRS-2677: Stop of ‘ora.cluster_interconnect.haip’ on ‘dm01db01’ succeeded
    CRS-2673: Attempting to stop ‘ora.cssd’ on ‘dm01db01’
    CRS-2677: Stop of ‘ora.cssd’ on ‘dm01db01’ succeeded
    CRS-2673: Attempting to stop ‘ora.diskmon’ on ‘dm01db01’
    CRS-2677: Stop of ‘ora.diskmon’ on ‘dm01db01’ succeeded
    CRS-2672: Attempting to start ‘ora.evmd’ on ‘dm01db01’
    CRS-2672: Attempting to start ‘ora.cssdmonitor’ on ‘dm01db01’
    CRS-2676: Start of ‘ora.cssdmonitor’ on ‘dm01db01’ succeeded
    CRS-2672: Attempting to start ‘ora.cssd’ on ‘dm01db01’
    CRS-2672: Attempting to start ‘ora.diskmon’ on ‘dm01db01’
    CRS-2676: Start of ‘ora.evmd’ on ‘dm01db01’ succeeded
    CRS-2676: Start of ‘ora.diskmon’ on ‘dm01db01’ succeeded
    CRS-2676: Start of ‘ora.cssd’ on ‘dm01db01’ succeeded
    CRS-2672: Attempting to start ‘ora.ctssd’ on ‘dm01db01’
    CRS-2672: Attempting to start ‘ora.cluster_interconnect.haip’ on ‘dm01db01’
    CRS-2676: Start of ‘ora.ctssd’ on ‘dm01db01’ succeeded
    CRS-2676: Start of ‘ora.cluster_interconnect.haip’ on ‘dm01db01’ succeeded
    CRS-2672: Attempting to start ‘ora.asm’ on ‘dm01db01’
    CRS-2676: Start of ‘ora.asm’ on ‘dm01db01’ succeeded
    CRS-2672: Attempting to start ‘ora.storage’ on ‘dm01db01’
    CRS-2676: Start of ‘ora.storage’ on ‘dm01db01’ succeeded
    CRS-2672: Attempting to start ‘ora.crsd’ on ‘dm01db01’
    CRS-2676: Start of ‘ora.crsd’ on ‘dm01db01’ succeeded
    Oracle Grid Infrastructure restarted in node dm01db01
    CRS-2673: Attempting to stop ‘ora.crsd’ on ‘dm01db02’
    CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘dm01db02’
    CRS-2673: Attempting to stop ‘ora.acfs_dg.acfsvol.acfs’ on ‘dm01db02’
    CRS-2673: Attempting to stop ‘ora.orcl.db’ on ‘dm01db02’
    CRS-2673: Attempting to stop ‘ora.orcldb.db’ on ‘dm01db02’
    CRS-2673: Attempting to stop ‘ora.RECO.dg’ on ‘dm01db02’
    CRS-2673: Attempting to stop ‘ora.DATA.dg’ on ‘dm01db02’
    CRS-2677: Stop of ‘ora.RECO.dg’ on ‘dm01db02’ succeeded
    CRS-2677: Stop of ‘ora.DATA.dg’ on ‘dm01db02’ succeeded
    CRS-2677: Stop of ‘ora.orcl.db’ on ‘dm01db02’ succeeded
    CRS-2677: Stop of ‘ora.orcldb.db’ on ‘dm01db02’ succeeded
    …
    …


    [root@dm01db01 ~]#

    • Go back to ASMCA and click close.

    Verify the cluster mode now.


    ASMCMD> showclustermode
    ASM cluster : Flex mode enabled

    Conclusion
    In this article we have learned about Flex ASM in Oracle database 12c and how to convert a Standard ASM to Flex ASM to take advantage of 12c new feature.