Steps to power down a cell without affecting ASM in Exadata:-
Environment:-Oracle SuperCluster T5-8
2 SPARC T5-8 Compute nodes, 4 EXADATA X5-2 Storage cells
Scenario:- One of exadata Storage cell node had a faully motherboard, which required a replacement. Due to this we had to shutdown the storage cell and perform the replacement activity.
Note:- When performing maintenance on Exadata Cells, it may be necessary to power down or reboot the cell. If a storage server is to be shut down when one or more databases are running, then verify that taking the storage server offline will not impact Oracle ASM disk group and database availability. The ability to take Oracle Exadata Storage Server offline without affecting database availability depends on the level of Oracle ASM redundancy used on the affected disk groups, and the current status of disks in other Oracle Exadata Storage Servers that have mirror copies of data as Oracle Exadata Storage Server to be taken offline.
Step 1.
By default, ASM drops a disk shortly after it is taken offline; however, you can set the
DISK_REPAIR_TIME attribute to prevent this operation by specifying a time interval to repair the
disk and bring it back online. The default DISK_REPAIR_TIME attribute value of 3.6h should be adequate
for most environments.
(a) To check repair times for all mounted disk groups - log into the ASM instance and perform the following query:
From Any Compute Node :-
From asm user.
Envoke grid environment
export ORACLE_HOME=/u01/app/11.2.0.4/grid
export ORACLE_SID=+ASM1 [We are logged into compute node 1]
export PATH=$ORACLE_HOME/bin:$PATH:.
sqlplus / as sysasm
SQL> select dg.name,a.value from v$asm_diskgroup
dg, v$asm_attribute a where dg.group_number=a.group_number and
a.name='disk_repair_time';
NAME VALUE
---------------- ------------------
DATAC1 3.6h
DBFS_DG1 3.6h
RECOC1 3.6h
(b) If you need to offline the ASM disks for more than the default time of 3.6 hours then adjust the
parameter by issuing the command below as an example:
SQL> ALTER DISKGROUP <DISKGROUP NAME> SET ATTRIBUTE 'DISK_REPAIR_TIME'='8.5H';
In our case,we estimated more than 3.6hrs for the entire activity. So we decided to alter the
disk_repair_time for two DB domains in supercluster.
From DB domain 1:-
SQL>ALTER DISKGROUP DATAC1 SET ATTRIBUTE ‘DISK_REPAIR_TIME’=’8.5H’;
SQL>ALTER DISKGROUP DBFS_DG1 SET ATTRIBUTE ‘DISK_REPAIR_TIME’=’8.5H’;
SQL>ALTER DISKGROUP RECOC1 SET ATTRIBUTE ‘DISK_REPAIR_TIME’=’8.5H’;
From DB domain2:-
SQL>ALTER DISKGROUP DATAC2 SET ATTRIBUTE ‘DISK_REPAIR_TIME’=’8.5H’;
SQL>ALTER DISKGROUP DBFS_DG2 SET ATTRIBUTE ‘DISK_REPAIR_TIME’=’8.5H’;
SQL>ALTER DISKGROUP RECOC2 SET ATTRIBUTE ‘DISK_REPAIR_TIME’=’8.5H’;
Step 2.
Next we need to check if ASM will be OK if the grid disks go OFFLINE. The following command
should return 'Yes' for the grid disks being listed:
Login to the particular cell server which you will shut down.
[root@itsccelladm01 ~]# cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
DATAC1_CD_00_itscceladm01 ONLINE yes
DATAC1_CD_01_itscceladm01 ONLINE yes
DATAC1_CD_02_itscceladm01 ONLINE yes
DATAC1_CD_03_itscceladm01 ONLINE yes
DATAC1_CD_04_itscceladm01 ONLINE yes
DATAC1_CD_05_itscceladm01 ONLINE yes
DATAC1_CD_06_itscceladm01 ONLINE yes
DATAC1_CD_07_itscceladm01 ONLINE yes
DATAC1_CD_08_itscceladm01 ONLINE yes
DATAC1_CD_09_itscceladm01 ONLINE yes
DATAC1_CD_10_itscceladm01 ONLINE yes
DATAC1_CD_11_itscceladm01 ONLINE yes
DATAC2_CD_00_itscceladm01 ONLINE yes
DATAC2_CD_01_itscceladm01 ONLINE yes
DATAC2_CD_02_itscceladm01 ONLINE yes
DATAC2_CD_03_itscceladm01 ONLINE yes
DATAC2_CD_04_itscceladm01 ONLINE yes
DATAC2_CD_05_itscceladm01 ONLINE yes
DATAC2_CD_06_itscceladm01 ONLINE yes
DATAC2_CD_07_itscceladm01 ONLINE yes
DATAC2_CD_08_itscceladm01 ONLINE yes
DATAC2_CD_09_itscceladm01 ONLINE yes
DATAC2_CD_10_itscceladm01 ONLINE yes
DATAC2_CD_11_itscceladm01 ONLINE yes
DBFS_DG1_CD_00_itscceladm01 ONLINE yes
DBFS_DG1_CD_01_itscceladm01 ONLINE yes
DBFS_DG1_CD_02_itscceladm01 ONLINE yes
DBFS_DG1_CD_03_itscceladm01 ONLINE yes
DBFS_DG1_CD_04_itscceladm01 ONLINE yes
DBFS_DG1_CD_05_itscceladm01 ONLINE yes
DBFS_DG1_CD_06_itscceladm01 ONLINE yes
DBFS_DG1_CD_07_itscceladm01 ONLINE yes
DBFS_DG1_CD_08_itscceladm01 ONLINE yes
DBFS_DG1_CD_09_itscceladm01 ONLINE yes
DBFS_DG1_CD_10_itscceladm01 ONLINE yes
DBFS_DG1_CD_11_itscceladm01 ONLINE yes
DBFS_DG2_CD_00_itscceladm01 ONLINE yes
DBFS_DG2_CD_01_itscceladm01 ONLINE yes
DBFS_DG2_CD_02_itscceladm01 ONLINE yes
DBFS_DG2_CD_03_itscceladm01 ONLINE yes
DBFS_DG2_CD_04_itscceladm01 ONLINE yes
DBFS_DG2_CD_05_itscceladm01 ONLINE yes
DBFS_DG2_CD_06_itscceladm01 ONLINE yes
DBFS_DG2_CD_07_itscceladm01 ONLINE yes
DBFS_DG2_CD_08_itscceladm01 ONLINE yes
DBFS_DG2_CD_09_itscceladm01 ONLINE yes
DBFS_DG2_CD_10_itscceladm01 ONLINE yes
DBFS_DG2_CD_11_itscceladm01 ONLINE yes
RECOC1_CD_00_itscceladm01 ONLINE yes
RECOC1_CD_01_itscceladm01 ONLINE yes
RECOC1_CD_02_itscceladm01 ONLINE yes
RECOC1_CD_03_itscceladm01 ONLINE yes
RECOC1_CD_04_itscceladm01 ONLINE yes
RECOC1_CD_05_itscceladm01 ONLINE yes
RECOC1_CD_06_itscceladm01 ONLINE yes
RECOC1_CD_07_itscceladm01 ONLINE yes
RECOC1_CD_08_itscceladm01 ONLINE yes
RECOC1_CD_09_itscceladm01 ONLINE yes
RECOC1_CD_10_itscceladm01 ONLINE yes
RECOC1_CD_11_itscceladm01 ONLINE yes
RECOC2_CD_00_itscceladm01 ONLINE yes
RECOC2_CD_01_itscceladm01 ONLINE yes
RECOC2_CD_02_itscceladm01 ONLINE yes
RECOC2_CD_03_itscceladm01 ONLINE yes
RECOC2_CD_04_itscceladm01 ONLINE yes
RECOC2_CD_05_itscceladm01 ONLINE yes
RECOC2_CD_06_itscceladm01 ONLINE yes
RECOC2_CD_07_itscceladm01 ONLINE yes
RECOC2_CD_08_itscceladm01 ONLINE yes
RECOC2_CD_09_itscceladm01 ONLINE yes
RECOC2_CD_10_itscceladm01 ONLINE yes
RECOC2_CD_11_itscceladm01 ONLINE yes
If one or more disks does not return asmdeactivationoutcome='Yes', then we should check the respective
diskgroup and restore the data redundancy for that diskgroup.
Once the diskgroup data redundancy is fully restored, repeat the previous command (step 2).
Once all disks return asmdeactivationoutcome='Yes', qw can proceed with taking the griddisk
offline (step 3).
Note: Shutting down the cell services when one or more grid disks does not return
asmdeactivationoutcome='Yes' will cause Oracle ASM to dismount the affected disk group, causing the
databases to shut down abruptly.
Step 3.
Run cellcli command to Inactivate all grid disks on the cell you wish to power down/reboot:
[root@itsccelladm01 ~]#cellcli -e alter griddisk all inactive
GridDisk DATAC1_CD_00_itscceladm01 successfully altered
GridDisk DATAC1_CD_01_itscceladm01 successfully altered
GridDisk DATAC1_CD_02_itscceladm01 successfully altered
GridDisk DATAC1_CD_03_itscceladm01 successfully altered
GridDisk DATAC1_CD_04_itscceladm01 successfully altered
GridDisk DATAC1_CD_05_itscceladm01 successfully altered
GridDisk DATAC1_CD_06_itscceladm01 successfully altered
GridDisk DATAC1_CD_07_itscceladm01 successfully altered
GridDisk DATAC1_CD_08_itscceladm01 successfully altered
GridDisk DATAC1_CD_09_itscceladm01 successfully altered
GridDisk DATAC1_CD_10_itscceladm01 successfully altered
GridDisk DATAC1_CD_11_itscceladm01 successfully altered
GridDisk DATAC2_CD_00_itscceladm01 successfully altered
GridDisk DATAC2_CD_01_itscceladm01 successfully altered
GridDisk DATAC2_CD_02_itscceladm01 successfully altered
GridDisk DATAC2_CD_03_itscceladm01 successfully altered
GridDisk DATAC2_CD_04_itscceladm01 successfully altered
GridDisk DATAC2_CD_05_itscceladm01 successfully altered
GridDisk DATAC2_CD_06_itscceladm01 successfully altered
GridDisk DATAC2_CD_07_itscceladm01 successfully altered
GridDisk DATAC2_CD_08_itscceladm01 successfully altered
GridDisk DATAC2_CD_09_itscceladm01 successfully altered
GridDisk DATAC2_CD_10_itscceladm01 successfully altered
GridDisk DATAC2_CD_11_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_00_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_01_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_02_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_03_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_04_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_05_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_06_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_07_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_08_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_09_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_10_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_11_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_00_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_01_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_02_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_03_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_04_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_05_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_06_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_07_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_08_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_09_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_10_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_11_itscceladm01 successfully altered
GridDisk RECOC1_CD_00_itscceladm01 successfully altered
GridDisk RECOC1_CD_01_itscceladm01 successfully altered
GridDisk RECOC1_CD_02_itscceladm01 successfully altered
GridDisk RECOC1_CD_03_itscceladm01 successfully altered
GridDisk RECOC1_CD_04_itscceladm01 successfully altered
GridDisk RECOC1_CD_05_itscceladm01 successfully altered
GridDisk RECOC1_CD_06_itscceladm01 successfully altered
GridDisk RECOC1_CD_07_itscceladm01 successfully altered
GridDisk RECOC1_CD_08_itscceladm01 successfully altered
GridDisk RECOC1_CD_09_itscceladm01 successfully altered
GridDisk RECOC1_CD_10_itscceladm01 successfully altered
GridDisk RECOC1_CD_11_itscceladm01 successfully altered
GridDisk RECOC2_CD_00_itscceladm01 successfully altered
GridDisk RECOC2_CD_01_itscceladm01 successfully altered
GridDisk RECOC2_CD_02_itscceladm01 successfully altered
GridDisk RECOC2_CD_03_itscceladm01 successfully altered
GridDisk RECOC2_CD_04_itscceladm01 successfully altered
GridDisk RECOC2_CD_05_itscceladm01 successfully altered
GridDisk RECOC2_CD_06_itscceladm01 successfully altered
GridDisk RECOC2_CD_07_itscceladm01 successfully altered
GridDisk RECOC2_CD_08_itscceladm01 successfully altered
GridDisk RECOC2_CD_09_itscceladm01 successfully altered
GridDisk RECOC2_CD_10_itscceladm01 successfully altered
GridDisk RECOC2_CD_11_itscceladm01 successfully altered
* Please note - This action could take 10 minutes or longer depending on activity. It is very important
to make sure you were able to offline all the disks successfully before shutting down the cell services.
Inactivating the grid disks will automatically OFFLINE the disks in the ASM instance.
Step 4.
Confirm that the griddisks are now offline by performing the following actions:
(a) Execute the command below and the output should show either asmmodestatus=OFFLINE or
asmmodestatus=UNUSED and asmdeactivationoutcome=Yes for all griddisks once the disks are offline in ASM.
Only then is it safe to proceed with shutting down or restarting the cell:
[root@itsccelladm01 ~]#cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
DATAC1_CD_00_itscceladm01 OFFLINE yes
DATAC1_CD_01_itscceladm01 OFFLINE yes
DATAC1_CD_02_itscceladm01 OFFLINE yes
DATAC1_CD_03_itscceladm01 OFFLINE yes
DATAC1_CD_04_itscceladm01 OFFLINE yes
DATAC1_CD_05_itscceladm01 OFFLINE yes
DATAC1_CD_06_itscceladm01 OFFLINE yes
DATAC1_CD_07_itscceladm01 OFFLINE yes
DATAC1_CD_08_itscceladm01 OFFLINE yes
DATAC1_CD_09_itscceladm01 OFFLINE yes
DATAC1_CD_10_itscceladm01 OFFLINE yes
DATAC1_CD_11_itscceladm01 OFFLINE yes
DATAC2_CD_00_itscceladm01 OFFLINE yes
DATAC2_CD_01_itscceladm01 OFFLINE yes
DATAC2_CD_02_itscceladm01 OFFLINE yes
DATAC2_CD_03_itscceladm01 OFFLINE yes
DATAC2_CD_04_itscceladm01 OFFLINE yes
DATAC2_CD_05_itscceladm01 OFFLINE yes
DATAC2_CD_06_itscceladm01 OFFLINE yes
DATAC2_CD_07_itscceladm01 OFFLINE yes
DATAC2_CD_08_itscceladm01 OFFLINE yes
DATAC2_CD_09_itscceladm01 OFFLINE yes
DATAC2_CD_10_itscceladm01 OFFLINE yes
DATAC2_CD_11_itscceladm01 OFFLINE yes
DBFS_DG1_CD_00_itscceladm01 OFFLINE yes
DBFS_DG1_CD_01_itscceladm01 OFFLINE yes
DBFS_DG1_CD_02_itscceladm01 OFFLINE yes
DBFS_DG1_CD_03_itscceladm01 OFFLINE yes
DBFS_DG1_CD_04_itscceladm01 OFFLINE yes
DBFS_DG1_CD_05_itscceladm01 OFFLINE yes
DBFS_DG1_CD_06_itscceladm01 OFFLINE yes
DBFS_DG1_CD_07_itscceladm01 OFFLINE yes
DBFS_DG1_CD_08_itscceladm01 OFFLINE yes
DBFS_DG1_CD_09_itscceladm01 OFFLINE yes
DBFS_DG1_CD_10_itscceladm01 OFFLINE yes
DBFS_DG1_CD_11_itscceladm01 OFFLINE yes
DBFS_DG2_CD_00_itscceladm01 OFFLINE yes
DBFS_DG2_CD_01_itscceladm01 OFFLINE yes
DBFS_DG2_CD_02_itscceladm01 OFFLINE yes
DBFS_DG2_CD_03_itscceladm01 OFFLINE yes
DBFS_DG2_CD_04_itscceladm01 OFFLINE yes
DBFS_DG2_CD_05_itscceladm01 OFFLINE yes
DBFS_DG2_CD_06_itscceladm01 OFFLINE yes
DBFS_DG2_CD_07_itscceladm01 OFFLINE yes
DBFS_DG2_CD_08_itscceladm01 OFFLINE yes
DBFS_DG2_CD_09_itscceladm01 OFFLINE yes
DBFS_DG2_CD_10_itscceladm01 OFFLINE yes
DBFS_DG2_CD_11_itscceladm01 OFFLINE yes
RECOC1_CD_00_itscceladm01 OFFLINE yes
RECOC1_CD_01_itscceladm01 OFFLINE yes
RECOC1_CD_02_itscceladm01 OFFLINE yes
RECOC1_CD_03_itscceladm01 OFFLINE yes
RECOC1_CD_04_itscceladm01 OFFLINE yes
RECOC1_CD_05_itscceladm01 OFFLINE yes
RECOC1_CD_06_itscceladm01 OFFLINE yes
RECOC1_CD_07_itscceladm01 OFFLINE yes
RECOC1_CD_08_itscceladm01 OFFLINE yes
RECOC1_CD_09_itscceladm01 OFFLINE yes
RECOC1_CD_10_itscceladm01 OFFLINE yes
RECOC1_CD_11_itscceladm01 OFFLINE yes
RECOC2_CD_00_itscceladm01 OFFLINE yes
RECOC2_CD_01_itscceladm01 OFFLINE yes
RECOC2_CD_02_itscceladm01 OFFLINE yes
RECOC2_CD_03_itscceladm01 OFFLINE yes
RECOC2_CD_04_itscceladm01 OFFLINE yes
RECOC2_CD_05_itscceladm01 OFFLINE yes
RECOC2_CD_06_itscceladm01 OFFLINE yes
RECOC2_CD_07_itscceladm01 OFFLINE yes
RECOC2_CD_08_itscceladm01 OFFLINE yes
RECOC2_CD_09_itscceladm01 OFFLINE yes
RECOC2_CD_10_itscceladm01 OFFLINE yes
RECOC2_CD_11_itscceladm01 OFFLINE yes
(b) List the griddisks to confirm all now show inactive:
[root@itsccelladm01 ~]#cellcli -e list griddisk
DATAC1_CD_00_itscceladm01 inactive
DATAC1_CD_01_itscceladm01 inactive
DATAC1_CD_02_itscceladm01 inactive
DATAC1_CD_03_itscceladm01 inactive
DATAC1_CD_04_itscceladm01 inactive
DATAC1_CD_05_itscceladm01 inactive
DATAC1_CD_06_itscceladm01 inactive
DATAC1_CD_07_itscceladm01 inactive
DATAC1_CD_08_itscceladm01 inactive
DATAC1_CD_09_itscceladm01 inactive
DATAC1_CD_10_itscceladm01 inactive
DATAC1_CD_11_itscceladm01 inactive
DATAC2_CD_00_itscceladm01 inactive
DATAC2_CD_01_itscceladm01 inactive
DATAC2_CD_02_itscceladm01 inactive
DATAC2_CD_03_itscceladm01 inactive
DATAC2_CD_04_itscceladm01 inactive
DATAC2_CD_05_itscceladm01 inactive
DATAC2_CD_06_itscceladm01 inactive
DATAC2_CD_07_itscceladm01 inactive
DATAC2_CD_08_itscceladm01 inactive
DATAC2_CD_09_itscceladm01 inactive
DATAC2_CD_10_itscceladm01 inactive
DATAC2_CD_11_itscceladm01 inactive
DBFS_DG1_CD_00_itscceladm01 inactive
DBFS_DG1_CD_01_itscceladm01 inactive
DBFS_DG1_CD_02_itscceladm01 inactive
DBFS_DG1_CD_03_itscceladm01 inactive
DBFS_DG1_CD_04_itscceladm01 inactive
DBFS_DG1_CD_05_itscceladm01 inactive
DBFS_DG1_CD_06_itscceladm01 inactive
DBFS_DG1_CD_07_itscceladm01 inactive
DBFS_DG1_CD_08_itscceladm01 inactive
DBFS_DG1_CD_09_itscceladm01 inactive
DBFS_DG1_CD_10_itscceladm01 inactive
DBFS_DG1_CD_11_itscceladm01 inactive
DBFS_DG2_CD_00_itscceladm01 inactive
DBFS_DG2_CD_01_itscceladm01 inactive
DBFS_DG2_CD_02_itscceladm01 inactive
DBFS_DG2_CD_03_itscceladm01 inactive
DBFS_DG2_CD_04_itscceladm01 inactive
DBFS_DG2_CD_05_itscceladm01 inactive
DBFS_DG2_CD_06_itscceladm01 inactive
DBFS_DG2_CD_07_itscceladm01 inactive
DBFS_DG2_CD_08_itscceladm01 inactive
DBFS_DG2_CD_09_itscceladm01 inactive
DBFS_DG2_CD_10_itscceladm01 inactive
DBFS_DG2_CD_11_itscceladm01 inactive
RECOC1_CD_00_itscceladm01 inactive
RECOC1_CD_01_itscceladm01 inactive
RECOC1_CD_02_itscceladm01 inactive
RECOC1_CD_03_itscceladm01 inactive
RECOC1_CD_04_itscceladm01 inactive
RECOC1_CD_05_itscceladm01 inactive
RECOC1_CD_06_itscceladm01 inactive
RECOC1_CD_07_itscceladm01 inactive
RECOC1_CD_08_itscceladm01 inactive
RECOC1_CD_09_itscceladm01 inactive
RECOC1_CD_10_itscceladm01 inactive
RECOC1_CD_11_itscceladm01 inactive
RECOC2_CD_00_itscceladm01 inactive
RECOC2_CD_01_itscceladm01 inactive
RECOC2_CD_02_itscceladm01 inactive
RECOC2_CD_03_itscceladm01 inactive
RECOC2_CD_04_itscceladm01 inactive
RECOC2_CD_05_itscceladm01 inactive
RECOC2_CD_06_itscceladm01 inactive
RECOC2_CD_07_itscceladm01 inactive
RECOC2_CD_08_itscceladm01 inactive
RECOC2_CD_09_itscceladm01 inactive
RECOC2_CD_10_itscceladm01 inactive
RECOC2_CD_11_itscceladm01 inactive
Step 5.
Now the cell can be shutdown using linux shutdown command.
[root@itsccelladm01 ~]#shutdown -h now
Step 6.
Once the cell comes back online activate the grid disks:
[root@itsccelladm01 ~]#cellcli -e alter griddisk all active
GridDisk DATAC1_CD_00_itscceladm01 successfully altered
GridDisk DATAC1_CD_01_itscceladm01 successfully altered
GridDisk DATAC1_CD_02_itscceladm01 successfully altered
GridDisk DATAC1_CD_03_itscceladm01 successfully altered
GridDisk DATAC1_CD_04_itscceladm01 successfully altered
GridDisk DATAC1_CD_05_itscceladm01 successfully altered
GridDisk DATAC1_CD_06_itscceladm01 successfully altered
GridDisk DATAC1_CD_07_itscceladm01 successfully altered
GridDisk DATAC1_CD_08_itscceladm01 successfully altered
GridDisk DATAC1_CD_09_itscceladm01 successfully altered
GridDisk DATAC1_CD_10_itscceladm01 successfully altered
GridDisk DATAC1_CD_11_itscceladm01 successfully altered
GridDisk DATAC2_CD_00_itscceladm01 successfully altered
GridDisk DATAC2_CD_01_itscceladm01 successfully altered
GridDisk DATAC2_CD_02_itscceladm01 successfully altered
GridDisk DATAC2_CD_03_itscceladm01 successfully altered
GridDisk DATAC2_CD_04_itscceladm01 successfully altered
GridDisk DATAC2_CD_05_itscceladm01 successfully altered
GridDisk DATAC2_CD_06_itscceladm01 successfully altered
GridDisk DATAC2_CD_07_itscceladm01 successfully altered
GridDisk DATAC2_CD_08_itscceladm01 successfully altered
GridDisk DATAC2_CD_09_itscceladm01 successfully altered
GridDisk DATAC2_CD_10_itscceladm01 successfully altered
GridDisk DATAC2_CD_11_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_00_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_01_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_02_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_03_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_04_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_05_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_06_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_07_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_08_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_09_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_10_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_11_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_00_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_01_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_02_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_03_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_04_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_05_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_06_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_07_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_08_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_09_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_10_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_11_itscceladm01 successfully altered
GridDisk RECOC1_CD_00_itscceladm01 successfully altered
GridDisk RECOC1_CD_01_itscceladm01 successfully altered
GridDisk RECOC1_CD_02_itscceladm01 successfully altered
GridDisk RECOC1_CD_03_itscceladm01 successfully altered
GridDisk RECOC1_CD_04_itscceladm01 successfully altered
GridDisk RECOC1_CD_05_itscceladm01 successfully altered
GridDisk RECOC1_CD_06_itscceladm01 successfully altered
GridDisk RECOC1_CD_07_itscceladm01 successfully altered
GridDisk RECOC1_CD_08_itscceladm01 successfully altered
GridDisk RECOC1_CD_09_itscceladm01 successfully altered
GridDisk RECOC1_CD_10_itscceladm01 successfully altered
GridDisk RECOC1_CD_11_itscceladm01 successfully altered
GridDisk RECOC2_CD_00_itscceladm01 successfully altered
GridDisk RECOC2_CD_01_itscceladm01 successfully altered
GridDisk RECOC2_CD_02_itscceladm01 successfully altered
GridDisk RECOC2_CD_03_itscceladm01 successfully altered
GridDisk RECOC2_CD_04_itscceladm01 successfully altered
GridDisk RECOC2_CD_05_itscceladm01 successfully altered
GridDisk RECOC2_CD_06_itscceladm01 successfully altered
GridDisk RECOC2_CD_07_itscceladm01 successfully altered
GridDisk RECOC2_CD_08_itscceladm01 successfully altered
GridDisk RECOC2_CD_09_itscceladm01 successfully altered
GridDisk RECOC2_CD_10_itscceladm01 successfully altered
GridDisk RECOC2_CD_11_itscceladm01 successfully altered
[root@itsccelladm01 ~]#cellcli -e list griddisk
DATAC1_CD_00_itscceladm01 active
DATAC1_CD_01_itscceladm01 active
DATAC1_CD_02_itscceladm01 active
DATAC1_CD_03_itscceladm01 active
DATAC1_CD_04_itscceladm01 active
DATAC1_CD_05_itscceladm01 active
DATAC1_CD_06_itscceladm01 active
DATAC1_CD_07_itscceladm01 active
DATAC1_CD_08_itscceladm01 active
DATAC1_CD_09_itscceladm01 active
DATAC1_CD_10_itscceladm01 active
DATAC1_CD_11_itscceladm01 active
DATAC2_CD_00_itscceladm01 active
DATAC2_CD_01_itscceladm01 active
DATAC2_CD_02_itscceladm01 active
DATAC2_CD_03_itscceladm01 active
DATAC2_CD_04_itscceladm01 active
DATAC2_CD_05_itscceladm01 active
DATAC2_CD_06_itscceladm01 active
DATAC2_CD_07_itscceladm01 active
DATAC2_CD_08_itscceladm01 active
DATAC2_CD_09_itscceladm01 active
DATAC2_CD_10_itscceladm01 active
DATAC2_CD_11_itscceladm01 active
DBFS_DG1_CD_00_itscceladm01 active
DBFS_DG1_CD_01_itscceladm01 active
DBFS_DG1_CD_02_itscceladm01 active
DBFS_DG1_CD_03_itscceladm01 active
DBFS_DG1_CD_04_itscceladm01 active
DBFS_DG1_CD_05_itscceladm01 active
DBFS_DG1_CD_06_itscceladm01 active
DBFS_DG1_CD_07_itscceladm01 active
DBFS_DG1_CD_08_itscceladm01 active
DBFS_DG1_CD_09_itscceladm01 active
DBFS_DG1_CD_10_itscceladm01 active
DBFS_DG1_CD_11_itscceladm01 active
DBFS_DG2_CD_00_itscceladm01 active
DBFS_DG2_CD_01_itscceladm01 active
DBFS_DG2_CD_02_itscceladm01 active
DBFS_DG2_CD_03_itscceladm01 active
DBFS_DG2_CD_04_itscceladm01 active
DBFS_DG2_CD_05_itscceladm01 active
DBFS_DG2_CD_06_itscceladm01 active
DBFS_DG2_CD_07_itscceladm01 active
DBFS_DG2_CD_08_itscceladm01 active
DBFS_DG2_CD_09_itscceladm01 active
DBFS_DG2_CD_10_itscceladm01 active
DBFS_DG2_CD_11_itscceladm01 active
RECOC1_CD_00_itscceladm01 active
RECOC1_CD_01_itscceladm01 active
RECOC1_CD_02_itscceladm01 active
RECOC1_CD_03_itscceladm01 active
RECOC1_CD_04_itscceladm01 active
RECOC1_CD_05_itscceladm01 active
RECOC1_CD_06_itscceladm01 active
RECOC1_CD_07_itscceladm01 active
RECOC1_CD_08_itscceladm01 active
RECOC1_CD_09_itscceladm01 active
RECOC1_CD_10_itscceladm01 active
RECOC1_CD_11_itscceladm01 active
RECOC2_CD_00_itscceladm01 active
RECOC2_CD_01_itscceladm01 active
RECOC2_CD_02_itscceladm01 active
RECOC2_CD_03_itscceladm01 active
RECOC2_CD_04_itscceladm01 active
RECOC2_CD_05_itscceladm01 active
RECOC2_CD_06_itscceladm01 active
RECOC2_CD_07_itscceladm01 active
RECOC2_CD_08_itscceladm01 active
RECOC2_CD_09_itscceladm01 active
RECOC2_CD_10_itscceladm01 active
RECOC2_CD_11_itscceladm01 active
Step 7.
Now find out the grid disk status:-
P.S.Wait until asmmodestatus is ONLINE for all grid disks. Each disk will go to a 'SYNCING' state first then 'ONLINE'. The following is an example of the output:
[root@itsccelladm01 ~]# cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
DATAC1_CD_00_itscceladm01 SYNCING yes
DATAC1_CD_01_itscceladm01 SYNCING yes
DATAC1_CD_02_itscceladm01 SYNCING yes
DATAC1_CD_03_itscceladm01 SYNCING yes
DATAC1_CD_04_itscceladm01 SYNCING yes
DATAC1_CD_05_itscceladm01 SYNCING yes
DATAC1_CD_06_itscceladm01 SYNCING yes
DATAC1_CD_07_itscceladm01 SYNCING yes
DATAC1_CD_08_itscceladm01 SYNCING yes
DATAC1_CD_09_itscceladm01 SYNCING yes
DATAC1_CD_10_itscceladm01 SYNCING yes
DATAC1_CD_11_itscceladm01 SYNCING yes
DATAC2_CD_00_itscceladm01 ONLINE yes
DATAC2_CD_01_itscceladm01 ONLINE yes
DATAC2_CD_02_itscceladm01 ONLINE yes
DATAC2_CD_03_itscceladm01 ONLINE yes
DATAC2_CD_04_itscceladm01 ONLINE yes
DATAC2_CD_05_itscceladm01 ONLINE yes
DATAC2_CD_06_itscceladm01 ONLINE yes
DATAC2_CD_07_itscceladm01 ONLINE yes
DATAC2_CD_08_itscceladm01 ONLINE yes
DATAC2_CD_09_itscceladm01 ONLINE yes
DATAC2_CD_10_itscceladm01 ONLINE yes
DATAC2_CD_11_itscceladm01 ONLINE yes
DBFS_DG1_CD_00_itscceladm01 ONLINE yes
DBFS_DG1_CD_01_itscceladm01 ONLINE yes
DBFS_DG1_CD_02_itscceladm01 ONLINE yes
DBFS_DG1_CD_03_itscceladm01 ONLINE yes
DBFS_DG1_CD_04_itscceladm01 ONLINE yes
DBFS_DG1_CD_05_itscceladm01 ONLINE yes
DBFS_DG1_CD_06_itscceladm01 ONLINE yes
DBFS_DG1_CD_07_itscceladm01 ONLINE yes
DBFS_DG1_CD_08_itscceladm01 ONLINE yes
DBFS_DG1_CD_09_itscceladm01 ONLINE yes
DBFS_DG1_CD_10_itscceladm01 ONLINE yes
DBFS_DG1_CD_11_itscceladm01 ONLINE yes
DBFS_DG2_CD_00_itscceladm01 SYNCING yes
DBFS_DG2_CD_01_itscceladm01 SYNCING yes
DBFS_DG2_CD_02_itscceladm01 SYNCING yes
DBFS_DG2_CD_03_itscceladm01 SYNCING yes
DBFS_DG2_CD_04_itscceladm01 SYNCING yes
DBFS_DG2_CD_05_itscceladm01 SYNCING yes
DBFS_DG2_CD_06_itscceladm01 SYNCING yes
DBFS_DG2_CD_07_itscceladm01 SYNCING yes
DBFS_DG2_CD_08_itscceladm01 SYNCING yes
DBFS_DG2_CD_09_itscceladm01 SYNCING yes
DBFS_DG2_CD_10_itscceladm01 SYNCING yes
DBFS_DG2_CD_11_itscceladm01 SYNCING yes
RECOC1_CD_00_itscceladm01 ONLINE yes
RECOC1_CD_01_itscceladm01 ONLINE yes
RECOC1_CD_02_itscceladm01 ONLINE yes
RECOC1_CD_03_itscceladm01 ONLINE yes
RECOC1_CD_04_itscceladm01 ONLINE yes
RECOC1_CD_05_itscceladm01 ONLINE yes
RECOC1_CD_06_itscceladm01 ONLINE yes
RECOC1_CD_07_itscceladm01 ONLINE yes
RECOC1_CD_08_itscceladm01 ONLINE yes
RECOC1_CD_09_itscceladm01 ONLINE yes
RECOC1_CD_10_itscceladm01 ONLINE yes
RECOC1_CD_11_itscceladm01 ONLINE yes
RECOC2_CD_00_itscceladm01 ONLINE yes
RECOC2_CD_01_itscceladm01 ONLINE yes
RECOC2_CD_02_itscceladm01 ONLINE yes
RECOC2_CD_03_itscceladm01 ONLINE yes
RECOC2_CD_04_itscceladm01 ONLINE yes
RECOC2_CD_05_itscceladm01 ONLINE yes
RECOC2_CD_06_itscceladm01 ONLINE yes
RECOC2_CD_07_itscceladm01 ONLINE yes
RECOC2_CD_08_itscceladm01 ONLINE yes
RECOC2_CD_09_itscceladm01 ONLINE yes
RECOC2_CD_10_itscceladm01 ONLINE yes
RECOC2_CD_11_itscceladm01 ONLINE yes
Now this concludes our motherboard replacement activity on cell storage node. Now all the cell nodes are
up and all the diskgroup are active and functional.
Environment:-Oracle SuperCluster T5-8
2 SPARC T5-8 Compute nodes, 4 EXADATA X5-2 Storage cells
Scenario:- One of exadata Storage cell node had a faully motherboard, which required a replacement. Due to this we had to shutdown the storage cell and perform the replacement activity.
Note:- When performing maintenance on Exadata Cells, it may be necessary to power down or reboot the cell. If a storage server is to be shut down when one or more databases are running, then verify that taking the storage server offline will not impact Oracle ASM disk group and database availability. The ability to take Oracle Exadata Storage Server offline without affecting database availability depends on the level of Oracle ASM redundancy used on the affected disk groups, and the current status of disks in other Oracle Exadata Storage Servers that have mirror copies of data as Oracle Exadata Storage Server to be taken offline.
Step 1.
By default, ASM drops a disk shortly after it is taken offline; however, you can set the
DISK_REPAIR_TIME attribute to prevent this operation by specifying a time interval to repair the
disk and bring it back online. The default DISK_REPAIR_TIME attribute value of 3.6h should be adequate
for most environments.
(a) To check repair times for all mounted disk groups - log into the ASM instance and perform the following query:
From Any Compute Node :-
From asm user.
Envoke grid environment
export ORACLE_HOME=/u01/app/11.2.0.4/grid
export ORACLE_SID=+ASM1 [We are logged into compute node 1]
export PATH=$ORACLE_HOME/bin:$PATH:.
sqlplus / as sysasm
SQL> select dg.name,a.value from v$asm_diskgroup
dg, v$asm_attribute a where dg.group_number=a.group_number and
a.name='disk_repair_time';
NAME VALUE
---------------- ------------------
DATAC1 3.6h
DBFS_DG1 3.6h
RECOC1 3.6h
(b) If you need to offline the ASM disks for more than the default time of 3.6 hours then adjust the
parameter by issuing the command below as an example:
SQL> ALTER DISKGROUP <DISKGROUP NAME> SET ATTRIBUTE 'DISK_REPAIR_TIME'='8.5H';
In our case,we estimated more than 3.6hrs for the entire activity. So we decided to alter the
disk_repair_time for two DB domains in supercluster.
From DB domain 1:-
SQL>ALTER DISKGROUP DATAC1 SET ATTRIBUTE ‘DISK_REPAIR_TIME’=’8.5H’;
SQL>ALTER DISKGROUP DBFS_DG1 SET ATTRIBUTE ‘DISK_REPAIR_TIME’=’8.5H’;
SQL>ALTER DISKGROUP RECOC1 SET ATTRIBUTE ‘DISK_REPAIR_TIME’=’8.5H’;
From DB domain2:-
SQL>ALTER DISKGROUP DATAC2 SET ATTRIBUTE ‘DISK_REPAIR_TIME’=’8.5H’;
SQL>ALTER DISKGROUP DBFS_DG2 SET ATTRIBUTE ‘DISK_REPAIR_TIME’=’8.5H’;
SQL>ALTER DISKGROUP RECOC2 SET ATTRIBUTE ‘DISK_REPAIR_TIME’=’8.5H’;
Step 2.
Next we need to check if ASM will be OK if the grid disks go OFFLINE. The following command
should return 'Yes' for the grid disks being listed:
Login to the particular cell server which you will shut down.
[root@itsccelladm01 ~]# cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
DATAC1_CD_00_itscceladm01 ONLINE yes
DATAC1_CD_01_itscceladm01 ONLINE yes
DATAC1_CD_02_itscceladm01 ONLINE yes
DATAC1_CD_03_itscceladm01 ONLINE yes
DATAC1_CD_04_itscceladm01 ONLINE yes
DATAC1_CD_05_itscceladm01 ONLINE yes
DATAC1_CD_06_itscceladm01 ONLINE yes
DATAC1_CD_07_itscceladm01 ONLINE yes
DATAC1_CD_08_itscceladm01 ONLINE yes
DATAC1_CD_09_itscceladm01 ONLINE yes
DATAC1_CD_10_itscceladm01 ONLINE yes
DATAC1_CD_11_itscceladm01 ONLINE yes
DATAC2_CD_00_itscceladm01 ONLINE yes
DATAC2_CD_01_itscceladm01 ONLINE yes
DATAC2_CD_02_itscceladm01 ONLINE yes
DATAC2_CD_03_itscceladm01 ONLINE yes
DATAC2_CD_04_itscceladm01 ONLINE yes
DATAC2_CD_05_itscceladm01 ONLINE yes
DATAC2_CD_06_itscceladm01 ONLINE yes
DATAC2_CD_07_itscceladm01 ONLINE yes
DATAC2_CD_08_itscceladm01 ONLINE yes
DATAC2_CD_09_itscceladm01 ONLINE yes
DATAC2_CD_10_itscceladm01 ONLINE yes
DATAC2_CD_11_itscceladm01 ONLINE yes
DBFS_DG1_CD_00_itscceladm01 ONLINE yes
DBFS_DG1_CD_01_itscceladm01 ONLINE yes
DBFS_DG1_CD_02_itscceladm01 ONLINE yes
DBFS_DG1_CD_03_itscceladm01 ONLINE yes
DBFS_DG1_CD_04_itscceladm01 ONLINE yes
DBFS_DG1_CD_05_itscceladm01 ONLINE yes
DBFS_DG1_CD_06_itscceladm01 ONLINE yes
DBFS_DG1_CD_07_itscceladm01 ONLINE yes
DBFS_DG1_CD_08_itscceladm01 ONLINE yes
DBFS_DG1_CD_09_itscceladm01 ONLINE yes
DBFS_DG1_CD_10_itscceladm01 ONLINE yes
DBFS_DG1_CD_11_itscceladm01 ONLINE yes
DBFS_DG2_CD_00_itscceladm01 ONLINE yes
DBFS_DG2_CD_01_itscceladm01 ONLINE yes
DBFS_DG2_CD_02_itscceladm01 ONLINE yes
DBFS_DG2_CD_03_itscceladm01 ONLINE yes
DBFS_DG2_CD_04_itscceladm01 ONLINE yes
DBFS_DG2_CD_05_itscceladm01 ONLINE yes
DBFS_DG2_CD_06_itscceladm01 ONLINE yes
DBFS_DG2_CD_07_itscceladm01 ONLINE yes
DBFS_DG2_CD_08_itscceladm01 ONLINE yes
DBFS_DG2_CD_09_itscceladm01 ONLINE yes
DBFS_DG2_CD_10_itscceladm01 ONLINE yes
DBFS_DG2_CD_11_itscceladm01 ONLINE yes
RECOC1_CD_00_itscceladm01 ONLINE yes
RECOC1_CD_01_itscceladm01 ONLINE yes
RECOC1_CD_02_itscceladm01 ONLINE yes
RECOC1_CD_03_itscceladm01 ONLINE yes
RECOC1_CD_04_itscceladm01 ONLINE yes
RECOC1_CD_05_itscceladm01 ONLINE yes
RECOC1_CD_06_itscceladm01 ONLINE yes
RECOC1_CD_07_itscceladm01 ONLINE yes
RECOC1_CD_08_itscceladm01 ONLINE yes
RECOC1_CD_09_itscceladm01 ONLINE yes
RECOC1_CD_10_itscceladm01 ONLINE yes
RECOC1_CD_11_itscceladm01 ONLINE yes
RECOC2_CD_00_itscceladm01 ONLINE yes
RECOC2_CD_01_itscceladm01 ONLINE yes
RECOC2_CD_02_itscceladm01 ONLINE yes
RECOC2_CD_03_itscceladm01 ONLINE yes
RECOC2_CD_04_itscceladm01 ONLINE yes
RECOC2_CD_05_itscceladm01 ONLINE yes
RECOC2_CD_06_itscceladm01 ONLINE yes
RECOC2_CD_07_itscceladm01 ONLINE yes
RECOC2_CD_08_itscceladm01 ONLINE yes
RECOC2_CD_09_itscceladm01 ONLINE yes
RECOC2_CD_10_itscceladm01 ONLINE yes
RECOC2_CD_11_itscceladm01 ONLINE yes
If one or more disks does not return asmdeactivationoutcome='Yes', then we should check the respective
diskgroup and restore the data redundancy for that diskgroup.
Once the diskgroup data redundancy is fully restored, repeat the previous command (step 2).
Once all disks return asmdeactivationoutcome='Yes', qw can proceed with taking the griddisk
offline (step 3).
Note: Shutting down the cell services when one or more grid disks does not return
asmdeactivationoutcome='Yes' will cause Oracle ASM to dismount the affected disk group, causing the
databases to shut down abruptly.
Step 3.
Run cellcli command to Inactivate all grid disks on the cell you wish to power down/reboot:
[root@itsccelladm01 ~]#cellcli -e alter griddisk all inactive
GridDisk DATAC1_CD_00_itscceladm01 successfully altered
GridDisk DATAC1_CD_01_itscceladm01 successfully altered
GridDisk DATAC1_CD_02_itscceladm01 successfully altered
GridDisk DATAC1_CD_03_itscceladm01 successfully altered
GridDisk DATAC1_CD_04_itscceladm01 successfully altered
GridDisk DATAC1_CD_05_itscceladm01 successfully altered
GridDisk DATAC1_CD_06_itscceladm01 successfully altered
GridDisk DATAC1_CD_07_itscceladm01 successfully altered
GridDisk DATAC1_CD_08_itscceladm01 successfully altered
GridDisk DATAC1_CD_09_itscceladm01 successfully altered
GridDisk DATAC1_CD_10_itscceladm01 successfully altered
GridDisk DATAC1_CD_11_itscceladm01 successfully altered
GridDisk DATAC2_CD_00_itscceladm01 successfully altered
GridDisk DATAC2_CD_01_itscceladm01 successfully altered
GridDisk DATAC2_CD_02_itscceladm01 successfully altered
GridDisk DATAC2_CD_03_itscceladm01 successfully altered
GridDisk DATAC2_CD_04_itscceladm01 successfully altered
GridDisk DATAC2_CD_05_itscceladm01 successfully altered
GridDisk DATAC2_CD_06_itscceladm01 successfully altered
GridDisk DATAC2_CD_07_itscceladm01 successfully altered
GridDisk DATAC2_CD_08_itscceladm01 successfully altered
GridDisk DATAC2_CD_09_itscceladm01 successfully altered
GridDisk DATAC2_CD_10_itscceladm01 successfully altered
GridDisk DATAC2_CD_11_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_00_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_01_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_02_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_03_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_04_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_05_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_06_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_07_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_08_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_09_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_10_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_11_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_00_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_01_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_02_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_03_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_04_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_05_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_06_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_07_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_08_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_09_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_10_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_11_itscceladm01 successfully altered
GridDisk RECOC1_CD_00_itscceladm01 successfully altered
GridDisk RECOC1_CD_01_itscceladm01 successfully altered
GridDisk RECOC1_CD_02_itscceladm01 successfully altered
GridDisk RECOC1_CD_03_itscceladm01 successfully altered
GridDisk RECOC1_CD_04_itscceladm01 successfully altered
GridDisk RECOC1_CD_05_itscceladm01 successfully altered
GridDisk RECOC1_CD_06_itscceladm01 successfully altered
GridDisk RECOC1_CD_07_itscceladm01 successfully altered
GridDisk RECOC1_CD_08_itscceladm01 successfully altered
GridDisk RECOC1_CD_09_itscceladm01 successfully altered
GridDisk RECOC1_CD_10_itscceladm01 successfully altered
GridDisk RECOC1_CD_11_itscceladm01 successfully altered
GridDisk RECOC2_CD_00_itscceladm01 successfully altered
GridDisk RECOC2_CD_01_itscceladm01 successfully altered
GridDisk RECOC2_CD_02_itscceladm01 successfully altered
GridDisk RECOC2_CD_03_itscceladm01 successfully altered
GridDisk RECOC2_CD_04_itscceladm01 successfully altered
GridDisk RECOC2_CD_05_itscceladm01 successfully altered
GridDisk RECOC2_CD_06_itscceladm01 successfully altered
GridDisk RECOC2_CD_07_itscceladm01 successfully altered
GridDisk RECOC2_CD_08_itscceladm01 successfully altered
GridDisk RECOC2_CD_09_itscceladm01 successfully altered
GridDisk RECOC2_CD_10_itscceladm01 successfully altered
GridDisk RECOC2_CD_11_itscceladm01 successfully altered
* Please note - This action could take 10 minutes or longer depending on activity. It is very important
to make sure you were able to offline all the disks successfully before shutting down the cell services.
Inactivating the grid disks will automatically OFFLINE the disks in the ASM instance.
Step 4.
Confirm that the griddisks are now offline by performing the following actions:
(a) Execute the command below and the output should show either asmmodestatus=OFFLINE or
asmmodestatus=UNUSED and asmdeactivationoutcome=Yes for all griddisks once the disks are offline in ASM.
Only then is it safe to proceed with shutting down or restarting the cell:
[root@itsccelladm01 ~]#cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
DATAC1_CD_00_itscceladm01 OFFLINE yes
DATAC1_CD_01_itscceladm01 OFFLINE yes
DATAC1_CD_02_itscceladm01 OFFLINE yes
DATAC1_CD_03_itscceladm01 OFFLINE yes
DATAC1_CD_04_itscceladm01 OFFLINE yes
DATAC1_CD_05_itscceladm01 OFFLINE yes
DATAC1_CD_06_itscceladm01 OFFLINE yes
DATAC1_CD_07_itscceladm01 OFFLINE yes
DATAC1_CD_08_itscceladm01 OFFLINE yes
DATAC1_CD_09_itscceladm01 OFFLINE yes
DATAC1_CD_10_itscceladm01 OFFLINE yes
DATAC1_CD_11_itscceladm01 OFFLINE yes
DATAC2_CD_00_itscceladm01 OFFLINE yes
DATAC2_CD_01_itscceladm01 OFFLINE yes
DATAC2_CD_02_itscceladm01 OFFLINE yes
DATAC2_CD_03_itscceladm01 OFFLINE yes
DATAC2_CD_04_itscceladm01 OFFLINE yes
DATAC2_CD_05_itscceladm01 OFFLINE yes
DATAC2_CD_06_itscceladm01 OFFLINE yes
DATAC2_CD_07_itscceladm01 OFFLINE yes
DATAC2_CD_08_itscceladm01 OFFLINE yes
DATAC2_CD_09_itscceladm01 OFFLINE yes
DATAC2_CD_10_itscceladm01 OFFLINE yes
DATAC2_CD_11_itscceladm01 OFFLINE yes
DBFS_DG1_CD_00_itscceladm01 OFFLINE yes
DBFS_DG1_CD_01_itscceladm01 OFFLINE yes
DBFS_DG1_CD_02_itscceladm01 OFFLINE yes
DBFS_DG1_CD_03_itscceladm01 OFFLINE yes
DBFS_DG1_CD_04_itscceladm01 OFFLINE yes
DBFS_DG1_CD_05_itscceladm01 OFFLINE yes
DBFS_DG1_CD_06_itscceladm01 OFFLINE yes
DBFS_DG1_CD_07_itscceladm01 OFFLINE yes
DBFS_DG1_CD_08_itscceladm01 OFFLINE yes
DBFS_DG1_CD_09_itscceladm01 OFFLINE yes
DBFS_DG1_CD_10_itscceladm01 OFFLINE yes
DBFS_DG1_CD_11_itscceladm01 OFFLINE yes
DBFS_DG2_CD_00_itscceladm01 OFFLINE yes
DBFS_DG2_CD_01_itscceladm01 OFFLINE yes
DBFS_DG2_CD_02_itscceladm01 OFFLINE yes
DBFS_DG2_CD_03_itscceladm01 OFFLINE yes
DBFS_DG2_CD_04_itscceladm01 OFFLINE yes
DBFS_DG2_CD_05_itscceladm01 OFFLINE yes
DBFS_DG2_CD_06_itscceladm01 OFFLINE yes
DBFS_DG2_CD_07_itscceladm01 OFFLINE yes
DBFS_DG2_CD_08_itscceladm01 OFFLINE yes
DBFS_DG2_CD_09_itscceladm01 OFFLINE yes
DBFS_DG2_CD_10_itscceladm01 OFFLINE yes
DBFS_DG2_CD_11_itscceladm01 OFFLINE yes
RECOC1_CD_00_itscceladm01 OFFLINE yes
RECOC1_CD_01_itscceladm01 OFFLINE yes
RECOC1_CD_02_itscceladm01 OFFLINE yes
RECOC1_CD_03_itscceladm01 OFFLINE yes
RECOC1_CD_04_itscceladm01 OFFLINE yes
RECOC1_CD_05_itscceladm01 OFFLINE yes
RECOC1_CD_06_itscceladm01 OFFLINE yes
RECOC1_CD_07_itscceladm01 OFFLINE yes
RECOC1_CD_08_itscceladm01 OFFLINE yes
RECOC1_CD_09_itscceladm01 OFFLINE yes
RECOC1_CD_10_itscceladm01 OFFLINE yes
RECOC1_CD_11_itscceladm01 OFFLINE yes
RECOC2_CD_00_itscceladm01 OFFLINE yes
RECOC2_CD_01_itscceladm01 OFFLINE yes
RECOC2_CD_02_itscceladm01 OFFLINE yes
RECOC2_CD_03_itscceladm01 OFFLINE yes
RECOC2_CD_04_itscceladm01 OFFLINE yes
RECOC2_CD_05_itscceladm01 OFFLINE yes
RECOC2_CD_06_itscceladm01 OFFLINE yes
RECOC2_CD_07_itscceladm01 OFFLINE yes
RECOC2_CD_08_itscceladm01 OFFLINE yes
RECOC2_CD_09_itscceladm01 OFFLINE yes
RECOC2_CD_10_itscceladm01 OFFLINE yes
RECOC2_CD_11_itscceladm01 OFFLINE yes
(b) List the griddisks to confirm all now show inactive:
[root@itsccelladm01 ~]#cellcli -e list griddisk
DATAC1_CD_00_itscceladm01 inactive
DATAC1_CD_01_itscceladm01 inactive
DATAC1_CD_02_itscceladm01 inactive
DATAC1_CD_03_itscceladm01 inactive
DATAC1_CD_04_itscceladm01 inactive
DATAC1_CD_05_itscceladm01 inactive
DATAC1_CD_06_itscceladm01 inactive
DATAC1_CD_07_itscceladm01 inactive
DATAC1_CD_08_itscceladm01 inactive
DATAC1_CD_09_itscceladm01 inactive
DATAC1_CD_10_itscceladm01 inactive
DATAC1_CD_11_itscceladm01 inactive
DATAC2_CD_00_itscceladm01 inactive
DATAC2_CD_01_itscceladm01 inactive
DATAC2_CD_02_itscceladm01 inactive
DATAC2_CD_03_itscceladm01 inactive
DATAC2_CD_04_itscceladm01 inactive
DATAC2_CD_05_itscceladm01 inactive
DATAC2_CD_06_itscceladm01 inactive
DATAC2_CD_07_itscceladm01 inactive
DATAC2_CD_08_itscceladm01 inactive
DATAC2_CD_09_itscceladm01 inactive
DATAC2_CD_10_itscceladm01 inactive
DATAC2_CD_11_itscceladm01 inactive
DBFS_DG1_CD_00_itscceladm01 inactive
DBFS_DG1_CD_01_itscceladm01 inactive
DBFS_DG1_CD_02_itscceladm01 inactive
DBFS_DG1_CD_03_itscceladm01 inactive
DBFS_DG1_CD_04_itscceladm01 inactive
DBFS_DG1_CD_05_itscceladm01 inactive
DBFS_DG1_CD_06_itscceladm01 inactive
DBFS_DG1_CD_07_itscceladm01 inactive
DBFS_DG1_CD_08_itscceladm01 inactive
DBFS_DG1_CD_09_itscceladm01 inactive
DBFS_DG1_CD_10_itscceladm01 inactive
DBFS_DG1_CD_11_itscceladm01 inactive
DBFS_DG2_CD_00_itscceladm01 inactive
DBFS_DG2_CD_01_itscceladm01 inactive
DBFS_DG2_CD_02_itscceladm01 inactive
DBFS_DG2_CD_03_itscceladm01 inactive
DBFS_DG2_CD_04_itscceladm01 inactive
DBFS_DG2_CD_05_itscceladm01 inactive
DBFS_DG2_CD_06_itscceladm01 inactive
DBFS_DG2_CD_07_itscceladm01 inactive
DBFS_DG2_CD_08_itscceladm01 inactive
DBFS_DG2_CD_09_itscceladm01 inactive
DBFS_DG2_CD_10_itscceladm01 inactive
DBFS_DG2_CD_11_itscceladm01 inactive
RECOC1_CD_00_itscceladm01 inactive
RECOC1_CD_01_itscceladm01 inactive
RECOC1_CD_02_itscceladm01 inactive
RECOC1_CD_03_itscceladm01 inactive
RECOC1_CD_04_itscceladm01 inactive
RECOC1_CD_05_itscceladm01 inactive
RECOC1_CD_06_itscceladm01 inactive
RECOC1_CD_07_itscceladm01 inactive
RECOC1_CD_08_itscceladm01 inactive
RECOC1_CD_09_itscceladm01 inactive
RECOC1_CD_10_itscceladm01 inactive
RECOC1_CD_11_itscceladm01 inactive
RECOC2_CD_00_itscceladm01 inactive
RECOC2_CD_01_itscceladm01 inactive
RECOC2_CD_02_itscceladm01 inactive
RECOC2_CD_03_itscceladm01 inactive
RECOC2_CD_04_itscceladm01 inactive
RECOC2_CD_05_itscceladm01 inactive
RECOC2_CD_06_itscceladm01 inactive
RECOC2_CD_07_itscceladm01 inactive
RECOC2_CD_08_itscceladm01 inactive
RECOC2_CD_09_itscceladm01 inactive
RECOC2_CD_10_itscceladm01 inactive
RECOC2_CD_11_itscceladm01 inactive
Step 5.
Now the cell can be shutdown using linux shutdown command.
[root@itsccelladm01 ~]#shutdown -h now
Step 6.
Once the cell comes back online activate the grid disks:
[root@itsccelladm01 ~]#cellcli -e alter griddisk all active
GridDisk DATAC1_CD_00_itscceladm01 successfully altered
GridDisk DATAC1_CD_01_itscceladm01 successfully altered
GridDisk DATAC1_CD_02_itscceladm01 successfully altered
GridDisk DATAC1_CD_03_itscceladm01 successfully altered
GridDisk DATAC1_CD_04_itscceladm01 successfully altered
GridDisk DATAC1_CD_05_itscceladm01 successfully altered
GridDisk DATAC1_CD_06_itscceladm01 successfully altered
GridDisk DATAC1_CD_07_itscceladm01 successfully altered
GridDisk DATAC1_CD_08_itscceladm01 successfully altered
GridDisk DATAC1_CD_09_itscceladm01 successfully altered
GridDisk DATAC1_CD_10_itscceladm01 successfully altered
GridDisk DATAC1_CD_11_itscceladm01 successfully altered
GridDisk DATAC2_CD_00_itscceladm01 successfully altered
GridDisk DATAC2_CD_01_itscceladm01 successfully altered
GridDisk DATAC2_CD_02_itscceladm01 successfully altered
GridDisk DATAC2_CD_03_itscceladm01 successfully altered
GridDisk DATAC2_CD_04_itscceladm01 successfully altered
GridDisk DATAC2_CD_05_itscceladm01 successfully altered
GridDisk DATAC2_CD_06_itscceladm01 successfully altered
GridDisk DATAC2_CD_07_itscceladm01 successfully altered
GridDisk DATAC2_CD_08_itscceladm01 successfully altered
GridDisk DATAC2_CD_09_itscceladm01 successfully altered
GridDisk DATAC2_CD_10_itscceladm01 successfully altered
GridDisk DATAC2_CD_11_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_00_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_01_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_02_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_03_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_04_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_05_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_06_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_07_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_08_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_09_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_10_itscceladm01 successfully altered
GridDisk DBFS_DG1_CD_11_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_00_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_01_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_02_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_03_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_04_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_05_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_06_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_07_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_08_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_09_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_10_itscceladm01 successfully altered
GridDisk DBFS_DG2_CD_11_itscceladm01 successfully altered
GridDisk RECOC1_CD_00_itscceladm01 successfully altered
GridDisk RECOC1_CD_01_itscceladm01 successfully altered
GridDisk RECOC1_CD_02_itscceladm01 successfully altered
GridDisk RECOC1_CD_03_itscceladm01 successfully altered
GridDisk RECOC1_CD_04_itscceladm01 successfully altered
GridDisk RECOC1_CD_05_itscceladm01 successfully altered
GridDisk RECOC1_CD_06_itscceladm01 successfully altered
GridDisk RECOC1_CD_07_itscceladm01 successfully altered
GridDisk RECOC1_CD_08_itscceladm01 successfully altered
GridDisk RECOC1_CD_09_itscceladm01 successfully altered
GridDisk RECOC1_CD_10_itscceladm01 successfully altered
GridDisk RECOC1_CD_11_itscceladm01 successfully altered
GridDisk RECOC2_CD_00_itscceladm01 successfully altered
GridDisk RECOC2_CD_01_itscceladm01 successfully altered
GridDisk RECOC2_CD_02_itscceladm01 successfully altered
GridDisk RECOC2_CD_03_itscceladm01 successfully altered
GridDisk RECOC2_CD_04_itscceladm01 successfully altered
GridDisk RECOC2_CD_05_itscceladm01 successfully altered
GridDisk RECOC2_CD_06_itscceladm01 successfully altered
GridDisk RECOC2_CD_07_itscceladm01 successfully altered
GridDisk RECOC2_CD_08_itscceladm01 successfully altered
GridDisk RECOC2_CD_09_itscceladm01 successfully altered
GridDisk RECOC2_CD_10_itscceladm01 successfully altered
GridDisk RECOC2_CD_11_itscceladm01 successfully altered
[root@itsccelladm01 ~]#cellcli -e list griddisk
DATAC1_CD_00_itscceladm01 active
DATAC1_CD_01_itscceladm01 active
DATAC1_CD_02_itscceladm01 active
DATAC1_CD_03_itscceladm01 active
DATAC1_CD_04_itscceladm01 active
DATAC1_CD_05_itscceladm01 active
DATAC1_CD_06_itscceladm01 active
DATAC1_CD_07_itscceladm01 active
DATAC1_CD_08_itscceladm01 active
DATAC1_CD_09_itscceladm01 active
DATAC1_CD_10_itscceladm01 active
DATAC1_CD_11_itscceladm01 active
DATAC2_CD_00_itscceladm01 active
DATAC2_CD_01_itscceladm01 active
DATAC2_CD_02_itscceladm01 active
DATAC2_CD_03_itscceladm01 active
DATAC2_CD_04_itscceladm01 active
DATAC2_CD_05_itscceladm01 active
DATAC2_CD_06_itscceladm01 active
DATAC2_CD_07_itscceladm01 active
DATAC2_CD_08_itscceladm01 active
DATAC2_CD_09_itscceladm01 active
DATAC2_CD_10_itscceladm01 active
DATAC2_CD_11_itscceladm01 active
DBFS_DG1_CD_00_itscceladm01 active
DBFS_DG1_CD_01_itscceladm01 active
DBFS_DG1_CD_02_itscceladm01 active
DBFS_DG1_CD_03_itscceladm01 active
DBFS_DG1_CD_04_itscceladm01 active
DBFS_DG1_CD_05_itscceladm01 active
DBFS_DG1_CD_06_itscceladm01 active
DBFS_DG1_CD_07_itscceladm01 active
DBFS_DG1_CD_08_itscceladm01 active
DBFS_DG1_CD_09_itscceladm01 active
DBFS_DG1_CD_10_itscceladm01 active
DBFS_DG1_CD_11_itscceladm01 active
DBFS_DG2_CD_00_itscceladm01 active
DBFS_DG2_CD_01_itscceladm01 active
DBFS_DG2_CD_02_itscceladm01 active
DBFS_DG2_CD_03_itscceladm01 active
DBFS_DG2_CD_04_itscceladm01 active
DBFS_DG2_CD_05_itscceladm01 active
DBFS_DG2_CD_06_itscceladm01 active
DBFS_DG2_CD_07_itscceladm01 active
DBFS_DG2_CD_08_itscceladm01 active
DBFS_DG2_CD_09_itscceladm01 active
DBFS_DG2_CD_10_itscceladm01 active
DBFS_DG2_CD_11_itscceladm01 active
RECOC1_CD_00_itscceladm01 active
RECOC1_CD_01_itscceladm01 active
RECOC1_CD_02_itscceladm01 active
RECOC1_CD_03_itscceladm01 active
RECOC1_CD_04_itscceladm01 active
RECOC1_CD_05_itscceladm01 active
RECOC1_CD_06_itscceladm01 active
RECOC1_CD_07_itscceladm01 active
RECOC1_CD_08_itscceladm01 active
RECOC1_CD_09_itscceladm01 active
RECOC1_CD_10_itscceladm01 active
RECOC1_CD_11_itscceladm01 active
RECOC2_CD_00_itscceladm01 active
RECOC2_CD_01_itscceladm01 active
RECOC2_CD_02_itscceladm01 active
RECOC2_CD_03_itscceladm01 active
RECOC2_CD_04_itscceladm01 active
RECOC2_CD_05_itscceladm01 active
RECOC2_CD_06_itscceladm01 active
RECOC2_CD_07_itscceladm01 active
RECOC2_CD_08_itscceladm01 active
RECOC2_CD_09_itscceladm01 active
RECOC2_CD_10_itscceladm01 active
RECOC2_CD_11_itscceladm01 active
Step 7.
Now find out the grid disk status:-
P.S.Wait until asmmodestatus is ONLINE for all grid disks. Each disk will go to a 'SYNCING' state first then 'ONLINE'. The following is an example of the output:
[root@itsccelladm01 ~]# cellcli -e list griddisk attributes name,asmmodestatus,asmdeactivationoutcome
DATAC1_CD_00_itscceladm01 SYNCING yes
DATAC1_CD_01_itscceladm01 SYNCING yes
DATAC1_CD_02_itscceladm01 SYNCING yes
DATAC1_CD_03_itscceladm01 SYNCING yes
DATAC1_CD_04_itscceladm01 SYNCING yes
DATAC1_CD_05_itscceladm01 SYNCING yes
DATAC1_CD_06_itscceladm01 SYNCING yes
DATAC1_CD_07_itscceladm01 SYNCING yes
DATAC1_CD_08_itscceladm01 SYNCING yes
DATAC1_CD_09_itscceladm01 SYNCING yes
DATAC1_CD_10_itscceladm01 SYNCING yes
DATAC1_CD_11_itscceladm01 SYNCING yes
DATAC2_CD_00_itscceladm01 ONLINE yes
DATAC2_CD_01_itscceladm01 ONLINE yes
DATAC2_CD_02_itscceladm01 ONLINE yes
DATAC2_CD_03_itscceladm01 ONLINE yes
DATAC2_CD_04_itscceladm01 ONLINE yes
DATAC2_CD_05_itscceladm01 ONLINE yes
DATAC2_CD_06_itscceladm01 ONLINE yes
DATAC2_CD_07_itscceladm01 ONLINE yes
DATAC2_CD_08_itscceladm01 ONLINE yes
DATAC2_CD_09_itscceladm01 ONLINE yes
DATAC2_CD_10_itscceladm01 ONLINE yes
DATAC2_CD_11_itscceladm01 ONLINE yes
DBFS_DG1_CD_00_itscceladm01 ONLINE yes
DBFS_DG1_CD_01_itscceladm01 ONLINE yes
DBFS_DG1_CD_02_itscceladm01 ONLINE yes
DBFS_DG1_CD_03_itscceladm01 ONLINE yes
DBFS_DG1_CD_04_itscceladm01 ONLINE yes
DBFS_DG1_CD_05_itscceladm01 ONLINE yes
DBFS_DG1_CD_06_itscceladm01 ONLINE yes
DBFS_DG1_CD_07_itscceladm01 ONLINE yes
DBFS_DG1_CD_08_itscceladm01 ONLINE yes
DBFS_DG1_CD_09_itscceladm01 ONLINE yes
DBFS_DG1_CD_10_itscceladm01 ONLINE yes
DBFS_DG1_CD_11_itscceladm01 ONLINE yes
DBFS_DG2_CD_00_itscceladm01 SYNCING yes
DBFS_DG2_CD_01_itscceladm01 SYNCING yes
DBFS_DG2_CD_02_itscceladm01 SYNCING yes
DBFS_DG2_CD_03_itscceladm01 SYNCING yes
DBFS_DG2_CD_04_itscceladm01 SYNCING yes
DBFS_DG2_CD_05_itscceladm01 SYNCING yes
DBFS_DG2_CD_06_itscceladm01 SYNCING yes
DBFS_DG2_CD_07_itscceladm01 SYNCING yes
DBFS_DG2_CD_08_itscceladm01 SYNCING yes
DBFS_DG2_CD_09_itscceladm01 SYNCING yes
DBFS_DG2_CD_10_itscceladm01 SYNCING yes
DBFS_DG2_CD_11_itscceladm01 SYNCING yes
RECOC1_CD_00_itscceladm01 ONLINE yes
RECOC1_CD_01_itscceladm01 ONLINE yes
RECOC1_CD_02_itscceladm01 ONLINE yes
RECOC1_CD_03_itscceladm01 ONLINE yes
RECOC1_CD_04_itscceladm01 ONLINE yes
RECOC1_CD_05_itscceladm01 ONLINE yes
RECOC1_CD_06_itscceladm01 ONLINE yes
RECOC1_CD_07_itscceladm01 ONLINE yes
RECOC1_CD_08_itscceladm01 ONLINE yes
RECOC1_CD_09_itscceladm01 ONLINE yes
RECOC1_CD_10_itscceladm01 ONLINE yes
RECOC1_CD_11_itscceladm01 ONLINE yes
RECOC2_CD_00_itscceladm01 ONLINE yes
RECOC2_CD_01_itscceladm01 ONLINE yes
RECOC2_CD_02_itscceladm01 ONLINE yes
RECOC2_CD_03_itscceladm01 ONLINE yes
RECOC2_CD_04_itscceladm01 ONLINE yes
RECOC2_CD_05_itscceladm01 ONLINE yes
RECOC2_CD_06_itscceladm01 ONLINE yes
RECOC2_CD_07_itscceladm01 ONLINE yes
RECOC2_CD_08_itscceladm01 ONLINE yes
RECOC2_CD_09_itscceladm01 ONLINE yes
RECOC2_CD_10_itscceladm01 ONLINE yes
RECOC2_CD_11_itscceladm01 ONLINE yes
Now this concludes our motherboard replacement activity on cell storage node. Now all the cell nodes are
up and all the diskgroup are active and functional.
