How to resize ASM Disk Groups in Exadata?

December 13, 2012

We ran into a situation where Oracle ACS delivered Exadata (Quarter Rack) with 20% of space allocated to DATA Diskgroup, and 80% to RECO! We requested the reverse. Resizing ASM Disk Groups in Exadata is not as straight forward as it is in non-Exadata environment.

We followed MOS Note: 1245494.1 to resize ASM Disk Groups.

SQL>  select name, total_mb, free_mb, required_mirror_free_mb from v$asm_diskgroup;

NAME                 TOTAL_MB    FREE_MB REQUIRED_MIRROR_FREE_MB
—————————— ———- ———- ———————–
DBFS_DG               1038240    1036984              346080
DATA_EXA             15593472    8392296             5197824
RECO_EXA             86155200   82385996            28718400

SQL> select name,total_mb,free_mb
from v$asm_disk
where mount_status=’CACHED’ and (name like ‘DATA%’ or name like ‘RECO%’) order by 1;

NAME                 TOTAL_MB    FREE_MB
—————————— ———- ———-
DATA_EXA_CD_00_EXACEL01       433152     233152
DATA_EXA_CD_00_EXACEL02       433152     233180
DATA_EXA_CD_00_EXACEL03       433152     233124
DATA_EXA_CD_01_EXACEL01       433152     233116
DATA_EXA_CD_01_EXACEL02       433152     233312
DATA_EXA_CD_01_EXACEL03       433152     233244
DATA_EXA_CD_02_EXACEL01       433152     233056
DATA_EXA_CD_02_EXACEL02       433152     233208
DATA_EXA_CD_02_EXACEL03       433152     233096
DATA_EXA_CD_03_EXACEL01       433152     233024
DATA_EXA_CD_03_EXACEL02       433152     233092
DATA_EXA_CD_03_EXACEL03       433152     233100
DATA_EXA_CD_04_EXACEL01       433152     233200
DATA_EXA_CD_04_EXACEL02       433152     233216
DATA_EXA_CD_04_EXACEL03       433152     233000
DATA_EXA_CD_05_EXACEL01       433152     233040
DATA_EXA_CD_05_EXACEL02       433152     233012
DATA_EXA_CD_05_EXACEL03       433152     233176
DATA_EXA_CD_06_EXACEL01       433152     233152
DATA_EXA_CD_06_EXACEL02       433152     233184
DATA_EXA_CD_06_EXACEL03       433152     233064
DATA_EXA_CD_07_EXACEL01       433152     232968
DATA_EXA_CD_07_EXACEL02       433152     232928
DATA_EXA_CD_07_EXACEL03       433152     233124
DATA_EXA_CD_08_EXACEL01       433152     233128
DATA_EXA_CD_08_EXACEL02       433152     233176
DATA_EXA_CD_08_EXACEL03       433152     232984
DATA_EXA_CD_09_EXACEL01       433152     233140
DATA_EXA_CD_09_EXACEL02       433152     233148
DATA_EXA_CD_09_EXACEL03       433152     233348
DATA_EXA_CD_10_EXACEL01       433152     233036
DATA_EXA_CD_10_EXACEL02       433152     233084
DATA_EXA_CD_10_EXACEL03       433152     233188
DATA_EXA_CD_11_EXACEL01       433152     233104
DATA_EXA_CD_11_EXACEL02       433152     233032
DATA_EXA_CD_11_EXACEL03       433152     233136
RECO_EXA_CD_00_EXACEL01      2393200    2288452
RECO_EXA_CD_00_EXACEL02      2393200    2288392
RECO_EXA_CD_00_EXACEL03      2393200    2288496
RECO_EXA_CD_01_EXACEL01      2393200    2288332
RECO_EXA_CD_01_EXACEL02      2393200    2288372
RECO_EXA_CD_01_EXACEL03      2393200    2288512
RECO_EXA_CD_02_EXACEL01      2393200    2288504
RECO_EXA_CD_02_EXACEL02      2393200    2288492
RECO_EXA_CD_02_EXACEL03      2393200    2288520
RECO_EXA_CD_03_EXACEL01      2393200    2288452
RECO_EXA_CD_03_EXACEL02      2393200    2288572
RECO_EXA_CD_03_EXACEL03      2393200    2288528
RECO_EXA_CD_04_EXACEL01      2393200    2288576
RECO_EXA_CD_04_EXACEL02      2393200    2288428
RECO_EXA_CD_04_EXACEL03      2393200    2288460
RECO_EXA_CD_05_EXACEL01      2393200    2288620
RECO_EXA_CD_05_EXACEL02      2393200    2288500
RECO_EXA_CD_05_EXACEL03      2393200    2288428
RECO_EXA_CD_06_EXACEL01      2393200    2288456
RECO_EXA_CD_06_EXACEL02      2393200    2288592
RECO_EXA_CD_06_EXACEL03      2393200    2288588
RECO_EXA_CD_07_EXACEL01      2393200    2288392
RECO_EXA_CD_07_EXACEL02      2393200    2288412
RECO_EXA_CD_07_EXACEL03      2393200    2288448
RECO_EXA_CD_08_EXACEL01      2393200    2288628
RECO_EXA_CD_08_EXACEL02      2393200    2288456
RECO_EXA_CD_08_EXACEL03      2393200    2288440
RECO_EXA_CD_09_EXACEL01      2393200    2288448
RECO_EXA_CD_09_EXACEL02      2393200    2288540
RECO_EXA_CD_09_EXACEL03      2393200    2288532
RECO_EXA_CD_10_EXACEL01      2393200    2288604
RECO_EXA_CD_10_EXACEL02      2393200    2288512
RECO_EXA_CD_10_EXACEL03      2393200    2288584
RECO_EXA_CD_11_EXACEL01      2393200    2288584
RECO_EXA_CD_11_EXACEL02      2393200    2288528
RECO_EXA_CD_11_EXACEL03      2393200    2288560

72 rows selected.

CellCLI> list griddisk attributes name,size,status
     DATA_EXA_CD_00_EXAcel01     423G             active
     DATA_EXA_CD_01_EXAcel01     423G             active
     DATA_EXA_CD_02_EXAcel01     423G             active
     DATA_EXA_CD_03_EXAcel01     423G             active
     DATA_EXA_CD_04_EXAcel01     423G             active
     DATA_EXA_CD_05_EXAcel01     423G             active
     DATA_EXA_CD_06_EXAcel01     423G             active
     DATA_EXA_CD_07_EXAcel01     423G             active
     DATA_EXA_CD_08_EXAcel01     423G             active
     DATA_EXA_CD_09_EXAcel01     423G             active
     DATA_EXA_CD_10_EXAcel01     423G             active
     DATA_EXA_CD_11_EXAcel01     423G             active
     DBFS_DG_CD_02_EXAcel01       33.796875G       active
     DBFS_DG_CD_03_EXAcel01       33.796875G       active
     DBFS_DG_CD_04_EXAcel01       33.796875G       active
     DBFS_DG_CD_05_EXAcel01       33.796875G       active
     DBFS_DG_CD_06_EXAcel01       33.796875G       active
     DBFS_DG_CD_07_EXAcel01       33.796875G       active
     DBFS_DG_CD_08_EXAcel01       33.796875G       active
     DBFS_DG_CD_09_EXAcel01       33.796875G       active
     DBFS_DG_CD_10_EXAcel01       33.796875G       active
     DBFS_DG_CD_11_EXAcel01       33.796875G       active
     RECO_EXA_CD_00_EXAcel01     2337.109375G     active
     RECO_EXA_CD_01_EXAcel01     2337.109375G     active
     RECO_EXA_CD_02_EXAcel01     2337.109375G     active
     RECO_EXA_CD_03_EXAcel01     2337.109375G     active
     RECO_EXA_CD_04_EXAcel01     2337.109375G     active
     RECO_EXA_CD_05_EXAcel01     2337.109375G     active
     RECO_EXA_CD_06_EXAcel01     2337.109375G     active
     RECO_EXA_CD_07_EXAcel01     2337.109375G     active
     RECO_EXA_CD_08_EXAcel01     2337.109375G     active
     RECO_EXA_CD_09_EXAcel01     2337.109375G     active
     RECO_EXA_CD_10_EXAcel01     2337.109375G     active
     RECO_EXA_CD_11_EXAcel01     2337.109375G     active

SQL> select distinct failgroup from v$asm_disk;

FAILGROUP
——————————
EXACEL01
EXACEL02
EXACEL03

— For DATA diskgroup, get the list of disk name for DATA dikgroup and failgroup storage EXACEL01

SQL> select name,header_status,mount_status,failgroup from v$asm_disk where group_number=2 and failgroup=’EXACEL01′;

NAME                   HEADER_STATU MOUNT_S FAILGROUP
—————————— ———— ——- ——————–
DATA_EXA_CD_08_EXACEL01      MEMBER        CACHED  EXACEL01
DATA_EXA_CD_05_EXACEL01      MEMBER        CACHED  EXACEL01
DATA_EXA_CD_09_EXACEL01      MEMBER        CACHED  EXACEL01
DATA_EXA_CD_10_EXACEL01      MEMBER        CACHED  EXACEL01
DATA_EXA_CD_07_EXACEL01      MEMBER        CACHED  EXACEL01
DATA_EXA_CD_03_EXACEL01      MEMBER        CACHED  EXACEL01
DATA_EXA_CD_01_EXACEL01      MEMBER        CACHED  EXACEL01
DATA_EXA_CD_00_EXACEL01      MEMBER        CACHED  EXACEL01
DATA_EXA_CD_06_EXACEL01      MEMBER        CACHED  EXACEL01
DATA_EXA_CD_02_EXACEL01      MEMBER        CACHED  EXACEL01
DATA_EXA_CD_04_EXACEL01      MEMBER        CACHED  EXACEL01
DATA_EXA_CD_11_EXACEL01      MEMBER        CACHED  EXACEL01

12 rows selected.

— Now use the below command to drop all disks of failgroup “EXACEL01”

SQL> alter diskgroup DATA_EXA drop disks in failgroup EXACEL01 rebalance power 11 NOWAIT;

— Check status of rebalance using following SQL:

SQL> select * from v$asm_operation;

GROUP_NUMBER OPERA STAT      POWER     ACTUAL       SOFAR   EST_WORK   EST_RATE
———— —– —- ———- ———- ———- ———- ———-
EST_MINUTES ERROR_CODE
———– ——————————————–
       2 REBAL RUN        11       11      592583     869386      9634
     28

— Once the rebalance complets ,check the header_status column in v$asm_disk by running below sql..It should show as FORMER for dropped disk
 
set linesize 300
column path format a40
select name,path,header_status,mount_status
from v$asm_disk
where group_number=0
order by 2;

NAME                   PATH                    HEADER_STATU MOUNT_S
—————————— —————————————- ———— ——-
                   o/192.168.10.3/DATA_EXA_CD_00_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_01_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_02_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_03_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_04_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_05_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_06_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_07_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_08_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_09_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_10_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_11_EXAcel01 FORMER         CLOSED

12 rows selected.

— Now peform the steps for RECO diskgroup. For RECO diskgroup, get the list of disk name for RECO dikgroup and failgroup EXACEL01

column failgroup format a20
set pages 200
set linesize 200
select name,header_status,mount_status,group_number,failgroup
from v$asm_disk where group_number=3 and failgroup=’EXACEL01′;

NAME                   HEADER_STATU MOUNT_S GROUP_NUMBER FAILGROUP
—————————— ———— ——- ———— ——————–
RECO_EXA_CD_10_EXACEL01      MEMBER        CACHED           3 EXACEL01
RECO_EXA_CD_09_EXACEL01      MEMBER        CACHED           3 EXACEL01
RECO_EXA_CD_07_EXACEL01      MEMBER        CACHED           3 EXACEL01
RECO_EXA_CD_00_EXACEL01      MEMBER        CACHED           3 EXACEL01
RECO_EXA_CD_08_EXACEL01      MEMBER        CACHED           3 EXACEL01
RECO_EXA_CD_02_EXACEL01      MEMBER        CACHED           3 EXACEL01
RECO_EXA_CD_11_EXACEL01      MEMBER        CACHED           3 EXACEL01
RECO_EXA_CD_01_EXACEL01      MEMBER        CACHED           3 EXACEL01
RECO_EXA_CD_06_EXACEL01      MEMBER        CACHED           3 EXACEL01
RECO_EXA_CD_05_EXACEL01      MEMBER        CACHED           3 EXACEL01
RECO_EXA_CD_03_EXACEL01      MEMBER        CACHED           3 EXACEL01
RECO_EXA_CD_04_EXACEL01      MEMBER        CACHED           3 EXACEL01

12 rows selected.

— Now use the below command to drop all disks of failgroup  “EXACEL01′
 
alter diskgroup RECO_EXA drop disks in failgroup EXACEL01 rebalance power 11 NOWAIT;

Diskgroup altered.

— Check the rebalance operation has started or not. Use rebalance_progress.sh as shown below to monitor progress of ASM rebalance operation as v$asm_operation will not show you right estimate.
 
select * from v$asm_operation;
SQL> l
  1* select INST_ID, OPERATION, STATE, POWER, SOFAR, EST_WORK, EST_RATE, EST_MINUTES from GV$ASM_OPERATION
SQL> /

   INST_ID OPERA STAT       POWER      SOFAR   EST_WORK     EST_RATE EST_MINUTES
———- —– —- ———- ———- ———- ———- ———–
     1 REBAL RUN          11       9137    470223         7659       60
     2 REBAL WAIT          11

— Once the rebalance completes ,check the header_status column in v$asm_disk. It should show as FORMER for dropped disk
 
set linesize 300
column path format a40
select name,path,header_status,mount_status from v$asm_disk where group_number=0 order by 2;

NAME                   PATH                    HEADER_STATU MOUNT_S
—————————— —————————————- ———— ——-
                   o/192.168.10.3/DATA_EXA_CD_00_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_01_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_02_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_03_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_04_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_05_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_06_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_07_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_08_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_09_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_10_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/DATA_EXA_CD_11_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/RECO_EXA_CD_00_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/RECO_EXA_CD_01_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/RECO_EXA_CD_02_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/RECO_EXA_CD_03_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/RECO_EXA_CD_04_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/RECO_EXA_CD_05_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/RECO_EXA_CD_06_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/RECO_EXA_CD_07_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/RECO_EXA_CD_08_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/RECO_EXA_CD_09_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/RECO_EXA_CD_10_EXAcel01 FORMER         CLOSED
                   o/192.168.10.3/RECO_EXA_CD_11_EXAcel01 FORMER         CLOSED

24 rows selected.

— Drop and re-create the Grid disks at Storage cell node EXACEL01 with desired size.

[celladmin@EXAcel01 ~]$ cellcli
CellCLI: Release 11.2.3.1.1 – Production on Sun Oct 21 08:23:03 CDT 2012

Copyright (c) 2007, 2011, Oracle.  All rights reserved.
Cell Efficiency Ratio: 1,026

CellCLI> list griddisk attributes name,cellDisk,size,status;
     DATA_EXA_CD_00_EXAcel01     CD_00_EXAcel01     423G             active
     DATA_EXA_CD_01_EXAcel01     CD_01_EXAcel01     423G             active
     DATA_EXA_CD_02_EXAcel01     CD_02_EXAcel01     423G             active
     DATA_EXA_CD_03_EXAcel01     CD_03_EXAcel01     423G             active
     DATA_EXA_CD_04_EXAcel01     CD_04_EXAcel01     423G             active
     DATA_EXA_CD_05_EXAcel01     CD_05_EXAcel01     423G             active
     DATA_EXA_CD_06_EXAcel01     CD_06_EXAcel01     423G             active
     DATA_EXA_CD_07_EXAcel01     CD_07_EXAcel01     423G             active
     DATA_EXA_CD_08_EXAcel01     CD_08_EXAcel01     423G             active
     DATA_EXA_CD_09_EXAcel01     CD_09_EXAcel01     423G             active
     DATA_EXA_CD_10_EXAcel01     CD_10_EXAcel01     423G             active
     DATA_EXA_CD_11_EXAcel01     CD_11_EXAcel01     423G             active
     DBFS_DG_CD_02_EXAcel01       CD_02_EXAcel01     33.796875G       active
     DBFS_DG_CD_03_EXAcel01       CD_03_EXAcel01     33.796875G       active
     DBFS_DG_CD_04_EXAcel01       CD_04_EXAcel01     33.796875G       active
     DBFS_DG_CD_05_EXAcel01       CD_05_EXAcel01     33.796875G       active
     DBFS_DG_CD_06_EXAcel01       CD_06_EXAcel01     33.796875G       active
     DBFS_DG_CD_07_EXAcel01       CD_07_EXAcel01     33.796875G       active
     DBFS_DG_CD_08_EXAcel01       CD_08_EXAcel01     33.796875G       active
     DBFS_DG_CD_09_EXAcel01       CD_09_EXAcel01     33.796875G       active
     DBFS_DG_CD_10_EXAcel01       CD_10_EXAcel01     33.796875G       active
     DBFS_DG_CD_11_EXAcel01       CD_11_EXAcel01     33.796875G       active
     RECO_EXA_CD_00_EXAcel01     CD_00_EXAcel01     2337.109375G     active
     RECO_EXA_CD_01_EXAcel01     CD_01_EXAcel01     2337.109375G     active
     RECO_EXA_CD_02_EXAcel01     CD_02_EXAcel01     2337.109375G     active
     RECO_EXA_CD_03_EXAcel01     CD_03_EXAcel01     2337.109375G     active
     RECO_EXA_CD_04_EXAcel01     CD_04_EXAcel01     2337.109375G     active
     RECO_EXA_CD_05_EXAcel01     CD_05_EXAcel01     2337.109375G     active
     RECO_EXA_CD_06_EXAcel01     CD_06_EXAcel01     2337.109375G     active
     RECO_EXA_CD_07_EXAcel01     CD_07_EXAcel01     2337.109375G     active
     RECO_EXA_CD_08_EXAcel01     CD_08_EXAcel01     2337.109375G     active
     RECO_EXA_CD_09_EXAcel01     CD_09_EXAcel01     2337.109375G     active
     RECO_EXA_CD_10_EXAcel01     CD_10_EXAcel01     2337.109375G     active
     RECO_EXA_CD_11_EXAcel01     CD_11_EXAcel01     2337.109375G     active

#Login into EXACEL01 cell server and start cellcli.

ALTER GRIDDISK  DATA_EXA_CD_00_EXACEL01,DATA_EXA_CD_01_EXACEL01,DATA_EXA_CD_02_EXACEL01,DATA_EXA_CD_03_EXACEL01,DATA_EXA_CD_04_EXACEL01,DATA_EXA_CD_05_EXACEL01,DATA_EXA_CD_06_EXACEL01,DATA_EXA_CD_07_EXACEL01,DATA_EXA_CD_08_EXACEL01,DATA_EXA_CD_09_EXACEL01,DATA_EXA_CD_10_EXACEL01,DATA_EXA_CD_11_EXACEL01 INACTIVE
GridDisk DATA_EXA_CD_00_EXAcel01 successfully altered
GridDisk DATA_EXA_CD_01_EXAcel01 successfully altered
GridDisk DATA_EXA_CD_02_EXAcel01 successfully altered
GridDisk DATA_EXA_CD_03_EXAcel01 successfully altered
GridDisk DATA_EXA_CD_04_EXAcel01 successfully altered
GridDisk DATA_EXA_CD_05_EXAcel01 successfully altered
GridDisk DATA_EXA_CD_06_EXAcel01 successfully altered
GridDisk DATA_EXA_CD_07_EXAcel01 successfully altered
GridDisk DATA_EXA_CD_08_EXAcel01 successfully altered
GridDisk DATA_EXA_CD_09_EXAcel01 successfully altered
GridDisk DATA_EXA_CD_10_EXAcel01 successfully altered
GridDisk DATA_EXA_CD_11_EXAcel01 successfully altered

CellCLI> DROP GRIDDISK ALL PREFIX=DATA_EXA;
GridDisk DATA_EXA_CD_00_EXAcel01 successfully dropped
GridDisk DATA_EXA_CD_01_EXAcel01 successfully dropped
GridDisk DATA_EXA_CD_02_EXAcel01 successfully dropped
GridDisk DATA_EXA_CD_03_EXAcel01 successfully dropped
GridDisk DATA_EXA_CD_04_EXAcel01 successfully dropped
GridDisk DATA_EXA_CD_05_EXAcel01 successfully dropped
GridDisk DATA_EXA_CD_06_EXAcel01 successfully dropped
GridDisk DATA_EXA_CD_07_EXAcel01 successfully dropped
GridDisk DATA_EXA_CD_08_EXAcel01 successfully dropped
GridDisk DATA_EXA_CD_09_EXAcel01 successfully dropped
GridDisk DATA_EXA_CD_10_EXAcel01 successfully dropped
GridDisk DATA_EXA_CD_11_EXAcel01 successfully dropped

— Inactivate and DROP GDs for RECO

CellCLI> ALTER GRIDDISK  RECO_EXA_CD_00_EXACEL01,RECO_EXA_CD_01_EXACEL01,RECO_EXA_CD_02_EXACEL01,RECO_EXA_CD_03_EXACEL01,RECO_EXA_CD_04_EXACEL01,RECO_EXA_CD_05_EXACEL01,RECO_EXA_CD_06_EXACEL01,RECO_EXA_CD_07_EXACEL01,RECO_EXA_CD_08_EXACEL01,RECO_EXA_CD_09_EXACEL01,RECO_EXA_CD_10_EXACEL01,RECO_EXA_CD_11_EXACEL01 INACTIVE
GridDisk RECO_EXA_CD_00_EXAcel01 successfully altered
GridDisk RECO_EXA_CD_01_EXAcel01 successfully altered
GridDisk RECO_EXA_CD_02_EXAcel01 successfully altered
GridDisk RECO_EXA_CD_03_EXAcel01 successfully altered
GridDisk RECO_EXA_CD_04_EXAcel01 successfully altered
GridDisk RECO_EXA_CD_05_EXAcel01 successfully altered
GridDisk RECO_EXA_CD_06_EXAcel01 successfully altered
GridDisk RECO_EXA_CD_07_EXAcel01 successfully altered
GridDisk RECO_EXA_CD_08_EXAcel01 successfully altered
GridDisk RECO_EXA_CD_09_EXAcel01 successfully altered
GridDisk RECO_EXA_CD_10_EXAcel01 successfully altered
GridDisk RECO_EXA_CD_11_EXAcel01 successfully altered

CellCLI> DROP GRIDDISK ALL PREFIX=RECO_EXA;
GridDisk RECO_EXA_CD_00_EXAcel01 successfully dropped
GridDisk RECO_EXA_CD_01_EXAcel01 successfully dropped
GridDisk RECO_EXA_CD_02_EXAcel01 successfully dropped
GridDisk RECO_EXA_CD_03_EXAcel01 successfully dropped
GridDisk RECO_EXA_CD_04_EXAcel01 successfully dropped
GridDisk RECO_EXA_CD_05_EXAcel01 successfully dropped
GridDisk RECO_EXA_CD_06_EXAcel01 successfully dropped
GridDisk RECO_EXA_CD_07_EXAcel01 successfully dropped
GridDisk RECO_EXA_CD_08_EXAcel01 successfully dropped
GridDisk RECO_EXA_CD_09_EXAcel01 successfully dropped
GridDisk RECO_EXA_CD_10_EXAcel01 successfully dropped
GridDisk RECO_EXA_CD_11_EXAcel01 successfully dropped

CellCLI> CREATE GRIDDISK ALL PREFIX=DATA_EXA, size=2337.10G;
Cell disks were skipped because they had no freespace for grid disks: FD_00_EXAcel01, FD_01_EXAcel01, FD_02_EXAcel01, FD_03_EXAcel01, FD_04_EXAcel01, FD_05_EXAcel01, FD_06_EXAcel01, FD_07_EXAcel01, FD_08_EXAcel01, FD_09_EXAcel01, FD_10_EXAcel01, FD_11_EXAcel01, FD_12_EXAcel01, FD_13_EXAcel01, FD_14_EXAcel01, FD_15_EXAcel01.
GridDisk DATA_EXA_CD_00_EXAcel01 successfully created
GridDisk DATA_EXA_CD_01_EXAcel01 successfully created
GridDisk DATA_EXA_CD_02_EXAcel01 successfully created
GridDisk DATA_EXA_CD_03_EXAcel01 successfully created
GridDisk DATA_EXA_CD_04_EXAcel01 successfully created
GridDisk DATA_EXA_CD_05_EXAcel01 successfully created
GridDisk DATA_EXA_CD_06_EXAcel01 successfully created
GridDisk DATA_EXA_CD_07_EXAcel01 successfully created
GridDisk DATA_EXA_CD_08_EXAcel01 successfully created
GridDisk DATA_EXA_CD_09_EXAcel01 successfully created
GridDisk DATA_EXA_CD_10_EXAcel01 successfully created
GridDisk DATA_EXA_CD_11_EXAcel01 successfully created

CellCLI> CREATE GRIDDISK ALL PREFIX=RECO_EXA, size=423G;
Cell disks were skipped because they had no freespace for grid disks: FD_00_EXAcel01, FD_01_EXAcel01, FD_02_EXAcel01, FD_03_EXAcel01, FD_04_EXAcel01, FD_05_EXAcel01, FD_06_EXAcel01, FD_07_EXAcel01, FD_08_EXAcel01, FD_09_EXAcel01, FD_10_EXAcel01, FD_11_EXAcel01, FD_12_EXAcel01, FD_13_EXAcel01, FD_14_EXAcel01, FD_15_EXAcel01.
GridDisk RECO_EXA_CD_00_EXAcel01 successfully created
GridDisk RECO_EXA_CD_01_EXAcel01 successfully created
GridDisk RECO_EXA_CD_02_EXAcel01 successfully created
GridDisk RECO_EXA_CD_03_EXAcel01 successfully created
GridDisk RECO_EXA_CD_04_EXAcel01 successfully created
GridDisk RECO_EXA_CD_05_EXAcel01 successfully created
GridDisk RECO_EXA_CD_06_EXAcel01 successfully created
GridDisk RECO_EXA_CD_07_EXAcel01 successfully created
GridDisk RECO_EXA_CD_08_EXAcel01 successfully created
GridDisk RECO_EXA_CD_09_EXAcel01 successfully created
GridDisk RECO_EXA_CD_10_EXAcel01 successfully created
GridDisk RECO_EXA_CD_11_EXAcel01 successfully created

— Check Griddisk information

CellCLI>  list griddisk attributes name,cellDisk,size,status;
     DATA_EXA_CD_00_EXAcel01     CD_00_EXAcel01     2337.09375G     active
     DATA_EXA_CD_01_EXAcel01     CD_01_EXAcel01     2337.09375G     active
     DATA_EXA_CD_02_EXAcel01     CD_02_EXAcel01     2337.09375G     active
     DATA_EXA_CD_03_EXAcel01     CD_03_EXAcel01     2337.09375G     active
     DATA_EXA_CD_04_EXAcel01     CD_04_EXAcel01     2337.09375G     active
     DATA_EXA_CD_05_EXAcel01     CD_05_EXAcel01     2337.09375G     active
     DATA_EXA_CD_06_EXAcel01     CD_06_EXAcel01     2337.09375G     active
     DATA_EXA_CD_07_EXAcel01     CD_07_EXAcel01     2337.09375G     active
     DATA_EXA_CD_08_EXAcel01     CD_08_EXAcel01     2337.09375G     active
     DATA_EXA_CD_09_EXAcel01     CD_09_EXAcel01     2337.09375G     active
     DATA_EXA_CD_10_EXAcel01     CD_10_EXAcel01     2337.09375G     active
     DATA_EXA_CD_11_EXAcel01     CD_11_EXAcel01     2337.09375G     active
     DBFS_DG_CD_02_EXAcel01       CD_02_EXAcel01     33.796875G      active
     DBFS_DG_CD_03_EXAcel01       CD_03_EXAcel01     33.796875G      active
     DBFS_DG_CD_04_EXAcel01       CD_04_EXAcel01     33.796875G      active
     DBFS_DG_CD_05_EXAcel01       CD_05_EXAcel01     33.796875G      active
     DBFS_DG_CD_06_EXAcel01       CD_06_EXAcel01     33.796875G      active
     DBFS_DG_CD_07_EXAcel01       CD_07_EXAcel01     33.796875G      active
     DBFS_DG_CD_08_EXAcel01       CD_08_EXAcel01     33.796875G      active
     DBFS_DG_CD_09_EXAcel01       CD_09_EXAcel01     33.796875G      active
     DBFS_DG_CD_10_EXAcel01       CD_10_EXAcel01     33.796875G      active
     DBFS_DG_CD_11_EXAcel01       CD_11_EXAcel01     33.796875G      active
     RECO_EXA_CD_00_EXAcel01     CD_00_EXAcel01     423G            active
     RECO_EXA_CD_01_EXAcel01     CD_01_EXAcel01     423G            active
     RECO_EXA_CD_02_EXAcel01     CD_02_EXAcel01     423G            active
     RECO_EXA_CD_03_EXAcel01     CD_03_EXAcel01     423G            active
     RECO_EXA_CD_04_EXAcel01     CD_04_EXAcel01     423G            active
     RECO_EXA_CD_05_EXAcel01     CD_05_EXAcel01     423G            active
     RECO_EXA_CD_06_EXAcel01     CD_06_EXAcel01     423G            active
     RECO_EXA_CD_07_EXAcel01     CD_07_EXAcel01     423G            active
     RECO_EXA_CD_08_EXAcel01     CD_08_EXAcel01     423G            active
     RECO_EXA_CD_09_EXAcel01     CD_09_EXAcel01     423G            active
     RECO_EXA_CD_10_EXAcel01     CD_10_EXAcel01     423G            active
     RECO_EXA_CD_11_EXAcel01     CD_11_EXAcel01     423G            active

–Last step is to add disks back to ASM disk groups and rebalance disks.

SQL> ALTER DISKGROUP DATA_EXA ADD DISK ‘o/192.168.10.3/DATA_EXA_CD*’ rebalance power 11 NOWAIT;

Diskgroup altered.

SQL> select INST_ID, OPERATION, STATE, POWER, SOFAR, EST_WORK, EST_RATE, EST_MINUTES from GV$ASM_OPERATION;

   INST_ID OPERA STAT       POWER      SOFAR   EST_WORK     EST_RATE EST_MINUTES
———- —– —- ———- ———- ———- ———- ———–
     1 REBAL RUN          11       1897    1796448         9344      192
     2 REBAL WAIT          11

SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 – 64bit Production
With the Real Application Clusters and Automatic Storage Management options
[oracle@EXAdb01 ~]$ cd scripts/
[oracle@EXAdb01 scripts]$ ./rebalance_progress.sh
######################################################################
This script will monitor Phase 1 (rebalance) file by file and Phase 2
(compaction) disk by disk. Both phases should increment, showing progress.
This script will *not* estimate how long the rebalance will take.
######################################################################
 
Diskgroup being rebalanced is DATA_EXA
ASM file numbers for databases start at 256.
Default check interval is 600 seconds. This run using 600 seconds…
 
Sun Oct 21 08:42:16 CDT 2012: PHASE 1 (of 2): Processing file 261 out of 605
Sun Oct 21 09:28:10 CDT 2012: PHASE 1 (of 2): Processing file 562 out of 605
Sun Oct 21 09:32:11 CDT 2012: PHASE 1 (of 2): Processing file 588 out of 605
Sun Oct 21 10:08:39 CDT 2012: PHASE 1 (of 2): Processing file 596 out of 605
Sun Oct 21 10:24:57 CDT 2012: PHASE 1 (of 2): Processing file 605 out of 605
*******************************************************
Sun Oct 21 10:27:27 CDT 2012: PHASE 1 (of 2) complete.
*******************************************************

SQL> ALTER DISKGROUP RECO_EXA ADD DISK ‘o/192.168.10.3/RECO_EXA_CD*’ rebalance power 11 NOWAIT;

Diskgroup altered.

Diskgroup being rebalanced is DATA_EXA
ASM file numbers for databases start at 256.
Default check interval is 600 seconds. This run using 600 seconds…
 
Sun Oct 21 10:31:59 CDT 2012: PHASE 1 (of 2): Processing file 315 out of 605
Sun Oct 21 10:41:59 CDT 2012: PHASE 1 (of 2): Processing file 592 out of 605
Sun Oct 21 10:51:59 CDT 2012: PHASE 1 (of 2): Processing file 605 out of 605
*******************************************************
Sun Oct 21 11:02:29 CDT 2012: PHASE 1 (of 2) complete.
*******************************************************

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: