Exadata · Oracle

Exadata Storage Cell Calibrate

calibrateOn an exadata machine you can investigate the physical disk performance using calibrate command. It will do parallel stress tests on the cell. If there are some low performing disks detected, calibrate will test them individually and on the command prompt displays the output. This command is mainly used to initial setup for the exadata. By the way it is the 9th step for the OneCommand Utility.

From the output, you can see how much IOPS or throughput you can get on that cell in total and it will display according to individual physical disks and flash disks. It should not be run when you have active online system running. To run it you should stop the CELLSRV service on the cell or use the FORCE option.

Sample Output :

CellCLI> calibrate force
Calibration will take a few minutes...
Aggregate random read throughput across all hard disk LUNs: 1460 MBPS
Aggregate random read throughput across all flash disk LUNs: 8327.04 MBPS
Aggregate random read IOs per second (IOPS) across all hard disk LUNs: 2375
Aggregate random read IOs per second (IOPS) across all flash disk LUNs: 133583
Controller read throughput: 1996.68 MBPS
Calibrating hard disks (read only) ...
LUN 0_0 on drive [20:0 ] random read throughput: 127.05 MBPS, and 195 IOPS
LUN 0_1 on drive [20:1 ] random read throughput: 126.73 MBPS, and 197 IOPS
LUN 0_10 on drive [20:10 ] random read throughput: 129.29 MBPS, and 201 IOPS
LUN 0_11 on drive [20:11 ] random read throughput: 130.08 MBPS, and 202 IOPS
LUN 0_2 on drive [20:2 ] random read throughput: 122.90 MBPS, and 199 IOPS
LUN 0_3 on drive [20:3 ] random read throughput: 126.55 MBPS, and 200 IOPS
LUN 0_4 on drive [20:4 ] random read throughput: 130.18 MBPS, and 200 IOPS
LUN 0_5 on drive [20:5 ] random read throughput: 132.53 MBPS, and 204 IOPS
LUN 0_6 on drive [20:6 ] random read throughput: 126.81 MBPS, and 201 IOPS
LUN 0_7 on drive [20:7 ] random read throughput: 129.71 MBPS, and 201 IOPS
LUN 0_8 on drive [20:8 ] random read throughput: 132.04 MBPS, and 205 IOPS
LUN 0_9 on drive [20:9 ] random read throughput: 129.91 MBPS, and 203 IOPS
Calibrating flash disks (read only, note that writes will be significantly slower) ...
LUN 1_0 on drive [FLASH_1_0] random read throughput: 545.28 MBPS, and 35326 IOPS
LUN 1_1 on drive [FLASH_1_1] random read throughput: 545.44 MBPS, and 34953 IOPS
LUN 1_2 on drive [FLASH_1_2] random read throughput: 545.41 MBPS, and 35329 IOPS
LUN 1_3 on drive [FLASH_1_3] random read throughput: 545.34 MBPS, and 34787 IOPS
LUN 2_0 on drive [FLASH_2_0] random read throughput: 545.46 MBPS, and 37043 IOPS
LUN 2_1 on drive [FLASH_2_1] random read throughput: 545.41 MBPS, and 37038 IOPS
LUN 2_2 on drive [FLASH_2_2] random read throughput: 545.38 MBPS, and 37367 IOPS
LUN 2_3 on drive [FLASH_2_3] random read throughput: 545.16 MBPS, and 37164 IOPS
LUN 4_0 on drive [FLASH_4_0] random read throughput: 545.06 MBPS, and 36247 IOPS
LUN 4_1 on drive [FLASH_4_1] random read throughput: 542.92 MBPS, and 35784 IOPS
LUN 4_2 on drive [FLASH_4_2] random read throughput: 545.26 MBPS, and 36176 IOPS
LUN 4_3 on drive [FLASH_4_3] random read throughput: 543.00 MBPS, and 36372 IOPS
LUN 5_0 on drive [FLASH_5_0] random read throughput: 542.80 MBPS, and 36594 IOPS
LUN 5_1 on drive [FLASH_5_1] random read throughput: 543.18 MBPS, and 37055 IOPS
LUN 5_2 on drive [FLASH_5_2] random read throughput: 543.20 MBPS, and 36837 IOPS
LUN 5_3 on drive [FLASH_5_3] random read throughput: 543.69 MBPS, and 36701 IOPS
CALIBRATE results are within an acceptable range.
Calibration has finished.

Before running the command the CELLSRV process should not be running

CellCLI> calibrate
CELL-01523: CALIBRATE should not run while CELLSRV is running. Stop CELLSRV or enter CALIBRATE FORCE.
 
 
CellCLI>  ALTER CELL SHUTDOWN SERVICES CELLSRV;
 
Stopping CELLSRV services...
The SHUTDOWN of CELLSRV services was successful.

dcli

To run the command over the all available cells, you can use “dcli” utility.

[root@hostdbadm01 ~]# dcli -g /opt/oracle.SupportTools/onecommand/cell_group -l root cellcli -e calibrate force

Restrictions :

Calibrate command is only available to the root user. There are other users like celladmin and cellmonitor on a cell storage server and if you login with these users you will not be able to run the calibrate command and get the following errors :

for celladmin :

[celladmin@hostceladm02 ~]$ cellcli
CellCLI: Release 11.2.3.2.1 - Production on Tue Sep 17 16:30:42 EEST 2013

Copyright (c) 2007, 2012, Oracle. All rights reserved.
Cell Efficiency Ratio: 1,000

CellCLI> calibrate force
CELL-01522: CALIBRATE must be run as the root user id.

for cellmonitor :

[cellmonitor@hostceladm02 ~]$ cellcli
CellCLI: Release 11.2.3.2.1 - Production on Tue Sep 17 16:31:35 EEST 2013

Copyright (c) 2007, 2012, Oracle. All rights reserved.
Cell Efficiency Ratio: 1,000

CellCLI> calibrate force
CELL-01520: This command is not permitted in monitor mode.

Help

CellCLI> help calibrate 

  Usage: CALIBRATE [HARDDISK | FLASHDISK | lun1 [, lun2]] [FORCE]
  Purpose: Runs raw performance tests on disks.
           CELLSRV must be shutdown.  User id root is required.

  Options:
    [FLASHDISK]: option to specify that only flash LUNs be calibrated.
    [HARDDISK] : option to specify that only hard disk LUNs be calibrated.
    lun1 [, lun2] : option to specify list of LUNs by name    [FORCE]    : runs test even while CELLSRV is running.

  Examples:
    CALIBRATE
    CALIBRATE '0_8', '0_10' force
Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s