How many IOPS gives the Exadata ?

 Немного фактов в продолжение темы производительности.

Если Вы помните, то год назад 1/4 Экзадаты давала по паспорту 225К IOPS. И мы дружно произносили эту цифру в презентациях.Потом в паспорте появилась цифра 375К, и мы все сказали «Вау!», но поверили и стали повторять эту цифру:

Однако, в наших тестах на стенде я никогда не видел цифры выше 20К. Она вообще редко поднималась выше 15К.

Команда dbms_resource_manager.CALIBRATE_IO тоже показывала 18К-24К.

Была еще команда cellcli CALIBRATE – но как-то до нее не доходили руки ...

В результате этот вопрос так и остался вопросом.

Итак, посмотрим на то, что показывает cellcli CALIBRATE на нашей 1/4 сегодня. Для полноты картины приведу все замеры очень подробно:

Первый cell:

 [root@ed01cel01 ~]# cellcli

CellCLI>  calibrate FORCE
Calibration will take a few minutes...
Aggregate random read throughput across all hard disk luns: 1865 MBPS
Aggregate random read throughput across all flash disk luns: 4079.81 MBPS
Aggregate random read IOs per second (IOPS) across all hard disk luns: 4940
Aggregate random read IOs per second (IOPS) across all flash disk luns: 146465
Controller read throughput: 2002.22 MBPS
Calibrating hard disks (read only) ...
Lun 0_0  on drive [20:0     ] random read throughput: 163.40 MBPS, and 403 IOPS
Lun 0_1  on drive [20:1     ] random read throughput: 163.34 MBPS, and 406 IOPS
Lun 0_10 on drive [20:10    ] random read throughput: 171.50 MBPS, and 430 IOPS
Lun 0_11 on drive [20:11    ] random read throughput: 171.76 MBPS, and 428 IOPS
Lun 0_2  on drive [20:2     ] random read throughput: 173.33 MBPS, and 433 IOPS
Lun 0_3  on drive [20:3     ] random read throughput: 170.54 MBPS, and 434 IOPS
Lun 0_4  on drive [20:4     ] random read throughput: 169.95 MBPS, and 435 IOPS
Lun 0_5  on drive [20:5     ] random read throughput: 172.08 MBPS, and 436 IOPS
Lun 0_6  on drive [20:6     ] random read throughput: 173.01 MBPS, and 427 IOPS
Lun 0_7  on drive [20:7     ] random read throughput: 166.70 MBPS, and 426 IOPS
Lun 0_8  on drive [20:8     ] random read throughput: 169.87 MBPS, and 431 IOPS
Lun 0_9  on drive [20:9     ] random read throughput: 171.46 MBPS, and 432 IOPS
Calibrating flash disks (read only, note that writes will be significantly slower) ...
Lun 1_0  on drive [FLASH_1_0] random read throughput: 264.93 MBPS, and 19528 IOPS
Lun 1_1  on drive [FLASH_1_1] random read throughput: 263.69 MBPS, and 19499 IOPS
Lun 1_2  on drive [FLASH_1_2] random read throughput: 265.34 MBPS, and 19515 IOPS
Lun 1_3  on drive [FLASH_1_3] random read throughput: 264.61 MBPS, and 19566 IOPS
Lun 2_0  on drive [FLASH_2_0] random read throughput: 267.67 MBPS, and 20284 IOPS
Lun 2_1  on drive [FLASH_2_1] random read throughput: 262.09 MBPS, and 20081 IOPS
Lun 2_2  on drive [FLASH_2_2] random read throughput: 267.15 MBPS, and 20271 IOPS
Lun 2_3  on drive [FLASH_2_3] random read throughput: 265.52 MBPS, and 20197 IOPS
Lun 4_0  on drive [FLASH_4_0] random read throughput: 268.30 MBPS, and 19697 IOPS
Lun 4_1  on drive [FLASH_4_1] random read throughput: 267.86 MBPS, and 19615 IOPS
Lun 4_2  on drive [FLASH_4_2] random read throughput: 263.98 MBPS, and 19514 IOPS
Lun 4_3  on drive [FLASH_4_3] random read throughput: 266.26 MBPS, and 19585 IOPS
Lun 5_0  on drive [FLASH_5_0] random read throughput: 266.86 MBPS, and 19546 IOPS
Lun 5_1  on drive [FLASH_5_1] random read throughput: 264.70 MBPS, and 19510 IOPS
Lun 5_2  on drive [FLASH_5_2] random read throughput: 265.29 MBPS, and 19496 IOPS
Lun 5_3  on drive [FLASH_5_3] random read throughput: 262.10 MBPS, and 19387 IOPS
CALIBRATE results are within an acceptable range.
Calibration has finished.

Второй cell:

[root@ed01cel02 ~]# cellcli
CellCLI: Release 11.2.2.4.2 - Production on Fri May 04 10:43:35 MSD 2012

Copyright (c) 2007, 2011, Oracle.  All rights reserved.
Cell Efficiency Ratio: 1,000

CellCLI> calibrate force
Calibration will take a few minutes...
Aggregate random read throughput across all hard disk luns: 1893 MBPS
Aggregate random read throughput across all flash disk luns: 3973.78 MBPS
Aggregate random read IOs per second (IOPS) across all hard disk luns: 4995
Aggregate random read IOs per second (IOPS) across all flash disk luns: 149567
Controller read throughput: 1977.18 MBPS
Calibrating hard disks (read only) ...
Lun 0_0  on drive [20:0     ] random read throughput: 164.22 MBPS, and 383 IOPS
Lun 0_1  on drive [20:1     ] random read throughput: 162.29 MBPS, and 389 IOPS
Lun 0_10 on drive [20:10    ] random read throughput: 169.10 MBPS, and 435 IOPS
Lun 0_11 on drive [20:11    ] random read throughput: 172.07 MBPS, and 430 IOPS
Lun 0_2  on drive [20:2     ] random read throughput: 168.09 MBPS, and 431 IOPS
Lun 0_3  on drive [20:3     ] random read throughput: 171.74 MBPS, and 434 IOPS
Lun 0_4  on drive [20:4     ] random read throughput: 169.82 MBPS, and 420 IOPS
Lun 0_5  on drive [20:5     ] random read throughput: 168.58 MBPS, and 433 IOPS
Lun 0_6  on drive [20:6     ] random read throughput: 171.92 MBPS, and 429 IOPS
Lun 0_7  on drive [20:7     ] random read throughput: 172.27 MBPS, and 433 IOPS
Lun 0_8  on drive [20:8     ] random read throughput: 170.74 MBPS, and 425 IOPS
Lun 0_9  on drive [20:9     ] random read throughput: 169.73 MBPS, and 433 IOPS
Calibrating flash disks (read only, note that writes will be significantly slower) ...
Lun 1_0  on drive [FLASH_1_0] random read throughput: 263.68 MBPS, and 19473 IOPS
Lun 1_1  on drive [FLASH_1_1] random read throughput: 263.71 MBPS, and 19568 IOPS
Lun 1_2  on drive [FLASH_1_2] random read throughput: 263.73 MBPS, and 19488 IOPS
Lun 1_3  on drive [FLASH_1_3] random read throughput: 261.28 MBPS, and 19521 IOPS
Lun 2_0  on drive [FLASH_2_0] random read throughput: 265.27 MBPS, and 20189 IOPS
Lun 2_1  on drive [FLASH_2_1] random read throughput: 260.58 MBPS, and 20019 IOPS
Lun 2_2  on drive [FLASH_2_2] random read throughput: 267.76 MBPS, and 20296 IOPS
Lun 2_3  on drive [FLASH_2_3] random read throughput: 264.98 MBPS, and 20183 IOPS
Lun 4_0  on drive [FLASH_4_0] random read throughput: 264.42 MBPS, and 19609 IOPS
Lun 4_1  on drive [FLASH_4_1] random read throughput: 247.96 MBPS, and 19099 IOPS
Lun 4_2  on drive [FLASH_4_2] random read throughput: 265.27 MBPS, and 19558 IOPS
Lun 4_3  on drive [FLASH_4_3] random read throughput: 264.14 MBPS, and 19583 IOPS
Lun 5_0  on drive [FLASH_5_0] random read throughput: 264.39 MBPS, and 19605 IOPS
Lun 5_1  on drive [FLASH_5_1] random read throughput: 261.98 MBPS, and 19517 IOPS
Lun 5_2  on drive [FLASH_5_2] random read throughput: 264.05 MBPS, and 19554 IOPS
Lun 5_3  on drive [FLASH_5_3] random read throughput: 257.84 MBPS, and 19337 IOPS
CALIBRATE results are within an acceptable range.
Calibration has finished.

Третий cell:
[root@ed01cel03 ~]# cellcli
CellCLI: Release 11.2.2.4.2 - Production on Fri May 04 10:46:48 MSD 2012

Copyright (c) 2007, 2011, Oracle.  All rights reserved.
Cell Efficiency Ratio: 1,000

CellCLI> calibrate force
Calibration will take a few minutes...
Aggregate random read throughput across all hard disk luns: 1791 MBPS
Aggregate random read throughput across all flash disk luns: 4040.75 MBPS
Aggregate random read IOs per second (IOPS) across all hard disk luns: 4805
Aggregate random read IOs per second (IOPS) across all flash disk luns: 138115
Controller read throughput: 1911.32 MBPS
Calibrating hard disks (read only) ...
Lun 0_0  on drive [20:0     ] random read throughput: 155.82 MBPS, and 376 IOPS
Lun 0_1  on drive [20:1     ] random read throughput: 159.34 MBPS, and 389 IOPS
Lun 0_10 on drive [20:10    ] random read throughput: 169.62 MBPS, and 440 IOPS
Lun 0_11 on drive [20:11    ] random read throughput: 171.88 MBPS, and 436 IOPS
Lun 0_2  on drive [20:2     ] random read throughput: 170.86 MBPS, and 433 IOPS
Lun 0_3  on drive [20:3     ] random read throughput: 173.52 MBPS, and 436 IOPS
Lun 0_4  on drive [20:4     ] random read throughput: 170.50 MBPS, and 430 IOPS
Lun 0_5  on drive [20:5     ] random read throughput: 167.67 MBPS, and 428 IOPS
Lun 0_6  on drive [20:6     ] random read throughput: 173.30 MBPS, and 433 IOPS
Lun 0_7  on drive [20:7     ] random read throughput: 172.67 MBPS, and 431 IOPS
Lun 0_8  on drive [20:8     ] random read throughput: 171.47 MBPS, and 434 IOPS
Lun 0_9  on drive [20:9     ] random read throughput: 169.42 MBPS, and 424 IOPS
Calibrating flash disks (read only, note that writes will be significantly slower) ...
Lun 1_0  on drive [FLASH_1_0] random read throughput: 264.46 MBPS, and 19521 IOPS
Lun 1_1  on drive [FLASH_1_1] random read throughput: 262.71 MBPS, and 19530 IOPS
Lun 1_2  on drive [FLASH_1_2] random read throughput: 265.43 MBPS, and 19541 IOPS
Lun 1_3  on drive [FLASH_1_3] random read throughput: 266.02 MBPS, and 19539 IOPS
Lun 2_0  on drive [FLASH_2_0] random read throughput: 267.42 MBPS, and 20277 IOPS
Lun 2_1  on drive [FLASH_2_1] random read throughput: 267.34 MBPS, and 20289 IOPS
Lun 2_2  on drive [FLASH_2_2] random read throughput: 268.13 MBPS, and 20273 IOPS
Lun 2_3  on drive [FLASH_2_3] random read throughput: 268.48 MBPS, and 20255 IOPS
Lun 4_0  on drive [FLASH_4_0] random read throughput: 254.06 MBPS, and 19242 IOPS
Lun 4_1  on drive [FLASH_4_1] random read throughput: 256.97 MBPS, and 19347 IOPS
Lun 4_2  on drive [FLASH_4_2] random read throughput: 259.41 MBPS, and 19554 IOPS
Lun 4_3  on drive [FLASH_4_3] random read throughput: 260.35 MBPS, and 19490 IOPS
Lun 5_0  on drive [FLASH_5_0] random read throughput: 265.13 MBPS, and 19569 IOPS
Lun 5_1  on drive [FLASH_5_1] random read throughput: 264.08 MBPS, and 19599 IOPS
Lun 5_2  on drive [FLASH_5_2] random read throughput: 264.07 MBPS, and 19618 IOPS
Lun 5_3  on drive [FLASH_5_3] random read throughput: 262.33 MBPS, and 19484 IOPS
CALIBRATE results are within an acceptable range.
Calibration has finished.

Итого получаем в сумме:

Диски:    4940  +  4995  +  4805 = 14740 IOPS (в паспорте 10800, +36%)

Флеш: 146465+149567+138115 = 434147 IOPS (в паспорте 375К, +16%)