HBase

This page presents the results obtained under the two configurations of the HBase deployment:

  • Without compaction effects – waiting 30 minutes after the workload loading phase and before running the workload (enough time for resulting compactions to finish);

  • With compaction effects – performing each workload immediately after the corresponding loading phase is done, thus evaluating the deployment under the effect of ongoing compactions.

Tip

Results are presented in tabular form. Click on the cells! :) to see the value of all observed metrics across the duration of each benchmarking run.

Performance metrics

The following table presents the mean and 99th percentile latency (rows) achieved by both configurations (columns) under each workload and for each type of operation, as reported by YCSB.

The operation types are denoted by a single letter: Rread, Uupdate, Iinsert, Sscan, Mread-modify-write.

Absolute latency in μs/op is presented for the configuration without compaction effects, while the relative difference of the latency against that baseline is presented as a percentage for the configuration with compaction effects.

Cells containing a relative difference \(R\) are colored according to the following rule: blue if \(R < -5\%\), green if \(R \in [-5\%, +5\%]\), yellow if \(R \in (+5\%, +15\%]\), orange if \(R \in (+15\%, +30\%]\), and red if \(R > +30\%\).

Without
compaction
effects
With
compaction
effects
A - 1th  R  mean lat. (μs/op) (rel. diff. %) 577.2 +37.1
99th p. lat. (μs/op) (rel. diff. %) 1375.0 +51.7
 U  mean lat. (μs/op) (rel. diff. %) 311.0 +14.5
99th p. lat. (μs/op) (rel. diff. %) 537.0 +25.6
A - 10th  R  mean lat. (μs/op) (rel. diff. %) 1888.7 +25.7
99th p. lat. (μs/op) (rel. diff. %) 5832.3 +348.9
 U  mean lat. (μs/op) (rel. diff. %) 1455.0 +4.2
99th p. lat. (μs/op) (rel. diff. %) 5092.3 +14.9
B - 1th  U  mean lat. (μs/op) (rel. diff. %) 304.4 +1.6
99th p. lat. (μs/op) (rel. diff. %) 408.7 +26.7
B - 10th  U  mean lat. (μs/op) (rel. diff. %) 710.1 +14.7
99th p. lat. (μs/op) (rel. diff. %) 6855.0 +4.7
C - 1th  R  mean lat. (μs/op) (rel. diff. %) 672.7 +32.9
99th p. lat. (μs/op) (rel. diff. %) 1348.3 +69.3
C - 10th  R  mean lat. (μs/op) (rel. diff. %) 2495.5 +21.4
99th p. lat. (μs/op) (rel. diff. %) 7275.0 +249.1
D - 1th  R  mean lat. (μs/op) (rel. diff. %) 826.3 +53.2
99th p. lat. (μs/op) (rel. diff. %) 3096.3 +955.2
 I  mean lat. (μs/op) (rel. diff. %) 356.2 +7.2
99th p. lat. (μs/op) (rel. diff. %) 613.0 +27.0
D - 10th  R  mean lat. (μs/op) (rel. diff. %) 2994.5 +10.8
99th p. lat. (μs/op) (rel. diff. %) 66855.7 +4.9
 I  mean lat. (μs/op) (rel. diff. %) 1054.3 +4.3
99th p. lat. (μs/op) (rel. diff. %) 6026.5 -1.5
E - 1th  S  mean lat. (μs/op) (rel. diff. %) 1848.5 +87.3
99th p. lat. (μs/op) (rel. diff. %) 5024.3 +177.1
 I  mean lat. (μs/op) (rel. diff. %) 876.6 -0.7
99th p. lat. (μs/op) (rel. diff. %) 2943.7 -43.1
E - 10th  S  mean lat. (μs/op) (rel. diff. %) 7094.4 +71.0
99th p. lat. (μs/op) (rel. diff. %) 26077.5 +210.7
 I  mean lat. (μs/op) (rel. diff. %) 3749.1 +5.4
99th p. lat. (μs/op) (rel. diff. %) 12951.7 +40.0
F - 1th  R  mean lat. (μs/op) (rel. diff. %) 552.6 +36.3
99th p. lat. (μs/op) (rel. diff. %) 1342.0 +46.7
 M  mean lat. (μs/op) (rel. diff. %) 909.0 +27.6
99th p. lat. (μs/op) (rel. diff. %) 1825.0 +66.8
F - 10th  R  mean lat. (μs/op) (rel. diff. %) 1967.5 +23.8
99th p. lat. (μs/op) (rel. diff. %) 6063.0 +191.2
 M  mean lat. (μs/op) (rel. diff. %) 3592.8 +15.4
99th p. lat. (μs/op) (rel. diff. %) 9999.0 +281.0

Resource utilization metrics

The following table presents mean CPU and disk utilization metrics (rows) for both configurations (columns) under each workload, as reported by Dstat.

Absolute CPU utilization (busy and waiting percentages of total CPU time) and disk utilization (read and write throughput in MiB/s) are presented for the configuration without compaction effects, while the absolute difference of these metrics against that baseline is presented for the configuration with compaction effects.

For CPU utilization, cells containing an absolute difference \(D\) are colored according to the following rule: blue if \(D < -5\), green if \(D \in [-5, +5]\), yellow if \(D \in (+5, +15]\), orange if \(D \in (+15, +30]\), and red if \(D > +30\).

For disk utilization, the greater the magnitude of the throughput difference against the baseline, the darker the cell.

Without
compaction
effects
With
compaction
effects
A - 1th CPU busy (%) (diff.) 30.6 +1.6
CPU wait (%) (diff.) 2.7 +2.9
disk read thr. (MiB/s) (diff.) 46.7 +4.6
disk write thr. (MiB/s) (diff.) 0.2 +14.8
A - 10th CPU busy (%) (diff.) 90.3 -5.8
CPU wait (%) (diff.) 1.4 +6.1
disk read thr. (MiB/s) (diff.) 124.7 -2.5
disk write thr. (MiB/s) (diff.) 0.9 +14.9
B - 1th CPU busy (%) (diff.) 34.5 +5.4
CPU wait (%) (diff.) 0.1 +1.6
disk read thr. (MiB/s) (diff.) 0.0 +14.6
disk write thr. (MiB/s) (diff.) 0.9 +15.2
B - 10th CPU busy (%) (diff.) 85.9 +0.7
CPU wait (%) (diff.) 0.1 +0.4
disk read thr. (MiB/s) (diff.) 0.1 +15.7
disk write thr. (MiB/s) (diff.) 4.6 +15.6
C - 1th CPU busy (%) (diff.) 26.3 +3.0
CPU wait (%) (diff.) 8.1 +0.2
disk read thr. (MiB/s) (diff.) 98.5 -9.9
disk write thr. (MiB/s) (diff.) 0.0 +15.2
C - 10th CPU busy (%) (diff.) 91.7 -6.3
CPU wait (%) (diff.) 3.0 +6.3
disk read thr. (MiB/s) (diff.) 267.3 -31.5
disk write thr. (MiB/s) (diff.) 0.0 +15.1
D - 1th CPU busy (%) (diff.) 35.2 +2.9
CPU wait (%) (diff.) 2.2 +2.6
disk read thr. (MiB/s) (diff.) 5.3 +12.9
disk write thr. (MiB/s) (diff.) 11.7 +11.8
D - 10th CPU busy (%) (diff.) 82.9 +0.6
CPU wait (%) (diff.) 4.3 +0.1
disk read thr. (MiB/s) (diff.) 21.6 +5.7
disk write thr. (MiB/s) (diff.) 39.7 +4.8
E - 1th CPU busy (%) (diff.) 27.8 +2.3
CPU wait (%) (diff.) 4.2 +2.9
disk read thr. (MiB/s) (diff.) 73.5 +14.9
disk write thr. (MiB/s) (diff.) 0.1 +15.1
E - 10th CPU busy (%) (diff.) 94.3 -5.1
CPU wait (%) (diff.) 1.2 +6.1
disk read thr. (MiB/s) (diff.) 192.6 +30.4
disk write thr. (MiB/s) (diff.) 0.1 +15.0
F - 1th CPU busy (%) (diff.) 30.6 +0.9
CPU wait (%) (diff.) 3.9 +2.1
disk read thr. (MiB/s) (diff.) 56.7 +2.2
disk write thr. (MiB/s) (diff.) 0.2 +15.1
F - 10th CPU busy (%) (diff.) 91.1 -5.8
CPU wait (%) (diff.) 1.3 +6.3
disk read thr. (MiB/s) (diff.) 148.4 -6.9
disk write thr. (MiB/s) (diff.) 0.4 +14.9