repository: go
branch: master
builder: gotip-linux-amd64_c3h88-perf_vs_parent
runstamp: 2025-04-21T20:26:55.725396277Z
goos: linux
goarch: amd64
cpu: Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
│ baseline │ experiment │
│ p99.999-sec │ p99.999-sec vs base │
GCLatency/how=stack/fluff=false-88 115.84µ ± 29% 79.99µ ± 11% -30.95% (p=0.009 n=6)
GCLatency/how=heap/fluff=false-88 77.65µ ± 29% 79.25µ ± 3% ~ (p=0.310 n=6)
GCLatency/how=global/fluff=false-88 85.48µ ± 9% 82.20µ ± 5% ~ (p=0.132 n=6)
geomean 91.61µ 80.47µ -12.16%
│ baseline │ experiment │
│ p99.9999-sec │ p99.9999-sec vs base │
GCLatency/how=stack/fluff=false-88 162.3µ ± 40% 146.9µ ± 32% ~ (p=0.240 n=6)
GCLatency/how=heap/fluff=false-88 152.4µ ± 49% 134.0µ ± 5% -12.07% (p=0.002 n=6)
GCLatency/how=global/fluff=false-88 248.9µ ± 438% 271.9µ ± 2% ~ (p=0.394 n=6)
geomean 183.3µ 174.9µ -4.55%
│ baseline │ experiment │
│ total-bytes │ total-bytes vs base │
Ethereum_trie 7.329Mi ± 0% 7.354Mi ± 0% +0.35% (n=1)
Spexs2 4.386Mi ± 0% 4.412Mi ± 0% +0.59% (n=1)
Cespare_xxhash 3.800Mi ± 0% 3.826Mi ± 0% +0.67% (n=1)
K8s_cache 15.89Mi ± 0% 15.92Mi ± 0% +0.17% (n=1)
Bloom_bloom 4.797Mi ± 0% 4.822Mi ± 0% +0.52% (n=1)
Dustin_broadcast 3.910Mi ± 0% 3.936Mi ± 0% +0.65% (n=1)
Shopify_sarama 12.20Mi ± 0% 12.22Mi ± 0% +0.21% (n=1)
Benhoyt_goawk_1_18 5.962Mi ± 0% 5.987Mi ± 0% +0.43% (n=1)
Cespare_mph 3.876Mi ± 0% 3.902Mi ± 0% +0.65% (n=1)
Ajstarks_deck_generate 3.949Mi ± 0% 3.975Mi ± 0% +0.65% (n=1)
Ethereum_core 15.04Mi ± 0% 15.06Mi ± 0% +0.17% (n=1)
Uber_tally 6.279Mi ± 0% 6.306Mi ± 0% +0.42% (n=1)
Wazero 7.999Mi ± 0% 8.025Mi ± 0% +0.32% (n=1)
Uber_zap 7.544Mi ± 0% 7.570Mi ± 0% +0.35% (n=1)
Ethereum_ethash 10.57Mi ± 0% 10.59Mi ± 0% +0.24% (n=1)
K8s_workqueue 9.146Mi ± 0% 9.173Mi ± 0% +0.29% (n=1)
Ethereum_ecies 4.873Mi ± 0% 4.898Mi ± 0% +0.51% (n=1)
Gonum_topo 4.372Mi ± 0% 4.398Mi ± 0% +0.58% (n=1)
Aws_restxml 12.78Mi ± 0% 12.81Mi ± 0% +0.20% (n=1)
Semver 4.395Mi ± 0% 4.421Mi ± 0% +0.58% (n=1)
Aws_jsonutil 7.806Mi ± 0% 7.833Mi ± 0% +0.33% (n=1)
Gonum_community 4.708Mi ± 0% 4.734Mi ± 0% +0.55% (n=1)
Gtank_blake2s 4.310Mi ± 0% 4.336Mi ± 0% +0.60% (n=1)
Aws_restjson 12.70Mi ± 0% 12.73Mi ± 0% +0.20% (n=1)
Dustin_humanize 4.408Mi ± 0% 4.433Mi ± 0% +0.58% (n=1)
Kanzi 4.392Mi ± 0% 4.417Mi ± 0% +0.58% (n=1)
Minio 106.6Mi ± 0% 106.6Mi ± 0% +0.02% (n=1)
Ethereum_bitutil 4.065Mi ± 0% 4.091Mi ± 0% +0.63% (n=1)
Bindata 11.37Mi ± 0% 11.39Mi ± 0% +0.22% (n=1)
Capnproto2 5.083Mi ± 0% 5.109Mi ± 0% +0.51% (n=1)
Gonum_lapack_native 6.497Mi ± 0% 6.522Mi ± 0% +0.40% (n=1)
Gonum_traverse 4.101Mi ± 0% 4.126Mi ± 0% +0.62% (n=1)
Ethereum_corevm 6.998Mi ± 0% 7.022Mi ± 0% +0.35% (n=1)
Aws_jsonrpc 12.40Mi ± 0% 12.42Mi ± 0% +0.21% (n=1)
Ericlagergren_decimal 4.412Mi ± 0% 4.438Mi ± 0% +0.58% (n=1)
Gonum_blas_native 5.322Mi ± 0% 5.347Mi ± 0% +0.48% (n=1)
Gonum_path 4.533Mi ± 0% 4.559Mi ± 0% +0.56% (n=1)
Gonum_mat 7.126Mi ± 0% 7.152Mi ± 0% +0.36% (n=1)
Toml 6.383Mi ± 0% 6.409Mi ± 0% +0.40% (n=1)
Commonmark_markdown 5.468Mi ± 0% 5.493Mi ± 0% +0.46% (n=1)
Hugo_hugolib 47.50Mi ± 0% 47.53Mi ± 0% +0.05% (n=1)
geomean 7.091Mi 7.121Mi +0.42%
│ baseline │ experiment │
│ text-bytes │ text-bytes vs base │
Ethereum_trie 2.511Mi ± 0% 2.518Mi ± 0% +0.28% (n=1)
Spexs2 1.423Mi ± 0% 1.430Mi ± 0% +0.50% (n=1)
Cespare_xxhash 1.173Mi ± 0% 1.180Mi ± 0% +0.60% (n=1)
K8s_cache 5.838Mi ± 0% 5.845Mi ± 0% +0.12% (n=1)
Bloom_bloom 1.580Mi ± 0% 1.587Mi ± 0% +0.45% (n=1)
Dustin_broadcast 1.235Mi ± 0% 1.242Mi ± 0% +0.57% (n=1)
Shopify_sarama 4.361Mi ± 0% 4.369Mi ± 0% +0.16% (n=1)
Benhoyt_goawk_1_18 2.022Mi ± 0% 2.029Mi ± 0% +0.35% (n=1)
Cespare_mph 1.224Mi ± 0% 1.231Mi ± 0% +0.58% (n=1)
Ajstarks_deck_generate 1.246Mi ± 0% 1.253Mi ± 0% +0.57% (n=1)
Ethereum_core 5.347Mi ± 0% 5.354Mi ± 0% +0.13% (n=1)
Uber_tally 1.978Mi ± 0% 1.985Mi ± 0% +0.36% (n=1)
Wazero 2.679Mi ± 0% 2.686Mi ± 0% +0.26% (n=1)
Uber_zap 2.484Mi ± 0% 2.491Mi ± 0% +0.28% (n=1)
Ethereum_ethash 3.601Mi ± 0% 3.608Mi ± 0% +0.20% (n=1)
K8s_workqueue 3.061Mi ± 0% 3.068Mi ± 0% +0.23% (n=1)
Ethereum_ecies 1.596Mi ± 0% 1.603Mi ± 0% +0.44% (n=1)
Gonum_topo 1.401Mi ± 0% 1.409Mi ± 0% +0.51% (n=1)
Aws_restxml 4.758Mi ± 0% 4.765Mi ± 0% +0.15% (n=1)
Semver 1.431Mi ± 0% 1.438Mi ± 0% +0.49% (n=1)
Aws_jsonutil 2.823Mi ± 0% 2.830Mi ± 0% +0.25% (n=1)
Gonum_community 1.563Mi ± 0% 1.570Mi ± 0% +0.45% (n=1)
Gtank_blake2s 1.402Mi ± 0% 1.409Mi ± 0% +0.51% (n=1)
Aws_restjson 4.719Mi ± 0% 4.726Mi ± 0% +0.15% (n=1)
Dustin_humanize 1.437Mi ± 0% 1.444Mi ± 0% +0.49% (n=1)
Kanzi 1.390Mi ± 0% 1.397Mi ± 0% +0.51% (n=1)
Minio 34.35Mi ± 0% 34.36Mi ± 0% +0.02% (n=1)
Ethereum_bitutil 1.297Mi ± 0% 1.304Mi ± 0% +0.55% (n=1)
Bindata 1.607Mi ± 0% 1.614Mi ± 0% +0.44% (n=1)
Capnproto2 1.691Mi ± 0% 1.698Mi ± 0% +0.42% (n=1)
Gonum_lapack_native 2.433Mi ± 0% 2.440Mi ± 0% +0.29% (n=1)
Gonum_traverse 1.287Mi ± 0% 1.294Mi ± 0% +0.55% (n=1)
Ethereum_corevm 2.340Mi ± 0% 2.347Mi ± 0% +0.30% (n=1)
Aws_jsonrpc 4.576Mi ± 0% 4.583Mi ± 0% +0.15% (n=1)
Ericlagergren_decimal 1.412Mi ± 0% 1.419Mi ± 0% +0.50% (n=1)
Gonum_blas_native 1.943Mi ± 0% 1.950Mi ± 0% +0.36% (n=1)
Gonum_path 1.465Mi ± 0% 1.472Mi ± 0% +0.48% (n=1)
Gonum_mat 2.750Mi ± 0% 2.757Mi ± 0% +0.26% (n=1)
Toml 2.124Mi ± 0% 2.131Mi ± 0% +0.33% (n=1)
Commonmark_markdown 1.757Mi ± 0% 1.764Mi ± 0% +0.40% (n=1)
Hugo_hugolib 20.34Mi ± 0% 20.35Mi ± 0% +0.03% (n=1)
geomean 2.345Mi 2.354Mi +0.36%
│ baseline │ experiment │
│ data-bytes │ data-bytes vs base │
Ethereum_trie 1.190Mi ± 0% 1.193Mi ± 0% +0.23% (n=1)
Spexs2 703.4Ki ± 0% 706.3Ki ± 0% +0.41% (n=1)
Cespare_xxhash 641.2Ki ± 0% 644.1Ki ± 0% +0.45% (n=1)
K8s_cache 2.548Mi ± 0% 2.551Mi ± 0% +0.11% (n=1)
Bloom_bloom 766.4Ki ± 0% 769.3Ki ± 0% +0.38% (n=1)
Dustin_broadcast 648.1Ki ± 0% 651.0Ki ± 0% +0.44% (n=1)
Shopify_sarama 1.994Mi ± 0% 1.996Mi ± 0% +0.14% (n=1)
Benhoyt_goawk_1_18 1.000Mi ± 0% 1.003Mi ± 0% +0.28% (n=1)
Cespare_mph 641.6Ki ± 0% 644.5Ki ± 0% +0.45% (n=1)
Ajstarks_deck_generate 667.6Ki ± 0% 670.5Ki ± 0% +0.44% (n=1)
Ethereum_core 2.701Mi ± 0% 2.704Mi ± 0% +0.10% (n=1)
Uber_tally 1.173Mi ± 0% 1.176Mi ± 0% +0.24% (n=1)
Wazero 1.281Mi ± 0% 1.284Mi ± 0% +0.22% (n=1)
Uber_zap 1.353Mi ± 0% 1.356Mi ± 0% +0.21% (n=1)
Ethereum_ethash 1.884Mi ± 0% 1.887Mi ± 0% +0.15% (n=1)
K8s_workqueue 1.495Mi ± 0% 1.498Mi ± 0% +0.19% (n=1)
Ethereum_ecies 834.5Ki ± 0% 837.4Ki ± 0% +0.34% (n=1)
Gonum_topo 734.9Ki ± 0% 737.8Ki ± 0% +0.39% (n=1)
Aws_restxml 2.557Mi ± 0% 2.560Mi ± 0% +0.11% (n=1)
Semver 714.0Ki ± 0% 716.8Ki ± 0% +0.40% (n=1)
Aws_jsonutil 1.778Mi ± 0% 1.781Mi ± 0% +0.16% (n=1)
Gonum_community 776.8Ki ± 0% 779.7Ki ± 0% +0.37% (n=1)
Gtank_blake2s 686.7Ki ± 0% 689.6Ki ± 0% +0.41% (n=1)
Aws_restjson 2.554Mi ± 0% 2.557Mi ± 0% +0.11% (n=1)
Dustin_humanize 720.7Ki ± 0% 723.6Ki ± 0% +0.39% (n=1)
Kanzi 696.8Ki ± 0% 699.7Ki ± 0% +0.41% (n=1)
Minio 30.57Mi ± 0% 30.57Mi ± 0% +0.01% (n=1)
Ethereum_bitutil 661.2Ki ± 0% 664.1Ki ± 0% +0.43% (n=1)
Bindata 7.304Mi ± 0% 7.307Mi ± 0% +0.04% (n=1)
Capnproto2 847.6Ki ± 0% 850.5Ki ± 0% +0.34% (n=1)
Gonum_lapack_native 1.107Mi ± 0% 1.110Mi ± 0% +0.25% (n=1)
Gonum_traverse 689.2Ki ± 0% 692.1Ki ± 0% +0.41% (n=1)
Ethereum_corevm 1.173Mi ± 0% 1.176Mi ± 0% +0.24% (n=1)
Aws_jsonrpc 2.487Mi ± 0% 2.489Mi ± 0% +0.11% (n=1)
Ericlagergren_decimal 707.4Ki ± 0% 710.3Ki ± 0% +0.41% (n=1)
Gonum_blas_native 858.2Ki ± 0% 861.1Ki ± 0% +0.33% (n=1)
Gonum_path 769.1Ki ± 0% 771.9Ki ± 0% +0.37% (n=1)
Gonum_mat 1.005Mi ± 0% 1.008Mi ± 0% +0.28% (n=1)
Toml 1.161Mi ± 0% 1.164Mi ± 0% +0.24% (n=1)
Commonmark_markdown 1017.1Ki ± 0% 1019.9Ki ± 0% +0.28% (n=1)
Hugo_hugolib 9.172Mi ± 0% 9.175Mi ± 0% +0.03% (n=1)
geomean 1.254Mi 1.258Mi +0.28%
│ baseline │ experiment │
│ rodata-bytes │ rodata-bytes vs base │
Ethereum_trie 991.9Ki ± 0% 994.7Ki ± 0% +0.29% (n=1)
Spexs2 577.3Ki ± 0% 580.2Ki ± 0% +0.50% (n=1)
Cespare_xxhash 517.0Ki ± 0% 519.9Ki ± 0% +0.56% (n=1)
K8s_cache 2.147Mi ± 0% 2.150Mi ± 0% +0.13% (n=1)
Bloom_bloom 638.8Ki ± 0% 641.7Ki ± 0% +0.45% (n=1)
Dustin_broadcast 524.2Ki ± 0% 527.0Ki ± 0% +0.54% (n=1)
Shopify_sarama 1.719Mi ± 0% 1.722Mi ± 0% +0.16% (n=1)
Benhoyt_goawk_1_18 843.4Ki ± 0% 846.3Ki ± 0% +0.34% (n=1)
Cespare_mph 517.3Ki ± 0% 520.2Ki ± 0% +0.56% (n=1)
Ajstarks_deck_generate 543.1Ki ± 0% 546.0Ki ± 0% +0.54% (n=1)
Ethereum_core 2.286Mi ± 0% 2.289Mi ± 0% +0.12% (n=1)
Uber_tally 868.6Ki ± 0% 871.5Ki ± 0% +0.33% (n=1)
Wazero 1.087Mi ± 0% 1.090Mi ± 0% +0.26% (n=1)
Uber_zap 1.020Mi ± 0% 1.023Mi ± 0% +0.28% (n=1)
Ethereum_ethash 1.500Mi ± 0% 1.503Mi ± 0% +0.18% (n=1)
K8s_workqueue 1.166Mi ± 0% 1.168Mi ± 0% +0.24% (n=1)
Ethereum_ecies 622.7Ki ± 0% 625.5Ki ± 0% +0.46% (n=1)
Gonum_topo 598.2Ki ± 0% 601.0Ki ± 0% +0.48% (n=1)
Aws_restxml 2.199Mi ± 0% 2.202Mi ± 0% +0.13% (n=1)
Semver 587.1Ki ± 0% 590.0Ki ± 0% +0.49% (n=1)
Aws_jsonutil 1.454Mi ± 0% 1.457Mi ± 0% +0.20% (n=1)
Gonum_community 621.0Ki ± 0% 623.8Ki ± 0% +0.46% (n=1)
Gtank_blake2s 560.5Ki ± 0% 563.3Ki ± 0% +0.51% (n=1)
Aws_restjson 2.197Mi ± 0% 2.200Mi ± 0% +0.13% (n=1)
Dustin_humanize 593.9Ki ± 0% 596.7Ki ± 0% +0.48% (n=1)
Kanzi 557.5Ki ± 0% 560.3Ki ± 0% +0.51% (n=1)
Minio 29.51Mi ± 0% 29.52Mi ± 0% +0.01% (n=1)
Ethereum_bitutil 536.0Ki ± 0% 538.8Ki ± 0% +0.53% (n=1)
Bindata 643.6Ki ± 0% 646.5Ki ± 0% +0.45% (n=1)
Capnproto2 716.7Ki ± 0% 719.5Ki ± 0% +0.40% (n=1)
Gonum_lapack_native 821.5Ki ± 0% 824.3Ki ± 0% +0.34% (n=1)
Gonum_traverse 560.5Ki ± 0% 563.3Ki ± 0% +0.51% (n=1)
Ethereum_corevm 961.8Ki ± 0% 964.7Ki ± 0% +0.30% (n=1)
Aws_jsonrpc 2.131Mi ± 0% 2.134Mi ± 0% +0.13% (n=1)
Ericlagergren_decimal 579.8Ki ± 0% 582.6Ki ± 0% +0.50% (n=1)
Gonum_blas_native 653.8Ki ± 0% 656.7Ki ± 0% +0.43% (n=1)
Gonum_path 615.7Ki ± 0% 618.6Ki ± 0% +0.47% (n=1)
Gonum_mat 860.7Ki ± 0% 863.6Ki ± 0% +0.33% (n=1)
Toml 1.032Mi ± 0% 1.035Mi ± 0% +0.27% (n=1)
Commonmark_markdown 871.0Ki ± 0% 873.9Ki ± 0% +0.33% (n=1)
Hugo_hugolib 8.420Mi ± 0% 8.423Mi ± 0% +0.03% (n=1)
geomean 996.4Ki 999.9Ki +0.35%
│ baseline │ experiment │
│ pclntab-bytes │ pclntab-bytes vs base │
Ethereum_trie 1.613Mi ± 0% 1.620Mi ± 0% +0.43% (n=1)
Spexs2 997.2Ki ± 0% 1004.1Ki ± 0% +0.69% (n=1)
Cespare_xxhash 848.4Ki ± 0% 855.3Ki ± 0% +0.81% (n=1)
K8s_cache 3.518Mi ± 0% 3.525Mi ± 0% +0.21% (n=1)
Bloom_bloom 1.061Mi ± 0% 1.068Mi ± 0% +0.63% (n=1)
Dustin_broadcast 889.4Ki ± 0% 896.3Ki ± 0% +0.78% (n=1)
Shopify_sarama 2.631Mi ± 0% 2.638Mi ± 0% +0.28% (n=1)
Benhoyt_goawk_1_18 1.279Mi ± 0% 1.286Mi ± 0% +0.54% (n=1)
Cespare_mph 878.8Ki ± 0% 885.7Ki ± 0% +0.78% (n=1)
Ajstarks_deck_generate 894.0Ki ± 0% 900.9Ki ± 0% +0.77% (n=1)
Ethereum_core 3.254Mi ± 0% 3.262Mi ± 0% +0.23% (n=1)
Uber_tally 1.356Mi ± 0% 1.364Mi ± 0% +0.53% (n=1)
Wazero 1.806Mi ± 0% 1.813Mi ± 0% +0.38% (n=1)
Uber_zap 1.639Mi ± 0% 1.647Mi ± 0% +0.44% (n=1)
Ethereum_ethash 2.282Mi ± 0% 2.290Mi ± 0% +0.32% (n=1)
K8s_workqueue 2.088Mi ± 0% 2.096Mi ± 0% +0.35% (n=1)
Ethereum_ecies 1.033Mi ± 0% 1.040Mi ± 0% +0.66% (n=1)
Gonum_topo 978.1Ki ± 0% 985.1Ki ± 0% +0.71% (n=1)
Aws_restxml 2.463Mi ± 0% 2.470Mi ± 0% +0.30% (n=1)
Semver 992.0Ki ± 0% 998.9Ki ± 0% +0.70% (n=1)
Aws_jsonutil 1.401Mi ± 0% 1.408Mi ± 0% +0.51% (n=1)
Gonum_community 1.014Mi ± 0% 1.020Mi ± 0% +0.66% (n=1)
Gtank_blake2s 972.7Ki ± 0% 979.6Ki ± 0% +0.71% (n=1)
Aws_restjson 2.453Mi ± 0% 2.460Mi ± 0% +0.30% (n=1)
Dustin_humanize 985.9Ki ± 0% 992.9Ki ± 0% +0.70% (n=1)
Kanzi 960.4Ki ± 0% 967.2Ki ± 0% +0.72% (n=1)
Minio 22.54Mi ± 0% 22.55Mi ± 0% +0.03% (n=1)
Ethereum_bitutil 921.3Ki ± 0% 928.2Ki ± 0% +0.75% (n=1)
Bindata 1.058Mi ± 0% 1.065Mi ± 0% +0.65% (n=1)
Capnproto2 1.105Mi ± 0% 1.111Mi ± 0% +0.62% (n=1)
Gonum_lapack_native 1.207Mi ± 0% 1.214Mi ± 0% +0.56% (n=1)
Gonum_traverse 927.5Ki ± 0% 934.4Ki ± 0% +0.74% (n=1)
Ethereum_corevm 1.554Mi ± 0% 1.561Mi ± 0% +0.44% (n=1)
Aws_jsonrpc 2.396Mi ± 0% 2.403Mi ± 0% +0.31% (n=1)
Ericlagergren_decimal 1000.8Ki ± 0% 1007.8Ki ± 0% +0.70% (n=1)
Gonum_blas_native 1.062Mi ± 0% 1.069Mi ± 0% +0.63% (n=1)
Gonum_path 1017.2Ki ± 0% 1024.2Ki ± 0% +0.68% (n=1)
Gonum_mat 1.412Mi ± 0% 1.419Mi ± 0% +0.48% (n=1)
Toml 1.361Mi ± 0% 1.368Mi ± 0% +0.51% (n=1)
Commonmark_markdown 1.179Mi ± 0% 1.185Mi ± 0% +0.58% (n=1)
Hugo_hugolib 9.049Mi ± 0% 9.056Mi ± 0% +0.08% (n=1)
geomean 1.480Mi 1.488Mi +0.53%
│ baseline │ experiment │
│ debug-bytes │ debug-bytes vs base │
Ethereum_trie 1.651Mi ± 0% 1.659Mi ± 0% +0.46% (n=1)
Spexs2 1.028Mi ± 0% 1.036Mi ± 0% +0.79% (n=1)
Cespare_xxhash 934.1Ki ± 0% 941.8Ki ± 0% +0.83% (n=1)
K8s_cache 3.359Mi ± 0% 3.367Mi ± 0% +0.24% (n=1)
Bloom_bloom 1.119Mi ± 0% 1.127Mi ± 0% +0.65% (n=1)
Dustin_broadcast 935.8Ki ± 0% 943.6Ki ± 0% +0.83% (n=1)
Shopify_sarama 2.681Mi ± 0% 2.689Mi ± 0% +0.29% (n=1)
Benhoyt_goawk_1_18 1.338Mi ± 0% 1.345Mi ± 0% +0.55% (n=1)
Cespare_mph 929.7Ki ± 0% 937.4Ki ± 0% +0.82% (n=1)
Ajstarks_deck_generate 939.9Ki ± 0% 947.9Ki ± 0% +0.85% (n=1)
Ethereum_core 3.121Mi ± 0% 3.128Mi ± 0% +0.23% (n=1)
Uber_tally 1.411Mi ± 0% 1.420Mi ± 0% +0.59% (n=1)
Wazero 1.806Mi ± 0% 1.814Mi ± 0% +0.42% (n=1)
Uber_zap 1.673Mi ± 0% 1.681Mi ± 0% +0.48% (n=1)
Ethereum_ethash 2.312Mi ± 0% 2.319Mi ± 0% +0.29% (n=1)
K8s_workqueue 2.064Mi ± 0% 2.072Mi ± 0% +0.38% (n=1)
Ethereum_ecies 1.129Mi ± 0% 1.136Mi ± 0% +0.61% (n=1)
Gonum_topo 1.008Mi ± 0% 1.015Mi ± 0% +0.74% (n=1)
Aws_restxml 2.512Mi ± 0% 2.520Mi ± 0% +0.30% (n=1)
Semver 1.023Mi ± 0% 1.031Mi ± 0% +0.75% (n=1)
Aws_jsonutil 1.439Mi ± 0% 1.447Mi ± 0% +0.54% (n=1)
Gonum_community 1.070Mi ± 0% 1.078Mi ± 0% +0.76% (n=1)
Gtank_blake2s 1.015Mi ± 0% 1.022Mi ± 0% +0.77% (n=1)
Aws_restjson 2.490Mi ± 0% 2.497Mi ± 0% +0.29% (n=1)
Dustin_humanize 1.027Mi ± 0% 1.035Mi ± 0% +0.76% (n=1)
Kanzi 1.016Mi ± 0% 1.023Mi ± 0% +0.75% (n=1)
Minio 16.92Mi ± 0% 16.93Mi ± 0% +0.02% (n=1)
Ethereum_bitutil 978.5Ki ± 0% 986.6Ki ± 0% +0.83% (n=1)
Bindata 1.114Mi ± 0% 1.121Mi ± 0% +0.67% (n=1)
Capnproto2 1.161Mi ± 0% 1.169Mi ± 0% +0.68% (n=1)
Gonum_lapack_native 1.403Mi ± 0% 1.411Mi ± 0% +0.57% (n=1)
Gonum_traverse 975.3Ki ± 0% 983.0Ki ± 0% +0.79% (n=1)
Ethereum_corevm 1.555Mi ± 0% 1.562Mi ± 0% +0.44% (n=1)
Aws_jsonrpc 2.456Mi ± 0% 2.463Mi ± 0% +0.29% (n=1)
Ericlagergren_decimal 1.039Mi ± 0% 1.046Mi ± 0% +0.73% (n=1)
Gonum_blas_native 1.176Mi ± 0% 1.184Mi ± 0% +0.67% (n=1)
Gonum_path 1.031Mi ± 0% 1.038Mi ± 0% +0.74% (n=1)
Gonum_mat 1.571Mi ± 0% 1.579Mi ± 0% +0.49% (n=1)
Toml 1.414Mi ± 0% 1.422Mi ± 0% +0.54% (n=1)
Commonmark_markdown 1.211Mi ± 0% 1.218Mi ± 0% +0.62% (n=1)
Hugo_hugolib 7.768Mi ± 0% 7.774Mi ± 0% +0.08% (n=1)
geomean 1.526Mi 1.535Mi +0.56%
│ baseline │ experiment │
│ sec/op │ sec/op vs base │
Invocation/interpreter/fib_for_20-88 2.106m ± 0% 2.111m ± 0% +0.23% (p=0.003 n=10)
Invocation/interpreter/string_manipulation_size_50-88 813.7µ ± 0% 820.0µ ± 0% +0.78% (p=0.000 n=10)
Invocation/interpreter/random_mat_mul_size_20-88 5.305m ± 0% 5.330m ± 0% +0.47% (p=0.043 n=10)
Compilation/with_extern_cache-88 340.6µ ± 0% 341.0µ ± 0% ~ (p=0.089 n=10)
Compilation/without_extern_cache-88 16.90m ± 1% 16.85m ± 0% ~ (p=0.353 n=10)
Listener-88 1.087µ ± 1% 1.094µ ± 2% ~ (p=0.783 n=10)
ReflectorResyncChanMany-88 471.0n ± 2% 468.9n ± 2% ~ (p=0.579 n=10)
Decode/large-doc-88 1.810m ± 0% 1.812m ± 1% ~ (p=0.912 n=10)
Dgeev/Circulant10-88 26.76µ ± 0% 26.85µ ± 0% +0.33% (p=0.000 n=10)
Dgeev/Circulant100-88 9.410m ± 1% 9.397m ± 0% ~ (p=0.280 n=10)
GenerateKeyP256-88 15.89µ ± 0% 15.87µ ± 0% -0.08% (p=0.045 n=10)
GenSharedKeyP256-88 59.87µ ± 0% 59.96µ ± 0% +0.15% (p=0.000 n=10)
GenSharedKeyS256-88 52.53µ ± 0% 52.53µ ± 0% ~ (p=0.983 n=10)
DecodehealingTracker-88 662.4n ± 1% 665.9n ± 0% +0.51% (p=0.009 n=10)
AppendMsgResyncTargetsInfo-88 5.252n ± 0% 5.067n ± 2% -3.52% (p=0.000 n=10)
DataUpdateTracker-88 1.572µ ± 1% 1.581µ ± 2% +0.57% (p=0.037 n=10)
MarshalMsgdataUsageCacheInfo-88 46.77n ± 1% 44.56n ± 0% -4.70% (p=0.000 n=10)
Arc-88 2.780µ ± 0% 2.792µ ± 0% +0.43% (p=0.000 n=10)
Polygon-88 5.005µ ± 0% 4.993µ ± 0% -0.25% (p=0.001 n=10)
FPAQ-88 17.46m ± 0% 17.51m ± 0% +0.29% (p=0.009 n=10)
LZ-88 1006.3µ ± 3% 992.4µ ± 3% ~ (p=0.123 n=10)
MTFT-88 710.5µ ± 3% 717.1µ ± 1% ~ (p=0.739 n=10)
RecursiveFunc-88 8.322µ ± 0% 8.444µ ± 0% +1.47% (p=0.000 n=10)
RegexMatch-88 771.3n ± 1% 766.4n ± 1% -0.64% (p=0.000 n=10)
RepeatExecProgram-88 13.87µ ± 0% 13.96µ ± 0% +0.70% (p=0.004 n=10)
RepeatNew-88 97.68n ± 1% 96.59n ± 2% ~ (p=0.052 n=10)
RepeatIOExecProgram-88 29.01µ ± 3% 29.62µ ± 1% +2.10% (p=0.000 n=10)
RepeatIONew-88 721.3n ± 0% 722.4n ± 0% ~ (p=0.123 n=10)
ParseBigBytes-88 1.253µ ± 0% 1.250µ ± 0% -0.28% (p=0.015 n=10)
BuildJSON-88 3.019µ ± 0% 2.981µ ± 0% -1.28% (p=0.000 n=10)
StdlibJSON-88 2.068µ ± 0% 2.043µ ± 1% -1.21% (p=0.000 n=10)
ValidateVersionTildeFail-88 477.2n ± 0% 476.2n ± 0% ~ (p=0.224 n=10)
Run/10k/1-88 16.64 ± 0% 16.67 ± 1% ~ (p=0.353 n=10)
Run/10k/16-88 4.507 ± 4% 4.000 ± 9% -11.26% (p=0.000 n=10)
OpDiv128-88 60.87n ± 0% 61.13n ± 0% +0.42% (p=0.003 n=10)
Pi/foo=ericlagergren_(Go)/prec=100-88 98.09µ ± 0% 99.30µ ± 0% +1.23% (p=0.000 n=10)
Pi/foo=ericlagergren_(GDA)/prec=100-88 205.0µ ± 0% 204.3µ ± 0% -0.31% (p=0.001 n=10)
Pi/foo=shopspring/prec=100-88 294.9µ ± 0% 300.6µ ± 0% +1.96% (p=0.000 n=10)
Pi/foo=apmckinlay/prec=100-88 1.571µ ± 0% 1.569µ ± 0% ~ (p=0.443 n=10)
Pi/foo=go-inf/prec=100-88 81.03µ ± 0% 82.26µ ± 1% +1.52% (p=0.000 n=10)
Pi/foo=float64/prec=100-88 5.861µ ± 0% 5.858µ ± 0% -0.06% (p=0.039 n=10)
DirectSend-88 380.9n ± 4% 383.2n ± 2% ~ (p=0.342 n=10)
ParallelDirectSend-88 397.6n ± 2% 403.7n ± 0% +1.53% (p=0.003 n=10)
ParallelBrodcast-88 574.1n ± 2% 568.5n ± 9% ~ (p=0.060 n=10)
MuxBrodcast-88 546.1n ± 2% 541.8n ± 1% ~ (p=0.159 n=10)
SeparateTestAndAdd-88 263.7n ± 2% 265.2n ± 3% ~ (p=0.617 n=10)
CombinedTestAndAdd-88 296.4n ± 2% 293.7n ± 2% ~ (p=0.956 n=10)
LouvainDirectedMultiplex-88 14.49m ± 0% 14.13m ± 0% -2.47% (p=0.000 n=10)
FastTest2KB-88 144.2n ± 0% 143.2n ± 0% -0.69% (p=0.000 n=10)
BaseTest2KB-88 706.9n ± 0% 706.6n ± 0% ~ (p=0.446 n=10)
Encoding4KBVerySparse-88 12.54µ ± 0% 12.65µ ± 0% +0.91% (p=0.000 n=10)
HashimotoLight-88 1.988m ± 12% 1.813m ± 21% ~ (p=0.853 n=10)
Dnrm2MediumPosInc-88 1.887µ ± 0% 1.894µ ± 0% +0.37% (p=0.000 n=10)
DasumMediumUnitaryInc-88 649.2n ± 0% 650.3n ± 0% +0.17% (p=0.010 n=10)
ScopeTaggedNoCachedSubscopes-88 2.863µ ± 1% 2.734µ ± 1% -4.52% (p=0.000 n=10)
HistogramAllocation-88 1.268µ ± 4% 1.326µ ± 1% +4.53% (p=0.003 n=10)
TextMovementBetweenSegments-88 328.6µ ± 3% 333.1µ ± 4% ~ (p=0.353 n=10)
Growth_MultiSegment-88 10.59m ± 0% 10.41m ± 0% -1.65% (p=0.000 n=10)
TarjanSCCGnp_10_tenth-88 5.151µ ± 1% 4.927µ ± 0% -4.35% (p=0.000 n=10)
TarjanSCCGnp_1000_half-88 39.14m ± 0% 38.22m ± 1% -2.35% (p=0.000 n=10)
MulWorkspaceDense1000Hundredth-88 23.06m ± 0% 23.07m ± 0% ~ (p=0.912 n=10)
ScaleVec10000Inc20-88 6.888µ ± 0% 6.889µ ± 0% ~ (p=0.381 n=10)
MergeByLanguage-88 372.4n ± 0% 372.4n ± 0% ~ (p=0.754 n=10)
ResourceChainPostProcess-88 41.85m ± 1% 41.26m ± 2% ~ (p=0.105 n=10)
ReplaceShortcodeTokens-88 2.505µ ± 3% 2.569µ ± 1% +2.55% (p=0.008 n=10)
PendingDemotion10000-88 104.0n ± 0% 103.0n ± 0% -0.96% (p=0.000 n=10)
PoolBatchInsert10000-88 687.0m ± 0% 685.6m ± 0% ~ (p=0.075 n=10)
PoolBatchLocalInsert10000-88 762.5m ± 0% 755.7m ± 0% -0.89% (p=0.000 n=10)
Bindata-88 195.4m ± 1% 196.0m ± 1% ~ (p=0.684 n=10)
Broker_Open-88 105.75µ ± 5% 92.33µ ± 5% -12.70% (p=0.000 n=10)
Broker_No_Metrics_Open-88 51.63µ ± 19% 57.86µ ± 17% ~ (p=0.684 n=10)
HashFixedSize/10K-88 3.956m ± 3% 3.639m ± 2% -8.01% (p=0.000 n=10)
CommitAfterHashFixedSize/10K-88 10.369m ± 1% 9.104m ± 0% -12.20% (p=0.000 n=10)
ParallelizeUntil/pieces:1000,workers:10,chunkSize:1-88 161.0µ ± 2% 161.4µ ± 1% ~ (p=0.353 n=10)
ParallelizeUntil/pieces:1000,workers:10,chunkSize:10-88 37.18µ ± 2% 36.99µ ± 1% ~ (p=0.529 n=10)
ParallelizeUntil/pieces:1000,workers:10,chunkSize:100-88 15.67µ ± 1% 15.39µ ± 2% -1.76% (p=0.037 n=10)
ParallelizeUntil/pieces:999,workers:10,chunkSize:13-88 31.01µ ± 2% 31.04µ ± 1% ~ (p=0.971 n=10)
RenderSpecNoHTML-88 5.079m ± 0% 4.906m ± 0% -3.41% (p=0.000 n=10)
RenderSpec-88 5.096m ± 0% 4.926m ± 1% -3.34% (p=0.000 n=10)
RenderSpecBlackFriday2-88 3.399m ± 1% 3.232m ± 1% -4.90% (p=0.000 n=10)
WalkAllBreadthFirstGnp_10_tenth-88 2.638µ ± 1% 2.565µ ± 1% -2.79% (p=0.000 n=10)
WalkAllBreadthFirstGnp_1000_tenth-88 6.007m ± 0% 5.933m ± 0% -1.23% (p=0.000 n=10)
Hash8K-88 21.27µ ± 0% 21.28µ ± 0% ~ (p=0.108 n=10)
BufferedWriteSyncer/write_file_with_buffer-88 226.1n ± 2% 224.7n ± 2% ~ (p=0.315 n=10)
MultiWriteSyncer/2_discarder-88 7.172n ± 8% 8.002n ± 1% +11.57% (p=0.000 n=10)
MultiWriteSyncer/4_discarder-88 7.569n ± 2% 8.782n ± 1% +16.02% (p=0.000 n=10)
MultiWriteSyncer/4_discarder_with_buffer-88 177.4n ± 2% 172.5n ± 4% -2.76% (p=0.012 n=10)
WriteSyncer/write_file_with_no_buffer-88 1.672µ ± 2% 1.682µ ± 2% ~ (p=0.424 n=10)
ZapConsole-88 719.5n ± 3% 763.6n ± 2% +6.12% (p=0.000 n=10)
JSONLogMarshalerFunc-88 896.9n ± 1% 816.0n ± 1% -9.01% (p=0.000 n=10)
ZapJSON-88 477.4n ± 2% 523.4n ± 1% +9.64% (p=0.000 n=10)
StandardJSON-88 643.2n ± 2% 668.0n ± 3% +3.84% (p=0.001 n=10)
Sampler_Check/7_keys-88 10.10n ± 1% 10.09n ± 1% ~ (p=0.955 n=10)
Sampler_Check/50_keys-88 2.498n ± 1% 2.431n ± 2% -2.66% (p=0.001 n=10)
Sampler_Check/100_keys-88 2.031n ± 2% 1.982n ± 2% -2.39% (p=0.005 n=10)
Sampler_CheckWithHook/7_keys-88 43.25n ± 1% 42.52n ± 3% ~ (p=0.149 n=10)
Sampler_CheckWithHook/50_keys-88 42.66n ± 1% 42.34n ± 3% ~ (p=0.280 n=10)
Sampler_CheckWithHook/100_keys-88 42.73n ± 1% 42.30n ± 3% ~ (p=0.197 n=10)
TeeCheck-88 77.07n ± 3% 76.11n ± 6% ~ (p=0.529 n=10)
BleveIndexBatch100-88 3.411 ± 1% 3.185 ± 2% -6.61% (p=0.000 n=10)
CockroachDBkv0/nodes=1-44 38.52µ ± 8% 38.51µ ± 7% ~ (p=0.912 n=10)
CockroachDBkv50/nodes=1-44 40.88µ ± 27% 40.87µ ± 1% ~ (p=0.796 n=10)
CockroachDBkv95/nodes=1-44 35.68µ ± 2% 35.64µ ± 3% ~ (p=0.796 n=10)
CockroachDBkv0/nodes=3-44 38.95µ ± 6% 38.38µ ± 11% ~ (p=0.796 n=10)
CockroachDBkv50/nodes=3-44 40.29µ ± 5% 40.90µ ± 3% ~ (p=0.190 n=10)
CockroachDBkv95/nodes=3-44 36.56µ ± 4% 37.01µ ± 6% ~ (p=0.436 n=10)
ESBuildThreeJS-88 315.5m ± 1% 315.3m ± 1% ~ (p=0.796 n=10)
ESBuildRomeTS-88 94.47m ± 2% 94.89m ± 2% ~ (p=0.315 n=10)
EtcdPut-88 10.19m ± 1% 10.20m ± 1% ~ (p=1.000 n=10)
EtcdSTM-88 90.33m ± 1% 86.96m ± 0% -3.72% (p=0.000 n=10)
GoBuildKubelet-88 24.37 ± 0% 24.34 ± 6% ~ (p=0.436 n=10)
GoBuildKubeletLink-88 6.377 ± 0% 6.358 ± 1% ~ (p=0.218 n=10)
GoBuildIstioctl-88 25.69 ± 1% 25.83 ± 1% +0.54% (p=0.035 n=10)
GoBuildIstioctlLink-88 6.726 ± 0% 6.710 ± 0% ~ (p=0.280 n=10)
GoBuildFrontend-88 9.652 ± 0% 9.696 ± 0% +0.46% (p=0.009 n=10)
GoBuildFrontendLink-88 1.062 ± 1% 1.056 ± 1% ~ (p=0.105 n=10)
GopherLuaKNucleotide-88 15.68 ± 0% 15.72 ± 0% +0.23% (p=0.004 n=10)
MarkdownRenderXHTML-88 170.6m ± 0% 170.5m ± 0% ~ (p=0.796 n=10)
Tile38QueryLoad-88 779.1µ ± 1% 767.5µ ± 1% -1.49% (p=0.007 n=10)
geomean 62.72µ 62.40µ -0.52%
│ baseline │ experiment │
│ B/op │ B/op vs base │
Listener-88 16.00 ± 0% 16.00 ± 0% ~ (p=1.000 n=10) ¹
DecodehealingTracker-88 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹
AppendMsgResyncTargetsInfo-88 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹
DataUpdateTracker-88 276.0 ± 0% 275.0 ± 0% -0.36% (p=0.001 n=10)
MarshalMsgdataUsageCacheInfo-88 96.00 ± 0% 96.00 ± 0% ~ (p=1.000 n=10) ¹
Encoding4KBVerySparse-88 9.750Ki ± 0% 9.750Ki ± 0% ~ (p=1.000 n=10) ¹
HistogramAllocation-88 1.152Ki ± 0% 1.152Ki ± 0% ~ (p=1.000 n=10) ¹
Growth_MultiSegment-88 1.572Mi ± 0% 1.572Mi ± 0% ~ (p=0.100 n=10)
Bindata-88 183.1Mi ± 0% 183.1Mi ± 0% -0.00% (p=0.000 n=10)
HashFixedSize/10K-88 6.101Mi ± 0% 6.095Mi ± 0% -0.10% (p=0.000 n=10)
CommitAfterHashFixedSize/10K-88 7.375Mi ± 0% 7.370Mi ± 0% ~ (p=0.123 n=10)
geomean ² -0.05% ²
¹ all samples are equal
² summaries must be >0 to compute geomean
│ baseline │ experiment │
│ allocs/op │ allocs/op vs base │
Listener-88 1.000 ± 0% 1.000 ± 0% ~ (p=1.000 n=10) ¹
DecodehealingTracker-88 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹
AppendMsgResyncTargetsInfo-88 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹
DataUpdateTracker-88 8.000 ± 0% 8.000 ± 0% ~ (p=1.000 n=10) ¹
MarshalMsgdataUsageCacheInfo-88 1.000 ± 0% 1.000 ± 0% ~ (p=1.000 n=10) ¹
Encoding4KBVerySparse-88 15.00 ± 0% 15.00 ± 0% ~ (p=1.000 n=10) ¹
HistogramAllocation-88 20.00 ± 0% 20.00 ± 0% ~ (p=1.000 n=10) ¹
Growth_MultiSegment-88 22.00 ± 0% 22.00 ± 0% ~ (p=1.000 n=10) ¹
Bindata-88 5.798k ± 0% 5.792k ± 0% -0.11% (p=0.000 n=10)
HashFixedSize/10K-88 77.30k ± 0% 77.25k ± 0% -0.07% (p=0.000 n=10)
CommitAfterHashFixedSize/10K-88 79.55k ± 0% 79.55k ± 0% -0.00% (p=0.004 n=10)
geomean ² -0.02% ²
¹ all samples are equal
² summaries must be >0 to compute geomean
│ baseline │ experiment │
│ B/s │ B/s vs base │
DecodehealingTracker-88 447.7Mi ± 1% 445.4Mi ± 0% -0.51% (p=0.009 n=10)
AppendMsgResyncTargetsInfo-88 1.773Gi ± 0% 1.838Gi ± 2% +3.65% (p=0.000 n=10)
DataUpdateTracker-88 625.0Ki ± 2% 615.2Ki ± 2% ~ (p=0.072 n=10)
Growth_MultiSegment-88 94.46Mi ± 0% 96.04Mi ± 0% +1.68% (p=0.000 n=10)
Bindata-88 33.50Mi ± 1% 33.41Mi ± 1% ~ (p=0.700 n=10)
Hash8K-88 367.3Mi ± 0% 367.2Mi ± 0% ~ (p=0.091 n=10)
geomean 91.24Mi 91.67Mi +0.48%
│ baseline │ experiment │
│ average-RSS-bytes │ average-RSS-bytes vs base │
BleveIndexBatch100-88 171.7Mi ± 2% 177.5Mi ± 2% +3.41% (p=0.000 n=10)
CockroachDBkv0/nodes=1-44 7.126Gi ± 3% 7.189Gi ± 3% ~ (p=0.315 n=10)
CockroachDBkv50/nodes=1-44 6.500Gi ± 15% 6.540Gi ± 3% ~ (p=0.579 n=10)
CockroachDBkv95/nodes=1-44 5.103Gi ± 1% 5.198Gi ± 1% +1.85% (p=0.009 n=10)
CockroachDBkv0/nodes=3-44 7.172Gi ± 3% 7.108Gi ± 5% ~ (p=0.529 n=10)
CockroachDBkv50/nodes=3-44 6.488Gi ± 6% 6.566Gi ± 2% ~ (p=0.105 n=10)
CockroachDBkv95/nodes=3-44 5.072Gi ± 1% 5.200Gi ± 2% +2.52% (p=0.002 n=10)
EtcdPut-88 114.0Mi ± 2% 115.0Mi ± 2% ~ (p=0.404 n=10)
EtcdSTM-88 98.40Mi ± 1% 97.16Mi ± 1% -1.26% (p=0.003 n=10)
GopherLuaKNucleotide-88 35.19Mi ± 2% 35.62Mi ± 2% ~ (p=0.123 n=10)
MarkdownRenderXHTML-88 21.08Mi ± 2% 21.32Mi ± 2% ~ (p=0.218 n=10)
Tile38QueryLoad-88 5.317Gi ± 1% 5.332Gi ± 1% ~ (p=0.684 n=10)
geomean 943.9Mi 953.2Mi +0.98%
│ baseline │ experiment │
│ peak-RSS-bytes │ peak-RSS-bytes vs base │
BleveIndexBatch100-88 244.4Mi ± 4% 251.5Mi ± 4% +2.91% (p=0.005 n=10)
CockroachDBkv0/nodes=1-44 9.754Gi ± 3% 10.127Gi ± 5% ~ (p=0.052 n=10)
CockroachDBkv50/nodes=1-44 9.476Gi ± 10% 9.380Gi ± 5% ~ (p=0.393 n=10)
CockroachDBkv95/nodes=1-44 7.460Gi ± 2% 7.630Gi ± 6% ~ (p=0.165 n=10)
CockroachDBkv0/nodes=3-44 10.000Gi ± 10% 9.848Gi ± 7% ~ (p=0.853 n=10)
CockroachDBkv50/nodes=3-44 9.213Gi ± 4% 9.178Gi ± 5% ~ (p=0.684 n=10)
CockroachDBkv95/nodes=3-44 7.465Gi ± 2% 7.631Gi ± 3% ~ (p=0.123 n=10)
EtcdPut-88 152.0Mi ± 2% 152.5Mi ± 2% ~ (p=0.579 n=10)
EtcdSTM-88 127.5Mi ± 2% 125.3Mi ± 2% -1.68% (p=0.050 n=10)
GopherLuaKNucleotide-88 40.47Mi ± 9% 40.74Mi ± 1% ~ (p=0.247 n=10)
MarkdownRenderXHTML-88 21.96Mi ± 2% 22.22Mi ± 2% ~ (p=0.271 n=10)
Tile38QueryLoad-88 5.761Gi ± 3% 5.661Gi ± 1% ~ (p=0.165 n=10)
geomean 1.214Gi 1.221Gi +0.57%
│ baseline │ experiment │
│ peak-VM-bytes │ peak-VM-bytes vs base │
BleveIndexBatch100-88 7.791Gi ± 1% 7.719Gi ± 1% -0.93% (p=0.000 n=10)
CockroachDBkv0/nodes=1-44 13.55Gi ± 3% 13.80Gi ± 5% ~ (p=0.075 n=10)
CockroachDBkv50/nodes=1-44 12.27Gi ± 5% 12.12Gi ± 4% ~ (p=0.481 n=10)
CockroachDBkv95/nodes=1-44 9.786Gi ± 2% 9.924Gi ± 5% ~ (p=0.247 n=10)
CockroachDBkv0/nodes=3-44 13.74Gi ± 7% 13.88Gi ± 4% ~ (p=0.912 n=10)
CockroachDBkv50/nodes=3-44 12.05Gi ± 3% 12.06Gi ± 2% ~ (p=0.853 n=10)
CockroachDBkv95/nodes=3-44 9.812Gi ± 2% 9.967Gi ± 3% ~ (p=0.143 n=10)
EtcdPut-88 11.32Gi ± 0% 11.32Gi ± 0% ~ (p=0.380 n=10)
EtcdSTM-88 11.26Gi ± 0% 11.26Gi ± 0% ~ (p=0.153 n=10)
GopherLuaKNucleotide-88 1.177Gi ± 0% 1.176Gi ± 0% -0.06% (p=0.001 n=10)
MarkdownRenderXHTML-88 1.176Gi ± 0% 1.176Gi ± 0% ~ (p=0.209 n=10)
Tile38QueryLoad-88 6.907Gi ± 2% 6.813Gi ± 1% ~ (p=0.247 n=10)
geomean 7.356Gi 7.370Gi +0.20%
│ baseline │ experiment │
│ write-avg-latency-sec │ write-avg-latency-sec vs base │
CockroachDBkv0/nodes=1-44 142.0m ± 31% 111.0m ± 69% ~ (p=0.971 n=10)
CockroachDBkv50/nodes=1-44 280.9m ± 205% 272.4m ± 7% ~ (p=0.494 n=10)
CockroachDBkv95/nodes=1-44 500.9m ± 16% 494.8m ± 15% ~ (p=0.579 n=10)
CockroachDBkv0/nodes=3-44 143.8m ± 48% 106.3m ± 96% ~ (p=0.280 n=10)
CockroachDBkv50/nodes=3-44 260.1m ± 45% 280.2m ± 14% ~ (p=0.218 n=10)
CockroachDBkv95/nodes=3-44 534.9m ± 20% 626.7m ± 36% ~ (p=0.165 n=10)
geomean 271.4m 255.7m -5.80%
│ baseline │ experiment │
│ write-p100-latency-sec │ write-p100-latency-sec vs base │
CockroachDBkv0/nodes=1-44 10.74 ± 10% 10.74 ± 5% ~ (p=0.759 n=10)
CockroachDBkv50/nodes=1-44 11.81 ± 5% 11.81 ± 14% ~ (p=0.392 n=10)
CockroachDBkv95/nodes=1-44 9.664 ± 22% 9.664 ± 22% ~ (p=0.536 n=10)
CockroachDBkv0/nodes=3-44 10.74 ± 10% 10.74 ± 10% ~ (p=0.692 n=10)
CockroachDBkv50/nodes=3-44 11.27 ± 5% 11.27 ± 10% ~ (p=0.790 n=10)
CockroachDBkv95/nodes=3-44 11.81 ± 23% 11.27 ± 19% ~ (p=0.812 n=10)
geomean 10.98 10.90 -0.77%
│ baseline │ experiment │
│ write-p50-latency-sec │ write-p50-latency-sec vs base │
CockroachDBkv0/nodes=1-44 26.75m ± 10% 24.10m ± 22% ~ (p=0.204 n=10)
CockroachDBkv50/nodes=1-44 1.900m ± 44053% 1.900m ± 5% ~ (p=0.779 n=10)
CockroachDBkv95/nodes=1-44 2.200m ± 9% 2.200m ± 9% ~ (p=0.734 n=10)
CockroachDBkv0/nodes=3-44 27.25m ± 16% 23.60m ± 29% ~ (p=0.096 n=10)
CockroachDBkv50/nodes=3-44 1.900m ± 16% 1.900m ± 5% ~ (p=0.998 n=10)
CockroachDBkv95/nodes=3-44 2.200m ± 0% 2.200m ± 0% ~ (p=1.000 n=10)
geomean 4.833m 4.637m -4.05%
│ baseline │ experiment │
│ write-p95-latency-sec │ write-p95-latency-sec vs base │
CockroachDBkv0/nodes=1-44 419.5m ± 60% 209.7m ± 172% ~ (p=0.972 n=10)
CockroachDBkv50/nodes=1-44 973.1m ± 24% 1006.6m ± 3% ~ (p=0.651 n=10)
CockroachDBkv95/nodes=1-44 2.080 ± 10% 2.147 ± 6% ~ (p=0.480 n=10)
CockroachDBkv0/nodes=3-44 452.9m ± 61% 176.2m ± 224% ~ (p=0.125 n=10)
CockroachDBkv50/nodes=3-44 939.5m ± 76% 973.1m ± 7% +3.58% (p=0.031 n=10)
CockroachDBkv95/nodes=3-44 2.080 ± 3% 2.282 ± 9% +9.68% (p=0.013 n=10)
geomean 953.6m 749.6m -21.39%
│ baseline │ experiment │
│ write-p99-latency-sec │ write-p99-latency-sec vs base │
CockroachDBkv0/nodes=1-44 822.1m ± 27% 872.4m ± 8% ~ (p=0.247 n=10)
CockroachDBkv50/nodes=1-44 10.74 ± 28% 10.20 ± 11% ~ (p=0.288 n=10)
CockroachDBkv95/nodes=1-44 7.650 ± 19% 7.516 ± 21% ~ (p=0.900 n=10)
CockroachDBkv0/nodes=3-44 889.2m ± 13% 805.3m ± 13% ~ (p=0.096 n=10)
CockroachDBkv50/nodes=3-44 10.20 ± 21% 10.20 ± 5% ~ (p=0.688 n=10)
CockroachDBkv95/nodes=3-44 9.395 ± 29% 9.932 ± 38% ~ (p=0.640 n=10)
geomean 4.233 4.196 -0.88%
│ baseline │ experiment │
│ write-ops/sec │ write-ops/sec vs base │
CockroachDBkv0/nodes=1-44 25.95k ± 7% 25.95k ± 7% ~ (p=0.912 n=10)
CockroachDBkv50/nodes=1-44 12.29k ± 21% 12.30k ± 1% ~ (p=0.796 n=10)
CockroachDBkv95/nodes=1-44 1.420k ± 2% 1.421k ± 3% ~ (p=0.956 n=10)
CockroachDBkv0/nodes=3-44 25.66k ± 6% 26.04k ± 10% ~ (p=0.796 n=10)
CockroachDBkv50/nodes=3-44 12.46k ± 5% 12.29k ± 2% ~ (p=0.218 n=10)
CockroachDBkv95/nodes=3-44 1.390k ± 3% 1.374k ± 5% ~ (p=0.469 n=10)
geomean 7.656k 7.644k -0.15%
│ baseline │ experiment │
│ write-ops │ write-ops vs base │
CockroachDBkv0/nodes=1-44 1.557M ± 7% 1.558M ± 7% ~ (p=0.912 n=10)
CockroachDBkv50/nodes=1-44 737.6k ± 21% 738.1k ± 1% ~ (p=0.796 n=10)
CockroachDBkv95/nodes=1-44 85.26k ± 2% 85.30k ± 3% ~ (p=0.971 n=10)
CockroachDBkv0/nodes=3-44 1.540M ± 6% 1.563M ± 10% ~ (p=0.796 n=10)
CockroachDBkv50/nodes=3-44 747.9k ± 5% 737.8k ± 2% ~ (p=0.225 n=10)
CockroachDBkv95/nodes=3-44 83.45k ± 3% 82.47k ± 5% ~ (p=0.481 n=10)
geomean 459.5k 458.8k -0.15%
│ baseline │ experiment │
│ read-avg-latency-sec │ read-avg-latency-sec vs base │
CockroachDBkv50/nodes=1-44 34.35m ± 69% 33.05m ± 16% ~ (p=0.739 n=10)
CockroachDBkv95/nodes=1-44 77.45m ± 12% 77.15m ± 13% ~ (p=0.529 n=10)
CockroachDBkv50/nodes=3-44 32.40m ± 17% 29.90m ± 14% ~ (p=0.529 n=10)
CockroachDBkv95/nodes=3-44 83.40m ± 15% 89.55m ± 27% ~ (p=0.218 n=10)
geomean 51.78m 51.12m -1.28%
│ baseline │ experiment │
│ read-p100-latency-sec │ read-p100-latency-sec vs base │
CockroachDBkv50/nodes=1-44 11.27 ± 14% 10.74 ± 10% ~ (p=0.531 n=10)
CockroachDBkv95/nodes=1-44 9.664 ± 22% 8.590 ± 25% ~ (p=0.104 n=10)
CockroachDBkv50/nodes=3-44 10.74 ± 5% 10.74 ± 5% ~ (p=0.691 n=10)
CockroachDBkv95/nodes=3-44 11.01 ± 17% 11.27 ± 29% ~ (p=0.929 n=10)
geomean 10.65 10.28 -3.50%
│ baseline │ experiment │
│ read-p50-latency-sec │ read-p50-latency-sec vs base │
CockroachDBkv50/nodes=1-44 600.0µ ± 2867% 600.0µ ± 0% ~ (p=0.350 n=10)
CockroachDBkv95/nodes=1-44 500.0µ ± 0% 500.0µ ± 0% ~ (p=1.000 n=10)
CockroachDBkv50/nodes=3-44 600.0µ ± 17% 600.0µ ± 0% ~ (p=1.000 n=10)
CockroachDBkv95/nodes=3-44 500.0µ ± 0% 500.0µ ± 0% ~ (p=1.000 n=10) ¹
geomean 547.7µ 547.7µ +0.00%
¹ all samples are equal
│ baseline │ experiment │
│ read-p95-latency-sec │ read-p95-latency-sec vs base │
CockroachDBkv50/nodes=1-44 39.80m ± 111% 41.90m ± 10% ~ (p=0.853 n=10)
CockroachDBkv95/nodes=1-44 192.9m ± 13% 184.5m ± 27% ~ (p=0.756 n=10)
CockroachDBkv50/nodes=3-44 37.70m ± 95% 38.75m ± 8% ~ (p=0.506 n=10)
CockroachDBkv95/nodes=3-44 176.2m ± 9% 197.1m ± 15% ~ (p=0.266 n=10)
geomean 84.51m 87.66m +3.73%
│ baseline │ experiment │
│ read-p99-latency-sec │ read-p99-latency-sec vs base │
CockroachDBkv50/nodes=1-44 570.4m ± 35% 536.9m ± 12% ~ (p=0.437 n=10)
CockroachDBkv95/nodes=1-44 1.544 ± 4% 1.544 ± 9% ~ (p=0.337 n=10)
CockroachDBkv50/nodes=3-44 511.7m ± 56% 528.5m ± 8% ~ (p=0.724 n=10)
CockroachDBkv95/nodes=3-44 1.476 ± 5% 1.577 ± 11% ~ (p=0.082 n=10)
geomean 903.1m 911.6m +0.95%
│ baseline │ experiment │
│ read-ops/sec │ read-ops/sec vs base │
CockroachDBkv50/nodes=1-44 12.16k ± 21% 12.18k ± 1% ~ (p=0.853 n=10)
CockroachDBkv95/nodes=1-44 26.60k ± 2% 26.64k ± 3% ~ (p=0.796 n=10)
CockroachDBkv50/nodes=3-44 12.36k ± 5% 12.15k ± 3% ~ (p=0.143 n=10)
CockroachDBkv95/nodes=3-44 25.96k ± 4% 25.64k ± 6% ~ (p=0.393 n=10)
geomean 17.95k 17.83k -0.65%
│ baseline │ experiment │
│ read-ops │ read-ops vs base │
CockroachDBkv50/nodes=1-44 730.0k ± 21% 730.8k ± 1% ~ (p=0.853 n=10)
CockroachDBkv95/nodes=1-44 1.596M ± 2% 1.599M ± 3% ~ (p=0.796 n=10)
CockroachDBkv50/nodes=3-44 741.5k ± 5% 729.5k ± 3% ~ (p=0.143 n=10)
CockroachDBkv95/nodes=3-44 1.558M ± 4% 1.539M ± 6% ~ (p=0.393 n=10)
geomean 1.077M 1.070M -0.65%
│ baseline │ experiment │
│ p50-latency-sec │ p50-latency-sec vs base │
EtcdPut-88 9.886m ± 1% 9.964m ± 2% ~ (p=0.247 n=10)
EtcdSTM-88 69.08m ± 1% 66.70m ± 1% -3.44% (p=0.000 n=10)
Tile38QueryLoad-88 223.1µ ± 1% 217.3µ ± 0% -2.57% (p=0.000 n=10)
geomean 5.341m 5.247m -1.75%
│ baseline │ experiment │
│ p90-latency-sec │ p90-latency-sec vs base │
EtcdPut-88 15.22m ± 3% 15.01m ± 2% ~ (p=0.143 n=10)
EtcdSTM-88 180.6m ± 1% 173.9m ± 1% -3.71% (p=0.000 n=10)
Tile38QueryLoad-88 822.5µ ± 2% 772.1µ ± 1% -6.13% (p=0.000 n=10)
geomean 13.12m 12.63m -3.74%
│ baseline │ experiment │
│ p99-latency-sec │ p99-latency-sec vs base │
EtcdPut-88 23.86m ± 7% 23.79m ± 8% ~ (p=0.853 n=10)
EtcdSTM-88 385.4m ± 1% 370.0m ± 1% -3.98% (p=0.000 n=10)
Tile38QueryLoad-88 8.481m ± 2% 8.370m ± 2% ~ (p=0.280 n=10)
geomean 42.73m 41.92m -1.88%
│ baseline │ experiment │
│ ops/s │ ops/s vs base │
EtcdPut-88 97.30k ± 1% 97.17k ± 1% ~ (p=0.971 n=10)
EtcdSTM-88 11.02k ± 0% 11.45k ± 0% +3.88% (p=0.000 n=10)
Tile38QueryLoad-88 84.72k ± 1% 86.00k ± 1% +1.51% (p=0.007 n=10)
geomean 44.96k 45.74k +1.74%