repository: go
branch: master
builder: gotip-linux-arm64_c4as16-perf_vs_parent
runstamp: 2025-04-21T20:26:35.180666375Z
goos: linux
goarch: arm64
│ baseline │ experiment │
│ p99.999-sec │ p99.999-sec vs base │
GCLatency/how=stack/fluff=false-16 67.33µ ± 63% 63.63µ ± 40% -5.50% (p=0.041 n=6)
GCLatency/how=heap/fluff=false-16 66.15µ ± 2% 63.61µ ± 1% -3.84% (p=0.002 n=6)
GCLatency/how=global/fluff=false-16 69.76µ ± 3% 65.50µ ± 1% -6.11% (p=0.002 n=6)
geomean 67.73µ 64.24µ -5.15%
│ baseline │ experiment │
│ p99.9999-sec │ p99.9999-sec vs base │
GCLatency/how=stack/fluff=false-16 138.32µ ± 68% 84.29µ ± 191% ~ (p=0.240 n=6)
GCLatency/how=heap/fluff=false-16 76.98µ ± 119% 78.21µ ± 8% ~ (p=0.589 n=6)
GCLatency/how=global/fluff=false-16 359.0µ ± 1% 375.5µ ± 1% +4.61% (p=0.002 n=6)
geomean 156.4µ 135.3µ -13.48%
│ baseline │ experiment │
│ total-bytes │ total-bytes vs base │
Gonum_lapack_native 5.796Mi ± 0% 5.821Mi ± 0% +0.43% (n=1)
Gonum_community 4.413Mi ± 0% 4.437Mi ± 0% +0.55% (n=1)
Uber_zap 7.038Mi ± 0% 7.062Mi ± 0% +0.35% (n=1)
K8s_workqueue 8.476Mi ± 0% 8.501Mi ± 0% +0.29% (n=1)
Shopify_sarama 11.27Mi ± 0% 11.30Mi ± 0% +0.22% (n=1)
Gtank_blake2s 4.045Mi ± 0% 4.069Mi ± 0% +0.60% (n=1)
Aws_jsonutil 7.355Mi ± 0% 7.380Mi ± 0% +0.34% (n=1)
Gonum_traverse 3.867Mi ± 0% 3.891Mi ± 0% +0.63% (n=1)
Benhoyt_goawk_1_18 5.576Mi ± 0% 5.600Mi ± 0% +0.44% (n=1)
Bloom_bloom 4.496Mi ± 0% 4.520Mi ± 0% +0.55% (n=1)
Ericlagergren_decimal 4.139Mi ± 0% 4.163Mi ± 0% +0.58% (n=1)
Semver 4.123Mi ± 0% 4.148Mi ± 0% +0.59% (n=1)
Dustin_humanize 4.129Mi ± 0% 4.153Mi ± 0% +0.60% (n=1)
K8s_cache 14.77Mi ± 0% 14.79Mi ± 0% +0.17% (n=1)
Ethereum_ecies 4.513Mi ± 0% 4.532Mi ± 0% +0.43% (n=1)
Gonum_mat 6.372Mi ± 0% 6.396Mi ± 0% +0.37% (n=1)
Kanzi 4.136Mi ± 0% 4.161Mi ± 0% +0.59% (n=1)
Ethereum_bitutil 3.818Mi ± 0% 3.842Mi ± 0% +0.64% (n=1)
Commonmark_markdown 5.218Mi ± 0% 5.243Mi ± 0% +0.47% (n=1)
Ethereum_corevm 6.510Mi ± 0% 6.534Mi ± 0% +0.36% (n=1)
Hugo_hugolib 43.54Mi ± 0% 43.57Mi ± 0% +0.05% (n=1)
Aws_jsonrpc 11.52Mi ± 0% 11.54Mi ± 0% +0.21% (n=1)
Gonum_blas_native 4.810Mi ± 0% 4.834Mi ± 0% +0.51% (n=1)
Dustin_broadcast 3.683Mi ± 0% 3.707Mi ± 0% +0.66% (n=1)
Ajstarks_deck_generate 3.717Mi ± 0% 3.741Mi ± 0% +0.66% (n=1)
Minio 99.99Mi ± 0% 100.01Mi ± 0% +0.02% (n=1)
Spexs2 4.121Mi ± 0% 4.145Mi ± 0% +0.59% (n=1)
Cespare_xxhash 3.645Mi ± 0% 3.670Mi ± 0% +0.67% (n=1)
Bindata 11.06Mi ± 0% 11.09Mi ± 0% +0.22% (n=1)
Ethereum_core 13.85Mi ± 0% 13.87Mi ± 0% +0.17% (n=1)
Capnproto2 4.751Mi ± 0% 4.776Mi ± 0% +0.53% (n=1)
Uber_tally 5.894Mi ± 0% 5.919Mi ± 0% +0.42% (n=1)
Aws_restjson 11.79Mi ± 0% 11.82Mi ± 0% +0.21% (n=1)
Ethereum_trie 6.806Mi ± 0% 6.833Mi ± 0% +0.39% (n=1)
Gonum_topo 4.113Mi ± 0% 4.137Mi ± 0% +0.60% (n=1)
Gonum_path 4.259Mi ± 0% 4.282Mi ± 0% +0.56% (n=1)
Ethereum_ethash 9.763Mi ± 0% 9.786Mi ± 0% +0.24% (n=1)
Aws_restxml 11.85Mi ± 0% 11.88Mi ± 0% +0.21% (n=1)
Toml 5.976Mi ± 0% 6.001Mi ± 0% +0.41% (n=1)
Cespare_mph 3.650Mi ± 0% 3.674Mi ± 0% +0.66% (n=1)
Wazero 7.543Mi ± 0% 7.568Mi ± 0% +0.33% (n=1)
geomean 6.621Mi 6.649Mi +0.43%
│ baseline │ experiment │
│ text-bytes │ text-bytes vs base │
Gonum_lapack_native 1.945Mi ± 0% 1.952Mi ± 0% +0.35% (n=1)
Gonum_community 1.378Mi ± 0% 1.385Mi ± 0% +0.50% (n=1)
Uber_zap 2.176Mi ± 0% 2.183Mi ± 0% +0.32% (n=1)
K8s_workqueue 2.647Mi ± 0% 2.653Mi ± 0% +0.26% (n=1)
Shopify_sarama 3.744Mi ± 0% 3.751Mi ± 0% +0.18% (n=1)
Gtank_blake2s 1.249Mi ± 0% 1.256Mi ± 0% +0.55% (n=1)
Aws_jsonutil 2.495Mi ± 0% 2.502Mi ± 0% +0.28% (n=1)
Gonum_traverse 1.153Mi ± 0% 1.160Mi ± 0% +0.60% (n=1)
Benhoyt_goawk_1_18 1.781Mi ± 0% 1.788Mi ± 0% +0.39% (n=1)
Bloom_bloom 1.404Mi ± 0% 1.411Mi ± 0% +0.49% (n=1)
Ericlagergren_decimal 1.255Mi ± 0% 1.262Mi ± 0% +0.55% (n=1)
Semver 1.274Mi ± 0% 1.281Mi ± 0% +0.54% (n=1)
Dustin_humanize 1.270Mi ± 0% 1.277Mi ± 0% +0.54% (n=1)
K8s_cache 5.121Mi ± 0% 5.128Mi ± 0% +0.13% (n=1)
Ethereum_ecies 1.372Mi ± 0% 1.375Mi ± 0% +0.22% (n=1)
Gonum_mat 2.220Mi ± 0% 2.227Mi ± 0% +0.31% (n=1)
Kanzi 1.246Mi ± 0% 1.253Mi ± 0% +0.55% (n=1)
Ethereum_bitutil 1.153Mi ± 0% 1.160Mi ± 0% +0.60% (n=1)
Commonmark_markdown 1.586Mi ± 0% 1.593Mi ± 0% +0.43% (n=1)
Ethereum_corevm 2.032Mi ± 0% 2.039Mi ± 0% +0.34% (n=1)
Hugo_hugolib 17.23Mi ± 0% 17.24Mi ± 0% +0.04% (n=1)
Aws_jsonrpc 3.952Mi ± 0% 3.959Mi ± 0% +0.17% (n=1)
Gonum_blas_native 1.582Mi ± 0% 1.589Mi ± 0% +0.43% (n=1)
Dustin_broadcast 1.106Mi ± 0% 1.113Mi ± 0% +0.62% (n=1)
Ajstarks_deck_generate 1.112Mi ± 0% 1.119Mi ± 0% +0.62% (n=1)
Minio 29.61Mi ± 0% 29.61Mi ± 0% +0.02% (n=1)
Spexs2 1.271Mi ± 0% 1.278Mi ± 0% +0.54% (n=1)
Cespare_xxhash 1.090Mi ± 0% 1.097Mi ± 0% +0.63% (n=1)
Bindata 1.427Mi ± 0% 1.434Mi ± 0% +0.48% (n=1)
Ethereum_core 4.545Mi ± 0% 4.552Mi ± 0% +0.15% (n=1)
Capnproto2 1.471Mi ± 0% 1.478Mi ± 0% +0.47% (n=1)
Uber_tally 1.748Mi ± 0% 1.755Mi ± 0% +0.39% (n=1)
Aws_restjson 4.065Mi ± 0% 4.072Mi ± 0% +0.17% (n=1)
Ethereum_trie 2.187Mi ± 0% 2.198Mi ± 0% +0.49% (n=1)
Gonum_topo 1.249Mi ± 0% 1.256Mi ± 0% +0.55% (n=1)
Gonum_path 1.297Mi ± 0% 1.304Mi ± 0% +0.53% (n=1)
Ethereum_ethash 3.108Mi ± 0% 3.115Mi ± 0% +0.22% (n=1)
Aws_restxml 4.093Mi ± 0% 4.100Mi ± 0% +0.17% (n=1)
Toml 1.874Mi ± 0% 1.881Mi ± 0% +0.37% (n=1)
Cespare_mph 1.096Mi ± 0% 1.103Mi ± 0% +0.63% (n=1)
Wazero 2.374Mi ± 0% 2.381Mi ± 0% +0.29% (n=1)
geomean 2.051Mi 2.059Mi +0.39%
│ baseline │ experiment │
│ data-bytes │ data-bytes vs base │
Gonum_lapack_native 1.080Mi ± 0% 1.082Mi ± 0% +0.26% (n=1)
Gonum_community 775.9Ki ± 0% 778.8Ki ± 0% +0.37% (n=1)
Uber_zap 1.352Mi ± 0% 1.355Mi ± 0% +0.20% (n=1)
K8s_workqueue 1.491Mi ± 0% 1.494Mi ± 0% +0.19% (n=1)
Shopify_sarama 1.990Mi ± 0% 1.993Mi ± 0% +0.14% (n=1)
Gtank_blake2s 686.3Ki ± 0% 689.1Ki ± 0% +0.41% (n=1)
Aws_jsonutil 1.777Mi ± 0% 1.779Mi ± 0% +0.16% (n=1)
Gonum_traverse 689.2Ki ± 0% 692.0Ki ± 0% +0.41% (n=1)
Benhoyt_goawk_1_18 1023.1Ki ± 0% 1026.0Ki ± 0% +0.28% (n=1)
Bloom_bloom 764.9Ki ± 0% 767.7Ki ± 0% +0.37% (n=1)
Ericlagergren_decimal 706.7Ki ± 0% 709.5Ki ± 0% +0.40% (n=1)
Semver 713.5Ki ± 0% 716.3Ki ± 0% +0.40% (n=1)
Dustin_humanize 719.9Ki ± 0% 722.7Ki ± 0% +0.39% (n=1)
K8s_cache 2.540Mi ± 0% 2.543Mi ± 0% +0.11% (n=1)
Ethereum_ecies 833.9Ki ± 0% 836.8Ki ± 0% +0.34% (n=1)
Gonum_mat 1008.4Ki ± 0% 1011.3Ki ± 0% +0.28% (n=1)
Kanzi 696.2Ki ± 0% 699.0Ki ± 0% +0.41% (n=1)
Ethereum_bitutil 661.2Ki ± 0% 664.0Ki ± 0% +0.43% (n=1)
Commonmark_markdown 1016.6Ki ± 0% 1019.5Ki ± 0% +0.28% (n=1)
Ethereum_corevm 1.172Mi ± 0% 1.175Mi ± 0% +0.24% (n=1)
Hugo_hugolib 9.137Mi ± 0% 9.140Mi ± 0% +0.03% (n=1)
Aws_jsonrpc 2.482Mi ± 0% 2.485Mi ± 0% +0.11% (n=1)
Gonum_blas_native 857.0Ki ± 0% 859.8Ki ± 0% +0.33% (n=1)
Dustin_broadcast 647.7Ki ± 0% 650.6Ki ± 0% +0.44% (n=1)
Ajstarks_deck_generate 666.9Ki ± 0% 669.8Ki ± 0% +0.44% (n=1)
Minio 30.47Mi ± 0% 30.48Mi ± 0% +0.01% (n=1)
Spexs2 702.8Ki ± 0% 705.6Ki ± 0% +0.41% (n=1)
Cespare_xxhash 641.3Ki ± 0% 644.2Ki ± 0% +0.44% (n=1)
Bindata 7.303Mi ± 0% 7.306Mi ± 0% +0.04% (n=1)
Ethereum_core 2.696Mi ± 0% 2.699Mi ± 0% +0.10% (n=1)
Capnproto2 848.5Ki ± 0% 851.4Ki ± 0% +0.34% (n=1)
Uber_tally 1.173Mi ± 0% 1.175Mi ± 0% +0.24% (n=1)
Aws_restjson 2.549Mi ± 0% 2.552Mi ± 0% +0.11% (n=1)
Ethereum_trie 1.189Mi ± 0% 1.192Mi ± 0% +0.23% (n=1)
Gonum_topo 734.8Ki ± 0% 737.6Ki ± 0% +0.39% (n=1)
Gonum_path 769.5Ki ± 0% 772.3Ki ± 0% +0.37% (n=1)
Ethereum_ethash 1.880Mi ± 0% 1.883Mi ± 0% +0.15% (n=1)
Aws_restxml 2.552Mi ± 0% 2.555Mi ± 0% +0.11% (n=1)
Toml 1.159Mi ± 0% 1.162Mi ± 0% +0.25% (n=1)
Cespare_mph 641.2Ki ± 0% 644.1Ki ± 0% +0.45% (n=1)
Wazero 1.291Mi ± 0% 1.294Mi ± 0% +0.22% (n=1)
geomean 1.252Mi 1.255Mi +0.27%
│ baseline │ experiment │
│ rodata-bytes │ rodata-bytes vs base │
Gonum_lapack_native 793.1Ki ± 0% 795.9Ki ± 0% +0.36% (n=1)
Gonum_community 619.7Ki ± 0% 622.5Ki ± 0% +0.46% (n=1)
Uber_zap 1.019Mi ± 0% 1.021Mi ± 0% +0.27% (n=1)
K8s_workqueue 1.161Mi ± 0% 1.164Mi ± 0% +0.24% (n=1)
Shopify_sarama 1.716Mi ± 0% 1.719Mi ± 0% +0.16% (n=1)
Gtank_blake2s 559.7Ki ± 0% 562.5Ki ± 0% +0.50% (n=1)
Aws_jsonutil 1.452Mi ± 0% 1.455Mi ± 0% +0.20% (n=1)
Gonum_traverse 560.0Ki ± 0% 562.9Ki ± 0% +0.51% (n=1)
Benhoyt_goawk_1_18 841.9Ki ± 0% 844.8Ki ± 0% +0.34% (n=1)
Bloom_bloom 636.9Ki ± 0% 639.7Ki ± 0% +0.44% (n=1)
Ericlagergren_decimal 578.7Ki ± 0% 581.5Ki ± 0% +0.49% (n=1)
Semver 586.2Ki ± 0% 589.1Ki ± 0% +0.49% (n=1)
Dustin_humanize 592.7Ki ± 0% 595.5Ki ± 0% +0.47% (n=1)
K8s_cache 2.139Mi ± 0% 2.142Mi ± 0% +0.13% (n=1)
Ethereum_ecies 621.5Ki ± 0% 624.3Ki ± 0% +0.46% (n=1)
Gonum_mat 839.2Ki ± 0% 842.0Ki ± 0% +0.34% (n=1)
Kanzi 556.4Ki ± 0% 559.3Ki ± 0% +0.51% (n=1)
Ethereum_bitutil 535.5Ki ± 0% 538.3Ki ± 0% +0.53% (n=1)
Commonmark_markdown 870.1Ki ± 0% 873.0Ki ± 0% +0.33% (n=1)
Ethereum_corevm 960.0Ki ± 0% 962.9Ki ± 0% +0.30% (n=1)
Hugo_hugolib 8.384Mi ± 0% 8.387Mi ± 0% +0.03% (n=1)
Aws_jsonrpc 2.126Mi ± 0% 2.129Mi ± 0% +0.13% (n=1)
Gonum_blas_native 652.2Ki ± 0% 655.0Ki ± 0% +0.43% (n=1)
Dustin_broadcast 523.3Ki ± 0% 526.2Ki ± 0% +0.54% (n=1)
Ajstarks_deck_generate 542.1Ki ± 0% 545.0Ki ± 0% +0.54% (n=1)
Minio 29.42Mi ± 0% 29.42Mi ± 0% +0.01% (n=1)
Spexs2 576.3Ki ± 0% 579.1Ki ± 0% +0.50% (n=1)
Cespare_xxhash 517.2Ki ± 0% 520.0Ki ± 0% +0.55% (n=1)
Bindata 641.7Ki ± 0% 644.6Ki ± 0% +0.45% (n=1)
Ethereum_core 2.281Mi ± 0% 2.283Mi ± 0% +0.12% (n=1)
Capnproto2 717.2Ki ± 0% 720.1Ki ± 0% +0.40% (n=1)
Uber_tally 867.9Ki ± 0% 870.7Ki ± 0% +0.33% (n=1)
Aws_restjson 2.192Mi ± 0% 2.195Mi ± 0% +0.13% (n=1)
Ethereum_trie 990.4Ki ± 0% 993.3Ki ± 0% +0.29% (n=1)
Gonum_topo 597.6Ki ± 0% 600.5Ki ± 0% +0.48% (n=1)
Gonum_path 615.7Ki ± 0% 618.5Ki ± 0% +0.46% (n=1)
Ethereum_ethash 1.496Mi ± 0% 1.499Mi ± 0% +0.19% (n=1)
Aws_restxml 2.194Mi ± 0% 2.197Mi ± 0% +0.13% (n=1)
Toml 1.030Mi ± 0% 1.033Mi ± 0% +0.28% (n=1)
Cespare_mph 516.5Ki ± 0% 519.4Ki ± 0% +0.56% (n=1)
Wazero 1.097Mi ± 0% 1.100Mi ± 0% +0.26% (n=1)
geomean 993.4Ki 996.9Ki +0.35%
│ baseline │ experiment │
│ pclntab-bytes │ pclntab-bytes vs base │
Gonum_lapack_native 1.145Mi ± 0% 1.151Mi ± 0% +0.56% (n=1)
Gonum_community 977.1Ki ± 0% 983.7Ki ± 0% +0.67% (n=1)
Uber_zap 1.546Mi ± 0% 1.553Mi ± 0% +0.44% (n=1)
K8s_workqueue 1.966Mi ± 0% 1.973Mi ± 0% +0.35% (n=1)
Shopify_sarama 2.508Mi ± 0% 2.515Mi ± 0% +0.27% (n=1)
Gtank_blake2s 909.6Ki ± 0% 916.2Ki ± 0% +0.72% (n=1)
Aws_jsonutil 1.359Mi ± 0% 1.365Mi ± 0% +0.50% (n=1)
Gonum_traverse 866.6Ki ± 0% 873.1Ki ± 0% +0.76% (n=1)
Benhoyt_goawk_1_18 1.208Mi ± 0% 1.215Mi ± 0% +0.54% (n=1)
Bloom_bloom 1019.4Ki ± 0% 1026.0Ki ± 0% +0.65% (n=1)
Ericlagergren_decimal 935.9Ki ± 0% 942.4Ki ± 0% +0.70% (n=1)
Semver 928.4Ki ± 0% 935.0Ki ± 0% +0.71% (n=1)
Dustin_humanize 923.4Ki ± 0% 930.0Ki ± 0% +0.71% (n=1)
K8s_cache 3.362Mi ± 0% 3.369Mi ± 0% +0.21% (n=1)
Ethereum_ecies 990.6Ki ± 0% 997.3Ki ± 0% +0.67% (n=1)
Gonum_mat 1.342Mi ± 0% 1.349Mi ± 0% +0.48% (n=1)
Kanzi 899.1Ki ± 0% 905.6Ki ± 0% +0.73% (n=1)
Ethereum_bitutil 858.9Ki ± 0% 865.5Ki ± 0% +0.77% (n=1)
Commonmark_markdown 1.139Mi ± 0% 1.145Mi ± 0% +0.56% (n=1)
Ethereum_corevm 1.483Mi ± 0% 1.490Mi ± 0% +0.44% (n=1)
Hugo_hugolib 8.834Mi ± 0% 8.841Mi ± 0% +0.08% (n=1)
Aws_jsonrpc 2.309Mi ± 0% 2.316Mi ± 0% +0.30% (n=1)
Gonum_blas_native 1.008Mi ± 0% 1.014Mi ± 0% +0.64% (n=1)
Dustin_broadcast 828.8Ki ± 0% 835.4Ki ± 0% +0.79% (n=1)
Ajstarks_deck_generate 833.2Ki ± 0% 839.7Ki ± 0% +0.79% (n=1)
Minio 22.00Mi ± 0% 22.00Mi ± 0% +0.03% (n=1)
Spexs2 933.5Ki ± 0% 940.1Ki ± 0% +0.71% (n=1)
Cespare_xxhash 816.6Ki ± 0% 823.2Ki ± 0% +0.81% (n=1)
Bindata 1015.7Ki ± 0% 1022.3Ki ± 0% +0.65% (n=1)
Ethereum_core 3.131Mi ± 0% 3.138Mi ± 0% +0.22% (n=1)
Capnproto2 1.047Mi ± 0% 1.053Mi ± 0% +0.62% (n=1)
Uber_tally 1.275Mi ± 0% 1.282Mi ± 0% +0.53% (n=1)
Aws_restjson 2.366Mi ± 0% 2.373Mi ± 0% +0.30% (n=1)
Ethereum_trie 1.536Mi ± 0% 1.542Mi ± 0% +0.42% (n=1)
Gonum_topo 916.9Ki ± 0% 923.5Ki ± 0% +0.72% (n=1)
Gonum_path 955.5Ki ± 0% 962.0Ki ± 0% +0.68% (n=1)
Ethereum_ethash 2.156Mi ± 0% 2.163Mi ± 0% +0.32% (n=1)
Aws_restxml 2.375Mi ± 0% 2.382Mi ± 0% +0.30% (n=1)
Toml 1.286Mi ± 0% 1.292Mi ± 0% +0.51% (n=1)
Cespare_mph 818.6Ki ± 0% 825.2Ki ± 0% +0.80% (n=1)
Wazero 1.751Mi ± 0% 1.758Mi ± 0% +0.38% (n=1)
geomean 1.402Mi 1.410Mi +0.54%
│ baseline │ experiment │
│ debug-bytes │ debug-bytes vs base │
Gonum_lapack_native 1.288Mi ± 0% 1.295Mi ± 0% +0.58% (n=1)
Gonum_community 1.010Mi ± 0% 1.017Mi ± 0% +0.70% (n=1)
Uber_zap 1.567Mi ± 0% 1.574Mi ± 0% +0.46% (n=1)
K8s_workqueue 1.938Mi ± 0% 1.944Mi ± 0% +0.35% (n=1)
Shopify_sarama 2.509Mi ± 0% 2.516Mi ± 0% +0.27% (n=1)
Gtank_blake2s 975.7Ki ± 0% 983.0Ki ± 0% +0.75% (n=1)
Aws_jsonutil 1.354Mi ± 0% 1.361Mi ± 0% +0.54% (n=1)
Gonum_traverse 921.2Ki ± 0% 928.7Ki ± 0% +0.81% (n=1)
Benhoyt_goawk_1_18 1.257Mi ± 0% 1.264Mi ± 0% +0.56% (n=1)
Bloom_bloom 1.051Mi ± 0% 1.058Mi ± 0% +0.70% (n=1)
Ericlagergren_decimal 1000.1Ki ± 0% 1007.0Ki ± 0% +0.69% (n=1)
Semver 983.5Ki ± 0% 990.7Ki ± 0% +0.72% (n=1)
Dustin_humanize 989.3Ki ± 0% 996.9Ki ± 0% +0.77% (n=1)
K8s_cache 3.145Mi ± 0% 3.152Mi ± 0% +0.22% (n=1)
Ethereum_ecies 1.050Mi ± 0% 1.056Mi ± 0% +0.57% (n=1)
Gonum_mat 1.447Mi ± 0% 1.454Mi ± 0% +0.44% (n=1)
Kanzi 977.0Ki ± 0% 984.6Ki ± 0% +0.77% (n=1)
Ethereum_bitutil 922.7Ki ± 0% 930.1Ki ± 0% +0.80% (n=1)
Commonmark_markdown 1.144Mi ± 0% 1.151Mi ± 0% +0.64% (n=1)
Ethereum_corevm 1.445Mi ± 0% 1.451Mi ± 0% +0.44% (n=1)
Hugo_hugolib 7.253Mi ± 0% 7.258Mi ± 0% +0.08% (n=1)
Aws_jsonrpc 2.300Mi ± 0% 2.307Mi ± 0% +0.30% (n=1)
Gonum_blas_native 1.079Mi ± 0% 1.086Mi ± 0% +0.66% (n=1)
Dustin_broadcast 883.0Ki ± 0% 890.3Ki ± 0% +0.82% (n=1)
Ajstarks_deck_generate 887.1Ki ± 0% 894.7Ki ± 0% +0.85% (n=1)
Minio 15.91Mi ± 0% 15.91Mi ± 0% +0.02% (n=1)
Spexs2 989.7Ki ± 0% 996.9Ki ± 0% +0.72% (n=1)
Cespare_xxhash 878.8Ki ± 0% 886.4Ki ± 0% +0.87% (n=1)
Bindata 1.047Mi ± 0% 1.054Mi ± 0% +0.68% (n=1)
Ethereum_core 2.890Mi ± 0% 2.896Mi ± 0% +0.20% (n=1)
Capnproto2 1.096Mi ± 0% 1.104Mi ± 0% +0.69% (n=1)
Uber_tally 1.331Mi ± 0% 1.338Mi ± 0% +0.53% (n=1)
Aws_restjson 2.332Mi ± 0% 2.338Mi ± 0% +0.29% (n=1)
Ethereum_trie 1.530Mi ± 0% 1.535Mi ± 0% +0.37% (n=1)
Gonum_topo 972.0Ki ± 0% 979.4Ki ± 0% +0.77% (n=1)
Gonum_path 996.5Ki ± 0% 1003.3Ki ± 0% +0.69% (n=1)
Ethereum_ethash 2.144Mi ± 0% 2.149Mi ± 0% +0.27% (n=1)
Aws_restxml 2.351Mi ± 0% 2.359Mi ± 0% +0.31% (n=1)
Toml 1.328Mi ± 0% 1.334Mi ± 0% +0.51% (n=1)
Cespare_mph 876.4Ki ± 0% 883.5Ki ± 0% +0.81% (n=1)
Wazero 1.698Mi ± 0% 1.705Mi ± 0% +0.41% (n=1)
geomean 1.430Mi 1.438Mi +0.55%
│ baseline │ experiment │
│ sec/op │ sec/op vs base │
ValidateVersionTildeFail-16 413.1n ± 2% 409.6n ± 2% ~ (p=0.225 n=10)
TextMovementBetweenSegments-16 359.2µ ± 1% 360.4µ ± 0% ~ (p=0.247 n=10)
Growth_MultiSegment-16 10.82m ± 0% 10.71m ± 0% -1.00% (p=0.000 n=10)
Invocation/interpreter/fib_for_20-16 1.861m ± 0% 1.866m ± 0% +0.31% (p=0.007 n=10)
Invocation/interpreter/string_manipulation_size_50-16 721.9µ ± 1% 725.2µ ± 1% +0.47% (p=0.035 n=10)
Invocation/interpreter/random_mat_mul_size_20-16 4.697m ± 0% 4.702m ± 0% ~ (p=0.481 n=10)
Compilation/with_extern_cache-16 231.1µ ± 0% 232.7µ ± 0% +0.72% (p=0.000 n=10)
Compilation/without_extern_cache-16 11.62m ± 0% 11.58m ± 0% -0.36% (p=0.002 n=10)
Dgeev/Circulant10-16 20.12µ ± 0% 19.71µ ± 0% -2.03% (p=0.000 n=10)
Dgeev/Circulant100-16 6.713m ± 0% 6.537m ± 0% -2.62% (p=0.000 n=10)
Pi/foo=ericlagergren_(Go)/prec=100-16 103.2µ ± 0% 103.5µ ± 0% +0.27% (p=0.035 n=10)
Pi/foo=ericlagergren_(GDA)/prec=100-16 201.7µ ± 0% 201.3µ ± 0% -0.18% (p=0.041 n=10)
Pi/foo=shopspring/prec=100-16 304.6µ ± 2% 306.3µ ± 4% ~ (p=0.971 n=10)
Pi/foo=apmckinlay/prec=100-16 1.605µ ± 0% 1.607µ ± 0% +0.12% (p=0.000 n=10)
Pi/foo=go-inf/prec=100-16 81.46µ ± 2% 81.22µ ± 2% ~ (p=0.353 n=10)
Pi/foo=float64/prec=100-16 3.249µ ± 0% 3.250µ ± 0% ~ (p=0.270 n=10)
HashFixedSize/10K-16 3.637m ± 2% 3.325m ± 1% -8.60% (p=0.000 n=10)
CommitAfterHashFixedSize/10K-16 10.320m ± 1% 9.848m ± 0% -4.58% (p=0.000 n=10)
MergeByLanguage-16 400.1n ± 0% 397.7n ± 0% -0.59% (p=0.000 n=10)
ResourceChainPostProcess-16 35.44m ± 1% 35.40m ± 0% ~ (p=0.315 n=10)
ReplaceShortcodeTokens-16 2.026µ ± 2% 2.056µ ± 3% ~ (p=0.184 n=10)
ParallelizeUntil/pieces:1000,workers:10,chunkSize:1-16 192.6µ ± 1% 194.2µ ± 1% +0.80% (p=0.005 n=10)
ParallelizeUntil/pieces:1000,workers:10,chunkSize:10-16 38.28µ ± 1% 38.20µ ± 1% ~ (p=0.529 n=10)
ParallelizeUntil/pieces:1000,workers:10,chunkSize:100-16 15.76µ ± 0% 15.74µ ± 0% ~ (p=0.393 n=10)
ParallelizeUntil/pieces:999,workers:10,chunkSize:13-16 30.74µ ± 1% 30.82µ ± 0% ~ (p=0.353 n=10)
RenderSpecNoHTML-16 4.189m ± 1% 3.787m ± 1% -9.60% (p=0.000 n=10)
RenderSpec-16 4.193m ± 1% 3.810m ± 2% -9.13% (p=0.000 n=10)
RenderSpecBlackFriday2-16 2.968m ± 0% 2.789m ± 0% -6.05% (p=0.000 n=10)
FPAQ-16 14.83m ± 0% 14.68m ± 0% -0.98% (p=0.000 n=10)
LZ-16 615.1µ ± 3% 607.7µ ± 4% ~ (p=0.912 n=10)
MTFT-16 922.3µ ± 0% 925.5µ ± 0% +0.35% (p=0.002 n=10)
MulWorkspaceDense1000Hundredth-16 23.97m ± 0% 23.93m ± 0% ~ (p=0.063 n=10)
ScaleVec10000Inc20-16 7.474µ ± 9% 7.051µ ± 15% ~ (p=0.247 n=10)
Dnrm2MediumPosInc-16 1.443µ ± 0% 1.474µ ± 1% +2.15% (p=0.000 n=10)
DasumMediumUnitaryInc-16 640.9n ± 0% 647.7n ± 0% +1.06% (p=0.000 n=10)
BuildJSON-16 2.696µ ± 1% 2.713µ ± 1% +0.61% (p=0.027 n=10)
StdlibJSON-16 1.857µ ± 0% 1.842µ ± 1% ~ (p=0.148 n=10)
RecursiveFunc-16 8.027µ ± 2% 7.954µ ± 1% ~ (p=0.280 n=10)
RegexMatch-16 689.4n ± 1% 692.0n ± 1% ~ (p=0.271 n=10)
RepeatExecProgram-16 10.79µ ± 0% 10.79µ ± 0% ~ (p=0.811 n=10)
RepeatNew-16 74.24n ± 0% 74.04n ± 1% ~ (p=0.085 n=10)
RepeatIOExecProgram-16 18.17µ ± 1% 18.01µ ± 1% -0.85% (p=0.002 n=10)
RepeatIONew-16 589.2n ± 1% 582.1n ± 1% -1.20% (p=0.002 n=10)
Listener-16 1.038µ ± 3% 1.051µ ± 4% ~ (p=0.839 n=10)
ReflectorResyncChanMany-16 497.9n ± 2% 488.5n ± 2% -1.89% (p=0.006 n=10)
TarjanSCCGnp_10_tenth-16 4.079µ ± 0% 4.075µ ± 1% ~ (p=0.469 n=10)
TarjanSCCGnp_1000_half-16 39.89m ± 0% 39.85m ± 1% ~ (p=0.529 n=10)
FastTest2KB-16 696.3n ± 27% 696.7n ± 92% ~ (p=0.209 n=10)
BaseTest2KB-16 696.4n ± 7% 696.4n ± 96% ~ (p=0.402 n=10)
Encoding4KBVerySparse-16 9.136µ ± 0% 9.937µ ± 0% +8.77% (p=0.000 n=10)
BufferedWriteSyncer/write_file_with_buffer-16 267.0n ± 4% 264.3n ± 3% ~ (p=0.190 n=10)
MultiWriteSyncer/2_discarder-16 5.935n ± 27% 6.327n ± 2% ~ (p=0.306 n=10)
MultiWriteSyncer/4_discarder-16 6.421n ± 2% 6.733n ± 2% +4.86% (p=0.000 n=10)
MultiWriteSyncer/4_discarder_with_buffer-16 253.3n ± 4% 253.7n ± 4% ~ (p=0.579 n=10)
WriteSyncer/write_file_with_no_buffer-16 915.9n ± 2% 893.5n ± 1% -2.44% (p=0.000 n=10)
ZapConsole-16 628.2n ± 2% 635.5n ± 1% +1.15% (p=0.034 n=10)
JSONLogMarshalerFunc-16 610.8n ± 1% 613.8n ± 1% ~ (p=0.306 n=10)
ZapJSON-16 463.2n ± 1% 467.5n ± 1% ~ (p=0.159 n=10)
StandardJSON-16 466.1n ± 2% 478.9n ± 2% +2.75% (p=0.002 n=10)
Sampler_Check/7_keys-16 20.05n ± 10% 20.81n ± 11% ~ (p=0.579 n=10)
Sampler_Check/50_keys-16 8.694n ± 2% 8.840n ± 2% ~ (p=0.280 n=10)
Sampler_Check/100_keys-16 8.570n ± 2% 8.634n ± 2% ~ (p=0.247 n=10)
Sampler_CheckWithHook/7_keys-16 83.64n ± 25% 86.54n ± 21% ~ (p=0.424 n=10)
Sampler_CheckWithHook/50_keys-16 83.19n ± 25% 85.87n ± 22% ~ (p=0.543 n=10)
Sampler_CheckWithHook/100_keys-16 83.09n ± 25% 85.62n ± 22% ~ (p=0.645 n=10)
TeeCheck-16 71.46n ± 6% 70.75n ± 4% ~ (p=0.280 n=10)
PendingDemotion10000-16 97.71n ± 0% 97.38n ± 0% -0.33% (p=0.000 n=10)
PoolBatchInsert10000-16 669.1m ± 0% 668.2m ± 0% -0.13% (p=0.001 n=10)
PoolBatchLocalInsert10000-16 732.6m ± 0% 730.6m ± 0% -0.28% (p=0.000 n=10)
ParseBigBytes-16 1.226µ ± 1% 1.216µ ± 1% -0.82% (p=0.017 n=10)
GenerateKeyP256-16 14.94µ ± 0% 14.94µ ± 0% ~ (p=0.811 n=10)
GenSharedKeyP256-16 52.68µ ± 0% 52.65µ ± 0% -0.07% (p=0.002 n=10)
GenSharedKeyS256-16 51.85µ ± 0% 51.91µ ± 0% +0.12% (p=0.004 n=10)
Arc-16 1.867µ ± 0% 1.869µ ± 1% ~ (p=0.224 n=10)
Polygon-16 3.568µ ± 1% 3.602µ ± 0% +0.95% (p=0.000 n=10)
ScopeTaggedNoCachedSubscopes-16 2.491µ ± 2% 2.548µ ± 1% +2.29% (p=0.008 n=10)
HistogramAllocation-16 1.226µ ± 1% 1.207µ ± 2% ~ (p=0.072 n=10)
Broker_Open-16 68.99µ ± 4% 63.48µ ± 3% -7.99% (p=0.000 n=10)
Broker_No_Metrics_Open-16 50.92µ ± 20% 58.11µ ± 12% +14.14% (p=0.023 n=10)
Hash8K-16 19.58µ ± 0% 19.58µ ± 0% ~ (p=0.196 n=10)
LouvainDirectedMultiplex-16 11.88m ± 1% 11.48m ± 0% -3.29% (p=0.000 n=10)
Bindata-16 130.8m ± 1% 131.2m ± 1% ~ (p=0.218 n=10)
DecodehealingTracker-16 394.2n ± 0% 388.9n ± 0% -1.36% (p=0.000 n=10)
AppendMsgResyncTargetsInfo-16 4.468n ± 0% 4.484n ± 0% +0.35% (p=0.050 n=10)
DataUpdateTracker-16 1.517µ ± 1% 1.518µ ± 0% ~ (p=0.641 n=10)
MarshalMsgdataUsageCacheInfo-16 52.27n ± 3% 51.82n ± 4% ~ (p=0.481 n=10)
Run/10k/1-16 15.00 ± 1% 14.94 ± 1% ~ (p=0.247 n=10)
Run/10k/16-16 2.777 ± 5% 2.959 ± 4% +6.57% (p=0.002 n=10)
OpDiv128-16 60.69n ± 2% 59.25n ± 1% -2.36% (p=0.005 n=10)
DirectSend-16 349.1n ± 1% 349.6n ± 0% ~ (p=0.578 n=10)
ParallelDirectSend-16 358.2n ± 1% 357.7n ± 4% ~ (p=1.000 n=10)
ParallelBrodcast-16 517.5n ± 2% 516.1n ± 3% ~ (p=0.197 n=10)
MuxBrodcast-16 506.8n ± 4% 504.9n ± 3% ~ (p=0.684 n=10)
WalkAllBreadthFirstGnp_10_tenth-16 2.159µ ± 1% 2.154µ ± 0% ~ (p=0.616 n=10)
WalkAllBreadthFirstGnp_1000_tenth-16 6.449m ± 0% 6.463m ± 0% +0.22% (p=0.015 n=10)
Decode/large-doc-16 1.528m ± 0% 1.483m ± 1% -2.99% (p=0.000 n=10)
SeparateTestAndAdd-16 547.6n ± 1% 547.6n ± 2% ~ (p=0.928 n=10)
CombinedTestAndAdd-16 488.1n ± 1% 484.4n ± 1% ~ (p=0.247 n=10)
HashimotoLight-16 814.8µ ± 0% 813.2µ ± 1% ~ (p=0.089 n=10)
BleveIndexBatch100-16 3.874 ± 1% 3.984 ± 1% +2.85% (p=0.001 n=10)
CockroachDBkv0/nodes=1-8 74.61µ ± 3% 74.25µ ± 2% ~ (p=0.481 n=10)
CockroachDBkv50/nodes=1-8 66.88µ ± 4% 66.76µ ± 36% ~ (p=1.000 n=10)
CockroachDBkv95/nodes=1-8 47.58µ ± 16% 47.17µ ± 18% ~ (p=0.912 n=10)
CockroachDBkv0/nodes=3-8 74.77µ ± 4% 74.57µ ± 3% ~ (p=0.912 n=10)
CockroachDBkv50/nodes=3-8 66.77µ ± 2% 65.65µ ± 41% ~ (p=0.912 n=10)
CockroachDBkv95/nodes=3-8 47.73µ ± 15% 46.74µ ± 2% -2.07% (p=0.023 n=10)
ESBuildThreeJS-16 259.5m ± 1% 260.3m ± 1% ~ (p=0.579 n=10)
ESBuildRomeTS-16 79.02m ± 1% 79.29m ± 1% ~ (p=0.529 n=10)
EtcdPut-16 12.43m ± 2% 12.43m ± 3% ~ (p=0.579 n=10)
EtcdSTM-16 65.69m ± 1% 64.66m ± 2% ~ (p=0.063 n=10)
GoBuildKubelet-16 26.70 ± 1% 26.89 ± 1% +0.69% (p=0.007 n=10)
GoBuildKubeletLink-16 5.725 ± 1% 5.709 ± 0% ~ (p=0.190 n=10)
GoBuildIstioctl-16 22.95 ± 1% 23.05 ± 0% ~ (p=0.123 n=10)
GoBuildIstioctlLink-16 3.929 ± 3% 3.941 ± 2% ~ (p=0.529 n=10)
GoBuildFrontend-16 9.161 ± 0% 9.193 ± 1% ~ (p=0.075 n=10)
GoBuildFrontendLink-16 948.3m ± 1% 944.6m ± 1% ~ (p=0.579 n=10)
GopherLuaKNucleotide-16 15.61 ± 0% 15.57 ± 0% ~ (p=0.143 n=10)
MarkdownRenderXHTML-16 147.8m ± 0% 144.7m ± 1% -2.11% (p=0.000 n=10)
Tile38QueryLoad-16 353.7µ ± 1% 335.0µ ± 1% -5.28% (p=0.000 n=10)
geomean 61.02µ 60.89µ -0.22%
│ baseline │ experiment │
│ B/s │ B/s vs base │
Growth_MultiSegment-16 92.47Mi ± 0% 93.40Mi ± 0% +1.01% (p=0.000 n=10)
Hash8K-16 398.9Mi ± 0% 399.0Mi ± 0% ~ (p=0.196 n=10)
Bindata-16 50.04Mi ± 1% 49.92Mi ± 1% ~ (p=0.209 n=10)
DecodehealingTracker-16 752.2Mi ± 0% 762.6Mi ± 0% +1.38% (p=0.000 n=10)
AppendMsgResyncTargetsInfo-16 2.084Gi ± 0% 2.077Gi ± 0% ~ (p=0.063 n=10)
DataUpdateTracker-16 644.5Ki ± 0% 644.5Ki ± 0% ~ (p=1.000 n=10) ¹
geomean 110.9Mi 111.3Mi +0.30%
¹ all samples are equal
│ baseline │ experiment │
│ B/op │ B/op vs base │
Growth_MultiSegment-16 1.572Mi ± 0% 1.572Mi ± 0% ~ (p=0.897 n=10)
HashFixedSize/10K-16 6.046Mi ± 0% 6.048Mi ± 0% +0.03% (p=0.000 n=10)
CommitAfterHashFixedSize/10K-16 7.352Mi ± 0% 7.360Mi ± 0% ~ (p=0.247 n=10)
Listener-16 16.00 ± 0% 16.00 ± 0% ~ (p=1.000 n=10)
Encoding4KBVerySparse-16 9.750Ki ± 0% 9.750Ki ± 0% ~ (p=1.000 n=10) ¹
HistogramAllocation-16 1.152Ki ± 0% 1.152Ki ± 0% ~ (p=1.000 n=10) ¹
Bindata-16 183.0Mi ± 0% 183.0Mi ± 0% -0.00% (p=0.025 n=10)
DecodehealingTracker-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹
AppendMsgResyncTargetsInfo-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹
DataUpdateTracker-16 277.0 ± 0% 276.0 ± 0% -0.36% (p=0.028 n=10)
MarshalMsgdataUsageCacheInfo-16 96.00 ± 0% 96.00 ± 0% ~ (p=1.000 n=10) ¹
geomean ² -0.02% ²
¹ all samples are equal
² summaries must be >0 to compute geomean
│ baseline │ experiment │
│ allocs/op │ allocs/op vs base │
Growth_MultiSegment-16 22.00 ± 0% 22.00 ± 0% ~ (p=1.000 n=10) ¹
HashFixedSize/10K-16 77.20k ± 0% 77.21k ± 0% +0.01% (p=0.000 n=10)
CommitAfterHashFixedSize/10K-16 79.55k ± 0% 79.55k ± 0% ~ (p=0.132 n=10)
Listener-16 1.000 ± 0% 1.000 ± 0% ~ (p=1.000 n=10) ¹
Encoding4KBVerySparse-16 15.00 ± 0% 15.00 ± 0% ~ (p=1.000 n=10) ¹
HistogramAllocation-16 20.00 ± 0% 20.00 ± 0% ~ (p=1.000 n=10) ¹
Bindata-16 5.806k ± 0% 5.799k ± 0% -0.12% (p=0.000 n=10)
DecodehealingTracker-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹
AppendMsgResyncTargetsInfo-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹
DataUpdateTracker-16 8.000 ± 0% 8.000 ± 0% ~ (p=1.000 n=10) ¹
MarshalMsgdataUsageCacheInfo-16 1.000 ± 0% 1.000 ± 0% ~ (p=1.000 n=10) ¹
geomean ² -0.01% ²
¹ all samples are equal
² summaries must be >0 to compute geomean
│ baseline │ experiment │
│ average-RSS-bytes │ average-RSS-bytes vs base │
BleveIndexBatch100-16 173.4Mi ± 1% 172.4Mi ± 1% ~ (p=0.218 n=10)
CockroachDBkv0/nodes=1-8 7.800Gi ± 2% 7.789Gi ± 4% ~ (p=0.739 n=10)
CockroachDBkv50/nodes=1-8 7.803Gi ± 2% 7.965Gi ± 3% ~ (p=0.165 n=10)
CockroachDBkv95/nodes=1-8 6.762Gi ± 3% 6.778Gi ± 1% ~ (p=0.684 n=10)
CockroachDBkv0/nodes=3-8 7.709Gi ± 3% 7.863Gi ± 4% ~ (p=0.052 n=10)
CockroachDBkv50/nodes=3-8 7.788Gi ± 3% 7.861Gi ± 2% ~ (p=0.393 n=10)
CockroachDBkv95/nodes=3-8 6.776Gi ± 4% 6.711Gi ± 1% ~ (p=0.218 n=10)
EtcdPut-16 107.6Mi ± 2% 108.4Mi ± 2% ~ (p=0.280 n=10)
EtcdSTM-16 94.47Mi ± 1% 95.75Mi ± 1% +1.36% (p=0.001 n=10)
GopherLuaKNucleotide-16 34.65Mi ± 1% 33.81Mi ± 2% -2.42% (p=0.003 n=10)
MarkdownRenderXHTML-16 19.06Mi ± 3% 18.88Mi ± 3% -0.98% (p=0.017 n=10)
Tile38QueryLoad-16 6.047Gi ± 1% 5.570Gi ± 2% -7.89% (p=0.000 n=10)
geomean 1.004Gi 1022.8Mi -0.50%
│ baseline │ experiment │
│ peak-RSS-bytes │ peak-RSS-bytes vs base │
BleveIndexBatch100-16 240.8Mi ± 4% 242.4Mi ± 3% ~ (p=0.631 n=10)
CockroachDBkv0/nodes=1-8 11.50Gi ± 7% 11.30Gi ± 5% ~ (p=0.280 n=10)
CockroachDBkv50/nodes=1-8 11.22Gi ± 4% 11.36Gi ± 5% ~ (p=0.529 n=10)
CockroachDBkv95/nodes=1-8 9.579Gi ± 5% 9.683Gi ± 4% ~ (p=0.631 n=10)
CockroachDBkv0/nodes=3-8 10.96Gi ± 4% 11.47Gi ± 6% +4.64% (p=0.011 n=10)
CockroachDBkv50/nodes=3-8 11.36Gi ± 4% 11.37Gi ± 2% ~ (p=0.529 n=10)
CockroachDBkv95/nodes=3-8 9.740Gi ± 7% 9.459Gi ± 3% ~ (p=0.165 n=10)
EtcdPut-16 145.5Mi ± 4% 145.2Mi ± 2% ~ (p=0.912 n=10)
EtcdSTM-16 125.2Mi ± 4% 129.1Mi ± 3% ~ (p=0.105 n=10)
GopherLuaKNucleotide-16 39.30Mi ± 2% 39.49Mi ± 1% ~ (p=0.436 n=10)
MarkdownRenderXHTML-16 20.16Mi ± 1% 19.69Mi ± 2% -2.35% (p=0.004 n=10)
Tile38QueryLoad-16 6.313Gi ± 2% 5.731Gi ± 1% -9.23% (p=0.000 n=10)
geomean 1.325Gi 1.318Gi -0.49%
│ baseline │ experiment │
│ peak-VM-bytes │ peak-VM-bytes vs base │
BleveIndexBatch100-16 2.715Gi ± 0% 2.645Gi ± 0% -2.59% (p=0.000 n=10)
CockroachDBkv0/nodes=1-8 13.23Gi ± 4% 13.11Gi ± 4% ~ (p=0.436 n=10)
CockroachDBkv50/nodes=1-8 13.02Gi ± 4% 13.07Gi ± 5% ~ (p=0.739 n=10)
CockroachDBkv95/nodes=1-8 11.12Gi ± 4% 11.23Gi ± 4% ~ (p=0.739 n=10)
CockroachDBkv0/nodes=3-8 12.87Gi ± 3% 13.32Gi ± 4% +3.47% (p=0.011 n=10)
CockroachDBkv50/nodes=3-8 13.14Gi ± 3% 13.12Gi ± 3% ~ (p=0.529 n=10)
CockroachDBkv95/nodes=3-8 11.29Gi ± 6% 10.98Gi ± 3% ~ (p=0.190 n=10)
EtcdPut-16 11.32Gi ± 1% 11.32Gi ± 1% ~ (p=0.516 n=10)
EtcdSTM-16 11.25Gi ± 0% 11.25Gi ± 0% ~ (p=0.374 n=10)
GopherLuaKNucleotide-16 1.176Gi ± 0% 1.175Gi ± 0% -0.08% (p=0.000 n=10)
MarkdownRenderXHTML-16 1.176Gi ± 0% 1.175Gi ± 0% -0.07% (p=0.001 n=10)
Tile38QueryLoad-16 7.437Gi ± 2% 6.871Gi ± 1% -7.61% (p=0.000 n=10)
geomean 6.964Gi 6.907Gi -0.81%
│ baseline │ experiment │
│ write-avg-latency-sec │ write-avg-latency-sec vs base │
CockroachDBkv0/nodes=1-8 761.1m ± 2% 748.0m ± 3% ~ (p=0.210 n=10)
CockroachDBkv50/nodes=1-8 1.040 ± 13% 1.041 ± 61% ~ (p=0.796 n=10)
CockroachDBkv95/nodes=1-8 2.083 ± 70% 2.012 ± 83% ~ (p=0.971 n=10)
CockroachDBkv0/nodes=3-8 756.9m ± 4% 760.1m ± 3% ~ (p=0.247 n=10)
CockroachDBkv50/nodes=3-8 1.040 ± 3% 1.016 ± 67% ~ (p=0.971 n=10)
CockroachDBkv95/nodes=3-8 2.089 ± 69% 1.936 ± 14% ~ (p=0.063 n=10)
geomean 1.181 1.152 -2.40%
│ baseline │ experiment │
│ write-p100-latency-sec │ write-p100-latency-sec vs base │
CockroachDBkv0/nodes=1-8 11.81 ± 9% 11.81 ± 5% ~ (p=0.963 n=10)
CockroachDBkv50/nodes=1-8 13.42 ± 8% 12.88 ± 4% ~ (p=0.260 n=10)
CockroachDBkv95/nodes=1-8 16.64 ± 13% 15.30 ± 9% ~ (p=0.269 n=10)
CockroachDBkv0/nodes=3-8 11.54 ± 16% 11.81 ± 14% ~ (p=0.799 n=10)
CockroachDBkv50/nodes=3-8 12.88 ± 8% 13.15 ± 10% ~ (p=0.669 n=10)
CockroachDBkv95/nodes=3-8 17.18 ± 19% 14.76 ± 24% ~ (p=0.245 n=10)
geomean 13.74 13.22 -3.81%
│ baseline │ experiment │
│ write-p50-latency-sec │ write-p50-latency-sec vs base │
CockroachDBkv0/nodes=1-8 536.9m ± 6% 553.6m ± 3% ~ (p=0.873 n=10)
CockroachDBkv50/nodes=1-8 570.4m ± 41% 570.4m ± 159% ~ (p=0.672 n=10)
CockroachDBkv95/nodes=1-8 1.711 ± 96% 1.678 ± 100% ~ (p=0.809 n=10)
CockroachDBkv0/nodes=3-8 536.9m ± 6% 570.4m ± 6% ~ (p=0.179 n=10)
CockroachDBkv50/nodes=3-8 570.4m ± 6% 570.4m ± 159% ~ (p=0.135 n=10)
CockroachDBkv95/nodes=3-8 1.711 ± 96% 1.544 ± 30% ~ (p=0.099 n=10)
geomean 806.2m 802.0m -0.53%
│ baseline │ experiment │
│ write-p95-latency-sec │ write-p95-latency-sec vs base │
CockroachDBkv0/nodes=1-8 1.510 ± 7% 1.476 ± 5% ~ (p=0.584 n=10)
CockroachDBkv50/nodes=1-8 2.349 ± 9% 2.416 ± 14% ~ (p=0.900 n=10)
CockroachDBkv95/nodes=1-8 5.503 ± 22% 5.369 ± 10% ~ (p=0.808 n=10)
CockroachDBkv0/nodes=3-8 1.510 ± 7% 1.544 ± 22% ~ (p=0.570 n=10)
CockroachDBkv50/nodes=3-8 2.416 ± 6% 2.416 ± 14% ~ (p=0.078 n=10)
CockroachDBkv95/nodes=3-8 5.503 ± 27% 5.503 ± 17% ~ (p=0.538 n=10)
geomean 2.705 2.706 +0.05%
│ baseline │ experiment │
│ write-p99-latency-sec │ write-p99-latency-sec vs base │
CockroachDBkv0/nodes=1-8 9.932 ± 8% 9.664 ± 6% ~ (p=0.557 n=10)
CockroachDBkv50/nodes=1-8 11.54 ± 7% 11.01 ± 7% ~ (p=0.077 n=10)
CockroachDBkv95/nodes=1-8 11.81 ± 5% 11.27 ± 5% ~ (p=0.270 n=10)
CockroachDBkv0/nodes=3-8 9.932 ± 19% 9.932 ± 8% ~ (p=0.987 n=10)
CockroachDBkv50/nodes=3-8 11.27 ± 10% 10.74 ± 10% ~ (p=0.567 n=10)
CockroachDBkv95/nodes=3-8 11.81 ± 0% 11.81 ± 5% ~ (p=0.458 n=10)
geomean 11.02 10.71 -2.80%
│ baseline │ experiment │
│ write-ops/sec │ write-ops/sec vs base │
CockroachDBkv0/nodes=1-8 13.40k ± 3% 13.46k ± 2% ~ (p=0.481 n=10)
CockroachDBkv50/nodes=1-8 7.501k ± 4% 7.521k ± 27% ~ (p=0.971 n=10)
CockroachDBkv95/nodes=1-8 1.068k ± 19% 1.077k ± 20% ~ (p=0.754 n=10)
CockroachDBkv0/nodes=3-8 13.37k ± 4% 13.40k ± 3% ~ (p=0.912 n=10)
CockroachDBkv50/nodes=3-8 7.514k ± 2% 7.641k ± 29% ~ (p=0.912 n=10)
CockroachDBkv95/nodes=3-8 1.057k ± 17% 1.089k ± 2% +3.07% (p=0.018 n=10)
geomean 4.744k 4.796k +1.09%
│ baseline │ experiment │
│ write-ops │ write-ops vs base │
CockroachDBkv0/nodes=1-8 804.2k ± 3% 808.1k ± 2% ~ (p=0.481 n=10)
CockroachDBkv50/nodes=1-8 450.2k ± 4% 451.5k ± 27% ~ (p=1.000 n=10)
CockroachDBkv95/nodes=1-8 64.11k ± 19% 64.65k ± 20% ~ (p=0.796 n=10)
CockroachDBkv0/nodes=3-8 802.5k ± 4% 804.6k ± 3% ~ (p=0.796 n=10)
CockroachDBkv50/nodes=3-8 452.7k ± 2% 458.7k ± 29% ~ (p=0.853 n=10)
CockroachDBkv95/nodes=3-8 63.47k ± 17% 65.42k ± 2% +3.08% (p=0.019 n=10)
geomean 284.9k 287.9k +1.04%
│ baseline │ experiment │
│ read-avg-latency-sec │ read-avg-latency-sec vs base │
CockroachDBkv50/nodes=1-8 335.8m ± 26% 324.9m ± 41% ~ (p=0.247 n=10)
CockroachDBkv95/nodes=1-8 390.1m ± 7% 390.2m ± 6% ~ (p=0.971 n=10)
CockroachDBkv50/nodes=3-8 335.9m ± 5% 328.9m ± 41% ~ (p=0.159 n=10)
CockroachDBkv95/nodes=3-8 393.6m ± 3% 383.9m ± 1% ~ (p=0.079 n=10)
geomean 362.8m 355.7m -1.96%
│ baseline │ experiment │
│ read-p100-latency-sec │ read-p100-latency-sec vs base │
CockroachDBkv50/nodes=1-8 12.88 ± 12% 12.35 ± 9% ~ (p=0.259 n=10)
CockroachDBkv95/nodes=1-8 14.23 ± 6% 13.96 ± 4% ~ (p=0.314 n=10)
CockroachDBkv50/nodes=3-8 12.88 ± 8% 12.35 ± 9% ~ (p=0.851 n=10)
CockroachDBkv95/nodes=3-8 14.23 ± 6% 13.96 ± 12% ~ (p=0.575 n=10)
geomean 13.54 13.13 -3.03%
│ baseline │ experiment │
│ read-p50-latency-sec │ read-p50-latency-sec vs base │
CockroachDBkv50/nodes=1-8 302.0m ± 61% 276.8m ± 62% ~ (p=0.775 n=10)
CockroachDBkv95/nodes=1-8 213.9m ± 10% 213.9m ± 10% ~ (p=0.655 n=10)
CockroachDBkv50/nodes=3-8 302.0m ± 19% 285.2m ± 63% ~ (p=0.776 n=10)
CockroachDBkv95/nodes=3-8 209.7m ± 16% 226.5m ± 7% ~ (p=0.151 n=10)
geomean 252.9m 248.7m -1.67%
│ baseline │ experiment │
│ read-p95-latency-sec │ read-p95-latency-sec vs base │
CockroachDBkv50/nodes=1-8 738.2m ± 5% 738.2m ± 45% ~ (p=0.621 n=10)
CockroachDBkv95/nodes=1-8 1.476 ± 32% 1.476 ± 32% ~ (p=0.841 n=10)
CockroachDBkv50/nodes=3-8 738.2m ± 9% 687.9m ± 39% -6.82% (p=0.002 n=10)
CockroachDBkv95/nodes=3-8 1.476 ± 27% 1.309 ± 18% ~ (p=0.076 n=10)
geomean 1.044 995.2m -4.67%
│ baseline │ experiment │
│ read-p99-latency-sec │ read-p99-latency-sec vs base │
CockroachDBkv50/nodes=1-8 1.879 ± 11% 1.812 ± 33% ~ (p=0.926 n=10)
CockroachDBkv95/nodes=1-8 4.094 ± 18% 4.161 ± 16% ~ (p=0.638 n=10)
CockroachDBkv50/nodes=3-8 1.913 ± 9% 1.745 ± 15% ~ (p=0.100 n=10)
CockroachDBkv95/nodes=3-8 4.161 ± 16% 3.758 ± 11% ~ (p=0.071 n=10)
geomean 2.797 2.652 -5.20%
│ baseline │ experiment │
│ read-ops/sec │ read-ops/sec vs base │
CockroachDBkv50/nodes=1-8 7.440k ± 4% 7.450k ± 26% ~ (p=1.000 n=10)
CockroachDBkv95/nodes=1-8 19.94k ± 14% 20.12k ± 15% ~ (p=0.912 n=10)
CockroachDBkv50/nodes=3-8 7.455k ± 2% 7.582k ± 29% ~ (p=0.912 n=10)
CockroachDBkv95/nodes=3-8 19.90k ± 13% 20.29k ± 2% +1.97% (p=0.023 n=10)
geomean 12.18k 12.32k +1.17%
│ baseline │ experiment │
│ read-ops │ read-ops vs base │
CockroachDBkv50/nodes=1-8 446.9k ± 4% 447.3k ± 26% ~ (p=0.971 n=10)
CockroachDBkv95/nodes=1-8 1.197M ± 13% 1.207M ± 15% ~ (p=0.912 n=10)
CockroachDBkv50/nodes=3-8 448.6k ± 2% 455.2k ± 28% ~ (p=0.853 n=10)
CockroachDBkv95/nodes=3-8 1.195M ± 13% 1.218M ± 2% +1.96% (p=0.023 n=10)
geomean 731.7k 739.8k +1.10%
│ baseline │ experiment │
│ p50-latency-sec │ p50-latency-sec vs base │
EtcdPut-16 12.67m ± 2% 12.55m ± 2% ~ (p=0.436 n=10)
EtcdSTM-16 50.32m ± 1% 49.63m ± 2% ~ (p=0.052 n=10)
Tile38QueryLoad-16 120.7µ ± 0% 113.8µ ± 0% -5.71% (p=0.000 n=10)
geomean 4.253m 4.138m -2.70%
│ baseline │ experiment │
│ p90-latency-sec │ p90-latency-sec vs base │
EtcdPut-16 17.29m ± 3% 17.09m ± 2% ~ (p=0.089 n=10)
EtcdSTM-16 132.7m ± 1% 130.1m ± 3% ~ (p=0.063 n=10)
Tile38QueryLoad-16 455.0µ ± 1% 407.9µ ± 1% -10.36% (p=0.000 n=10)
geomean 10.15m 9.679m -4.61%
│ baseline │ experiment │
│ p99-latency-sec │ p99-latency-sec vs base │
EtcdPut-16 22.64m ± 6% 22.39m ± 9% ~ (p=0.631 n=10)
EtcdSTM-16 273.0m ± 1% 270.5m ± 3% ~ (p=0.218 n=10)
Tile38QueryLoad-16 3.785m ± 1% 3.730m ± 2% -1.46% (p=0.005 n=10)
geomean 28.60m 28.27m -1.16%
│ baseline │ experiment │
│ ops/s │ ops/s vs base │
EtcdPut-16 79.17k ± 2% 79.05k ± 3% ~ (p=0.631 n=10)
EtcdSTM-16 15.09k ± 1% 15.31k ± 1% ~ (p=0.075 n=10)
Tile38QueryLoad-16 33.92k ± 1% 35.82k ± 1% +5.57% (p=0.000 n=10)
geomean 34.35k 35.13k +2.28%