Back to build
Raw log | Switch to full mode | Login

repository: go branch: master builder: gotip-linux-arm64_c4ah72-perf_vs_parent runstamp: 2025-04-21T20:26:57.919737813Z goos: linux goarch: arm64 │ baseline │ experiment │ │ p99.999-sec │ p99.999-sec vs base │ GCLatency/how=stack/fluff=false-72 70.43µ ± 90% 69.92µ ± 3% ~ (p=0.394 n=6) GCLatency/how=heap/fluff=false-72 68.09µ ± 2% 68.71µ ± 3% ~ (p=0.093 n=6) GCLatency/how=global/fluff=false-72 72.08µ ± 6% 70.28µ ± 1% -2.50% (p=0.015 n=6) geomean 70.18µ 69.63µ -0.78% │ baseline │ experiment │ │ p99.9999-sec │ p99.9999-sec vs base │ GCLatency/how=stack/fluff=false-72 101.3µ ± 131% 113.1µ ± 4% ~ (p=0.065 n=6) GCLatency/how=heap/fluff=false-72 99.79µ ± 5% 109.05µ ± 8% +9.27% (p=0.002 n=6) GCLatency/how=global/fluff=false-72 332.8µ ± 5% 363.2µ ± 25% +9.12% (p=0.002 n=6) geomean 149.9µ 164.8µ +9.98% │ baseline │ experiment │ │ total-bytes │ total-bytes vs base │ Ethereum_trie 6.806Mi ± 0% 6.833Mi ± 0% +0.39% (n=1) Gtank_blake2s 4.045Mi ± 0% 4.069Mi ± 0% +0.60% (n=1) Ethereum_corevm 6.510Mi ± 0% 6.534Mi ± 0% +0.36% (n=1) Uber_zap 7.038Mi ± 0% 7.062Mi ± 0% +0.35% (n=1) Shopify_sarama 11.27Mi ± 0% 11.30Mi ± 0% +0.22% (n=1) Gonum_topo 4.113Mi ± 0% 4.137Mi ± 0% +0.60% (n=1) Ajstarks_deck_generate 3.717Mi ± 0% 3.741Mi ± 0% +0.66% (n=1) Dustin_humanize 4.129Mi ± 0% 4.153Mi ± 0% +0.60% (n=1) K8s_cache 14.77Mi ± 0% 14.79Mi ± 0% +0.17% (n=1) Benhoyt_goawk_1_18 5.576Mi ± 0% 5.600Mi ± 0% +0.44% (n=1) Gonum_lapack_native 5.796Mi ± 0% 5.821Mi ± 0% +0.43% (n=1) K8s_workqueue 8.476Mi ± 0% 8.501Mi ± 0% +0.29% (n=1) Gonum_mat 6.372Mi ± 0% 6.396Mi ± 0% +0.37% (n=1) Bloom_bloom 4.496Mi ± 0% 4.520Mi ± 0% +0.55% (n=1) Aws_restxml 11.85Mi ± 0% 11.88Mi ± 0% +0.21% (n=1) Wazero 7.543Mi ± 0% 7.568Mi ± 0% +0.33% (n=1) Semver 4.123Mi ± 0% 4.148Mi ± 0% +0.59% (n=1) Ethereum_ethash 9.763Mi ± 0% 9.786Mi ± 0% +0.24% (n=1) Gonum_path 4.259Mi ± 0% 4.282Mi ± 0% +0.56% (n=1) Ethereum_bitutil 3.818Mi ± 0% 3.842Mi ± 0% +0.64% (n=1) Ethereum_core 13.85Mi ± 0% 13.87Mi ± 0% +0.17% (n=1) Ericlagergren_decimal 4.139Mi ± 0% 4.163Mi ± 0% +0.58% (n=1) Gonum_blas_native 4.810Mi ± 0% 4.834Mi ± 0% +0.51% (n=1) Gonum_traverse 3.867Mi ± 0% 3.891Mi ± 0% +0.63% (n=1) Spexs2 4.121Mi ± 0% 4.145Mi ± 0% +0.59% (n=1) Minio 99.99Mi ± 0% 100.01Mi ± 0% +0.02% (n=1) Capnproto2 4.751Mi ± 0% 4.776Mi ± 0% +0.53% (n=1) Kanzi 4.136Mi ± 0% 4.161Mi ± 0% +0.59% (n=1) Aws_jsonutil 7.355Mi ± 0% 7.380Mi ± 0% +0.34% (n=1) Dustin_broadcast 3.683Mi ± 0% 3.707Mi ± 0% +0.66% (n=1) Uber_tally 5.894Mi ± 0% 5.919Mi ± 0% +0.42% (n=1) Cespare_xxhash 3.645Mi ± 0% 3.670Mi ± 0% +0.67% (n=1) Cespare_mph 3.650Mi ± 0% 3.674Mi ± 0% +0.66% (n=1) Toml 5.976Mi ± 0% 6.001Mi ± 0% +0.41% (n=1) Aws_restjson 11.79Mi ± 0% 11.82Mi ± 0% +0.21% (n=1) Bindata 11.06Mi ± 0% 11.09Mi ± 0% +0.22% (n=1) Ethereum_ecies 4.513Mi ± 0% 4.532Mi ± 0% +0.43% (n=1) Aws_jsonrpc 11.52Mi ± 0% 11.54Mi ± 0% +0.21% (n=1) Gonum_community 4.413Mi ± 0% 4.437Mi ± 0% +0.55% (n=1) Commonmark_markdown 5.218Mi ± 0% 5.243Mi ± 0% +0.47% (n=1) Hugo_hugolib 43.54Mi ± 0% 43.57Mi ± 0% +0.05% (n=1) geomean 6.621Mi 6.649Mi +0.43% │ baseline │ experiment │ │ text-bytes │ text-bytes vs base │ Ethereum_trie 2.187Mi ± 0% 2.198Mi ± 0% +0.49% (n=1) Gtank_blake2s 1.249Mi ± 0% 1.256Mi ± 0% +0.55% (n=1) Ethereum_corevm 2.032Mi ± 0% 2.039Mi ± 0% +0.34% (n=1) Uber_zap 2.176Mi ± 0% 2.183Mi ± 0% +0.32% (n=1) Shopify_sarama 3.744Mi ± 0% 3.751Mi ± 0% +0.18% (n=1) Gonum_topo 1.249Mi ± 0% 1.256Mi ± 0% +0.55% (n=1) Ajstarks_deck_generate 1.112Mi ± 0% 1.119Mi ± 0% +0.62% (n=1) Dustin_humanize 1.270Mi ± 0% 1.277Mi ± 0% +0.54% (n=1) K8s_cache 5.121Mi ± 0% 5.128Mi ± 0% +0.13% (n=1) Benhoyt_goawk_1_18 1.781Mi ± 0% 1.788Mi ± 0% +0.39% (n=1) Gonum_lapack_native 1.945Mi ± 0% 1.952Mi ± 0% +0.35% (n=1) K8s_workqueue 2.647Mi ± 0% 2.653Mi ± 0% +0.26% (n=1) Gonum_mat 2.220Mi ± 0% 2.227Mi ± 0% +0.31% (n=1) Bloom_bloom 1.404Mi ± 0% 1.411Mi ± 0% +0.49% (n=1) Aws_restxml 4.093Mi ± 0% 4.100Mi ± 0% +0.17% (n=1) Wazero 2.374Mi ± 0% 2.381Mi ± 0% +0.29% (n=1) Semver 1.274Mi ± 0% 1.281Mi ± 0% +0.54% (n=1) Ethereum_ethash 3.108Mi ± 0% 3.115Mi ± 0% +0.22% (n=1) Gonum_path 1.297Mi ± 0% 1.304Mi ± 0% +0.53% (n=1) Ethereum_bitutil 1.153Mi ± 0% 1.160Mi ± 0% +0.60% (n=1) Ethereum_core 4.545Mi ± 0% 4.552Mi ± 0% +0.15% (n=1) Ericlagergren_decimal 1.255Mi ± 0% 1.262Mi ± 0% +0.55% (n=1) Gonum_blas_native 1.582Mi ± 0% 1.589Mi ± 0% +0.43% (n=1) Gonum_traverse 1.153Mi ± 0% 1.160Mi ± 0% +0.60% (n=1) Spexs2 1.271Mi ± 0% 1.278Mi ± 0% +0.54% (n=1) Minio 29.61Mi ± 0% 29.61Mi ± 0% +0.02% (n=1) Capnproto2 1.471Mi ± 0% 1.478Mi ± 0% +0.47% (n=1) Kanzi 1.246Mi ± 0% 1.253Mi ± 0% +0.55% (n=1) Aws_jsonutil 2.495Mi ± 0% 2.502Mi ± 0% +0.28% (n=1) Dustin_broadcast 1.106Mi ± 0% 1.113Mi ± 0% +0.62% (n=1) Uber_tally 1.748Mi ± 0% 1.755Mi ± 0% +0.39% (n=1) Cespare_xxhash 1.090Mi ± 0% 1.097Mi ± 0% +0.63% (n=1) Cespare_mph 1.096Mi ± 0% 1.103Mi ± 0% +0.63% (n=1) Toml 1.874Mi ± 0% 1.881Mi ± 0% +0.37% (n=1) Aws_restjson 4.065Mi ± 0% 4.072Mi ± 0% +0.17% (n=1) Bindata 1.427Mi ± 0% 1.434Mi ± 0% +0.48% (n=1) Ethereum_ecies 1.372Mi ± 0% 1.375Mi ± 0% +0.22% (n=1) Aws_jsonrpc 3.952Mi ± 0% 3.959Mi ± 0% +0.17% (n=1) Gonum_community 1.378Mi ± 0% 1.385Mi ± 0% +0.50% (n=1) Commonmark_markdown 1.586Mi ± 0% 1.593Mi ± 0% +0.43% (n=1) Hugo_hugolib 17.23Mi ± 0% 17.24Mi ± 0% +0.04% (n=1) geomean 2.051Mi 2.059Mi +0.39% │ baseline │ experiment │ │ data-bytes │ data-bytes vs base │ Ethereum_trie 1.189Mi ± 0% 1.192Mi ± 0% +0.23% (n=1) Gtank_blake2s 686.3Ki ± 0% 689.1Ki ± 0% +0.41% (n=1) Ethereum_corevm 1.172Mi ± 0% 1.175Mi ± 0% +0.24% (n=1) Uber_zap 1.352Mi ± 0% 1.355Mi ± 0% +0.20% (n=1) Shopify_sarama 1.990Mi ± 0% 1.993Mi ± 0% +0.14% (n=1) Gonum_topo 734.8Ki ± 0% 737.6Ki ± 0% +0.39% (n=1) Ajstarks_deck_generate 666.9Ki ± 0% 669.8Ki ± 0% +0.44% (n=1) Dustin_humanize 719.9Ki ± 0% 722.7Ki ± 0% +0.39% (n=1) K8s_cache 2.540Mi ± 0% 2.543Mi ± 0% +0.11% (n=1) Benhoyt_goawk_1_18 1023.1Ki ± 0% 1026.0Ki ± 0% +0.28% (n=1) Gonum_lapack_native 1.080Mi ± 0% 1.082Mi ± 0% +0.26% (n=1) K8s_workqueue 1.491Mi ± 0% 1.494Mi ± 0% +0.19% (n=1) Gonum_mat 1008.4Ki ± 0% 1011.3Ki ± 0% +0.28% (n=1) Bloom_bloom 764.9Ki ± 0% 767.7Ki ± 0% +0.37% (n=1) Aws_restxml 2.552Mi ± 0% 2.555Mi ± 0% +0.11% (n=1) Wazero 1.291Mi ± 0% 1.294Mi ± 0% +0.22% (n=1) Semver 713.5Ki ± 0% 716.3Ki ± 0% +0.40% (n=1) Ethereum_ethash 1.880Mi ± 0% 1.883Mi ± 0% +0.15% (n=1) Gonum_path 769.5Ki ± 0% 772.3Ki ± 0% +0.37% (n=1) Ethereum_bitutil 661.2Ki ± 0% 664.0Ki ± 0% +0.43% (n=1) Ethereum_core 2.696Mi ± 0% 2.699Mi ± 0% +0.10% (n=1) Ericlagergren_decimal 706.7Ki ± 0% 709.5Ki ± 0% +0.40% (n=1) Gonum_blas_native 857.0Ki ± 0% 859.8Ki ± 0% +0.33% (n=1) Gonum_traverse 689.2Ki ± 0% 692.0Ki ± 0% +0.41% (n=1) Spexs2 702.8Ki ± 0% 705.6Ki ± 0% +0.41% (n=1) Minio 30.47Mi ± 0% 30.48Mi ± 0% +0.01% (n=1) Capnproto2 848.5Ki ± 0% 851.4Ki ± 0% +0.34% (n=1) Kanzi 696.2Ki ± 0% 699.0Ki ± 0% +0.41% (n=1) Aws_jsonutil 1.777Mi ± 0% 1.779Mi ± 0% +0.16% (n=1) Dustin_broadcast 647.7Ki ± 0% 650.6Ki ± 0% +0.44% (n=1) Uber_tally 1.173Mi ± 0% 1.175Mi ± 0% +0.24% (n=1) Cespare_xxhash 641.3Ki ± 0% 644.2Ki ± 0% +0.44% (n=1) Cespare_mph 641.2Ki ± 0% 644.1Ki ± 0% +0.45% (n=1) Toml 1.159Mi ± 0% 1.162Mi ± 0% +0.25% (n=1) Aws_restjson 2.549Mi ± 0% 2.552Mi ± 0% +0.11% (n=1) Bindata 7.303Mi ± 0% 7.306Mi ± 0% +0.04% (n=1) Ethereum_ecies 833.9Ki ± 0% 836.8Ki ± 0% +0.34% (n=1) Aws_jsonrpc 2.482Mi ± 0% 2.485Mi ± 0% +0.11% (n=1) Gonum_community 775.9Ki ± 0% 778.8Ki ± 0% +0.37% (n=1) Commonmark_markdown 1016.6Ki ± 0% 1019.5Ki ± 0% +0.28% (n=1) Hugo_hugolib 9.137Mi ± 0% 9.140Mi ± 0% +0.03% (n=1) geomean 1.252Mi 1.255Mi +0.27% │ baseline │ experiment │ │ rodata-bytes │ rodata-bytes vs base │ Ethereum_trie 990.4Ki ± 0% 993.3Ki ± 0% +0.29% (n=1) Gtank_blake2s 559.7Ki ± 0% 562.5Ki ± 0% +0.50% (n=1) Ethereum_corevm 960.0Ki ± 0% 962.9Ki ± 0% +0.30% (n=1) Uber_zap 1.019Mi ± 0% 1.021Mi ± 0% +0.27% (n=1) Shopify_sarama 1.716Mi ± 0% 1.719Mi ± 0% +0.16% (n=1) Gonum_topo 597.6Ki ± 0% 600.5Ki ± 0% +0.48% (n=1) Ajstarks_deck_generate 542.1Ki ± 0% 545.0Ki ± 0% +0.54% (n=1) Dustin_humanize 592.7Ki ± 0% 595.5Ki ± 0% +0.47% (n=1) K8s_cache 2.139Mi ± 0% 2.142Mi ± 0% +0.13% (n=1) Benhoyt_goawk_1_18 841.9Ki ± 0% 844.8Ki ± 0% +0.34% (n=1) Gonum_lapack_native 793.1Ki ± 0% 795.9Ki ± 0% +0.36% (n=1) K8s_workqueue 1.161Mi ± 0% 1.164Mi ± 0% +0.24% (n=1) Gonum_mat 839.2Ki ± 0% 842.0Ki ± 0% +0.34% (n=1) Bloom_bloom 636.9Ki ± 0% 639.7Ki ± 0% +0.44% (n=1) Aws_restxml 2.194Mi ± 0% 2.197Mi ± 0% +0.13% (n=1) Wazero 1.097Mi ± 0% 1.100Mi ± 0% +0.26% (n=1) Semver 586.2Ki ± 0% 589.1Ki ± 0% +0.49% (n=1) Ethereum_ethash 1.496Mi ± 0% 1.499Mi ± 0% +0.19% (n=1) Gonum_path 615.7Ki ± 0% 618.5Ki ± 0% +0.46% (n=1) Ethereum_bitutil 535.5Ki ± 0% 538.3Ki ± 0% +0.53% (n=1) Ethereum_core 2.281Mi ± 0% 2.283Mi ± 0% +0.12% (n=1) Ericlagergren_decimal 578.7Ki ± 0% 581.5Ki ± 0% +0.49% (n=1) Gonum_blas_native 652.2Ki ± 0% 655.0Ki ± 0% +0.43% (n=1) Gonum_traverse 560.0Ki ± 0% 562.9Ki ± 0% +0.51% (n=1) Spexs2 576.3Ki ± 0% 579.1Ki ± 0% +0.50% (n=1) Minio 29.42Mi ± 0% 29.42Mi ± 0% +0.01% (n=1) Capnproto2 717.2Ki ± 0% 720.1Ki ± 0% +0.40% (n=1) Kanzi 556.4Ki ± 0% 559.3Ki ± 0% +0.51% (n=1) Aws_jsonutil 1.452Mi ± 0% 1.455Mi ± 0% +0.20% (n=1) Dustin_broadcast 523.3Ki ± 0% 526.2Ki ± 0% +0.54% (n=1) Uber_tally 867.9Ki ± 0% 870.7Ki ± 0% +0.33% (n=1) Cespare_xxhash 517.2Ki ± 0% 520.0Ki ± 0% +0.55% (n=1) Cespare_mph 516.5Ki ± 0% 519.4Ki ± 0% +0.56% (n=1) Toml 1.030Mi ± 0% 1.033Mi ± 0% +0.28% (n=1) Aws_restjson 2.192Mi ± 0% 2.195Mi ± 0% +0.13% (n=1) Bindata 641.7Ki ± 0% 644.6Ki ± 0% +0.45% (n=1) Ethereum_ecies 621.5Ki ± 0% 624.3Ki ± 0% +0.46% (n=1) Aws_jsonrpc 2.126Mi ± 0% 2.129Mi ± 0% +0.13% (n=1) Gonum_community 619.7Ki ± 0% 622.5Ki ± 0% +0.46% (n=1) Commonmark_markdown 870.1Ki ± 0% 873.0Ki ± 0% +0.33% (n=1) Hugo_hugolib 8.384Mi ± 0% 8.387Mi ± 0% +0.03% (n=1) geomean 993.4Ki 996.9Ki +0.35% │ baseline │ experiment │ │ pclntab-bytes │ pclntab-bytes vs base │ Ethereum_trie 1.536Mi ± 0% 1.542Mi ± 0% +0.42% (n=1) Gtank_blake2s 909.6Ki ± 0% 916.2Ki ± 0% +0.72% (n=1) Ethereum_corevm 1.483Mi ± 0% 1.490Mi ± 0% +0.44% (n=1) Uber_zap 1.546Mi ± 0% 1.553Mi ± 0% +0.44% (n=1) Shopify_sarama 2.508Mi ± 0% 2.515Mi ± 0% +0.27% (n=1) Gonum_topo 916.9Ki ± 0% 923.5Ki ± 0% +0.72% (n=1) Ajstarks_deck_generate 833.2Ki ± 0% 839.7Ki ± 0% +0.79% (n=1) Dustin_humanize 923.4Ki ± 0% 930.0Ki ± 0% +0.71% (n=1) K8s_cache 3.362Mi ± 0% 3.369Mi ± 0% +0.21% (n=1) Benhoyt_goawk_1_18 1.208Mi ± 0% 1.215Mi ± 0% +0.54% (n=1) Gonum_lapack_native 1.145Mi ± 0% 1.151Mi ± 0% +0.56% (n=1) K8s_workqueue 1.966Mi ± 0% 1.973Mi ± 0% +0.35% (n=1) Gonum_mat 1.342Mi ± 0% 1.349Mi ± 0% +0.48% (n=1) Bloom_bloom 1019.4Ki ± 0% 1026.0Ki ± 0% +0.65% (n=1) Aws_restxml 2.375Mi ± 0% 2.382Mi ± 0% +0.30% (n=1) Wazero 1.751Mi ± 0% 1.758Mi ± 0% +0.38% (n=1) Semver 928.4Ki ± 0% 935.0Ki ± 0% +0.71% (n=1) Ethereum_ethash 2.156Mi ± 0% 2.163Mi ± 0% +0.32% (n=1) Gonum_path 955.5Ki ± 0% 962.0Ki ± 0% +0.68% (n=1) Ethereum_bitutil 858.9Ki ± 0% 865.5Ki ± 0% +0.77% (n=1) Ethereum_core 3.131Mi ± 0% 3.138Mi ± 0% +0.22% (n=1) Ericlagergren_decimal 935.9Ki ± 0% 942.4Ki ± 0% +0.70% (n=1) Gonum_blas_native 1.008Mi ± 0% 1.014Mi ± 0% +0.64% (n=1) Gonum_traverse 866.6Ki ± 0% 873.1Ki ± 0% +0.76% (n=1) Spexs2 933.5Ki ± 0% 940.1Ki ± 0% +0.71% (n=1) Minio 22.00Mi ± 0% 22.00Mi ± 0% +0.03% (n=1) Capnproto2 1.047Mi ± 0% 1.053Mi ± 0% +0.62% (n=1) Kanzi 899.1Ki ± 0% 905.6Ki ± 0% +0.73% (n=1) Aws_jsonutil 1.359Mi ± 0% 1.365Mi ± 0% +0.50% (n=1) Dustin_broadcast 828.8Ki ± 0% 835.4Ki ± 0% +0.79% (n=1) Uber_tally 1.275Mi ± 0% 1.282Mi ± 0% +0.53% (n=1) Cespare_xxhash 816.6Ki ± 0% 823.2Ki ± 0% +0.81% (n=1) Cespare_mph 818.6Ki ± 0% 825.2Ki ± 0% +0.80% (n=1) Toml 1.286Mi ± 0% 1.292Mi ± 0% +0.51% (n=1) Aws_restjson 2.366Mi ± 0% 2.373Mi ± 0% +0.30% (n=1) Bindata 1015.7Ki ± 0% 1022.3Ki ± 0% +0.65% (n=1) Ethereum_ecies 990.6Ki ± 0% 997.3Ki ± 0% +0.67% (n=1) Aws_jsonrpc 2.309Mi ± 0% 2.316Mi ± 0% +0.30% (n=1) Gonum_community 977.1Ki ± 0% 983.7Ki ± 0% +0.67% (n=1) Commonmark_markdown 1.139Mi ± 0% 1.145Mi ± 0% +0.56% (n=1) Hugo_hugolib 8.834Mi ± 0% 8.841Mi ± 0% +0.08% (n=1) geomean 1.402Mi 1.410Mi +0.54% │ baseline │ experiment │ │ debug-bytes │ debug-bytes vs base │ Ethereum_trie 1.530Mi ± 0% 1.535Mi ± 0% +0.37% (n=1) Gtank_blake2s 975.7Ki ± 0% 983.0Ki ± 0% +0.75% (n=1) Ethereum_corevm 1.445Mi ± 0% 1.451Mi ± 0% +0.44% (n=1) Uber_zap 1.567Mi ± 0% 1.574Mi ± 0% +0.46% (n=1) Shopify_sarama 2.509Mi ± 0% 2.516Mi ± 0% +0.27% (n=1) Gonum_topo 972.0Ki ± 0% 979.4Ki ± 0% +0.77% (n=1) Ajstarks_deck_generate 887.1Ki ± 0% 894.7Ki ± 0% +0.85% (n=1) Dustin_humanize 989.3Ki ± 0% 996.9Ki ± 0% +0.77% (n=1) K8s_cache 3.145Mi ± 0% 3.152Mi ± 0% +0.22% (n=1) Benhoyt_goawk_1_18 1.258Mi ± 0% 1.265Mi ± 0% +0.56% (n=1) Gonum_lapack_native 1.288Mi ± 0% 1.295Mi ± 0% +0.58% (n=1) K8s_workqueue 1.938Mi ± 0% 1.944Mi ± 0% +0.35% (n=1) Gonum_mat 1.447Mi ± 0% 1.454Mi ± 0% +0.44% (n=1) Bloom_bloom 1.051Mi ± 0% 1.058Mi ± 0% +0.70% (n=1) Aws_restxml 2.351Mi ± 0% 2.359Mi ± 0% +0.31% (n=1) Wazero 1.698Mi ± 0% 1.705Mi ± 0% +0.41% (n=1) Semver 983.5Ki ± 0% 990.6Ki ± 0% +0.72% (n=1) Ethereum_ethash 2.144Mi ± 0% 2.149Mi ± 0% +0.27% (n=1) Gonum_path 996.5Ki ± 0% 1003.3Ki ± 0% +0.69% (n=1) Ethereum_bitutil 922.7Ki ± 0% 930.0Ki ± 0% +0.80% (n=1) Ethereum_core 2.890Mi ± 0% 2.896Mi ± 0% +0.20% (n=1) Ericlagergren_decimal 1000.1Ki ± 0% 1007.0Ki ± 0% +0.69% (n=1) Gonum_blas_native 1.079Mi ± 0% 1.086Mi ± 0% +0.66% (n=1) Gonum_traverse 921.2Ki ± 0% 928.7Ki ± 0% +0.81% (n=1) Spexs2 989.7Ki ± 0% 996.9Ki ± 0% +0.72% (n=1) Minio 15.91Mi ± 0% 15.91Mi ± 0% +0.02% (n=1) Capnproto2 1.096Mi ± 0% 1.104Mi ± 0% +0.69% (n=1) Kanzi 977.0Ki ± 0% 984.6Ki ± 0% +0.77% (n=1) Aws_jsonutil 1.354Mi ± 0% 1.361Mi ± 0% +0.54% (n=1) Dustin_broadcast 883.0Ki ± 0% 890.3Ki ± 0% +0.82% (n=1) Uber_tally 1.331Mi ± 0% 1.338Mi ± 0% +0.53% (n=1) Cespare_xxhash 878.8Ki ± 0% 886.4Ki ± 0% +0.87% (n=1) Cespare_mph 876.4Ki ± 0% 883.4Ki ± 0% +0.81% (n=1) Toml 1.328Mi ± 0% 1.334Mi ± 0% +0.51% (n=1) Aws_restjson 2.332Mi ± 0% 2.338Mi ± 0% +0.29% (n=1) Bindata 1.047Mi ± 0% 1.054Mi ± 0% +0.68% (n=1) Ethereum_ecies 1.050Mi ± 0% 1.056Mi ± 0% +0.57% (n=1) Aws_jsonrpc 2.300Mi ± 0% 2.307Mi ± 0% +0.30% (n=1) Gonum_community 1.010Mi ± 0% 1.017Mi ± 0% +0.70% (n=1) Commonmark_markdown 1.144Mi ± 0% 1.151Mi ± 0% +0.64% (n=1) Hugo_hugolib 7.253Mi ± 0% 7.258Mi ± 0% +0.08% (n=1) geomean 1.430Mi 1.438Mi +0.55% │ baseline │ experiment │ │ sec/op │ sec/op vs base │ DirectSend-72 348.9n ± 2% 350.6n ± 4% ~ (p=0.382 n=10) ParallelDirectSend-72 387.3n ± 2% 388.1n ± 5% ~ (p=0.642 n=10) ParallelBrodcast-72 535.9n ± 1% 538.4n ± 1% ~ (p=0.912 n=10) MuxBrodcast-72 513.9n ± 3% 512.4n ± 4% ~ (p=0.812 n=10) Run/10k/1-72 14.77 ± 2% 14.68 ± 2% ~ (p=0.165 n=10) Run/10k/16-72 3.104 ± 3% 3.349 ± 3% +7.89% (p=0.000 n=10) BufferedWriteSyncer/write_file_with_buffer-72 285.5n ± 2% 290.2n ± 2% ~ (p=0.247 n=10) MultiWriteSyncer/2_discarder-72 6.776n ± 2% 6.560n ± 1% -3.20% (p=0.003 n=10) MultiWriteSyncer/4_discarder-72 7.283n ± 2% 6.969n ± 1% -4.31% (p=0.000 n=10) MultiWriteSyncer/4_discarder_with_buffer-72 262.5n ± 6% 265.6n ± 2% ~ (p=0.616 n=10) WriteSyncer/write_file_with_no_buffer-72 1.431µ ± 1% 1.428µ ± 2% ~ (p=0.617 n=10) ZapConsole-72 562.4n ± 1% 568.2n ± 1% +1.05% (p=0.045 n=10) JSONLogMarshalerFunc-72 964.7n ± 2% 877.9n ± 3% -9.00% (p=0.000 n=10) ZapJSON-72 381.1n ± 2% 401.0n ± 2% +5.22% (p=0.000 n=10) StandardJSON-72 459.1n ± 1% 493.3n ± 1% +7.47% (p=0.000 n=10) Sampler_Check/7_keys-72 23.60n ± 2% 23.18n ± 6% ~ (p=0.127 n=10) Sampler_Check/50_keys-72 3.042n ± 3% 3.079n ± 1% ~ (p=0.063 n=10) Sampler_Check/100_keys-72 2.409n ± 1% 2.414n ± 1% ~ (p=0.986 n=10) Sampler_CheckWithHook/7_keys-72 90.47n ± 6% 90.26n ± 13% ~ (p=0.617 n=10) Sampler_CheckWithHook/50_keys-72 90.08n ± 6% 89.88n ± 12% ~ (p=0.739 n=10) Sampler_CheckWithHook/100_keys-72 89.88n ± 6% 89.70n ± 12% ~ (p=0.739 n=10) TeeCheck-72 55.32n ± 7% 53.47n ± 6% ~ (p=0.393 n=10) Broker_Open-72 93.91µ ± 1% 84.05µ ± 1% -10.50% (p=0.000 n=10) Broker_No_Metrics_Open-72 54.20µ ± 13% 53.76µ ± 16% ~ (p=0.218 n=10) Arc-72 1.888µ ± 0% 1.897µ ± 0% +0.50% (p=0.037 n=10) Polygon-72 3.697µ ± 0% 3.743µ ± 1% +1.24% (p=0.000 n=10) ValidateVersionTildeFail-72 501.9n ± 2% 496.6n ± 2% ~ (p=0.190 n=10) Pi/foo=ericlagergren_(Go)/prec=100-72 107.1µ ± 0% 107.5µ ± 0% ~ (p=0.089 n=10) Pi/foo=ericlagergren_(GDA)/prec=100-72 215.6µ ± 0% 214.7µ ± 1% ~ (p=0.315 n=10) Pi/foo=shopspring/prec=100-72 399.1µ ± 3% 395.6µ ± 2% ~ (p=0.436 n=10) Pi/foo=apmckinlay/prec=100-72 1.604µ ± 1% 1.606µ ± 0% +0.12% (p=0.017 n=10) Pi/foo=go-inf/prec=100-72 101.4µ ± 2% 100.5µ ± 2% ~ (p=0.315 n=10) Pi/foo=float64/prec=100-72 3.249µ ± 0% 3.249µ ± 0% ~ (p=1.000 n=10) Hash8K-72 19.59µ ± 0% 20.51µ ± 0% +4.70% (p=0.000 n=10) ScopeTaggedNoCachedSubscopes-72 2.501µ ± 2% 2.467µ ± 1% -1.36% (p=0.043 n=10) HistogramAllocation-72 1.117µ ± 1% 1.106µ ± 1% -1.03% (p=0.027 n=10) Dgeev/Circulant10-72 20.15µ ± 0% 19.66µ ± 0% -2.40% (p=0.000 n=10) Dgeev/Circulant100-72 6.714m ± 0% 6.536m ± 0% -2.65% (p=0.000 n=10) TextMovementBetweenSegments-72 374.1µ ± 2% 373.6µ ± 1% ~ (p=0.796 n=10) Growth_MultiSegment-72 10.96m ± 0% 10.86m ± 0% -0.97% (p=0.000 n=10) Bindata-72 130.9m ± 1% 130.8m ± 1% ~ (p=0.971 n=10) PendingDemotion10000-72 97.72n ± 0% 97.23n ± 0% -0.50% (p=0.001 n=10) PoolBatchInsert10000-72 664.7m ± 0% 661.8m ± 0% -0.45% (p=0.000 n=10) PoolBatchLocalInsert10000-72 743.3m ± 1% 722.8m ± 0% -2.76% (p=0.000 n=10) GenerateKeyP256-72 15.03µ ± 1% 15.05µ ± 0% +0.13% (p=0.050 n=10) GenSharedKeyP256-72 52.73µ ± 0% 52.73µ ± 0% ~ (p=0.644 n=10) GenSharedKeyS256-72 51.94µ ± 0% 51.97µ ± 0% +0.06% (p=0.037 n=10) DecodehealingTracker-72 399.3n ± 0% 393.3n ± 0% -1.49% (p=0.000 n=10) AppendMsgResyncTargetsInfo-72 4.461n ± 0% 4.461n ± 0% ~ (p=0.897 n=10) DataUpdateTracker-72 1.556µ ± 1% 1.549µ ± 0% -0.48% (p=0.019 n=10) MarshalMsgdataUsageCacheInfo-72 70.98n ± 3% 68.87n ± 3% -2.98% (p=0.011 n=10) Invocation/interpreter/fib_for_20-72 1.922m ± 1% 1.911m ± 0% ~ (p=0.247 n=10) Invocation/interpreter/string_manipulation_size_50-72 747.6µ ± 0% 746.2µ ± 0% ~ (p=0.190 n=10) Invocation/interpreter/random_mat_mul_size_20-72 4.718m ± 1% 4.729m ± 0% ~ (p=0.579 n=10) Compilation/with_extern_cache-72 242.3µ ± 0% 244.6µ ± 0% +0.92% (p=0.002 n=10) Compilation/without_extern_cache-72 11.73m ± 1% 11.69m ± 0% -0.37% (p=0.004 n=10) ParallelizeUntil/pieces:1000,workers:10,chunkSize:1-72 192.7µ ± 1% 195.2µ ± 2% ~ (p=0.247 n=10) ParallelizeUntil/pieces:1000,workers:10,chunkSize:10-72 37.28µ ± 2% 37.30µ ± 1% ~ (p=1.000 n=10) ParallelizeUntil/pieces:1000,workers:10,chunkSize:100-72 14.14µ ± 1% 14.23µ ± 1% ~ (p=0.239 n=10) ParallelizeUntil/pieces:999,workers:10,chunkSize:13-72 29.79µ ± 2% 29.82µ ± 1% ~ (p=0.684 n=10) FPAQ-72 14.83m ± 0% 14.69m ± 0% -0.95% (p=0.000 n=10) LZ-72 671.1µ ± 5% 675.0µ ± 2% ~ (p=0.143 n=10) MTFT-72 922.7µ ± 0% 925.2µ ± 0% +0.26% (p=0.000 n=10) TarjanSCCGnp_10_tenth-72 4.165µ ± 1% 3.984µ ± 0% -4.36% (p=0.000 n=10) TarjanSCCGnp_1000_half-72 39.11m ± 1% 38.53m ± 0% -1.47% (p=0.000 n=10) Decode/large-doc-72 1.717m ± 1% 1.690m ± 1% -1.56% (p=0.000 n=10) HashFixedSize/10K-72 3.084m ± 1% 3.037m ± 1% -1.52% (p=0.005 n=10) CommitAfterHashFixedSize/10K-72 10.930m ± 1% 9.767m ± 1% -10.64% (p=0.000 n=10) Dnrm2MediumPosInc-72 1.443µ ± 0% 1.474µ ± 0% +2.15% (p=0.000 n=10) DasumMediumUnitaryInc-72 640.8n ± 0% 647.6n ± 0% +1.06% (p=0.000 n=10) ParseBigBytes-72 1.433µ ± 1% 1.420µ ± 2% ~ (p=0.101 n=10) RenderSpecNoHTML-72 4.384m ± 1% 4.152m ± 1% -5.29% (p=0.000 n=10) RenderSpec-72 4.385m ± 0% 4.164m ± 1% -5.05% (p=0.000 n=10) RenderSpecBlackFriday2-72 3.012m ± 1% 2.796m ± 2% -7.16% (p=0.000 n=10) LouvainDirectedMultiplex-72 12.20m ± 1% 11.74m ± 0% -3.75% (p=0.000 n=10) HashimotoLight-72 813.5µ ± 1% 809.9µ ± 1% ~ (p=0.393 n=10) WalkAllBreadthFirstGnp_10_tenth-72 2.274µ ± 1% 2.121µ ± 1% -6.73% (p=0.000 n=10) WalkAllBreadthFirstGnp_1000_tenth-72 6.417m ± 0% 6.344m ± 0% -1.14% (p=0.000 n=10) BuildJSON-72 2.962µ ± 1% 2.986µ ± 1% +0.79% (p=0.019 n=10) StdlibJSON-72 1.949µ ± 1% 1.936µ ± 1% ~ (p=0.183 n=10) SeparateTestAndAdd-72 312.4n ± 4% 315.8n ± 2% ~ (p=0.470 n=10) CombinedTestAndAdd-72 302.4n ± 2% 305.2n ± 1% ~ (p=0.239 n=10) Listener-72 1.181µ ± 6% 1.191µ ± 4% ~ (p=0.971 n=10) ReflectorResyncChanMany-72 557.0n ± 2% 556.9n ± 3% ~ (p=0.353 n=10) RecursiveFunc-72 9.380µ ± 2% 9.477µ ± 2% ~ (p=0.218 n=10) RegexMatch-72 688.2n ± 1% 695.3n ± 1% +1.02% (p=0.009 n=10) RepeatExecProgram-72 11.61µ ± 1% 11.67µ ± 1% +0.54% (p=0.023 n=10) RepeatNew-72 74.20n ± 1% 73.98n ± 1% -0.30% (p=0.021 n=10) RepeatIOExecProgram-72 24.39µ ± 3% 24.37µ ± 3% ~ (p=0.912 n=10) RepeatIONew-72 657.4n ± 0% 658.1n ± 2% ~ (p=0.926 n=10) FastTest2KB-72 700.5n ± 52% 696.2n ± 10% ~ (p=0.109 n=10) BaseTest2KB-72 697.3n ± 35% 696.1n ± 41% ~ (p=0.136 n=10) Encoding4KBVerySparse-72 9.614µ ± 1% 10.519µ ± 1% +9.42% (p=0.000 n=10) MulWorkspaceDense1000Hundredth-72 6.560m ± 0% 6.551m ± 0% -0.14% (p=0.007 n=10) ScaleVec10000Inc20-72 7.262µ ± 11% 7.274µ ± 9% ~ (p=0.631 n=10) OpDiv128-72 69.17n ± 2% 67.90n ± 3% ~ (p=0.315 n=10) MergeByLanguage-72 404.1n ± 0% 400.7n ± 0% -0.83% (p=0.000 n=10) ResourceChainPostProcess-72 40.04m ± 1% 39.86m ± 3% ~ (p=0.853 n=10) ReplaceShortcodeTokens-72 1.990µ ± 3% 2.177µ ± 3% +9.37% (p=0.000 n=10) BleveIndexBatch100-72 3.446 ± 1% 3.421 ± 2% -0.72% (p=0.005 n=10) CockroachDBkv0/nodes=1-36 39.27µ ± 5% 40.43µ ± 5% ~ (p=0.143 n=10) CockroachDBkv50/nodes=1-36 39.63µ ± 7% 38.85µ ± 1% -1.98% (p=0.003 n=10) CockroachDBkv95/nodes=1-36 34.23µ ± 3% 33.33µ ± 3% ~ (p=0.393 n=10) CockroachDBkv0/nodes=3-36 38.38µ ± 6% 40.21µ ± 5% ~ (p=0.315 n=10) CockroachDBkv50/nodes=3-36 39.60µ ± 2% 39.42µ ± 2% ~ (p=0.631 n=10) CockroachDBkv95/nodes=3-36 33.80µ ± 6% 34.27µ ± 5% ~ (p=0.382 n=10) ESBuildThreeJS-72 243.8m ± 1% 243.6m ± 1% ~ (p=0.684 n=10) ESBuildRomeTS-72 78.68m ± 2% 79.12m ± 1% ~ (p=0.481 n=10) EtcdPut-72 10.38m ± 10% 10.29m ± 9% ~ (p=0.579 n=10) EtcdSTM-72 60.39m ± 0% 58.41m ± 1% -3.27% (p=0.000 n=10) GoBuildKubelet-72 18.89 ± 1% 18.71 ± 1% -0.95% (p=0.005 n=10) GoBuildKubeletLink-72 5.482 ± 2% 5.507 ± 0% +0.45% (p=0.043 n=10) GoBuildIstioctl-72 17.67 ± 0% 17.56 ± 1% -0.63% (p=0.023 n=10) GoBuildIstioctlLink-72 3.530 ± 1% 3.552 ± 1% ~ (p=0.089 n=10) GoBuildFrontend-72 7.579 ± 0% 7.513 ± 1% -0.87% (p=0.003 n=10) GoBuildFrontendLink-72 860.9m ± 1% 859.9m ± 1% ~ (p=0.579 n=10) GopherLuaKNucleotide-72 15.88 ± 0% 15.78 ± 1% -0.66% (p=0.009 n=10) MarkdownRenderXHTML-72 151.8m ± 1% 149.6m ± 1% -1.45% (p=0.000 n=10) Tile38QueryLoad-72 437.4µ ± 2% 422.0µ ± 1% -3.52% (p=0.000 n=10) geomean 58.81µ 58.52µ -0.49% │ baseline │ experiment │ │ B/s │ B/s vs base │ Hash8K-72 398.8Mi ± 0% 380.9Mi ± 0% -4.49% (p=0.000 n=10) Growth_MultiSegment-72 91.23Mi ± 0% 92.12Mi ± 0% +0.98% (p=0.000 n=10) Bindata-72 50.00Mi ± 1% 50.07Mi ± 1% ~ (p=0.955 n=10) DecodehealingTracker-72 742.8Mi ± 0% 754.0Mi ± 0% +1.52% (p=0.000 n=10) AppendMsgResyncTargetsInfo-72 2.088Gi ± 0% 2.088Gi ± 0% ~ (p=0.927 n=10) DataUpdateTracker-72 625.0Ki ± 2% 634.8Ki ± 2% ~ (p=0.170 n=10) geomean 109.9Mi 109.8Mi -0.07% │ baseline │ experiment │ │ B/op │ B/op vs base │ HistogramAllocation-72 1.152Ki ± 0% 1.152Ki ± 0% ~ (p=1.000 n=10) ¹ Growth_MultiSegment-72 1.573Mi ± 0% 1.572Mi ± 0% -0.01% (p=0.000 n=10) Bindata-72 183.1Mi ± 0% 183.1Mi ± 0% ~ (p=0.063 n=10) DecodehealingTracker-72 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ AppendMsgResyncTargetsInfo-72 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ DataUpdateTracker-72 278.0 ± 0% 276.0 ± 0% -0.72% (p=0.000 n=10) MarshalMsgdataUsageCacheInfo-72 96.00 ± 0% 96.00 ± 0% ~ (p=1.000 n=10) ¹ HashFixedSize/10K-72 6.092Mi ± 0% 6.091Mi ± 0% -0.02% (p=0.000 n=10) CommitAfterHashFixedSize/10K-72 7.363Mi ± 0% 7.370Mi ± 0% ~ (p=0.315 n=10) Listener-72 16.00 ± 0% 16.00 ± 0% ~ (p=1.000 n=10) ¹ Encoding4KBVerySparse-72 9.750Ki ± 0% 9.750Ki ± 0% ~ (p=1.000 n=10) ¹ geomean ² -0.06% ² ¹ all samples are equal ² summaries must be >0 to compute geomean │ baseline │ experiment │ │ allocs/op │ allocs/op vs base │ HistogramAllocation-72 20.00 ± 0% 20.00 ± 0% ~ (p=1.000 n=10) ¹ Growth_MultiSegment-72 22.00 ± 0% 22.00 ± 0% ~ (p=1.000 n=10) Bindata-72 5.808k ± 0% 5.798k ± 0% -0.17% (p=0.000 n=10) DecodehealingTracker-72 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ AppendMsgResyncTargetsInfo-72 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ DataUpdateTracker-72 8.000 ± 0% 8.000 ± 0% ~ (p=1.000 n=10) ¹ MarshalMsgdataUsageCacheInfo-72 1.000 ± 0% 1.000 ± 0% ~ (p=1.000 n=10) ¹ HashFixedSize/10K-72 77.33k ± 0% 77.29k ± 0% -0.06% (p=0.000 n=10) CommitAfterHashFixedSize/10K-72 79.55k ± 0% 79.55k ± 0% -0.00% (p=0.000 n=10) Listener-72 1.000 ± 0% 1.000 ± 0% ~ (p=1.000 n=10) ¹ Encoding4KBVerySparse-72 15.00 ± 0% 15.00 ± 0% ~ (p=1.000 n=10) ¹ geomean ² -0.02% ² ¹ all samples are equal ² summaries must be >0 to compute geomean │ baseline │ experiment │ │ average-RSS-bytes │ average-RSS-bytes vs base │ BleveIndexBatch100-72 159.2Mi ± 1% 165.9Mi ± 2% +4.23% (p=0.000 n=10) CockroachDBkv0/nodes=1-36 6.421Gi ± 4% 6.796Gi ± 5% +5.84% (p=0.023 n=10) CockroachDBkv50/nodes=1-36 6.395Gi ± 16% 6.386Gi ± 2% ~ (p=0.353 n=10) CockroachDBkv95/nodes=1-36 4.084Gi ± 33% 2.797Gi ± 46% ~ (p=0.075 n=10) CockroachDBkv0/nodes=3-36 6.318Gi ± 7% 6.663Gi ± 6% ~ (p=0.105 n=10) CockroachDBkv50/nodes=3-36 6.320Gi ± 1% 6.386Gi ± 1% ~ (p=0.123 n=10) CockroachDBkv95/nodes=3-36 3.387Gi ± 21% 3.899Gi ± 35% ~ (p=0.853 n=10) EtcdPut-72 97.18Mi ± 3% 97.73Mi ± 2% ~ (p=0.971 n=10) EtcdSTM-72 77.98Mi ± 2% 76.77Mi ± 1% -1.55% (p=0.009 n=10) GopherLuaKNucleotide-72 34.14Mi ± 4% 35.21Mi ± 2% +3.13% (p=0.015 n=10) MarkdownRenderXHTML-72 19.12Mi ± 6% 19.12Mi ± 6% ~ (p=0.390 n=10) Tile38QueryLoad-72 5.681Gi ± 3% 5.482Gi ± 1% -3.51% (p=0.000 n=10) geomean 837.9Mi 831.5Mi -0.77% │ baseline │ experiment │ │ peak-RSS-bytes │ peak-RSS-bytes vs base │ BleveIndexBatch100-72 229.9Mi ± 2% 245.8Mi ± 5% +6.91% (p=0.000 n=10) CockroachDBkv0/nodes=1-36 9.244Gi ± 6% 9.799Gi ± 3% +6.00% (p=0.007 n=10) CockroachDBkv50/nodes=1-36 9.453Gi ± 6% 9.337Gi ± 2% ~ (p=0.105 n=10) CockroachDBkv95/nodes=1-36 5.120Gi ± 17% 4.919Gi ± 28% ~ (p=0.393 n=10) CockroachDBkv0/nodes=3-36 9.317Gi ± 4% 9.573Gi ± 4% +2.75% (p=0.023 n=10) CockroachDBkv50/nodes=3-36 9.276Gi ± 3% 9.387Gi ± 3% ~ (p=0.353 n=10) CockroachDBkv95/nodes=3-36 5.048Gi ± 21% 5.677Gi ± 16% ~ (p=0.190 n=10) EtcdPut-72 130.8Mi ± 2% 130.5Mi ± 2% ~ (p=0.697 n=10) EtcdSTM-72 105.0Mi ± 3% 104.0Mi ± 4% ~ (p=0.631 n=10) GopherLuaKNucleotide-72 37.43Mi ± 7% 37.67Mi ± 5% ~ (p=0.579 n=10) MarkdownRenderXHTML-72 19.41Mi ± 4% 19.69Mi ± 6% ~ (p=1.000 n=10) Tile38QueryLoad-72 6.368Gi ± 3% 5.875Gi ± 1% -7.73% (p=0.000 n=10) geomean 1.080Gi 1.095Gi +1.33% │ baseline │ experiment │ │ peak-VM-bytes │ peak-VM-bytes vs base │ BleveIndexBatch100-72 6.668Gi ± 0% 6.596Gi ± 0% -1.08% (p=0.000 n=10) CockroachDBkv0/nodes=1-36 13.04Gi ± 4% 13.41Gi ± 2% +2.89% (p=0.029 n=10) CockroachDBkv50/nodes=1-36 12.18Gi ± 1% 12.15Gi ± 2% ~ (p=0.393 n=10) CockroachDBkv95/nodes=1-36 7.483Gi ± 11% 7.245Gi ± 19% ~ (p=0.280 n=10) CockroachDBkv0/nodes=3-36 13.07Gi ± 2% 13.27Gi ± 2% +1.56% (p=0.043 n=10) CockroachDBkv50/nodes=3-36 12.05Gi ± 3% 12.14Gi ± 3% ~ (p=0.529 n=10) CockroachDBkv95/nodes=3-36 7.396Gi ± 15% 7.958Gi ± 12% ~ (p=0.143 n=10) EtcdPut-72 11.32Gi ± 0% 11.32Gi ± 0% ~ (p=0.156 n=10) EtcdSTM-72 11.26Gi ± 0% 11.26Gi ± 0% ~ (p=1.000 n=10) GopherLuaKNucleotide-72 1.177Gi ± 0% 1.176Gi ± 0% -0.11% (p=0.000 n=10) MarkdownRenderXHTML-72 1.176Gi ± 0% 1.177Gi ± 0% ~ (p=0.512 n=10) Tile38QueryLoad-72 7.570Gi ± 3% 7.064Gi ± 1% -6.69% (p=0.000 n=10) geomean 6.933Gi 6.938Gi +0.08% │ baseline │ experiment │ │ write-avg-latency-sec │ write-avg-latency-sec vs base │ CockroachDBkv0/nodes=1-36 110.2m ± 41% 149.7m ± 47% ~ (p=0.052 n=10) CockroachDBkv50/nodes=1-36 266.4m ± 103% 237.1m ± 10% -11.00% (p=0.002 n=10) CockroachDBkv95/nodes=1-36 82.85m ± 55% 39.50m ± 75% ~ (p=0.063 n=10) CockroachDBkv0/nodes=3-36 77.85m ± 97% 144.30m ± 48% ~ (p=0.288 n=10) CockroachDBkv50/nodes=3-36 265.1m ± 9% 259.0m ± 8% ~ (p=0.631 n=10) CockroachDBkv95/nodes=3-36 54.95m ± 56% 69.90m ± 61% ~ (p=0.739 n=10) geomean 118.4m 124.2m +4.85% │ baseline │ experiment │ │ write-p100-latency-sec │ write-p100-latency-sec vs base │ CockroachDBkv0/nodes=1-36 9.932 ± 8% 10.200 ± 11% ~ (p=0.405 n=10) CockroachDBkv50/nodes=1-36 10.74 ± 5% 10.20 ± 11% ~ (p=0.190 n=10) CockroachDBkv95/nodes=1-36 2.752 ± 59% 1.208 ± 144% ~ (p=0.148 n=10) CockroachDBkv0/nodes=3-36 10.20 ± 5% 10.20 ± 5% ~ (p=0.853 n=10) CockroachDBkv50/nodes=3-36 11.01 ± 12% 11.27 ± 10% ~ (p=0.958 n=10) CockroachDBkv95/nodes=3-36 2.047 ± 70% 2.751 ± 63% ~ (p=0.840 n=10) geomean 6.380 5.842 -8.42% │ baseline │ experiment │ │ write-p50-latency-sec │ write-p50-latency-sec vs base │ CockroachDBkv0/nodes=1-36 2.200m ± 9% 2.400m ± 8% ~ (p=0.268 n=10) CockroachDBkv50/nodes=1-36 1.600m ± 39744% 1.600m ± 0% ~ (p=0.211 n=10) CockroachDBkv95/nodes=1-36 2.500m ± 4% 2.550m ± 2% ~ (p=1.000 n=10) CockroachDBkv0/nodes=3-36 2.150m ± 7% 2.300m ± 9% ~ (p=0.146 n=10) CockroachDBkv50/nodes=3-36 1.600m ± 0% 1.600m ± 0% ~ (p=1.000 n=10) CockroachDBkv95/nodes=3-36 2.550m ± 2% 2.550m ± 2% ~ (p=1.000 n=10) geomean 2.063m 2.124m +2.95% │ baseline │ experiment │ │ write-p95-latency-sec │ write-p95-latency-sec vs base │ CockroachDBkv0/nodes=1-36 270.5m ± 97% 486.5m ± 91% ~ (p=0.206 n=10) CockroachDBkv50/nodes=1-36 805.3m ± 8% 805.3m ± 4% ~ (p=0.303 n=10) CockroachDBkv95/nodes=1-36 771.8m ± 57% 327.2m ± 98% -57.61% (p=0.030 n=10) CockroachDBkv0/nodes=3-36 21.25m ± 2268% 486.50m ± 98% ~ (p=0.539 n=10) CockroachDBkv50/nodes=3-36 805.3m ± 4% 805.3m ± 4% ~ (p=0.935 n=10) CockroachDBkv95/nodes=3-36 562.0m ± 31% 587.2m ± 66% ~ (p=0.516 n=10) geomean 342.6m 555.8m +62.24% │ baseline │ experiment │ │ write-p99-latency-sec │ write-p99-latency-sec vs base │ CockroachDBkv0/nodes=1-36 771.8m ± 9% 822.1m ± 6% ~ (p=0.096 n=10) CockroachDBkv50/nodes=1-36 10.200 ± 18% 9.127 ± 24% ~ (p=0.113 n=10) CockroachDBkv95/nodes=1-36 1442.8m ± 42% 889.2m ± 58% -38.37% (p=0.050 n=10) CockroachDBkv0/nodes=3-36 755.0m ± 11% 755.0m ± 11% ~ (p=0.895 n=10) CockroachDBkv50/nodes=3-36 10.20 ± 16% 10.20 ± 11% ~ (p=0.804 n=10) CockroachDBkv95/nodes=3-36 1.040 ± 132% 1.275 ± 79% ~ (p=0.591 n=10) geomean 2.121 2.008 -5.33% │ baseline │ experiment │ │ write-ops/sec │ write-ops/sec vs base │ CockroachDBkv0/nodes=1-36 25.47k ± 4% 24.73k ± 6% ~ (p=0.143 n=10) CockroachDBkv50/nodes=1-36 12.68k ± 6% 12.91k ± 1% +1.79% (p=0.002 n=10) CockroachDBkv95/nodes=1-36 1.476k ± 3% 1.501k ± 2% ~ (p=0.306 n=10) CockroachDBkv0/nodes=3-36 26.05k ± 6% 24.87k ± 5% ~ (p=0.315 n=10) CockroachDBkv50/nodes=3-36 12.68k ± 2% 12.75k ± 2% ~ (p=0.684 n=10) CockroachDBkv95/nodes=3-36 1.491k ± 5% 1.474k ± 5% ~ (p=0.698 n=10) geomean 7.854k 7.793k -0.78% │ baseline │ experiment │ │ write-ops │ write-ops vs base │ CockroachDBkv0/nodes=1-36 1.528M ± 4% 1.484M ± 6% ~ (p=0.143 n=10) CockroachDBkv50/nodes=1-36 761.1k ± 6% 774.7k ± 1% +1.79% (p=0.002 n=10) CockroachDBkv95/nodes=1-36 88.57k ± 3% 90.09k ± 2% ~ (p=0.315 n=10) CockroachDBkv0/nodes=3-36 1.563M ± 6% 1.492M ± 5% ~ (p=0.315 n=10) CockroachDBkv50/nodes=3-36 761.0k ± 2% 765.4k ± 2% ~ (p=0.684 n=10) CockroachDBkv95/nodes=3-36 89.50k ± 5% 88.43k ± 5% ~ (p=0.739 n=10) geomean 471.4k 467.7k -0.79% │ baseline │ experiment │ │ read-avg-latency-sec │ read-avg-latency-sec vs base │ CockroachDBkv50/nodes=1-36 25.35m ± 59% 28.55m ± 21% ~ (p=0.986 n=10) CockroachDBkv95/nodes=1-36 20.100m ± 85% 3.500m ± 477% ~ (p=0.055 n=10) CockroachDBkv50/nodes=3-36 24.45m ± 15% 24.90m ± 19% ~ (p=0.631 n=10) CockroachDBkv95/nodes=3-36 10.90m ± 232% 17.80m ± 115% ~ (p=0.645 n=10) geomean 19.20m 14.51m -24.43% │ baseline │ experiment │ │ read-p100-latency-sec │ read-p100-latency-sec vs base │ CockroachDBkv50/nodes=1-36 10.469 ± 13% 9.664 ± 6% ~ (p=0.151 n=10) CockroachDBkv95/nodes=1-36 2.752 ± 61% 1.141 ± 147% ~ (p=0.092 n=10) CockroachDBkv50/nodes=3-36 10.74 ± 10% 10.74 ± 10% ~ (p=0.815 n=10) CockroachDBkv95/nodes=3-36 1.980 ± 69% 2.617 ± 65% ~ (p=0.780 n=10) geomean 4.974 4.195 -15.66% │ baseline │ experiment │ │ read-p50-latency-sec │ read-p50-latency-sec vs base │ CockroachDBkv50/nodes=1-36 400.0µ ± 300% 400.0µ ± 0% ~ (p=0.211 n=10) CockroachDBkv95/nodes=1-36 300.0µ ± 0% 300.0µ ± 0% ~ (p=1.000 n=10) ¹ CockroachDBkv50/nodes=3-36 400.0µ ± 0% 400.0µ ± 0% ~ (p=1.000 n=10) CockroachDBkv95/nodes=3-36 300.0µ ± 0% 300.0µ ± 0% ~ (p=1.000 n=10) ¹ geomean 346.4µ 346.4µ +0.00% ¹ all samples are equal │ baseline │ experiment │ │ read-p95-latency-sec │ read-p95-latency-sec vs base │ CockroachDBkv50/nodes=1-36 22.55m ± 86% 21.50m ± 7% ~ (p=0.264 n=10) CockroachDBkv95/nodes=1-36 26250.0µ ± 124% 600.0µ ± 2867% ~ (p=0.076 n=10) CockroachDBkv50/nodes=3-36 23.60m ± 11% 22.00m ± 5% ~ (p=0.139 n=10) CockroachDBkv95/nodes=3-36 9.250m ± 489% 32.000m ± 98% ~ (p=1.000 n=10) geomean 18.96m 9.762m -48.51% │ baseline │ experiment │ │ read-p99-latency-sec │ read-p99-latency-sec vs base │ CockroachDBkv50/nodes=1-36 427.8m ± 41% 436.2m ± 8% ~ (p=0.926 n=10) CockroachDBkv95/nodes=1-36 314.55m ± 79% 68.15m ± 318% ~ (p=0.072 n=10) CockroachDBkv50/nodes=3-36 419.4m ± 4% 419.4m ± 12% ~ (p=0.660 n=10) CockroachDBkv95/nodes=3-36 134.2m ± 1400% 226.5m ± 759% ~ (p=0.780 n=10) geomean 295.0m 230.5m -21.86% │ baseline │ experiment │ │ read-ops/sec │ read-ops/sec vs base │ CockroachDBkv50/nodes=1-36 12.54k ± 6% 12.83k ± 2% +2.27% (p=0.003 n=10) CockroachDBkv95/nodes=1-36 27.73k ± 3% 28.50k ± 3% ~ (p=0.305 n=10) CockroachDBkv50/nodes=3-36 12.56k ± 3% 12.61k ± 2% ~ (p=0.529 n=10) CockroachDBkv95/nodes=3-36 28.09k ± 6% 27.71k ± 5% ~ (p=0.256 n=10) geomean 18.72k 18.91k +1.00% │ baseline │ experiment │ │ read-ops │ read-ops vs base │ CockroachDBkv50/nodes=1-36 752.8k ± 6% 769.8k ± 2% +2.27% (p=0.003 n=10) CockroachDBkv95/nodes=1-36 1.664M ± 3% 1.710M ± 3% ~ (p=0.315 n=10) CockroachDBkv50/nodes=3-36 754.0k ± 3% 756.7k ± 2% ~ (p=0.529 n=10) CockroachDBkv95/nodes=3-36 1.686M ± 6% 1.663M ± 5% ~ (p=0.247 n=10) geomean 1.123M 1.134M +1.00% │ baseline │ experiment │ │ p50-latency-sec │ p50-latency-sec vs base │ EtcdPut-72 9.996m ± 4% 10.054m ± 5% ~ (p=0.796 n=10) EtcdSTM-72 46.43m ± 0% 44.97m ± 1% -3.13% (p=0.000 n=10) Tile38QueryLoad-72 127.8µ ± 1% 121.6µ ± 0% -4.87% (p=0.000 n=10) geomean 3.900m 3.802m -2.50% │ baseline │ experiment │ │ p90-latency-sec │ p90-latency-sec vs base │ EtcdPut-72 14.92m ± 6% 14.44m ± 8% ~ (p=0.684 n=10) EtcdSTM-72 121.1m ± 0% 117.1m ± 1% -3.35% (p=0.000 n=10) Tile38QueryLoad-72 492.2µ ± 1% 423.3µ ± 1% -13.99% (p=0.000 n=10) geomean 9.617m 8.945m -6.99% │ baseline │ experiment │ │ p99-latency-sec │ p99-latency-sec vs base │ EtcdPut-72 40.29m ± 184% 26.91m ± 323% ~ (p=0.481 n=10) EtcdSTM-72 254.2m ± 1% 246.5m ± 1% -3.06% (p=0.000 n=10) Tile38QueryLoad-72 4.435m ± 2% 4.354m ± 1% -1.81% (p=0.019 n=10) geomean 35.68m 30.68m -14.02% │ baseline │ experiment │ │ ops/s │ ops/s vs base │ EtcdPut-72 95.60k ± 9% 96.39k ± 9% ~ (p=0.631 n=10) EtcdSTM-72 16.46k ± 0% 17.03k ± 1% +3.43% (p=0.000 n=10) Tile38QueryLoad-72 123.4k ± 2% 128.0k ± 1% +3.65% (p=0.000 n=10) geomean 57.92k 59.44k +2.63%