Skip to content

Commit

Permalink
add Latency Benchmark (S3 Express One Zone) (customSmallerIsBetter) b…
Browse files Browse the repository at this point in the history 
…enchmark result for 3ee6fbc
  • Loading branch information
github-action-benchmark committed Dec 18, 2024
1 parent 5dc1601 commit f0f4c97
Showing 1 changed file with 60 additions and 55 deletions.
115 changes: 60 additions & 55 deletions dev/s3-express/latency_bench/data.js
View file
Original file line number Diff line number Diff line change
@@ -1,62 +1,8 @@
window.BENCHMARK_DATA = {
"lastUpdate": 1734456114896,
"lastUpdate": 1734516666144,
"repoUrl": "https://github.com/awslabs/mountpoint-s3",
"entries": {
"Latency Benchmark (S3 Express One Zone)": [
{
"commit": {
"author": {
"email": "[email protected]",
"name": "Alessandro Passaro",
"username": "passaro"
},
"committer": {
"email": "[email protected]",
"name": "GitHub",
"username": "web-flow"
},
"distinct": true,
"id": "989f7bc6f5ff72deeb73ace3939836ae8c9e7814",
"message": "Update CRT submodules to latest releases (#1177)\n\nUpdate the CRT libraries to the latest releases. In particular, include:\n* Amazon S3 introduces support for AWS Dedicated Local Zones.\n([awslabs/aws-c-s3#465](https://github.com/awslabs/aws-c-s3/pull/465))\n \n\n<details>\n <summary>Full CRT changelog:</summary>\n \n```\nSubmodule mountpoint-s3-crt-sys/crt/aws-c-auth 48d647bf..3982bd75:\n > Update CMake to 3.9 (#255)\nSubmodule mountpoint-s3-crt-sys/crt/aws-c-cal 2cb1d2ea..fbbe2612:\n > RSA PKCS1.5 SHA1 signing (#201)\n > chore: Modified bug issue template to add checkbox to report potential regression. (#199)\n > Update CMake to 3.9 (#200)\nSubmodule mountpoint-s3-crt-sys/crt/aws-c-common f58e807d..be8ed873:\n > Fix test that made no sense (#1172)\n > Update CBMC proof tooling to latest releases (#1164)\n > Forward CMake variables to prebuilding dependencies (#1161)\n > Remove reliance on hardcoded user in ci (#1170)\n > Doc fix for cbor (#1171)\n > switch c compiler check to different cmake variable (#1169)\n > disable visibility hidden on old gcc (#1167)\n > fix empty xml node handling (#1168)\n > Unlink shutdown callback from ref count (#1166)\n > check if numa available or not before loading numa functions (#1163)\n > chore: Modified bug issue template to add checkbox to report potential regression. (#1151)\n > Update CMake to 3.9 (#1159)\n > Support Swift CXX Interop (#1160)\nSubmodule mountpoint-s3-crt-sys/crt/aws-c-compression f36d0167..c6c1191e:\n > Update CMake to 3.9 (#70)\nSubmodule mountpoint-s3-crt-sys/crt/aws-c-http 6068653e..fc3eded2:\n > Update for event loop API changes (#491)\n > Add cxx support (#490)\n > chore: Modified bug issue template to add checkbox to report potential regression. (#486)\n > Update CMake to 3.9 (#489)\n > Tweak error message for AWS_ERROR_HTTP_RESPONSE_FIRST_BYTE_TIMEOUT (#488)\nSubmodule mountpoint-s3-crt-sys/crt/aws-c-io e3637404..fcb38c80:\n > Add an Option to disable retries (#694)\n > Update checksum based on previous PR changes (#695)\n > Add ML-KEM Support (#693)\n > Event loop public api (#691)\n > Add cxx support (#689)\n > Fix s2n cleanup (#687)\n > chore: Modified bug issue template to add checkbox to report potential regression. (#671)\n > Update CMake to 3.9 (#686)\nSubmodule mountpoint-s3-crt-sys/crt/aws-c-s3 16701501..45894ed3:\n > Amazon S3 introduces support for AWS Dedicated Local Zones (#465)\n > Support trailing checksum with no signing (#459)\n > support if-none-match for upload (#462)\n > Use proper public event loop group API (#460)\n > chore: Modified bug issue template to add checkbox to report potential regression. (#452)\n > Update CMake to 3.9 (#458)\n > Support header checksum (#454)\nSubmodule mountpoint-s3-crt-sys/crt/aws-c-sdkutils 4658412a..ce09f797:\n > Add cxx support (#48)\n > chore: Modified bug issue template to add checkbox to report potential regression. (#45)\n > Update CMake to 3.9 (#47)\nSubmodule mountpoint-s3-crt-sys/crt/aws-checksums ce04ab00..3e4101b9:\n > fix predefines for bswap for old compilers (#99)\n > CRC big endian support (#97)\n > chore: Modified bug issue template to add checkbox to report potential regression. (#95)\n > Update CMake to 3.9 (#98)\nSubmodule mountpoint-s3-crt-sys/crt/aws-lc 8b2ebfcf..59828538:\n > Prepare for v1.40.0 release (#2019)\n > [EC] Use s2n-bignum point doubling for P-384 and P-521 (#2011)\n > Document TLS Server Renegotiation Behavior (#2018)\n > Fail FIPS rsa_keygen_pubexp on change (#2016)\n > Adding -verify and expanding -x509 options for our OpenSSL tool (#1951)\n > Upstream merge 2024-11-11 (#1985)\n > Implement PKCS7_encrypt and PKC7_decrypt (#1996)\n > [EC] Unify scalar_mul_public for ec_nistp curves (#2004)\n > Adding the OpenSSL s_client tool (#1959)\n > Add Clang 19 to CI (#1998)\n > [EC] Unify scalar_mul_base point for ec_nistp curves (#2003)\n > Add internal APIs for ML-DSA (#1999)\n > Test cleanup (#2000)\n > Minor improvement to DSA (ASN1) + DSA Tests (#1990)\n > Implement PKCS7_dataInit and PKCS7_dataFinal (#1816)\n > Addition of generic NIST-DSA PKEY and ASN1 to support ML-DSA (#1963)\n > Expose a bit of lhash/conf for Ruby (#1987)\n > Allow ASN1_get_object to parse indefinite and universal (#1994)\n > Added CRL tool to CLI (#1976)\n > Prepare release AWS-LC v1.39.0 (#1995)\n > Revert \"Replace CONF's internal representation with something more typesafe\" (#1986)\n > Add Cyrus-SASL to our CI (#1988)\n > Cleanup test File utilities (#1989)\n > Account for cipher auth with multiple cert slots (#1956)\n > Allocate 16k scratch on heap (#1991)\n > Add CRYPTO_sysrand benchmarks to speed.cc (#1978)\n > Update PQREADME to add link to the KEM readme file (#1973)\n > Avoid compiler warning (#1981)\n > Ruby Support - More EVP_PKEY_DSA (#1954)\n > Upstream merge 2024-10-23 (#1955)\n > CI gcc-4.8 - use 4.8.5 tag (#1980)\n > Fix sess_hits counter on the server (#1974)\n > Support Finished-based APIs for TLS 1.3 (#1952)\n > Fix i2d behavior for i2d_SSL_SESSION (#1966)\n > fix `-Wcast-function-type` build issues (#1972)\n > Prepare v1.38.0 release (#1975)\n > Expose AES_cfb1_encrypt and AES_cfb8_encrypt (#1967)\n > EDDSA PCT (#1968)\n > ML-KEM keygen Pairwise Consistency Test (#1964)\n > Coverity Fix Null Check (#1965)\n > Actually add support for SSL_get_server/peer_tmp_key (#1945)\n > Also test w/ gcc 4.8 (#1962)\n > Fixes for Coverity Alerts (#1960)\n > Add support for POINT_CONVERSION_HYBRID (#1936)\n > Ruby Support - DSA custom md (#1953)\n > Add PKCS7-internal BIO_f_md (#1886)\n > Add PKCS7-internal BIO_f_cipher (#1836)\n > Expand support for EVP_PKEY_HMAC (#1933)\n > Support encode or decode ∞ like OpenSSL (#1930)\n > Fix FIPS.md typo (#1950)\n > Missing functionality + Adding Nmap to our CI (#1915)\n > HKDF, HKDF_expand, and PBKDF Truncated SHA2-512 (#1946)\n > bump mysql CI to 9.1.0 (#1939)\n > PQ README (#1932)\n > Add p4p, bump up time (#1943)\n > Remove retries on PCT failure in EC and RSA key generation. (#1938)\n > Remove old Intel CPU types (#1942)\n > Upstream merge 2024 10 17 (#1934)\n > DH paramgen callback (#1928)\n > Add null check in dh testing (#1937)\n > Use illegal_parameter instead of decode_error for invalid key shares (#1923)\n > Also prune SSM documents from ec2-test-framework (#1925)\n > Marshalling/Unmarshalling DH public keys (#1916)\n > 800-131Ar1: length of the key-derivation key shall be at least 112 bits. (#1924)\n > Prepare 1.37.0 release (#1927)\n > Add 2024 FIPS and fix build issues on older arm FIPS (#1920)\n > Align X509 PARTIAL_CHAIN behavior with 1.1.1 (#1917)\n > P161732527 coverity cleanup (#1918)\n > build: fix pkgconfig files (#1913)\n > Avoid allocating EVP_PKEY on size checks (#1911)\n > Add EC_GROUP mutablility to custom curves (#1881)\n > Implement more EVP_PKEY_DH functionality (#1880)\n > ML-DSA parameter refactor (#1910)\n > Update FIPS docs w/ certs (#1900)\n > Handle Windows not supporting static array dimension (#1912)\n > Remove duplicate s2n-bignum prefix include option (#1909)\n > Add support for EVP_PKEY_CTX callback functions (#1905)\n > P159598331 coverity cleanup (#1908)\n > Add Alpine-Linux-x86 to GitHub Actions CI (#1753)\n > Upstream merge 2024 09 16 (#1862)\n > Update Dilithium from crystals upstream (#1894)\n > Create mutable EC_GROUP API for OpenSSL compatibility (#1860)\n > ML-KEM FIPS 203 destruction of intermediate values (#1883)\n > Remove special s2n-bignum symbol handling sauce from build (#1903)\nSubmodule mountpoint-s3-crt-sys/crt/s2n-tls ffe0bf42..493b7716:\n > feat: Reworking cleanup behavior (#4871)\n > chore: broaden use of flaky mark (#4865)\n > chore: configure dependabot (#4861)\n > fix: fix open AF_INET sockets in s2n_self_talk_ktls_test.c (#4852)\n > chore: update github PR template (#4885)\n > feat: add new security policy `20241106` (#4874)\n > chore: remove unused benchmarks (#4869)\n > ci: Clean dup source tree for CRT (#4882)\n > ci: remove www.mozilla.com from well-known to unblock CI (#4880)\n > fix: move prelude inclusion as PRIVATE (#4876)\n > build: add s2n_prelude.h to consolidate defines (#4465)\n > chore: bindings release 0.3.6 (#4867)\n > doc: fix incorrect README references (#4863)\n > fix: typo in comment of s2n_self_talk_tls13_test (#4864)\n > fix: close all /dev/urandom open fds (#4835)\n > docs: update fips documentation to specify supported libcrypto (#4857)\n > fix(bindings): correct poll_flush implementation (#4859)\n > feat: Adds cleanup_final (#4853)\n > test(bindings): Consolidate test pems (#4858)\n > chore: bindings release 0.3.5 (#4860)\n > chore: grant duvet action more permissions (#4854)\n > (feat): Adds certificate match metrics API (#4844)\n > chore: Fix failing OIDC workflows; cleanup unused actions (#4848)\n > chore(GHA): Update duvet arguments (#4850)\n > chore: remove unused compile definition (#4815)\n > Add new MLKEM TLS Policies (#4830)\n > fix: fix opened AF_UNIX sockets that didn't call s2n_io_pair_close (#4833)\n > bindings: pin openssl crate to 0.10.66 (#4849)\n > chore: flip 2 GHAs to use short lived creds. (#4839)\n > fix: fix s2n_io_pair_close_one_end (#4841)\n > ci: Re-enable asan and ubsan for fuzz tests (#4840)\n > fix: some open AF_UNIX sockets in forked child processes (#4834)\n > Update FIPS rules for ML-KEM (#4829)\n > ci: update ubuntu versions (#4828)\n > Add initial support for MLKEM768 (without any new Security Policies) (#4816)\n > chore: Adds print statements to help debug s2n_dynamic_load_test (#4836)\n > ci: add more libcryptos for fuzz batch & follow cmake idioms (#4795)\n > feature: bump cert authorities max size to 20kb (#4832)\n > ci: Add ubuntu24 with a new cmake buildspec (#4824)\n > Add ML-KEM Feature Probe and Test (#4823)\n > docs: update stateful resumption doc (#4818)\n > chore: remove make fuzz and AFL fuzz (#4808)\n```\n</details>\n\n---\n\nBy submitting this pull request, I confirm that my contribution is made\nunder the terms of the Apache 2.0 license and I agree to the terms of\nthe [Developer Certificate of Origin\n(DCO)](https://developercertificate.org/).\n\nSigned-off-by: Alessandro Passaro <[email protected]>",
"timestamp": "2024-12-02T09:15:27Z",
"tree_id": "f7ac9f5fe782e078712af31710787f283a2ea32c",
"url": "https://github.com/awslabs/mountpoint-s3/commit/989f7bc6f5ff72deeb73ace3939836ae8c9e7814"
},
"date": 1733132561840,
"tool": "customSmallerIsBetter",
"benches": [
{
"name": "readdir_100",
"value": 0.043,
"unit": "seconds"
},
{
"name": "readdir_1000",
"value": 0.192,
"unit": "seconds"
},
{
"name": "readdir_10000",
"value": 0.942,
"unit": "seconds"
},
{
"name": "readdir_100000",
"value": 8.716,
"unit": "seconds"
},
{
"name": "time_to_first_byte_read",
"value": 1.40553,
"unit": "milliseconds"
},
{
"name": "time_to_first_byte_read_small_file",
"value": 6.2412472,
"unit": "milliseconds"
}
]
},
{
"commit": {
"author": {
Expand Down Expand Up @@ -1107,6 +1053,65 @@ window.BENCHMARK_DATA = {
"unit": "milliseconds"
}
]
},
{
"commit": {
"author": {
"email": "[email protected]",
"name": "Alessandro Passaro",
"username": "passaro"
},
"committer": {
"email": "[email protected]",
"name": "GitHub",
"username": "web-flow"
},
"distinct": true,
"id": "3ee6fbc6e837a9c3c434d01dd7ac2a8d4d742545",
"message": "Wait for CreateMPU before returning from put_object (#1192)\n\n`S3CrtClient::put_object` was originally implemented so that it would\ncomplete immediately and return a `PutObjectRequest` implementation. Any\nerror from the S3 request would only be returned on calling `write` or\n`complete` on the `PutObjectRequest`. With this change, we modify\n`put_object` to await for the initial `CreateMultipartUpload` request to\ncomplete and only then either return a `PutObjectRequest` or propagate\nthe error from the request. This is analogous to what done for\n`get_object` in #1171 and addresses an issue where errors were not\npropagated correctly (#1007).\n\nAt the file handle level, however, we still want the `open` operation to\ncomplete quickly, without waiting for `CreateMultipartUpload` to\ncomplete. In order to preserve the previous behavior, `upload::atomic`\nwas adapted to spawn a concurrent task in the background when calling\n`put_object`.\n\n### Does this change impact existing behavior?\n\nYes.\n\n### Does this change need a changelog entry?\n\nYes, for `mountpoint-s3-client`. No user-visible changes in\n`mountpoint-s3`.\n\n---\n\nBy submitting this pull request, I confirm that my contribution is made\nunder the terms of the Apache 2.0 license and I agree to the terms of\nthe [Developer Certificate of Origin\n(DCO)](https://developercertificate.org/).\n\n---------\n\nSigned-off-by: Alessandro Passaro <[email protected]>",
"timestamp": "2024-12-18T09:46:54Z",
"tree_id": "9de535c6c2542ad4b28ec6a8fbe5a446d1fb38a3",
"url": "https://github.com/awslabs/mountpoint-s3/commit/3ee6fbc6e837a9c3c434d01dd7ac2a8d4d742545"
},
"date": 1734516665472,
"tool": "customSmallerIsBetter",
"benches": [
{
"name": "readdir_100",
"value": 0.039,
"unit": "seconds"
},
{
"name": "readdir_1000",
"value": 0.19,
"unit": "seconds"
},
{
"name": "readdir_10000",
"value": 0.983,
"unit": "seconds"
},
{
"name": "readdir_100000",
"value": 8.52,
"unit": "seconds"
},
{
"name": "time_to_write_one_byte_file",
"value": 8.0737531,
"unit": "milliseconds"
},
{
"name": "time_to_first_byte_read",
"value": 1.2188611,
"unit": "milliseconds"
},
{
"name": "time_to_first_byte_read_small_file",
"value": 5.8136254,
"unit": "milliseconds"
}
]
}
]
}
Expand Down

0 comments on commit f0f4c97

Please sign in to comment.