Conversation
Performance SLOsComparing candidate taegyunkimm/chore-hatch-multiple-os-tests (12c5625) with baseline main (04731eb) 📈 Performance Regressions (2 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 103.202µs (SLO: <130.000µs 📉 -20.6%) vs baseline: +3.2% Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.0% ✅ add_inplace_aspectTime: ✅ 101.352µs (SLO: <130.000µs 📉 -22.0%) vs baseline: +0.3% Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.1% ✅ add_inplace_noaspectTime: ✅ 28.066µs (SLO: <40.000µs 📉 -29.8%) vs baseline: -0.5% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ add_noaspectTime: ✅ 49.000µs (SLO: <70.000µs 📉 -30.0%) vs baseline: +0.4% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ bytearray_aspectTime: ✅ 253.291µs (SLO: <400.000µs 📉 -36.7%) vs baseline: +1.5% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ bytearray_extend_aspectTime: ✅ 634.889µs (SLO: <800.000µs 📉 -20.6%) vs baseline: -0.9% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ bytearray_extend_noaspectTime: ✅ 263.259µs (SLO: <400.000µs 📉 -34.2%) vs baseline: -1.5% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ bytearray_noaspectTime: ✅ 134.998µs (SLO: <300.000µs 📉 -55.0%) vs baseline: +0.6% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.9% ✅ bytes_aspectTime: ✅ 219.218µs (SLO: <300.000µs 📉 -26.9%) vs baseline: +0.9% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ bytes_noaspectTime: ✅ 132.854µs (SLO: <200.000µs 📉 -33.6%) vs baseline: -0.6% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ bytesio_aspectTime: ✅ 3.785ms (SLO: <5.000ms 📉 -24.3%) vs baseline: ~same Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ bytesio_noaspectTime: ✅ 316.686µs (SLO: <420.000µs 📉 -24.6%) vs baseline: -0.6% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ capitalize_aspectTime: ✅ 89.416µs (SLO: <300.000µs 📉 -70.2%) vs baseline: +0.3% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ capitalize_noaspectTime: ✅ 249.031µs (SLO: <300.000µs 📉 -17.0%) vs baseline: -1.4% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ casefold_aspectTime: ✅ 88.993µs (SLO: <500.000µs 📉 -82.2%) vs baseline: -0.3% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.0% ✅ casefold_noaspectTime: ✅ 306.733µs (SLO: <500.000µs 📉 -38.7%) vs baseline: +0.5% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.7% ✅ decode_aspectTime: ✅ 86.698µs (SLO: <100.000µs 📉 -13.3%) vs baseline: -0.3% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ decode_noaspectTime: ✅ 152.013µs (SLO: <210.000µs 📉 -27.6%) vs baseline: +0.5% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ encode_aspectTime: ✅ 83.945µs (SLO: <200.000µs 📉 -58.0%) vs baseline: -0.3% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ encode_noaspectTime: ✅ 140.664µs (SLO: <200.000µs 📉 -29.7%) vs baseline: +0.6% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ format_aspectTime: ✅ 14.639ms (SLO: <19.200ms 📉 -23.8%) vs baseline: -0.3% Memory: ✅ 43.077MB (SLO: <46.000MB -6.4%) vs baseline: +4.9% ✅ format_map_aspectTime: ✅ 16.382ms (SLO: <21.500ms 📉 -23.8%) vs baseline: -1.4% Memory: ✅ 43.057MB (SLO: <46.000MB -6.4%) vs baseline: +4.8% ✅ format_map_noaspectTime: ✅ 372.863µs (SLO: <500.000µs 📉 -25.4%) vs baseline: +0.2% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ format_noaspectTime: ✅ 302.074µs (SLO: <500.000µs 📉 -39.6%) vs baseline: -1.0% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ index_aspectTime: ✅ 125.210µs (SLO: <300.000µs 📉 -58.3%) vs baseline: +4.9% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ index_noaspectTime: ✅ 40.381µs (SLO: <300.000µs 📉 -86.5%) vs baseline: -0.8% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.6% ✅ join_aspectTime: ✅ 212.158µs (SLO: <300.000µs 📉 -29.3%) vs baseline: +0.2% Memory: ✅ 43.018MB (SLO: <46.000MB -6.5%) vs baseline: +5.2% ✅ join_noaspectTime: ✅ 141.388µs (SLO: <300.000µs 📉 -52.9%) vs baseline: -0.8% Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.0% ✅ ljust_aspectTime: ✅ 582.860µs (SLO: <700.000µs 📉 -16.7%) vs baseline: 📈 +17.3% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ ljust_noaspectTime: ✅ 258.731µs (SLO: <300.000µs 📉 -13.8%) vs baseline: -0.2% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ lower_aspectTime: ✅ 296.045µs (SLO: <500.000µs 📉 -40.8%) vs baseline: +1.4% Memory: ✅ 43.018MB (SLO: <46.000MB -6.5%) vs baseline: +5.2% ✅ lower_noaspectTime: ✅ 235.976µs (SLO: <300.000µs 📉 -21.3%) vs baseline: +1.0% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ lstrip_aspectTime: ✅ 0.269ms (SLO: <3.000ms 📉 -91.0%) vs baseline: -1.2% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.6% ✅ lstrip_noaspectTime: ✅ 0.177ms (SLO: <3.000ms 📉 -94.1%) vs baseline: -0.3% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.7% ✅ modulo_aspectTime: ✅ 14.277ms (SLO: <18.750ms 📉 -23.9%) vs baseline: -0.3% Memory: ✅ 43.116MB (SLO: <46.000MB -6.3%) vs baseline: +4.9% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 14.781ms (SLO: <19.350ms 📉 -23.6%) vs baseline: +0.1% Memory: ✅ 43.077MB (SLO: <46.000MB -6.4%) vs baseline: +5.0% ✅ modulo_aspect_for_bytesTime: ✅ 14.392ms (SLO: <18.900ms 📉 -23.8%) vs baseline: +0.3% Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +4.9% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 14.608ms (SLO: <19.150ms 📉 -23.7%) vs baseline: -0.3% Memory: ✅ 43.195MB (SLO: <46.000MB -6.1%) vs baseline: +5.1% ✅ modulo_noaspectTime: ✅ 0.363ms (SLO: <3.000ms 📉 -87.9%) vs baseline: +0.8% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.6% ✅ replace_aspectTime: ✅ 18.476ms (SLO: <24.000ms 📉 -23.0%) vs baseline: ~same Memory: ✅ 43.057MB (SLO: <46.000MB -6.4%) vs baseline: +4.9% ✅ replace_noaspectTime: ✅ 280.900µs (SLO: <300.000µs -6.4%) vs baseline: -0.2% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ repr_aspectTime: ✅ 310.713µs (SLO: <420.000µs 📉 -26.0%) vs baseline: -0.2% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ repr_noaspectTime: ✅ 46.789µs (SLO: <90.000µs 📉 -48.0%) vs baseline: +0.2% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ rstrip_aspectTime: ✅ 383.362µs (SLO: <500.000µs 📉 -23.3%) vs baseline: +0.6% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ rstrip_noaspectTime: ✅ 184.776µs (SLO: <300.000µs 📉 -38.4%) vs baseline: +0.8% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ slice_aspectTime: ✅ 185.089µs (SLO: <300.000µs 📉 -38.3%) vs baseline: +0.8% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.0% ✅ slice_noaspectTime: ✅ 54.204µs (SLO: <90.000µs 📉 -39.8%) vs baseline: ~same Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ stringio_aspectTime: ✅ 4.414ms (SLO: <5.000ms 📉 -11.7%) vs baseline: 📈 +14.5% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ stringio_noaspectTime: ✅ 345.817µs (SLO: <500.000µs 📉 -30.8%) vs baseline: ~same Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ strip_aspectTime: ✅ 267.805µs (SLO: <350.000µs 📉 -23.5%) vs baseline: -0.4% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ strip_noaspectTime: ✅ 176.435µs (SLO: <240.000µs 📉 -26.5%) vs baseline: +0.1% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ swapcase_aspectTime: ✅ 332.008µs (SLO: <500.000µs 📉 -33.6%) vs baseline: -0.2% Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.0% ✅ swapcase_noaspectTime: ✅ 270.031µs (SLO: <400.000µs 📉 -32.5%) vs baseline: -1.0% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.6% ✅ title_aspectTime: ✅ 319.748µs (SLO: <500.000µs 📉 -36.1%) vs baseline: -0.1% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ title_noaspectTime: ✅ 257.206µs (SLO: <400.000µs 📉 -35.7%) vs baseline: -0.2% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ translate_aspectTime: ✅ 491.886µs (SLO: <700.000µs 📉 -29.7%) vs baseline: -0.1% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) ✅ translate_noaspectTime: ✅ 422.653µs (SLO: <500.000µs 📉 -15.5%) vs baseline: -1.8% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.9% ✅ upper_aspectTime: ✅ 294.184µs (SLO: <500.000µs 📉 -41.2%) vs baseline: +0.2% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ upper_noaspectTime: ✅ 236.019µs (SLO: <400.000µs 📉 -41.0%) vs baseline: -0.1% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 516.602µs (SLO: <700.000µs 📉 -26.2%) vs baseline: 📈 +21.8% Memory: ✅ 42.625MB (SLO: <46.000MB -7.3%) vs baseline: +4.9% ✅ ospathbasename_noaspectTime: ✅ 436.871µs (SLO: <700.000µs 📉 -37.6%) vs baseline: +0.4% Memory: ✅ 42.664MB (SLO: <46.000MB -7.3%) vs baseline: +5.0% ✅ ospathjoin_aspectTime: ✅ 628.496µs (SLO: <700.000µs 📉 -10.2%) vs baseline: +0.3% Memory: ✅ 42.546MB (SLO: <46.000MB -7.5%) vs baseline: +4.6% ✅ ospathjoin_noaspectTime: ✅ 637.135µs (SLO: <700.000µs -9.0%) vs baseline: -0.2% Memory: ✅ 42.585MB (SLO: <46.000MB -7.4%) vs baseline: +5.1% ✅ ospathnormcase_aspectTime: ✅ 350.674µs (SLO: <700.000µs 📉 -49.9%) vs baseline: -0.5% Memory: ✅ 42.566MB (SLO: <46.000MB -7.5%) vs baseline: +4.9% ✅ ospathnormcase_noaspectTime: ✅ 359.842µs (SLO: <700.000µs 📉 -48.6%) vs baseline: -0.3% Memory: ✅ 42.566MB (SLO: <46.000MB -7.5%) vs baseline: +4.8% ✅ ospathsplit_aspectTime: ✅ 492.525µs (SLO: <700.000µs 📉 -29.6%) vs baseline: +0.4% Memory: ✅ 42.743MB (SLO: <46.000MB -7.1%) vs baseline: +5.1% ✅ ospathsplit_noaspectTime: ✅ 500.574µs (SLO: <700.000µs 📉 -28.5%) vs baseline: -1.3% Memory: ✅ 42.546MB (SLO: <46.000MB -7.5%) vs baseline: +4.6% ✅ ospathsplitdrive_aspectTime: ✅ 374.647µs (SLO: <700.000µs 📉 -46.5%) vs baseline: -1.1% Memory: ✅ 42.644MB (SLO: <46.000MB -7.3%) vs baseline: +5.0% ✅ ospathsplitdrive_noaspectTime: ✅ 73.401µs (SLO: <700.000µs 📉 -89.5%) vs baseline: +0.3% Memory: ✅ 42.625MB (SLO: <46.000MB -7.3%) vs baseline: +5.0% ✅ ospathsplitext_aspectTime: ✅ 462.361µs (SLO: <700.000µs 📉 -33.9%) vs baseline: -0.3% Memory: ✅ 42.723MB (SLO: <46.000MB -7.1%) vs baseline: +5.2% ✅ ospathsplitext_noaspectTime: ✅ 466.989µs (SLO: <700.000µs 📉 -33.3%) vs baseline: ~same Memory: ✅ 42.507MB (SLO: <46.000MB -7.6%) vs baseline: +4.7% 🟡 Near SLO Breach (2 suites)🟡 otelsdkspan - 24/24✅ add-eventTime: ✅ 40.864ms (SLO: <42.000ms -2.7%) vs baseline: +0.9% Memory: ✅ 38.083MB (SLO: <40.750MB -6.5%) vs baseline: +4.9% ✅ add-linkTime: ✅ 36.444ms (SLO: <38.550ms -5.5%) vs baseline: +0.4% Memory: ✅ 37.906MB (SLO: <40.750MB -7.0%) vs baseline: +4.6% ✅ add-metricsTime: ✅ 216.508ms (SLO: <232.000ms -6.7%) vs baseline: -1.0% Memory: ✅ 38.063MB (SLO: <40.750MB -6.6%) vs baseline: +5.2% ✅ add-tagsTime: ✅ 214.144ms (SLO: <221.600ms -3.4%) vs baseline: +0.9% Memory: ✅ 38.063MB (SLO: <40.750MB -6.6%) vs baseline: +4.7% ✅ get-contextTime: ✅ 29.232ms (SLO: <31.300ms -6.6%) vs baseline: -0.4% Memory: ✅ 38.083MB (SLO: <40.750MB -6.5%) vs baseline: +5.2% ✅ is-recordingTime: ✅ 29.502ms (SLO: <31.000ms -4.8%) vs baseline: ~same Memory: ✅ 38.044MB (SLO: <40.750MB -6.6%) vs baseline: +5.0% ✅ record-exceptionTime: ✅ 63.224ms (SLO: <65.850ms -4.0%) vs baseline: -0.1% Memory: ✅ 38.142MB (SLO: <40.750MB -6.4%) vs baseline: +5.3% ✅ set-statusTime: ✅ 32.071ms (SLO: <34.150ms -6.1%) vs baseline: ~same Memory: ✅ 37.945MB (SLO: <40.750MB -6.9%) vs baseline: +4.5% ✅ startTime: ✅ 29.675ms (SLO: <30.150ms 🟡 -1.6%) vs baseline: +2.3% Memory: ✅ 38.083MB (SLO: <40.750MB -6.5%) vs baseline: +4.9% ✅ start-finishTime: ✅ 33.865ms (SLO: <35.350ms -4.2%) vs baseline: -0.7% Memory: ✅ 38.103MB (SLO: <40.750MB -6.5%) vs baseline: +4.7% ✅ start-finish-telemetryTime: ✅ 33.986ms (SLO: <35.450ms -4.1%) vs baseline: -1.1% Memory: ✅ 37.985MB (SLO: <40.750MB -6.8%) vs baseline: +4.9% ✅ update-nameTime: ✅ 31.335ms (SLO: <33.400ms -6.2%) vs baseline: +0.4% Memory: ✅ 38.103MB (SLO: <40.750MB -6.5%) vs baseline: +5.5% 🟡 tracer - 6/6✅ largeTime: ✅ 31.412ms (SLO: <32.950ms -4.7%) vs baseline: +0.2% Memory: ✅ 36.648MB (SLO: <39.250MB -6.6%) vs baseline: +4.7% ✅ mediumTime: ✅ 3.096ms (SLO: <3.200ms -3.2%) vs baseline: -0.7% Memory: ✅ 35.488MB (SLO: <38.750MB -8.4%) vs baseline: +4.7% ✅ smallTime: ✅ 364.222µs (SLO: <370.000µs 🟡 -1.6%) vs baseline: +4.3% Memory: ✅ 35.527MB (SLO: <38.750MB -8.3%) vs baseline: +4.9%
|
Description
No longer used after we migrated it to run in GitLab #15608. It uses uv instead.
Testing
Risks
Additional Notes