ci: reduce profiling_native timeout#17109
ci: reduce profiling_native timeout#17109gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomainfrom
Conversation
Codeowners resolved as |
Performance SLOsComparing candidate brettlangdon/profiling_native.timeout (af432b6) with baseline main (8ff3ccb) 📈 Performance Regressions (2 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 104.490µs (SLO: <130.000µs 📉 -19.6%) vs baseline: +4.2% Memory: ✅ 43.964MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ add_inplace_aspectTime: ✅ 100.524µs (SLO: <130.000µs 📉 -22.7%) vs baseline: -0.5% Memory: ✅ 43.935MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ add_inplace_noaspectTime: ✅ 28.404µs (SLO: <40.000µs 📉 -29.0%) vs baseline: +0.2% Memory: ✅ 43.912MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ add_noaspectTime: ✅ 49.324µs (SLO: <70.000µs 📉 -29.5%) vs baseline: -0.2% Memory: ✅ 44.012MB (SLO: <46.000MB -4.3%) vs baseline: +4.0% ✅ bytearray_aspectTime: ✅ 247.925µs (SLO: <400.000µs 📉 -38.0%) vs baseline: -0.5% Memory: ✅ 43.933MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ bytearray_extend_aspectTime: ✅ 629.325µs (SLO: <800.000µs 📉 -21.3%) vs baseline: -1.2% Memory: ✅ 43.942MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ bytearray_extend_noaspectTime: ✅ 264.225µs (SLO: <400.000µs 📉 -33.9%) vs baseline: +0.9% Memory: ✅ 44.082MB (SLO: <46.000MB -4.2%) vs baseline: +5.1% ✅ bytearray_noaspectTime: ✅ 135.215µs (SLO: <300.000µs 📉 -54.9%) vs baseline: -0.1% Memory: ✅ 43.886MB (SLO: <46.000MB -4.6%) vs baseline: +4.7% ✅ bytes_aspectTime: ✅ 217.155µs (SLO: <300.000µs 📉 -27.6%) vs baseline: +0.1% Memory: ✅ 43.929MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ bytes_noaspectTime: ✅ 133.581µs (SLO: <200.000µs 📉 -33.2%) vs baseline: ~same Memory: ✅ 43.914MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ bytesio_aspectTime: ✅ 3.769ms (SLO: <5.000ms 📉 -24.6%) vs baseline: -0.1% Memory: ✅ 43.939MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ bytesio_noaspectTime: ✅ 316.303µs (SLO: <420.000µs 📉 -24.7%) vs baseline: ~same Memory: ✅ 43.889MB (SLO: <46.000MB -4.6%) vs baseline: +4.8% ✅ capitalize_aspectTime: ✅ 88.951µs (SLO: <300.000µs 📉 -70.3%) vs baseline: -0.6% Memory: ✅ 43.945MB (SLO: <46.000MB -4.5%) vs baseline: +5.0% ✅ capitalize_noaspectTime: ✅ 250.067µs (SLO: <300.000µs 📉 -16.6%) vs baseline: +0.8% Memory: ✅ 43.951MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ casefold_aspectTime: ✅ 93.374µs (SLO: <500.000µs 📉 -81.3%) vs baseline: +4.4% Memory: ✅ 43.910MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ casefold_noaspectTime: ✅ 302.548µs (SLO: <500.000µs 📉 -39.5%) vs baseline: -1.5% Memory: ✅ 43.972MB (SLO: <46.000MB -4.4%) vs baseline: +4.8% ✅ decode_aspectTime: ✅ 87.117µs (SLO: <100.000µs 📉 -12.9%) vs baseline: +0.3% Memory: ✅ 43.917MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ decode_noaspectTime: ✅ 152.623µs (SLO: <210.000µs 📉 -27.3%) vs baseline: +0.4% Memory: ✅ 43.993MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ encode_aspectTime: ✅ 84.273µs (SLO: <200.000µs 📉 -57.9%) vs baseline: -0.7% Memory: ✅ 43.963MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ encode_noaspectTime: ✅ 139.829µs (SLO: <200.000µs 📉 -30.1%) vs baseline: -1.1% Memory: ✅ 43.999MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ format_aspectTime: ✅ 14.662ms (SLO: <19.200ms 📉 -23.6%) vs baseline: +0.2% Memory: ✅ 44.041MB (SLO: <46.000MB -4.3%) vs baseline: +4.8% ✅ format_map_aspectTime: ✅ 16.432ms (SLO: <21.500ms 📉 -23.6%) vs baseline: -0.4% Memory: ✅ 44.040MB (SLO: <46.000MB -4.3%) vs baseline: +4.9% ✅ format_map_noaspectTime: ✅ 371.970µs (SLO: <500.000µs 📉 -25.6%) vs baseline: -0.1% Memory: ✅ 43.878MB (SLO: <46.000MB -4.6%) vs baseline: +4.7% ✅ format_noaspectTime: ✅ 301.904µs (SLO: <500.000µs 📉 -39.6%) vs baseline: +0.2% Memory: ✅ 43.952MB (SLO: <46.000MB -4.5%) vs baseline: +5.1% ✅ index_aspectTime: ✅ 121.242µs (SLO: <300.000µs 📉 -59.6%) vs baseline: +0.5% Memory: ✅ 43.894MB (SLO: <46.000MB -4.6%) vs baseline: +4.5% ✅ index_noaspectTime: ✅ 40.376µs (SLO: <300.000µs 📉 -86.5%) vs baseline: +0.5% Memory: ✅ 43.999MB (SLO: <46.000MB -4.3%) vs baseline: +5.0% ✅ join_aspectTime: ✅ 211.419µs (SLO: <300.000µs 📉 -29.5%) vs baseline: +0.6% Memory: ✅ 43.885MB (SLO: <46.000MB -4.6%) vs baseline: +4.8% ✅ join_noaspectTime: ✅ 143.141µs (SLO: <300.000µs 📉 -52.3%) vs baseline: -0.6% Memory: ✅ 43.912MB (SLO: <46.000MB -4.5%) vs baseline: +3.7% ✅ ljust_aspectTime: ✅ 496.236µs (SLO: <700.000µs 📉 -29.1%) vs baseline: +0.2% Memory: ✅ 43.926MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ ljust_noaspectTime: ✅ 253.836µs (SLO: <300.000µs 📉 -15.4%) vs baseline: -0.6% Memory: ✅ 43.991MB (SLO: <46.000MB -4.4%) vs baseline: +4.7% ✅ lower_aspectTime: ✅ 325.559µs (SLO: <500.000µs 📉 -34.9%) vs baseline: 📈 +11.6% Memory: ✅ 43.905MB (SLO: <46.000MB -4.6%) vs baseline: +4.9% ✅ lower_noaspectTime: ✅ 235.308µs (SLO: <300.000µs 📉 -21.6%) vs baseline: +0.3% Memory: ✅ 43.995MB (SLO: <46.000MB -4.4%) vs baseline: +4.8% ✅ lstrip_aspectTime: ✅ 0.268ms (SLO: <3.000ms 📉 -91.1%) vs baseline: -0.5% Memory: ✅ 43.939MB (SLO: <46.000MB -4.5%) vs baseline: +5.0% ✅ lstrip_noaspectTime: ✅ 0.178ms (SLO: <3.000ms 📉 -94.1%) vs baseline: -0.5% Memory: ✅ 43.932MB (SLO: <46.000MB -4.5%) vs baseline: +4.6% ✅ modulo_aspectTime: ✅ 14.289ms (SLO: <18.750ms 📉 -23.8%) vs baseline: -0.6% Memory: ✅ 44.057MB (SLO: <46.000MB -4.2%) vs baseline: +4.7% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 14.767ms (SLO: <19.350ms 📉 -23.7%) vs baseline: -0.1% Memory: ✅ 44.060MB (SLO: <46.000MB -4.2%) vs baseline: +4.9% ✅ modulo_aspect_for_bytesTime: ✅ 14.407ms (SLO: <18.900ms 📉 -23.8%) vs baseline: -0.9% Memory: ✅ 44.047MB (SLO: <46.000MB -4.2%) vs baseline: +3.8% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 14.601ms (SLO: <19.150ms 📉 -23.8%) vs baseline: -0.4% Memory: ✅ 44.007MB (SLO: <46.000MB -4.3%) vs baseline: +4.7% ✅ modulo_noaspectTime: ✅ 0.361ms (SLO: <3.000ms 📉 -88.0%) vs baseline: -0.9% Memory: ✅ 43.969MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ replace_aspectTime: ✅ 18.904ms (SLO: <24.000ms 📉 -21.2%) vs baseline: +3.1% Memory: ✅ 44.090MB (SLO: <46.000MB -4.2%) vs baseline: +5.2% ✅ replace_noaspectTime: ✅ 283.550µs (SLO: <400.000µs 📉 -29.1%) vs baseline: +2.0% Memory: ✅ 43.928MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ repr_aspectTime: ✅ 308.981µs (SLO: <420.000µs 📉 -26.4%) vs baseline: -0.4% Memory: ✅ 43.945MB (SLO: <46.000MB -4.5%) vs baseline: +4.8% ✅ repr_noaspectTime: ✅ 47.121µs (SLO: <90.000µs 📉 -47.6%) vs baseline: +1.0% Memory: ✅ 43.970MB (SLO: <46.000MB -4.4%) vs baseline: +3.9% ✅ rstrip_aspectTime: ✅ 382.436µs (SLO: <500.000µs 📉 -23.5%) vs baseline: -0.6% Memory: ✅ 43.945MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ rstrip_noaspectTime: ✅ 186.589µs (SLO: <300.000µs 📉 -37.8%) vs baseline: +1.3% Memory: ✅ 43.935MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ slice_aspectTime: ✅ 183.262µs (SLO: <300.000µs 📉 -38.9%) vs baseline: ~same Memory: ✅ 43.911MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ slice_noaspectTime: ✅ 54.172µs (SLO: <90.000µs 📉 -39.8%) vs baseline: +0.3% Memory: ✅ 43.970MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ stringio_aspectTime: ✅ 3.816ms (SLO: <5.000ms 📉 -23.7%) vs baseline: +0.2% Memory: ✅ 43.874MB (SLO: <46.000MB -4.6%) vs baseline: +4.6% ✅ stringio_noaspectTime: ✅ 346.631µs (SLO: <500.000µs 📉 -30.7%) vs baseline: -0.5% Memory: ✅ 44.037MB (SLO: <46.000MB -4.3%) vs baseline: +5.1% ✅ strip_aspectTime: ✅ 270.102µs (SLO: <350.000µs 📉 -22.8%) vs baseline: +1.0% Memory: ✅ 43.907MB (SLO: <46.000MB -4.6%) vs baseline: +4.9% ✅ strip_noaspectTime: ✅ 178.182µs (SLO: <240.000µs 📉 -25.8%) vs baseline: +1.1% Memory: ✅ 43.952MB (SLO: <46.000MB -4.5%) vs baseline: +5.0% ✅ swapcase_aspectTime: ✅ 329.223µs (SLO: <500.000µs 📉 -34.2%) vs baseline: +0.4% Memory: ✅ 43.971MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ swapcase_noaspectTime: ✅ 271.199µs (SLO: <400.000µs 📉 -32.2%) vs baseline: -0.5% Memory: ✅ 43.959MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ title_aspectTime: ✅ 319.594µs (SLO: <500.000µs 📉 -36.1%) vs baseline: +0.5% Memory: ✅ 44.005MB (SLO: <46.000MB -4.3%) vs baseline: +4.8% ✅ title_noaspectTime: ✅ 258.719µs (SLO: <400.000µs 📉 -35.3%) vs baseline: +0.7% Memory: ✅ 43.996MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ translate_aspectTime: ✅ 533.215µs (SLO: <700.000µs 📉 -23.8%) vs baseline: +9.6% Memory: ✅ 44.034MB (SLO: <46.000MB -4.3%) vs baseline: +5.3% ✅ translate_noaspectTime: ✅ 422.286µs (SLO: <500.000µs 📉 -15.5%) vs baseline: -2.3% Memory: ✅ 44.003MB (SLO: <46.000MB -4.3%) vs baseline: +4.9% ✅ upper_aspectTime: ✅ 293.109µs (SLO: <500.000µs 📉 -41.4%) vs baseline: -0.2% Memory: ✅ 43.929MB (SLO: <46.000MB -4.5%) vs baseline: +4.7% ✅ upper_noaspectTime: ✅ 235.036µs (SLO: <400.000µs 📉 -41.2%) vs baseline: +0.2% Memory: ✅ 43.913MB (SLO: <46.000MB -4.5%) vs baseline: +4.6% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 509.829µs (SLO: <700.000µs 📉 -27.2%) vs baseline: 📈 +20.9% Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +4.2% ✅ ospathbasename_noaspectTime: ✅ 430.298µs (SLO: <700.000µs 📉 -38.5%) vs baseline: +0.8% Memory: ✅ 43.804MB (SLO: <46.000MB -4.8%) vs baseline: +4.4% ✅ ospathjoin_aspectTime: ✅ 620.081µs (SLO: <700.000µs 📉 -11.4%) vs baseline: -0.5% Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +4.3% ✅ ospathjoin_noaspectTime: ✅ 626.905µs (SLO: <700.000µs 📉 -10.4%) vs baseline: -0.7% Memory: ✅ 43.726MB (SLO: <46.000MB -4.9%) vs baseline: +4.5% ✅ ospathnormcase_aspectTime: ✅ 345.084µs (SLO: <700.000µs 📉 -50.7%) vs baseline: -0.6% Memory: ✅ 43.824MB (SLO: <46.000MB -4.7%) vs baseline: +4.5% ✅ ospathnormcase_noaspectTime: ✅ 354.276µs (SLO: <700.000µs 📉 -49.4%) vs baseline: +0.1% Memory: ✅ 43.726MB (SLO: <46.000MB -4.9%) vs baseline: +4.1% ✅ ospathsplit_aspectTime: ✅ 484.729µs (SLO: <700.000µs 📉 -30.8%) vs baseline: +0.3% Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +4.8% ✅ ospathsplit_noaspectTime: ✅ 496.998µs (SLO: <700.000µs 📉 -29.0%) vs baseline: ~same Memory: ✅ 43.706MB (SLO: <46.000MB -5.0%) vs baseline: +4.9% ✅ ospathsplitdrive_aspectTime: ✅ 371.141µs (SLO: <700.000µs 📉 -47.0%) vs baseline: +0.3% Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +4.7% ✅ ospathsplitdrive_noaspectTime: ✅ 72.790µs (SLO: <700.000µs 📉 -89.6%) vs baseline: -1.1% Memory: ✅ 43.706MB (SLO: <46.000MB -5.0%) vs baseline: +4.6% ✅ ospathsplitext_aspectTime: ✅ 451.709µs (SLO: <700.000µs 📉 -35.5%) vs baseline: -0.3% Memory: ✅ 43.824MB (SLO: <46.000MB -4.7%) vs baseline: +4.4% ✅ ospathsplitext_noaspectTime: ✅ 461.791µs (SLO: <700.000µs 📉 -34.0%) vs baseline: -0.3% Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +4.1% 🟡 Near SLO Breach (2 suites)🟡 djangosimple - 30/30✅ appsecTime: ✅ 19.577ms (SLO: <22.300ms 📉 -12.2%) vs baseline: -0.5% Memory: ✅ 68.797MB (SLO: <73.500MB -6.4%) vs baseline: +5.0% ✅ exception-replay-enabledTime: ✅ 1.398ms (SLO: <1.450ms -3.6%) vs baseline: +0.3% Memory: ✅ 66.735MB (SLO: <71.500MB -6.7%) vs baseline: +4.8% ✅ iastTime: ✅ 19.597ms (SLO: <22.250ms 📉 -11.9%) vs baseline: -0.9% Memory: ✅ 68.749MB (SLO: <75.000MB -8.3%) vs baseline: +5.0% ✅ profilerTime: ✅ 15.138ms (SLO: <16.550ms -8.5%) vs baseline: +0.2% Memory: ✅ 60.444MB (SLO: <61.000MB 🟡 -0.9%) vs baseline: +4.9% ✅ resource-renamingTime: ✅ 19.605ms (SLO: <21.750ms -9.9%) vs baseline: +0.1% Memory: ✅ 68.812MB (SLO: <73.500MB -6.4%) vs baseline: +5.1% ✅ span-code-originTime: ✅ 20.161ms (SLO: <28.200ms 📉 -28.5%) vs baseline: +1.1% Memory: ✅ 68.505MB (SLO: <75.000MB -8.7%) vs baseline: +4.7% ✅ tracerTime: ✅ 19.662ms (SLO: <21.750ms -9.6%) vs baseline: -0.2% Memory: ✅ 68.822MB (SLO: <75.000MB -8.2%) vs baseline: +4.9% ✅ tracer-and-profilerTime: ✅ 21.037ms (SLO: <23.500ms 📉 -10.5%) vs baseline: -0.2% Memory: ✅ 70.719MB (SLO: <75.000MB -5.7%) vs baseline: +4.9% ✅ tracer-dont-create-db-spansTime: ✅ 19.790ms (SLO: <21.500ms -8.0%) vs baseline: -0.2% Memory: ✅ 68.821MB (SLO: <75.000MB -8.2%) vs baseline: +5.1% ✅ tracer-minimalTime: ✅ 16.795ms (SLO: <17.500ms -4.0%) vs baseline: ~same Memory: ✅ 68.761MB (SLO: <75.000MB -8.3%) vs baseline: +4.8% ✅ tracer-nativeTime: ✅ 19.659ms (SLO: <21.750ms -9.6%) vs baseline: ~same Memory: ✅ 68.743MB (SLO: <72.500MB -5.2%) vs baseline: +5.1% ✅ tracer-no-cachesTime: ✅ 17.618ms (SLO: <19.650ms 📉 -10.3%) vs baseline: ~same Memory: ✅ 68.776MB (SLO: <75.000MB -8.3%) vs baseline: +4.9% ✅ tracer-no-databasesTime: ✅ 19.341ms (SLO: <20.100ms -3.8%) vs baseline: ~same Memory: ✅ 68.712MB (SLO: <75.000MB -8.4%) vs baseline: +4.8% ✅ tracer-no-middlewareTime: ✅ 19.425ms (SLO: <21.500ms -9.7%) vs baseline: -0.2% Memory: ✅ 68.801MB (SLO: <75.000MB -8.3%) vs baseline: +4.9% ✅ tracer-no-templatesTime: ✅ 19.713ms (SLO: <22.000ms 📉 -10.4%) vs baseline: +0.9% Memory: ✅ 68.760MB (SLO: <73.500MB -6.4%) vs baseline: +5.0% 🟡 recursivecomputation - 8/8✅ deepTime: ✅ 310.684ms (SLO: <320.950ms -3.2%) vs baseline: -0.2% Memory: ✅ 37.454MB (SLO: <38.750MB -3.3%) vs baseline: +4.7% ✅ deep-profiledTime: ✅ 328.952ms (SLO: <359.150ms -8.4%) vs baseline: +0.2% Memory: ✅ 43.844MB (SLO: <46.000MB -4.7%) vs baseline: +4.8% ✅ mediumTime: ✅ 7.285ms (SLO: <7.400ms 🟡 -1.6%) vs baseline: -0.2% Memory: ✅ 36.687MB (SLO: <38.000MB -3.5%) vs baseline: +5.5% ✅ shallowTime: ✅ 1.017ms (SLO: <1.050ms -3.1%) vs baseline: +1.6% Memory: ✅ 36.392MB (SLO: <38.000MB -4.2%) vs baseline: +5.0%
|
Description
The P99 duration for these jobs is 8 minutes. Lowering this duration will help the CI to fail faster if we end up in a bad deadlock/infra state.
Testing
Risks
Additional Notes