Skip to content

Comments

ci(pytest): break up pytest test suite CI jobs#16610

Open
brettlangdon wants to merge 1 commit intomainfrom
brettlangdon/break.up.pytest.jobs
Open

ci(pytest): break up pytest test suite CI jobs#16610
brettlangdon wants to merge 1 commit intomainfrom
brettlangdon/break.up.pytest.jobs

Conversation

@brettlangdon
Copy link
Member

@brettlangdon brettlangdon commented Feb 20, 2026

Description

Right now we run all pytest* test suites in the same set of CI jobs.

This PR breaks up the pytest$, pytest_benchmark, pytest_bdd, pytest:flaky riot test suites into different GitLab test suites.

This will allow us to have better control over job level parallelism for the individual test suites.

riot list --hash-only pytest | wc -l is 34 venvs, this is a lot, but if we break up by actual test test suites we get:

  • pytest: 15
  • pytest_benchmark: 6
  • pytest_bdd: 7
  • pytest:flaky: 6
image

Testing

Risks

Additional Notes

@brettlangdon brettlangdon requested a review from gnufede February 20, 2026 17:31
@brettlangdon brettlangdon requested a review from a team as a code owner February 20, 2026 17:31
@brettlangdon brettlangdon added the changelog/no-changelog A changelog entry is not required for this PR. label Feb 20, 2026
@pr-commenter
Copy link

pr-commenter bot commented Feb 20, 2026

Performance SLOs

Comparing candidate brettlangdon/break.up.pytest.jobs (6eacb47) with baseline main (5e36f7e)

📈 Performance Regressions (2 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 103.184µs (SLO: <130.000µs 📉 -20.6%) vs baseline: +2.1%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.9%

✅ add_inplace_aspect

Time: ✅ 101.363µs (SLO: <130.000µs 📉 -22.0%) vs baseline: +1.0%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ add_inplace_noaspect

Time: ✅ 28.253µs (SLO: <40.000µs 📉 -29.4%) vs baseline: +0.5%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0%

✅ add_noaspect

Time: ✅ 48.785µs (SLO: <70.000µs 📉 -30.3%) vs baseline: -0.8%

Memory: ✅ 43.018MB (SLO: <46.000MB -6.5%) vs baseline: +5.1%

✅ bytearray_aspect

Time: ✅ 250.144µs (SLO: <400.000µs 📉 -37.5%) vs baseline: +0.4%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +5.0%

✅ bytearray_extend_aspect

Time: ✅ 633.819µs (SLO: <800.000µs 📉 -20.8%) vs baseline: ~same

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0%

✅ bytearray_extend_noaspect

Time: ✅ 264.666µs (SLO: <400.000µs 📉 -33.8%) vs baseline: -0.1%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.8%

✅ bytearray_noaspect

Time: ✅ 135.745µs (SLO: <300.000µs 📉 -54.8%) vs baseline: -0.2%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +4.8%

✅ bytes_aspect

Time: ✅ 219.740µs (SLO: <300.000µs 📉 -26.8%) vs baseline: +1.5%

Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.0%

✅ bytes_noaspect

Time: ✅ 134.404µs (SLO: <200.000µs 📉 -32.8%) vs baseline: +0.5%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0%

✅ bytesio_aspect

Time: ✅ 3.779ms (SLO: <5.000ms 📉 -24.4%) vs baseline: +0.4%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.8%

✅ bytesio_noaspect

Time: ✅ 315.477µs (SLO: <420.000µs 📉 -24.9%) vs baseline: ~same

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ capitalize_aspect

Time: ✅ 88.871µs (SLO: <300.000µs 📉 -70.4%) vs baseline: -0.5%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ capitalize_noaspect

Time: ✅ 251.463µs (SLO: <300.000µs 📉 -16.2%) vs baseline: +1.0%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ casefold_aspect

Time: ✅ 89.318µs (SLO: <500.000µs 📉 -82.1%) vs baseline: ~same

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%)

✅ casefold_noaspect

Time: ✅ 305.782µs (SLO: <500.000µs 📉 -38.8%) vs baseline: +0.4%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.8%

✅ decode_aspect

Time: ✅ 86.864µs (SLO: <100.000µs 📉 -13.1%) vs baseline: +0.6%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ decode_noaspect

Time: ✅ 153.482µs (SLO: <210.000µs 📉 -26.9%) vs baseline: +0.3%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0%

✅ encode_aspect

Time: ✅ 84.816µs (SLO: <200.000µs 📉 -57.6%) vs baseline: +0.9%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.8%

✅ encode_noaspect

Time: ✅ 140.851µs (SLO: <200.000µs 📉 -29.6%) vs baseline: ~same

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.8%

✅ format_aspect

Time: ✅ 14.701ms (SLO: <19.200ms 📉 -23.4%) vs baseline: +0.6%

Memory: ✅ 43.116MB (SLO: <46.000MB -6.3%) vs baseline: +5.1%

✅ format_map_aspect

Time: ✅ 16.405ms (SLO: <21.500ms 📉 -23.7%) vs baseline: -0.1%

Memory: ✅ 43.077MB (SLO: <46.000MB -6.4%) vs baseline: +4.8%

✅ format_map_noaspect

Time: ✅ 376.831µs (SLO: <500.000µs 📉 -24.6%) vs baseline: +1.1%

Memory: ✅ 42.841MB (SLO: <46.000MB -6.9%) vs baseline: +4.7%

✅ format_noaspect

Time: ✅ 301.497µs (SLO: <500.000µs 📉 -39.7%) vs baseline: +0.3%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ index_aspect

Time: ✅ 126.996µs (SLO: <300.000µs 📉 -57.7%) vs baseline: +5.0%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ index_noaspect

Time: ✅ 40.341µs (SLO: <300.000µs 📉 -86.6%) vs baseline: +0.2%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ join_aspect

Time: ✅ 210.679µs (SLO: <300.000µs 📉 -29.8%) vs baseline: -0.2%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.7%

✅ join_noaspect

Time: ✅ 141.449µs (SLO: <300.000µs 📉 -52.9%) vs baseline: -0.2%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0%

✅ ljust_aspect

Time: ✅ 579.186µs (SLO: <700.000µs 📉 -17.3%) vs baseline: 📈 +16.0%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ ljust_noaspect

Time: ✅ 258.073µs (SLO: <300.000µs 📉 -14.0%) vs baseline: -1.2%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ lower_aspect

Time: ✅ 294.441µs (SLO: <500.000µs 📉 -41.1%) vs baseline: -1.1%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0%

✅ lower_noaspect

Time: ✅ 236.515µs (SLO: <300.000µs 📉 -21.2%) vs baseline: +0.6%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ lstrip_aspect

Time: ✅ 0.271ms (SLO: <3.000ms 📉 -91.0%) vs baseline: +0.3%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.9%

✅ lstrip_noaspect

Time: ✅ 0.178ms (SLO: <3.000ms 📉 -94.1%) vs baseline: -0.5%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.6%

✅ modulo_aspect

Time: ✅ 14.431ms (SLO: <18.750ms 📉 -23.0%) vs baseline: +1.0%

Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +4.7%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 14.714ms (SLO: <19.350ms 📉 -24.0%) vs baseline: +0.1%

Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +4.9%

✅ modulo_aspect_for_bytes

Time: ✅ 14.487ms (SLO: <18.900ms 📉 -23.3%) vs baseline: +0.2%

Memory: ✅ 43.057MB (SLO: <46.000MB -6.4%) vs baseline: +4.7%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 14.608ms (SLO: <19.150ms 📉 -23.7%) vs baseline: -0.1%

Memory: ✅ 43.077MB (SLO: <46.000MB -6.4%) vs baseline: +4.9%

✅ modulo_noaspect

Time: ✅ 0.362ms (SLO: <3.000ms 📉 -87.9%) vs baseline: ~same

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ replace_aspect

Time: ✅ 18.419ms (SLO: <24.000ms 📉 -23.3%) vs baseline: +0.6%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.6%

✅ replace_noaspect

Time: ✅ 280.031µs (SLO: <300.000µs -6.7%) vs baseline: ~same

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0%

✅ repr_aspect

Time: ✅ 311.881µs (SLO: <420.000µs 📉 -25.7%) vs baseline: -0.5%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0%

✅ repr_noaspect

Time: ✅ 46.944µs (SLO: <90.000µs 📉 -47.8%) vs baseline: +0.4%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ rstrip_aspect

Time: ✅ 382.657µs (SLO: <500.000µs 📉 -23.5%) vs baseline: -1.2%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.9%

✅ rstrip_noaspect

Time: ✅ 185.316µs (SLO: <300.000µs 📉 -38.2%) vs baseline: +1.4%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ slice_aspect

Time: ✅ 184.120µs (SLO: <300.000µs 📉 -38.6%) vs baseline: -2.5%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0%

✅ slice_noaspect

Time: ✅ 54.630µs (SLO: <90.000µs 📉 -39.3%) vs baseline: +0.3%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.9%

✅ stringio_aspect

Time: ✅ 4.397ms (SLO: <5.000ms 📉 -12.1%) vs baseline: 📈 +14.8%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ stringio_noaspect

Time: ✅ 347.320µs (SLO: <500.000µs 📉 -30.5%) vs baseline: +0.3%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0%

✅ strip_aspect

Time: ✅ 270.342µs (SLO: <350.000µs 📉 -22.8%) vs baseline: ~same

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0%

✅ strip_noaspect

Time: ✅ 177.960µs (SLO: <240.000µs 📉 -25.8%) vs baseline: +0.3%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ swapcase_aspect

Time: ✅ 331.196µs (SLO: <500.000µs 📉 -33.8%) vs baseline: +0.8%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ swapcase_noaspect

Time: ✅ 272.595µs (SLO: <400.000µs 📉 -31.9%) vs baseline: +0.8%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.7%

✅ title_aspect

Time: ✅ 318.491µs (SLO: <500.000µs 📉 -36.3%) vs baseline: ~same

Memory: ✅ 42.861MB (SLO: <46.000MB -6.8%) vs baseline: +4.7%

✅ title_noaspect

Time: ✅ 258.591µs (SLO: <400.000µs 📉 -35.4%) vs baseline: +0.5%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0%

✅ translate_aspect

Time: ✅ 491.163µs (SLO: <700.000µs 📉 -29.8%) vs baseline: +0.4%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0%

✅ translate_noaspect

Time: ✅ 428.277µs (SLO: <500.000µs 📉 -14.3%) vs baseline: +0.1%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ upper_aspect

Time: ✅ 294.606µs (SLO: <500.000µs 📉 -41.1%) vs baseline: +0.9%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.6%

✅ upper_noaspect

Time: ✅ 235.806µs (SLO: <400.000µs 📉 -41.0%) vs baseline: +0.2%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.7%

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 506.900µs (SLO: <700.000µs 📉 -27.6%) vs baseline: 📈 +19.7%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.8%

✅ ospathbasename_noaspect

Time: ✅ 432.495µs (SLO: <700.000µs 📉 -38.2%) vs baseline: +0.6%

Memory: ✅ 42.625MB (SLO: <46.000MB -7.3%) vs baseline: +5.1%

✅ ospathjoin_aspect

Time: ✅ 624.375µs (SLO: <700.000µs 📉 -10.8%) vs baseline: ~same

Memory: ✅ 42.802MB (SLO: <46.000MB -7.0%) vs baseline: +4.7%

✅ ospathjoin_noaspect

Time: ✅ 634.339µs (SLO: <700.000µs -9.4%) vs baseline: +0.2%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +5.1%

✅ ospathnormcase_aspect

Time: ✅ 347.523µs (SLO: <700.000µs 📉 -50.4%) vs baseline: -0.8%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.8%

✅ ospathnormcase_noaspect

Time: ✅ 357.930µs (SLO: <700.000µs 📉 -48.9%) vs baseline: -0.4%

Memory: ✅ 42.585MB (SLO: <46.000MB -7.4%) vs baseline: +4.9%

✅ ospathsplit_aspect

Time: ✅ 486.791µs (SLO: <700.000µs 📉 -30.5%) vs baseline: -0.2%

Memory: ✅ 42.644MB (SLO: <46.000MB -7.3%) vs baseline: +4.2%

✅ ospathsplit_noaspect

Time: ✅ 501.165µs (SLO: <700.000µs 📉 -28.4%) vs baseline: ~same

Memory: ✅ 42.841MB (SLO: <46.000MB -6.9%) vs baseline: +4.9%

✅ ospathsplitdrive_aspect

Time: ✅ 374.886µs (SLO: <700.000µs 📉 -46.4%) vs baseline: +0.3%

Memory: ✅ 42.782MB (SLO: <46.000MB -7.0%) vs baseline: +4.5%

✅ ospathsplitdrive_noaspect

Time: ✅ 73.297µs (SLO: <700.000µs 📉 -89.5%) vs baseline: -0.6%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +5.0%

✅ ospathsplitext_aspect

Time: ✅ 460.189µs (SLO: <700.000µs 📉 -34.3%) vs baseline: -0.2%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +4.9%

✅ ospathsplitext_noaspect

Time: ✅ 464.481µs (SLO: <700.000µs 📉 -33.6%) vs baseline: +0.3%

Memory: ✅ 42.861MB (SLO: <46.000MB -6.8%) vs baseline: +5.5%

🟡 Near SLO Breach (1 suite)
🟡 tracer - 6/6

✅ large

Time: ✅ 31.323ms (SLO: <32.950ms -4.9%) vs baseline: -0.4%

Memory: ✅ 36.746MB (SLO: <39.250MB -6.4%) vs baseline: +4.9%

✅ medium

Time: ✅ 3.101ms (SLO: <3.200ms -3.1%) vs baseline: -0.1%

Memory: ✅ 35.566MB (SLO: <38.750MB -8.2%) vs baseline: +5.0%

✅ small

Time: ✅ 363.545µs (SLO: <370.000µs 🟡 -1.7%) vs baseline: +4.6%

Memory: ✅ 35.507MB (SLO: <38.750MB -8.4%) vs baseline: +4.7%

⚠️ Unstable Tests (2 suites)
⚠️ coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.302µs (SLO: <20.000µs 📉 -33.5%) vs baseline: ~same

Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +4.8%

✅ context_with_data_no_listeners

Time: ✅ 3.288µs (SLO: <10.000µs 📉 -67.1%) vs baseline: +0.8%

Memory: ✅ 35.704MB (SLO: <38.000MB -6.0%) vs baseline: +5.1%

✅ get_item_exists

Time: ✅ 0.581µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.3%

Memory: ✅ 35.547MB (SLO: <38.000MB -6.5%) vs baseline: +4.8%

✅ get_item_missing

Time: ✅ 0.638µs (SLO: <10.000µs 📉 -93.6%) vs baseline: -0.4%

Memory: ✅ 35.625MB (SLO: <38.000MB -6.2%) vs baseline: +5.0%

✅ set_item

Time: ✅ 24.067µs (SLO: <30.000µs 📉 -19.8%) vs baseline: +0.1%

Memory: ✅ 35.665MB (SLO: <38.000MB -6.1%) vs baseline: +5.0%

⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 155.000µs (SLO: <170.000µs -8.8%) vs baseline: +0.4%

Memory: ✅ 40.172MB (SLO: <46.000MB 📉 -12.7%) vs baseline: +4.3%

✅ import_many_cached

Time: ✅ 120.898µs (SLO: <130.000µs -7.0%) vs baseline: ~same

Memory: ✅ 40.158MB (SLO: <46.000MB 📉 -12.7%) vs baseline: +4.7%

✅ import_many_stdlib

Time: ✅ 0.768ms (SLO: <1.750ms 📉 -56.1%) vs baseline: ~same

Memory: ✅ 40.108MB (SLO: <46.000MB 📉 -12.8%) vs baseline: +4.1%

⚠️ import_many_stdlib_cached

Time: ⚠️ 0.174ms (SLO: <1.100ms 📉 -84.2%) vs baseline: +0.2%

Memory: ✅ 40.209MB (SLO: <46.000MB 📉 -12.6%) vs baseline: +4.7%

✅ import_many_unknown

Time: ✅ 832.766µs (SLO: <890.000µs -6.4%) vs baseline: +0.5%

Memory: ✅ 40.352MB (SLO: <46.000MB 📉 -12.3%) vs baseline: +5.2%

✅ import_many_unknown_cached

Time: ✅ 796.883µs (SLO: <870.000µs -8.4%) vs baseline: +0.7%

Memory: ✅ 40.380MB (SLO: <46.000MB 📉 -12.2%) vs baseline: +4.5%

✅ import_one

Time: ✅ 19.894µs (SLO: <30.000µs 📉 -33.7%) vs baseline: +0.2%

Memory: ✅ 40.410MB (SLO: <46.000MB 📉 -12.2%) vs baseline: +5.4%

✅ import_one_cache

Time: ✅ 6.316µs (SLO: <10.000µs 📉 -36.8%) vs baseline: +0.7%

Memory: ✅ 40.258MB (SLO: <46.000MB 📉 -12.5%) vs baseline: +5.5%

✅ import_one_stdlib

Time: ✅ 18.725µs (SLO: <20.000µs -6.4%) vs baseline: -0.6%

Memory: ✅ 40.321MB (SLO: <46.000MB 📉 -12.3%) vs baseline: +4.6%

✅ import_one_stdlib_cache

Time: ✅ 6.294µs (SLO: <10.000µs 📉 -37.1%) vs baseline: ~same

Memory: ✅ 39.868MB (SLO: <46.000MB 📉 -13.3%) vs baseline: +4.1%

✅ import_one_unknown

Time: ✅ 45.610µs (SLO: <50.000µs -8.8%) vs baseline: +0.2%

Memory: ✅ 40.400MB (SLO: <46.000MB 📉 -12.2%) vs baseline: +5.4%

✅ import_one_unknown_cache

Time: ✅ 6.319µs (SLO: <10.000µs 📉 -36.8%) vs baseline: +1.0%

Memory: ✅ 39.870MB (SLO: <43.000MB -7.3%) vs baseline: +4.2%

✅ All Tests Passing (20 suites)
✅ djangosimple - 30/30

✅ appsec

Time: ✅ 19.520ms (SLO: <22.300ms 📉 -12.5%) vs baseline: ~same

Memory: ✅ 67.633MB (SLO: <73.500MB -8.0%) vs baseline: +4.9%

✅ exception-replay-enabled

Time: ✅ 1.384ms (SLO: <1.450ms -4.5%) vs baseline: ~same

Memory: ✅ 65.726MB (SLO: <71.500MB -8.1%) vs baseline: +4.7%

✅ iast

Time: ✅ 19.586ms (SLO: <22.250ms 📉 -12.0%) vs baseline: ~same

Memory: ✅ 67.594MB (SLO: <75.000MB -9.9%)

✅ profiler

Time: ✅ 15.263ms (SLO: <16.550ms -7.8%) vs baseline: +0.3%

Memory: ✅ 58.751MB (SLO: <61.000MB -3.7%) vs baseline: +4.7%

✅ resource-renaming

Time: ✅ 19.595ms (SLO: <21.750ms -9.9%) vs baseline: -0.1%

Memory: ✅ 67.633MB (SLO: <73.500MB -8.0%)

✅ span-code-origin

Time: ✅ 20.107ms (SLO: <28.200ms 📉 -28.7%) vs baseline: +1.1%

Memory: ✅ 67.625MB (SLO: <75.000MB -9.8%)

✅ tracer

Time: ✅ 19.498ms (SLO: <21.750ms 📉 -10.4%) vs baseline: -0.8%

Memory: ✅ 67.613MB (SLO: <75.000MB -9.8%) vs baseline: +4.9%

✅ tracer-and-profiler

Time: ✅ 21.132ms (SLO: <23.500ms 📉 -10.1%) vs baseline: +0.4%

Memory: ✅ 69.147MB (SLO: <75.000MB -7.8%) vs baseline: +4.9%

✅ tracer-dont-create-db-spans

Time: ✅ 19.604ms (SLO: <21.500ms -8.8%) vs baseline: -0.9%

Memory: ✅ 67.633MB (SLO: <75.000MB -9.8%) vs baseline: +4.9%

✅ tracer-minimal

Time: ✅ 16.797ms (SLO: <17.500ms -4.0%) vs baseline: -0.4%

Memory: ✅ 67.633MB (SLO: <75.000MB -9.8%) vs baseline: +4.9%

✅ tracer-native

Time: ✅ 19.391ms (SLO: <21.750ms 📉 -10.8%) vs baseline: -0.8%

Memory: ✅ 67.613MB (SLO: <72.500MB -6.7%)

✅ tracer-no-caches

Time: ✅ 17.591ms (SLO: <19.650ms 📉 -10.5%) vs baseline: +0.4%

Memory: ✅ 67.633MB (SLO: <75.000MB -9.8%)

✅ tracer-no-databases

Time: ✅ 19.162ms (SLO: <20.100ms -4.7%) vs baseline: -0.2%

Memory: ✅ 67.633MB (SLO: <75.000MB -9.8%)

✅ tracer-no-middleware

Time: ✅ 19.314ms (SLO: <21.500ms 📉 -10.2%) vs baseline: +0.2%

Memory: ✅ 67.633MB (SLO: <75.000MB -9.8%)

✅ tracer-no-templates

Time: ✅ 19.497ms (SLO: <22.000ms 📉 -11.4%) vs baseline: +0.4%

Memory: ✅ 67.613MB (SLO: <73.500MB -8.0%)

✅ errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.353ms (SLO: <19.850ms 📉 -17.6%) vs baseline: ~same

Memory: ✅ 67.339MB (SLO: <75.000MB 📉 -10.2%) vs baseline: +5.1%

✅ errortracking-enabled-user

Time: ✅ 16.399ms (SLO: <19.400ms 📉 -15.5%) vs baseline: +0.2%

Memory: ✅ 67.163MB (SLO: <75.000MB 📉 -10.4%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 16.300ms (SLO: <19.450ms 📉 -16.2%) vs baseline: -0.3%

Memory: ✅ 67.199MB (SLO: <75.000MB 📉 -10.4%) vs baseline: +4.8%

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.111ms (SLO: <2.300ms -8.2%) vs baseline: ~same

Memory: ✅ 55.031MB (SLO: <60.000MB -8.3%) vs baseline: +5.0%

✅ errortracking-enabled-user

Time: ✅ 2.116ms (SLO: <2.250ms -5.9%) vs baseline: ~same

Memory: ✅ 55.070MB (SLO: <60.000MB -8.2%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.108ms (SLO: <2.300ms -8.4%) vs baseline: -0.1%

Memory: ✅ 54.991MB (SLO: <60.000MB -8.3%) vs baseline: +4.8%

✅ flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.423ms (SLO: <4.750ms 📉 -27.9%) vs baseline: ~same

Memory: ✅ 55.069MB (SLO: <66.500MB 📉 -17.2%) vs baseline: +4.7%

✅ appsec-post

Time: ✅ 2.902ms (SLO: <6.750ms 📉 -57.0%) vs baseline: +0.3%

Memory: ✅ 55.090MB (SLO: <66.500MB 📉 -17.2%) vs baseline: +5.0%

✅ appsec-telemetry

Time: ✅ 3.450ms (SLO: <4.750ms 📉 -27.4%) vs baseline: +1.0%

Memory: ✅ 55.027MB (SLO: <66.500MB 📉 -17.3%) vs baseline: +4.8%

✅ debugger

Time: ✅ 1.868ms (SLO: <2.000ms -6.6%) vs baseline: ~same

Memory: ✅ 48.555MB (SLO: <51.500MB -5.7%) vs baseline: +5.0%

✅ iast-get

Time: ✅ 1.861ms (SLO: <2.000ms -6.9%) vs baseline: +0.3%

Memory: ✅ 45.175MB (SLO: <49.000MB -7.8%) vs baseline: +4.8%

✅ profiler

Time: ✅ 1.899ms (SLO: <2.100ms -9.6%) vs baseline: -0.4%

Memory: ✅ 51.310MB (SLO: <52.500MB -2.3%) vs baseline: +4.8%

✅ resource-renaming

Time: ✅ 3.403ms (SLO: <3.650ms -6.8%) vs baseline: +0.4%

Memory: ✅ 55.125MB (SLO: <60.000MB -8.1%) vs baseline: +4.9%

✅ tracer

Time: ✅ 3.415ms (SLO: <3.650ms -6.4%) vs baseline: +0.2%

Memory: ✅ 55.083MB (SLO: <60.000MB -8.2%) vs baseline: +5.0%

✅ tracer-native

Time: ✅ 3.414ms (SLO: <3.650ms -6.5%) vs baseline: +0.3%

Memory: ✅ 55.147MB (SLO: <60.000MB -8.1%) vs baseline: +5.0%

✅ flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.104ms (SLO: <4.200ms 📉 -49.9%) vs baseline: -0.1%

Memory: ✅ 55.011MB (SLO: <66.000MB 📉 -16.7%) vs baseline: +4.9%

✅ iast-enabled

Time: ✅ 2.106ms (SLO: <2.800ms 📉 -24.8%) vs baseline: ~same

Memory: ✅ 55.011MB (SLO: <62.500MB 📉 -12.0%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.098ms (SLO: <2.250ms -6.8%) vs baseline: +0.1%

Memory: ✅ 55.070MB (SLO: <60.000MB -8.2%) vs baseline: +5.0%

✅ forktime - 4/4

✅ baseline

Time: ✅ 1.958ms (SLO: <3.000ms 📉 -34.7%) vs baseline: +2.6%

Memory: ✅ 29.216MB (SLO: <33.000MB 📉 -11.5%) vs baseline: +4.9%

✅ configured

Time: ✅ 8.694ms (SLO: <13.000ms 📉 -33.1%) vs baseline: +0.1%

Memory: ✅ 54.933MB (SLO: <60.000MB -8.4%) vs baseline: +4.9%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 79.196µs (SLO: <100.000µs 📉 -20.8%) vs baseline: +5.1%

Memory: ✅ 35.507MB (SLO: <38.000MB -6.6%) vs baseline: +4.4%

✅ b3_headers

Time: ✅ 12.765µs (SLO: <20.000µs 📉 -36.2%) vs baseline: ~same

Memory: ✅ 35.724MB (SLO: <38.000MB -6.0%) vs baseline: +4.9%

✅ b3_single_headers

Time: ✅ 11.829µs (SLO: <20.000µs 📉 -40.9%) vs baseline: +0.2%

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +5.0%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 60.699µs (SLO: <80.000µs 📉 -24.1%) vs baseline: -0.2%

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +4.6%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 62.508µs (SLO: <80.000µs 📉 -21.9%) vs baseline: ~same

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +4.9%

✅ empty_headers

Time: ✅ 1.312µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +1.3%

Memory: ✅ 35.724MB (SLO: <38.000MB -6.0%) vs baseline: +4.8%

✅ full_t_id_datadog_headers

Time: ✅ 20.882µs (SLO: <30.000µs 📉 -30.4%) vs baseline: ~same

Memory: ✅ 35.684MB (SLO: <38.000MB -6.1%) vs baseline: +4.9%

✅ invalid_priority_header

Time: ✅ 5.938µs (SLO: <10.000µs 📉 -40.6%) vs baseline: +0.1%

Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +4.7%

✅ invalid_span_id_header

Time: ✅ 5.953µs (SLO: <10.000µs 📉 -40.5%) vs baseline: ~same

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +4.5%

✅ invalid_tags_header

Time: ✅ 5.916µs (SLO: <10.000µs 📉 -40.8%) vs baseline: +0.1%

Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +4.7%

✅ invalid_trace_id_header

Time: ✅ 5.939µs (SLO: <10.000µs 📉 -40.6%) vs baseline: +0.3%

Memory: ✅ 35.625MB (SLO: <38.000MB -6.2%) vs baseline: +4.6%

✅ large_header_no_matches

Time: ✅ 27.038µs (SLO: <30.000µs -9.9%) vs baseline: ~same

Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +4.6%

✅ large_valid_headers_all

Time: ✅ 28.007µs (SLO: <40.000µs 📉 -30.0%) vs baseline: ~same

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +4.8%

✅ medium_header_no_matches

Time: ✅ 9.266µs (SLO: <20.000µs 📉 -53.7%) vs baseline: +0.7%

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +4.7%

✅ medium_valid_headers_all

Time: ✅ 10.728µs (SLO: <20.000µs 📉 -46.4%) vs baseline: +0.1%

Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +4.9%

✅ none_propagation_style

Time: ✅ 1.399µs (SLO: <10.000µs 📉 -86.0%) vs baseline: +1.0%

Memory: ✅ 35.625MB (SLO: <38.000MB -6.2%) vs baseline: +4.7%

✅ tracecontext_headers

Time: ✅ 32.675µs (SLO: <40.000µs 📉 -18.3%) vs baseline: ~same

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +4.6%

✅ valid_headers_all

Time: ✅ 5.953µs (SLO: <10.000µs 📉 -40.5%) vs baseline: +0.8%

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +4.6%

✅ valid_headers_basic

Time: ✅ 5.494µs (SLO: <10.000µs 📉 -45.1%) vs baseline: ~same

Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +4.6%

✅ wsgi_empty_headers

Time: ✅ 1.313µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +1.2%

Memory: ✅ 35.704MB (SLO: <38.000MB -6.0%) vs baseline: +5.1%

✅ wsgi_invalid_priority_header

Time: ✅ 5.967µs (SLO: <10.000µs 📉 -40.3%) vs baseline: -0.5%

Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +4.7%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.321µs (SLO: <10.000µs 📉 -86.8%) vs baseline: +1.1%

Memory: ✅ 35.665MB (SLO: <38.000MB -6.1%) vs baseline: +5.1%

✅ wsgi_invalid_tags_header

Time: ✅ 5.984µs (SLO: <10.000µs 📉 -40.2%) vs baseline: +0.2%

Memory: ✅ 35.625MB (SLO: <38.000MB -6.2%) vs baseline: +4.9%

✅ wsgi_invalid_trace_id_header

Time: ✅ 5.939µs (SLO: <10.000µs 📉 -40.6%) vs baseline: -0.6%

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +4.5%

✅ wsgi_large_header_no_matches

Time: ✅ 28.165µs (SLO: <40.000µs 📉 -29.6%) vs baseline: +0.2%

Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +4.9%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.346µs (SLO: <40.000µs 📉 -26.6%) vs baseline: +0.3%

Memory: ✅ 35.724MB (SLO: <38.000MB -6.0%) vs baseline: +5.0%

✅ wsgi_medium_header_no_matches

Time: ✅ 9.493µs (SLO: <20.000µs 📉 -52.5%) vs baseline: ~same

Memory: ✅ 35.724MB (SLO: <38.000MB -6.0%) vs baseline: +5.1%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.096µs (SLO: <20.000µs 📉 -44.5%) vs baseline: +1.2%

Memory: ✅ 35.625MB (SLO: <38.000MB -6.2%) vs baseline: +4.7%

✅ wsgi_valid_headers_all

Time: ✅ 5.975µs (SLO: <10.000µs 📉 -40.2%) vs baseline: ~same

Memory: ✅ 35.665MB (SLO: <38.000MB -6.1%) vs baseline: +4.8%

✅ wsgi_valid_headers_basic

Time: ✅ 5.520µs (SLO: <10.000µs 📉 -44.8%) vs baseline: +0.2%

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +4.7%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 20.291µs (SLO: <30.000µs 📉 -32.4%) vs baseline: +3.2%

Memory: ✅ 35.625MB (SLO: <38.000MB -6.2%) vs baseline: +4.8%

✅ with_all

Time: ✅ 26.380µs (SLO: <40.000µs 📉 -34.1%) vs baseline: +0.2%

Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +4.6%

✅ with_dd_origin

Time: ✅ 23.171µs (SLO: <30.000µs 📉 -22.8%) vs baseline: -0.3%

Memory: ✅ 35.724MB (SLO: <38.000MB -6.0%) vs baseline: +5.1%

✅ with_priority_and_origin

Time: ✅ 22.788µs (SLO: <40.000µs 📉 -43.0%) vs baseline: +0.4%

Memory: ✅ 35.625MB (SLO: <38.000MB -6.2%) vs baseline: +4.7%

✅ with_sampling_priority

Time: ✅ 19.600µs (SLO: <30.000µs 📉 -34.7%) vs baseline: -0.4%

Memory: ✅ 35.665MB (SLO: <38.000MB -6.1%) vs baseline: +5.0%

✅ with_tags

Time: ✅ 24.375µs (SLO: <40.000µs 📉 -39.1%) vs baseline: -0.3%

Memory: ✅ 35.763MB (SLO: <38.000MB -5.9%) vs baseline: +4.9%

✅ with_tags_invalid

Time: ✅ 25.807µs (SLO: <40.000µs 📉 -35.5%) vs baseline: +0.2%

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +4.8%

✅ with_tags_max_size

Time: ✅ 24.790µs (SLO: <40.000µs 📉 -38.0%) vs baseline: -0.2%

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +4.9%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 154.784µs (SLO: <250.000µs 📉 -38.1%) vs baseline: +2.5%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.8%

✅ rsplit_noaspect

Time: ✅ 155.162µs (SLO: <250.000µs 📉 -37.9%) vs baseline: -1.0%

Memory: ✅ 42.605MB (SLO: <46.000MB -7.4%) vs baseline: +4.3%

✅ split_aspect

Time: ✅ 148.163µs (SLO: <250.000µs 📉 -40.7%) vs baseline: -0.8%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ split_noaspect

Time: ✅ 154.078µs (SLO: <250.000µs 📉 -38.4%) vs baseline: ~same

Memory: ✅ 42.703MB (SLO: <46.000MB -7.2%) vs baseline: +4.6%

✅ splitlines_aspect

Time: ✅ 144.829µs (SLO: <250.000µs 📉 -42.1%) vs baseline: -0.7%

Memory: ✅ 42.821MB (SLO: <46.000MB -6.9%) vs baseline: +4.5%

✅ splitlines_noaspect

Time: ✅ 150.984µs (SLO: <250.000µs 📉 -39.6%) vs baseline: +0.2%

Memory: ✅ 42.546MB (SLO: <46.000MB -7.5%) vs baseline: +3.8%

✅ iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.065µs (SLO: <60.000µs 📉 -19.9%) vs baseline: -0.5%

Memory: ✅ 38.987MB (SLO: <42.000MB -7.2%) vs baseline: +4.6%

✅ propagation_enabled

Time: ✅ 134.753µs (SLO: <190.000µs 📉 -29.1%) vs baseline: -1.1%

Memory: ✅ 39.125MB (SLO: <42.000MB -6.8%) vs baseline: +5.1%

✅ propagation_enabled_100

Time: ✅ 1.564ms (SLO: <2.300ms 📉 -32.0%) vs baseline: +0.3%

Memory: ✅ 39.046MB (SLO: <42.000MB -7.0%) vs baseline: +4.8%

✅ propagation_enabled_1000

Time: ✅ 28.886ms (SLO: <34.550ms 📉 -16.4%) vs baseline: ~same

Memory: ✅ 39.007MB (SLO: <42.000MB -7.1%) vs baseline: +4.8%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.414ms (SLO: <42.000ms -3.8%) vs baseline: +0.3%

Memory: ✅ 37.965MB (SLO: <40.750MB -6.8%) vs baseline: +4.9%

✅ add-link

Time: ✅ 36.453ms (SLO: <38.550ms -5.4%) vs baseline: +0.4%

Memory: ✅ 37.965MB (SLO: <40.750MB -6.8%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 221.203ms (SLO: <232.000ms -4.7%) vs baseline: +1.6%

Memory: ✅ 37.965MB (SLO: <40.750MB -6.8%) vs baseline: +4.6%

✅ add-tags

Time: ✅ 213.424ms (SLO: <221.600ms -3.7%) vs baseline: +1.2%

Memory: ✅ 38.103MB (SLO: <40.750MB -6.5%) vs baseline: +5.3%

✅ get-context

Time: ✅ 29.190ms (SLO: <31.300ms -6.7%) vs baseline: +0.2%

Memory: ✅ 38.063MB (SLO: <40.750MB -6.6%) vs baseline: +5.3%

✅ is-recording

Time: ✅ 29.266ms (SLO: <31.000ms -5.6%) vs baseline: -0.9%

Memory: ✅ 38.024MB (SLO: <40.750MB -6.7%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 63.524ms (SLO: <65.850ms -3.5%) vs baseline: ~same

Memory: ✅ 38.083MB (SLO: <40.750MB -6.5%) vs baseline: +5.3%

✅ set-status

Time: ✅ 31.842ms (SLO: <34.150ms -6.8%) vs baseline: +0.2%

Memory: ✅ 37.945MB (SLO: <40.750MB -6.9%) vs baseline: +4.8%

✅ start

Time: ✅ 29.300ms (SLO: <30.150ms -2.8%) vs baseline: +2.0%

Memory: ✅ 38.044MB (SLO: <40.750MB -6.6%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 34.077ms (SLO: <35.350ms -3.6%) vs baseline: +0.9%

Memory: ✅ 37.926MB (SLO: <40.750MB -6.9%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 33.811ms (SLO: <35.450ms -4.6%) vs baseline: -0.7%

Memory: ✅ 37.985MB (SLO: <40.750MB -6.8%) vs baseline: +4.3%

✅ update-name

Time: ✅ 31.134ms (SLO: <33.400ms -6.8%) vs baseline: +0.6%

Memory: ✅ 37.926MB (SLO: <40.750MB -6.9%) vs baseline: +4.7%

✅ otelspan - 22/22

✅ add-event

Time: ✅ 40.973ms (SLO: <47.150ms 📉 -13.1%) vs baseline: +0.3%

Memory: ✅ 40.505MB (SLO: <47.000MB 📉 -13.8%) vs baseline: +4.8%

✅ add-metrics

Time: ✅ 253.612ms (SLO: <344.800ms 📉 -26.4%) vs baseline: +0.3%

Memory: ✅ 44.976MB (SLO: <47.500MB -5.3%) vs baseline: +4.9%

✅ add-tags

Time: ✅ 305.701ms (SLO: <330.000ms -7.4%) vs baseline: ~same

Memory: ✅ 44.967MB (SLO: <47.500MB -5.3%) vs baseline: +4.8%

✅ get-context

Time: ✅ 81.463ms (SLO: <92.350ms 📉 -11.8%) vs baseline: +0.5%

Memory: ✅ 40.892MB (SLO: <46.500MB 📉 -12.1%) vs baseline: +5.2%

✅ is-recording

Time: ✅ 37.186ms (SLO: <44.500ms 📉 -16.4%) vs baseline: +0.4%

Memory: ✅ 40.387MB (SLO: <47.500MB 📉 -15.0%) vs baseline: +4.9%

✅ record-exception

Time: ✅ 60.020ms (SLO: <67.650ms 📉 -11.3%) vs baseline: ~same

Memory: ✅ 40.899MB (SLO: <47.000MB 📉 -13.0%) vs baseline: +4.7%

✅ set-status

Time: ✅ 43.617ms (SLO: <50.400ms 📉 -13.5%) vs baseline: +0.2%

Memory: ✅ 40.383MB (SLO: <47.000MB 📉 -14.1%) vs baseline: +5.0%

✅ start

Time: ✅ 38.050ms (SLO: <43.450ms 📉 -12.4%) vs baseline: +4.3%

Memory: ✅ 40.383MB (SLO: <47.000MB 📉 -14.1%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 85.591ms (SLO: <90.000ms -4.9%) vs baseline: +0.1%

Memory: ✅ 38.063MB (SLO: <46.500MB 📉 -18.1%) vs baseline: +4.6%

✅ start-finish-telemetry

Time: ✅ 87.003ms (SLO: <91.000ms -4.4%) vs baseline: ~same

Memory: ✅ 38.063MB (SLO: <46.500MB 📉 -18.1%) vs baseline: +4.5%

✅ update-name

Time: ✅ 38.285ms (SLO: <45.150ms 📉 -15.2%) vs baseline: +0.5%

Memory: ✅ 40.527MB (SLO: <47.000MB 📉 -13.8%) vs baseline: +5.1%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 345.009ms (SLO: <354.300ms -2.6%) vs baseline: ~same

Memory: ✅ 41.317MB (SLO: <46.000MB 📉 -10.2%) vs baseline: +4.8%

✅ cache_on

Time: ✅ 0.388µs (SLO: <10.000µs 📉 -96.1%) vs baseline: -1.7%

Memory: ✅ 39.760MB (SLO: <46.000MB 📉 -13.6%) vs baseline: +5.1%

✅ rand - 2/2

✅ rand128bits

Time: ✅ 0.188µs (SLO: <21.000µs 📉 -99.1%) vs baseline: +0.1%

✅ rand64bits

Time: ✅ 0.123µs (SLO: <15.000µs 📉 -99.2%) vs baseline: +0.8%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.345µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -1.0%

Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +5.0%

✅ high_rate_limit

Time: ✅ 2.428µs (SLO: <10.000µs 📉 -75.7%) vs baseline: ~same

Memory: ✅ 35.507MB (SLO: <38.000MB -6.6%) vs baseline: +4.5%

✅ long_window

Time: ✅ 2.349µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -1.0%

Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +4.9%

✅ low_rate_limit

Time: ✅ 2.387µs (SLO: <10.000µs 📉 -76.1%) vs baseline: +0.9%

Memory: ✅ 35.507MB (SLO: <38.000MB -6.6%) vs baseline: +4.6%

✅ no_rate_limit

Time: ✅ 0.827µs (SLO: <10.000µs 📉 -91.7%) vs baseline: -1.2%

Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +4.3%

✅ short_window

Time: ✅ 2.485µs (SLO: <10.000µs 📉 -75.2%) vs baseline: -1.3%

Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +4.9%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 310.266ms (SLO: <320.950ms -3.3%) vs baseline: +0.1%

Memory: ✅ 36.274MB (SLO: <38.750MB -6.4%) vs baseline: +4.7%

✅ deep-profiled

Time: ✅ 330.843ms (SLO: <359.150ms -7.9%) vs baseline: ~same

Memory: ✅ 42.290MB (SLO: <46.000MB -8.1%) vs baseline: +4.5%

✅ medium

Time: ✅ 7.123ms (SLO: <7.400ms -3.7%) vs baseline: ~same

Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +5.0%

✅ shallow

Time: ✅ 0.987ms (SLO: <1.050ms -6.0%) vs baseline: +2.0%

Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +4.9%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 146.712µs (SLO: <290.000µs 📉 -49.4%) vs baseline: +0.1%

Memory: ✅ 35.488MB (SLO: <38.000MB -6.6%) vs baseline: +4.9%

✅ high_match

Time: ✅ 192.683µs (SLO: <480.000µs 📉 -59.9%) vs baseline: +0.3%

Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +4.7%

✅ low_match

Time: ✅ 99.590µs (SLO: <120.000µs 📉 -17.0%) vs baseline: ~same

Memory: ✅ 700.791MB (SLO: <780.000MB 📉 -10.2%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.851ms (SLO: <8.500ms 📉 -66.5%) vs baseline: -1.0%

Memory: ✅ 77.981MB (SLO: <85.000MB -8.3%) vs baseline: +4.8%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.536µs (SLO: <20.000µs 📉 -47.3%) vs baseline: -0.2%

Memory: ✅ 36.156MB (SLO: <38.750MB -6.7%) vs baseline: +5.0%

✅ all-enabled

Time: ✅ 41.057µs (SLO: <50.000µs 📉 -17.9%) vs baseline: +2.8%

Memory: ✅ 36.038MB (SLO: <38.750MB -7.0%) vs baseline: +4.7%

✅ collectipvariant_exists

Time: ✅ 41.088µs (SLO: <50.000µs 📉 -17.8%) vs baseline: +0.8%

Memory: ✅ 36.019MB (SLO: <38.750MB -7.0%) vs baseline: +4.6%

✅ no-collectipvariant

Time: ✅ 39.915µs (SLO: <50.000µs 📉 -20.2%) vs baseline: -0.2%

Memory: ✅ 36.196MB (SLO: <38.750MB -6.6%) vs baseline: +5.2%

✅ no-useragentvariant

Time: ✅ 38.598µs (SLO: <50.000µs 📉 -22.8%) vs baseline: -0.2%

Memory: ✅ 36.058MB (SLO: <38.750MB -6.9%) vs baseline: +4.7%

✅ obfuscation-no-query

Time: ✅ 40.363µs (SLO: <50.000µs 📉 -19.3%) vs baseline: -0.8%

Memory: ✅ 35.861MB (SLO: <38.750MB -7.5%) vs baseline: +3.9%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 76.226µs (SLO: <90.000µs 📉 -15.3%) vs baseline: +0.1%

Memory: ✅ 36.392MB (SLO: <38.750MB -6.1%) vs baseline: +4.9%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.757µs (SLO: <90.000µs 📉 -14.7%) vs baseline: +0.3%

Memory: ✅ 36.392MB (SLO: <38.750MB -6.1%) vs baseline: +4.8%

✅ obfuscation-send-querystring-disabled

Time: ✅ 155.243µs (SLO: <170.000µs -8.7%) vs baseline: ~same

Memory: ✅ 36.333MB (SLO: <38.750MB -6.2%) vs baseline: +4.9%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 149.551µs (SLO: <160.000µs -6.5%) vs baseline: ~same

Memory: ✅ 36.412MB (SLO: <38.750MB -6.0%) vs baseline: +4.7%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 156.065µs (SLO: <170.000µs -8.2%) vs baseline: ~same

Memory: ✅ 36.353MB (SLO: <38.750MB -6.2%) vs baseline: +4.7%

✅ useragentvariant_exists_1

Time: ✅ 39.624µs (SLO: <50.000µs 📉 -20.8%) vs baseline: +0.4%

Memory: ✅ 36.058MB (SLO: <38.750MB -6.9%) vs baseline: +5.0%

✅ useragentvariant_exists_2

Time: ✅ 40.512µs (SLO: <50.000µs 📉 -19.0%) vs baseline: +0.2%

Memory: ✅ 36.137MB (SLO: <38.750MB -6.7%) vs baseline: +5.0%

✅ useragentvariant_exists_3

Time: ✅ 39.944µs (SLO: <50.000µs 📉 -20.1%) vs baseline: -0.4%

Memory: ✅ 36.196MB (SLO: <38.750MB -6.6%) vs baseline: +5.0%

✅ useragentvariant_not_exists_1

Time: ✅ 39.530µs (SLO: <50.000µs 📉 -20.9%) vs baseline: +0.2%

Memory: ✅ 36.156MB (SLO: <38.750MB -6.7%) vs baseline: +5.5%

✅ useragentvariant_not_exists_2

Time: ✅ 39.327µs (SLO: <50.000µs 📉 -21.3%) vs baseline: -0.2%

Memory: ✅ 36.097MB (SLO: <38.750MB -6.8%) vs baseline: +5.0%

✅ span - 26/26

✅ add-event

Time: ✅ 18.653ms (SLO: <22.500ms 📉 -17.1%) vs baseline: ~same

Memory: ✅ 37.611MB (SLO: <53.000MB 📉 -29.0%) vs baseline: +4.8%

✅ add-metrics

Time: ✅ 89.275ms (SLO: <93.500ms -4.5%) vs baseline: +1.0%

Memory: ✅ 42.271MB (SLO: <53.000MB 📉 -20.2%) vs baseline: +4.9%

✅ add-tags

Time: ✅ 144.958ms (SLO: <155.000ms -6.5%) vs baseline: +0.4%

Memory: ✅ 42.051MB (SLO: <53.000MB 📉 -20.7%) vs baseline: +4.7%

✅ get-context

Time: ✅ 16.979ms (SLO: <20.500ms 📉 -17.2%) vs baseline: ~same

Memory: ✅ 37.650MB (SLO: <53.000MB 📉 -29.0%) vs baseline: +5.2%

✅ is-recording

Time: ✅ 17.109ms (SLO: <20.500ms 📉 -16.5%) vs baseline: ~same

Memory: ✅ 37.591MB (SLO: <53.000MB 📉 -29.1%) vs baseline: +4.9%

✅ record-exception

Time: ✅ 38.119ms (SLO: <41.000ms -7.0%) vs baseline: +0.3%

Memory: ✅ 38.225MB (SLO: <53.000MB 📉 -27.9%) vs baseline: +5.3%

✅ set-status

Time: ✅ 18.860ms (SLO: <22.000ms 📉 -14.3%) vs baseline: +0.6%

Memory: ✅ 37.611MB (SLO: <53.000MB 📉 -29.0%) vs baseline: +5.0%

✅ start

Time: ✅ 18.018ms (SLO: <20.500ms 📉 -12.1%) vs baseline: +5.8%

Memory: ✅ 37.552MB (SLO: <53.000MB 📉 -29.1%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 53.354ms (SLO: <56.000ms -4.7%) vs baseline: ~same

Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 54.575ms (SLO: <58.000ms -5.9%) vs baseline: -0.2%

Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +4.9%

✅ start-finish-traceid128

Time: ✅ 56.034ms (SLO: <60.000ms -6.6%) vs baseline: -0.7%

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +5.0%

✅ start-traceid128

Time: ✅ 16.947ms (SLO: <22.500ms 📉 -24.7%) vs baseline: ~same

Memory: ✅ 37.493MB (SLO: <53.000MB 📉 -29.3%) vs baseline: +4.9%

✅ update-name

Time: ✅ 17.638ms (SLO: <22.000ms 📉 -19.8%) vs baseline: ~same

Memory: ✅ 37.622MB (SLO: <53.000MB 📉 -29.0%) vs baseline: +4.8%

✅ telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 2.229µs (SLO: <20.000µs 📉 -88.9%) vs baseline: +6.8%

Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +4.9%

✅ 1-count-metrics-100-times

Time: ✅ 150.282µs (SLO: <220.000µs 📉 -31.7%) vs baseline: ~same

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +4.6%

✅ 1-distribution-metric-1-times

Time: ✅ 2.450µs (SLO: <20.000µs 📉 -87.8%) vs baseline: -0.1%

Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +4.7%

✅ 1-distribution-metrics-100-times

Time: ✅ 164.923µs (SLO: <230.000µs 📉 -28.3%) vs baseline: +0.6%

Memory: ✅ 35.468MB (SLO: <38.000MB -6.7%) vs baseline: +4.4%

✅ 1-gauge-metric-1-times

Time: ✅ 1.950µs (SLO: <20.000µs 📉 -90.2%) vs baseline: -0.5%

Memory: ✅ 35.488MB (SLO: <38.000MB -6.6%) vs baseline: +4.7%

✅ 1-gauge-metrics-100-times

Time: ✅ 135.961µs (SLO: <150.000µs -9.4%) vs baseline: -0.4%

Memory: ✅ 35.468MB (SLO: <38.000MB -6.7%) vs baseline: +4.5%

✅ 1-rate-metric-1-times

Time: ✅ 2.231µs (SLO: <20.000µs 📉 -88.8%) vs baseline: +0.7%

Memory: ✅ 35.507MB (SLO: <38.000MB -6.6%) vs baseline: +4.7%

✅ 1-rate-metrics-100-times

Time: ✅ 161.621µs (SLO: <250.000µs 📉 -35.4%) vs baseline: -1.3%

Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +4.9%

✅ 100-count-metrics-100-times

Time: ✅ 15.146ms (SLO: <22.000ms 📉 -31.2%) vs baseline: -0.8%

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +5.0%

✅ 100-distribution-metrics-100-times

Time: ✅ 1.743ms (SLO: <2.550ms 📉 -31.7%) vs baseline: ~same

Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +4.8%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.402ms (SLO: <1.550ms -9.5%) vs baseline: ~same

Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +4.7%

✅ 100-rate-metrics-100-times

Time: ✅ 1.688ms (SLO: <2.550ms 📉 -33.8%) vs baseline: -0.4%

Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +4.8%

✅ flush-1-metric

Time: ✅ 3.635µs (SLO: <20.000µs 📉 -81.8%) vs baseline: +0.2%

Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +4.7%

✅ flush-100-metrics

Time: ✅ 175.000µs (SLO: <250.000µs 📉 -30.0%) vs baseline: ~same

Memory: ✅ 35.704MB (SLO: <38.000MB -6.0%) vs baseline: +5.3%

✅ flush-1000-metrics

Time: ✅ 2.175ms (SLO: <2.500ms 📉 -13.0%) vs baseline: -0.3%

Memory: ✅ 36.392MB (SLO: <38.750MB -6.1%) vs baseline: +4.8%

ℹ️ Scenarios Missing SLO Configuration (46 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • iast_aspects-re_expand_aspect
  • iast_aspects-re_expand_noaspect
  • iast_aspects-re_findall_aspect
  • iast_aspects-re_findall_noaspect
  • iast_aspects-re_finditer_aspect
  • iast_aspects-re_finditer_noaspect
  • iast_aspects-re_fullmatch_aspect
  • iast_aspects-re_fullmatch_noaspect
  • iast_aspects-re_group_aspect
  • iast_aspects-re_group_noaspect
  • iast_aspects-re_groups_aspect
  • iast_aspects-re_groups_noaspect
  • iast_aspects-re_match_aspect
  • iast_aspects-re_match_noaspect
  • iast_aspects-re_search_aspect
  • iast_aspects-re_search_noaspect
  • iast_aspects-re_sub_aspect
  • iast_aspects-re_sub_noaspect
  • iast_aspects-re_subn_aspect
  • iast_aspects-re_subn_noaspect
  • sethttpmeta-obfuscation-disabled
  • startup-baseline
  • startup-baseline_django
  • startup-baseline_flask
  • startup-ddtrace_run
  • startup-ddtrace_run_appsec
  • startup-ddtrace_run_profiling
  • startup-ddtrace_run_runtime_metrics
  • startup-ddtrace_run_send_span
  • startup-ddtrace_run_telemetry_disabled
  • startup-ddtrace_run_telemetry_enabled
  • startup-import_ddtrace
  • startup-import_ddtrace_auto
  • startup-import_ddtrace_auto_django
  • startup-import_ddtrace_auto_flask
  • startup-import_ddtrace_django
  • startup-import_ddtrace_flask

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@taegyunkim taegyunkim taegyunkim approved these changes

@gnufede gnufede Awaiting requested review from gnufede

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

changelog/no-changelog A changelog entry is not required for this PR.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@brettlangdon @taegyunkim