Conversation
Codeowners resolved as |
Performance SLOsComparing candidate brettlangdon/langgraph.venvs.per.job (aa3ea33) with baseline main (5e36f7e) 📈 Performance Regressions (2 suites)📈 iastaspects - 117/117✅ add_aspectTime: ✅ 102.907µs (SLO: <130.000µs 📉 -20.8%) vs baseline: +2.5% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ add_inplace_aspectTime: ✅ 100.782µs (SLO: <130.000µs 📉 -22.5%) vs baseline: ~same Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.1% ✅ add_inplace_noaspectTime: ✅ 28.580µs (SLO: <40.000µs 📉 -28.6%) vs baseline: +1.0% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ add_noaspectTime: ✅ 48.666µs (SLO: <70.000µs 📉 -30.5%) vs baseline: -0.4% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.7% ✅ bytearray_aspectTime: ✅ 253.025µs (SLO: <400.000µs 📉 -36.7%) vs baseline: -0.1% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.7% ✅ bytearray_extend_aspectTime: ✅ 636.428µs (SLO: <800.000µs 📉 -20.4%) vs baseline: +0.4% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.0% ✅ bytearray_extend_noaspectTime: ✅ 264.095µs (SLO: <400.000µs 📉 -34.0%) vs baseline: -0.1% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.6% ✅ bytearray_noaspectTime: ✅ 134.630µs (SLO: <300.000µs 📉 -55.1%) vs baseline: -1.3% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.7% ✅ bytes_aspectTime: ✅ 219.456µs (SLO: <300.000µs 📉 -26.8%) vs baseline: -1.2% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.6% ✅ bytes_noaspectTime: ✅ 133.680µs (SLO: <200.000µs 📉 -33.2%) vs baseline: -0.3% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.7% ✅ bytesio_aspectTime: ✅ 3.773ms (SLO: <5.000ms 📉 -24.5%) vs baseline: -0.2% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +4.7% ✅ bytesio_noaspectTime: ✅ 318.179µs (SLO: <420.000µs 📉 -24.2%) vs baseline: +0.6% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ capitalize_aspectTime: ✅ 89.549µs (SLO: <300.000µs 📉 -70.2%) vs baseline: -0.2% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.1% ✅ capitalize_noaspectTime: ✅ 251.145µs (SLO: <300.000µs 📉 -16.3%) vs baseline: +0.2% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.7% ✅ casefold_aspectTime: ✅ 91.970µs (SLO: <500.000µs 📉 -81.6%) vs baseline: +3.4% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ casefold_noaspectTime: ✅ 306.162µs (SLO: <500.000µs 📉 -38.8%) vs baseline: -0.6% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ decode_aspectTime: ✅ 86.387µs (SLO: <100.000µs 📉 -13.6%) vs baseline: -0.4% Memory: ✅ 42.861MB (SLO: <46.000MB -6.8%) vs baseline: +4.7% ✅ decode_noaspectTime: ✅ 152.926µs (SLO: <210.000µs 📉 -27.2%) vs baseline: +0.2% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ encode_aspectTime: ✅ 84.098µs (SLO: <200.000µs 📉 -58.0%) vs baseline: ~same Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ encode_noaspectTime: ✅ 141.039µs (SLO: <200.000µs 📉 -29.5%) vs baseline: -0.3% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.7% ✅ format_aspectTime: ✅ 14.616ms (SLO: <19.200ms 📉 -23.9%) vs baseline: +0.4% Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +4.7% ✅ format_map_aspectTime: ✅ 16.397ms (SLO: <21.500ms 📉 -23.7%) vs baseline: -0.1% Memory: ✅ 43.037MB (SLO: <46.000MB -6.4%) vs baseline: +4.8% ✅ format_map_noaspectTime: ✅ 378.184µs (SLO: <500.000µs 📉 -24.4%) vs baseline: +1.9% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.6% ✅ format_noaspectTime: ✅ 302.196µs (SLO: <500.000µs 📉 -39.6%) vs baseline: -0.2% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +4.9% ✅ index_aspectTime: ✅ 120.779µs (SLO: <300.000µs 📉 -59.7%) vs baseline: -0.1% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.8% ✅ index_noaspectTime: ✅ 40.430µs (SLO: <300.000µs 📉 -86.5%) vs baseline: +0.2% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ join_aspectTime: ✅ 212.127µs (SLO: <300.000µs 📉 -29.3%) vs baseline: +0.4% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ join_noaspectTime: ✅ 141.959µs (SLO: <300.000µs 📉 -52.7%) vs baseline: +0.5% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ ljust_aspectTime: ✅ 495.668µs (SLO: <700.000µs 📉 -29.2%) vs baseline: -1.0% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.8% ✅ ljust_noaspectTime: ✅ 258.114µs (SLO: <300.000µs 📉 -14.0%) vs baseline: +0.1% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ lower_aspectTime: ✅ 295.030µs (SLO: <500.000µs 📉 -41.0%) vs baseline: -0.2% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ lower_noaspectTime: ✅ 237.235µs (SLO: <300.000µs 📉 -20.9%) vs baseline: +0.4% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ lstrip_aspectTime: ✅ 0.271ms (SLO: <3.000ms 📉 -91.0%) vs baseline: +1.3% Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.2% ✅ lstrip_noaspectTime: ✅ 0.212ms (SLO: <3.000ms 📉 -92.9%) vs baseline: 📈 +18.8% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ modulo_aspectTime: ✅ 14.263ms (SLO: <18.750ms 📉 -23.9%) vs baseline: ~same Memory: ✅ 43.077MB (SLO: <46.000MB -6.4%) vs baseline: +5.0% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 14.782ms (SLO: <19.350ms 📉 -23.6%) vs baseline: -0.2% Memory: ✅ 43.036MB (SLO: <46.000MB -6.4%) vs baseline: +4.8% ✅ modulo_aspect_for_bytesTime: ✅ 14.615ms (SLO: <18.900ms 📉 -22.7%) vs baseline: +1.3% Memory: ✅ 43.037MB (SLO: <46.000MB -6.4%) vs baseline: +4.9% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 14.596ms (SLO: <19.150ms 📉 -23.8%) vs baseline: -0.3% Memory: ✅ 43.037MB (SLO: <46.000MB -6.4%) vs baseline: +5.0% ✅ modulo_noaspectTime: ✅ 0.363ms (SLO: <3.000ms 📉 -87.9%) vs baseline: +0.5% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ replace_aspectTime: ✅ 18.404ms (SLO: <24.000ms 📉 -23.3%) vs baseline: +0.2% Memory: ✅ 43.037MB (SLO: <46.000MB -6.4%) vs baseline: +4.7% ✅ replace_noaspectTime: ✅ 282.562µs (SLO: <300.000µs -5.8%) vs baseline: +0.3% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ repr_aspectTime: ✅ 311.128µs (SLO: <420.000µs 📉 -25.9%) vs baseline: -1.3% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.7% ✅ repr_noaspectTime: ✅ 46.550µs (SLO: <90.000µs 📉 -48.3%) vs baseline: ~same Memory: ✅ 42.861MB (SLO: <46.000MB -6.8%) vs baseline: +4.7% ✅ rstrip_aspectTime: ✅ 383.342µs (SLO: <500.000µs 📉 -23.3%) vs baseline: +0.4% ✅ rstrip_noaspectTime: ✅ 186.563µs (SLO: <300.000µs 📉 -37.8%) vs baseline: +1.4% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ slice_aspectTime: ✅ 185.004µs (SLO: <300.000µs 📉 -38.3%) vs baseline: ~same Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ slice_noaspectTime: ✅ 54.023µs (SLO: <90.000µs 📉 -40.0%) vs baseline: -1.0% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ stringio_aspectTime: ✅ 3.840ms (SLO: <5.000ms 📉 -23.2%) vs baseline: +0.3% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8% ✅ stringio_noaspectTime: ✅ 346.226µs (SLO: <500.000µs 📉 -30.8%) vs baseline: +0.3% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0% ✅ strip_aspectTime: ✅ 267.980µs (SLO: <350.000µs 📉 -23.4%) vs baseline: -0.4% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +4.9% ✅ strip_noaspectTime: ✅ 178.341µs (SLO: <240.000µs 📉 -25.7%) vs baseline: +1.0% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.9% ✅ swapcase_aspectTime: ✅ 352.778µs (SLO: <500.000µs 📉 -29.4%) vs baseline: +5.8% Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.0% ✅ swapcase_noaspectTime: ✅ 270.975µs (SLO: <400.000µs 📉 -32.3%) vs baseline: -0.7% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.7% ✅ title_aspectTime: ✅ 321.182µs (SLO: <500.000µs 📉 -35.8%) vs baseline: +0.8% Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0% ✅ title_noaspectTime: ✅ 259.790µs (SLO: <400.000µs 📉 -35.1%) vs baseline: +0.2% Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ translate_aspectTime: ✅ 496.566µs (SLO: <700.000µs 📉 -29.1%) vs baseline: +0.1% Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.9% ✅ translate_noaspectTime: ✅ 426.934µs (SLO: <500.000µs 📉 -14.6%) vs baseline: -0.9% Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.9% ✅ upper_aspectTime: ✅ 296.836µs (SLO: <500.000µs 📉 -40.6%) vs baseline: +1.4% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.8% ✅ upper_noaspectTime: ✅ 234.319µs (SLO: <400.000µs 📉 -41.4%) vs baseline: -1.3% Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.9% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 510.826µs (SLO: <700.000µs 📉 -27.0%) vs baseline: 📈 +19.2% Memory: ✅ 42.487MB (SLO: <46.000MB -7.6%) vs baseline: +4.8% ✅ ospathbasename_noaspectTime: ✅ 432.221µs (SLO: <700.000µs 📉 -38.3%) vs baseline: +1.0% Memory: ✅ 42.664MB (SLO: <46.000MB -7.3%) vs baseline: +5.1% ✅ ospathjoin_aspectTime: ✅ 629.321µs (SLO: <700.000µs 📉 -10.1%) vs baseline: +0.6% Memory: ✅ 42.546MB (SLO: <46.000MB -7.5%) vs baseline: +4.7% ✅ ospathjoin_noaspectTime: ✅ 630.348µs (SLO: <700.000µs -10.0%) vs baseline: -0.9% Memory: ✅ 42.625MB (SLO: <46.000MB -7.3%) vs baseline: +4.8% ✅ ospathnormcase_aspectTime: ✅ 349.794µs (SLO: <700.000µs 📉 -50.0%) vs baseline: +0.4% Memory: ✅ 42.566MB (SLO: <46.000MB -7.5%) vs baseline: +4.7% ✅ ospathnormcase_noaspectTime: ✅ 356.302µs (SLO: <700.000µs 📉 -49.1%) vs baseline: -0.5% Memory: ✅ 42.605MB (SLO: <46.000MB -7.4%) vs baseline: +5.0% ✅ ospathsplit_aspectTime: ✅ 487.221µs (SLO: <700.000µs 📉 -30.4%) vs baseline: -0.8% Memory: ✅ 42.625MB (SLO: <46.000MB -7.3%) vs baseline: +5.1% ✅ ospathsplit_noaspectTime: ✅ 499.963µs (SLO: <700.000µs 📉 -28.6%) vs baseline: -0.7% Memory: ✅ 42.546MB (SLO: <46.000MB -7.5%) vs baseline: +4.5% ✅ ospathsplitdrive_aspectTime: ✅ 374.439µs (SLO: <700.000µs 📉 -46.5%) vs baseline: -0.6% Memory: ✅ 42.448MB (SLO: <46.000MB -7.7%) vs baseline: +4.5% ✅ ospathsplitdrive_noaspectTime: ✅ 73.436µs (SLO: <700.000µs 📉 -89.5%) vs baseline: +0.1% Memory: ✅ 42.605MB (SLO: <46.000MB -7.4%) vs baseline: +4.9% ✅ ospathsplitext_aspectTime: ✅ 459.443µs (SLO: <700.000µs 📉 -34.4%) vs baseline: +0.4% Memory: ✅ 42.605MB (SLO: <46.000MB -7.4%) vs baseline: +4.8% ✅ ospathsplitext_noaspectTime: ✅ 467.136µs (SLO: <700.000µs 📉 -33.3%) vs baseline: +0.3% Memory: ✅ 42.605MB (SLO: <46.000MB -7.4%) vs baseline: +4.7% 🟡 Near SLO Breach (1 suite)🟡 tracer - 6/6✅ largeTime: ✅ 31.482ms (SLO: <32.950ms -4.5%) vs baseline: +0.4% Memory: ✅ 36.707MB (SLO: <39.250MB -6.5%) vs baseline: +4.9% ✅ mediumTime: ✅ 3.093ms (SLO: <3.200ms -3.3%) vs baseline: ~same Memory: ✅ 35.507MB (SLO: <38.750MB -8.4%) vs baseline: +4.9% ✅ smallTime: ✅ 363.512µs (SLO: <370.000µs 🟡 -1.8%) vs baseline: +3.9% Memory: ✅ 35.448MB (SLO: <38.750MB -8.5%) vs baseline: +4.6%
|
Description
Current median duration of langgraph is 14m with p95 of 20m.
There are 24 venvs, so this change will result in us going from 2 jobs to 6, which should help reduce total duration a bit.
Testing
Risks
Additional Notes