explore some auto-optimize piplines

[Borda]

Search before asking

• I have searched the RF-DETR issues and found no similar feature requests.

Description

Check if this could help https://github.com/RightNow-AI/autokernel

Use case

No response

Additional

No response

Are you willing to submit a PR?

• Yes I'd like to help by submitting a PR!

[isaacrob]

That's an interesting one! One tricky bit is getting the model definition into a single file for it to optimize 😅 I'm also curious how these kernels can compare to the TRT engine we use. Maybe could do something like export it to ONNX, have it do the TRT compile, and write custom TRT kernels? One file, generic ie drop in any ONNX file, and is actually improving against the baseline

[isaacrob]

Frankly could do it as part of SAB