chore(llmobs): send dataset record tags & experiment config as part of experiment spans#16623
chore(llmobs): send dataset record tags & experiment config as part of experiment spans#16623gary-huang wants to merge 3 commits intomainfrom
Conversation
Codeowners resolved as |
33d7053 to
a611344
Compare
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: a6971df4f1
ℹ️ About Codex in GitHub
Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".
a6971df to
9198d23
Compare
Kyle-Verhoog
left a comment
There was a problem hiding this comment.
thank you gary, very cool!
|
/merge |
|
View all feedbacks in Devflow UI.
The expected merge time in Use ⏳ Processing |
Description
send dataset record tags and experiment configs as part of the spans so they can be searchable in EVP and data is surfaceable in widgets
Testing
given a dataset like this https://app.datadoghq.com/llm/datasets/a79ea50c-616a-4178-bd59-68661501c6b6?project=dc

where test:foo is on the record with input relating to capital of chad, running an experiment and then running a search with the query
@event_type:span experiment_id:2aa096ff-3910-4cd0-b1a4-6889a8434e44 test:foowe get the correct span
Risks
Additional Notes