Skip to content

Comments

chore(llmobs): send dataset record tags & experiment config as part of experiment spans#16623

Open
gary-huang wants to merge 3 commits intomainfrom
gary/mlob-5663
Open

chore(llmobs): send dataset record tags & experiment config as part of experiment spans#16623
gary-huang wants to merge 3 commits intomainfrom
gary/mlob-5663

Conversation

@gary-huang
Copy link
Contributor

@gary-huang gary-huang commented Feb 20, 2026

Description

send dataset record tags and experiment configs as part of the spans so they can be searchable in EVP and data is surfaceable in widgets

Testing

given a dataset like this https://app.datadoghq.com/llm/datasets/a79ea50c-616a-4178-bd59-68661501c6b6?project=dc
where test:foo is on the record with input relating to capital of chad, running an experiment and then running a search with the query @event_type:span experiment_id:2aa096ff-3910-4cd0-b1a4-6889a8434e44 test:foo
we get the correct span
image

Risks

Additional Notes

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 20, 2026

Codeowners resolved as

releasenotes/notes/llmobs-dne-experiments-dataset-record-tags-config-propagation-59397bb58866b19b.yaml  @DataDog/apm-python

Base automatically changed from gary/mlob-4860-v2 to main February 21, 2026 00:58
@gary-huang gary-huang changed the title send config as part of experiment spans upgrade(llmobs): send dataset record tags & experiment config as part of experiment spans Feb 21, 2026
@gary-huang gary-huang changed the title upgrade(llmobs): send dataset record tags & experiment config as part of experiment spans chore(llmobs): send dataset record tags & experiment config as part of experiment spans Feb 21, 2026
@gary-huang gary-huang marked this pull request as ready for review February 21, 2026 03:50
@gary-huang gary-huang requested review from a team as code owners February 21, 2026 03:50
Copy link

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: a6971df4f1

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Copy link
Member

@Kyle-Verhoog Kyle-Verhoog left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thank you gary, very cool!

@gary-huang
Copy link
Contributor Author

/merge

@gh-worker-devflow-routing-ef8351
Copy link

gh-worker-devflow-routing-ef8351 bot commented Feb 23, 2026

View all feedbacks in Devflow UI.

2026-02-23 06:13:53 UTC ℹ️ Start processing command /merge
Use /merge -c to cancel this operation!


2026-02-23 06:13:56 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in main is approximately 4h (p90).

Use /merge -c to cancel this operation!


⏳ Processing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants