Skip to content

[jsonnet]: set block-builder to follow repliacs of live-store by default#6634

Merged
zalegrala merged 1 commit intografana:mainfrom
zalegrala:tempoMicroservicesBlockBuilderFollowLiveStoreReplicas
Mar 10, 2026
Merged

[jsonnet]: set block-builder to follow repliacs of live-store by default#6634
zalegrala merged 1 commit intografana:mainfrom
zalegrala:tempoMicroservicesBlockBuilderFollowLiveStoreReplicas

Conversation

@zalegrala
Copy link
Copy Markdown
Contributor

@zalegrala zalegrala commented Mar 9, 2026

What this PR does:

Here we set the rollout-operator to manage the replicas of the block-builder and follow the live-store, since the replicas should always match. Rollout-operator is no longer optional for live-store, and so we continue to leverage it here for this purpose.

Which issue(s) this PR fixes:
Fixes #

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

@zalegrala zalegrala changed the title [jsonnet]: set the block-builder to follow the live-store scale by de… [jsonnet]: set block-builder to follow repliacs of live-store by default Mar 9, 2026
@zalegrala zalegrala marked this pull request as ready for review March 9, 2026 16:59
@mdisibio
Copy link
Copy Markdown
Contributor

mdisibio commented Mar 9, 2026

When scaling down a cluster - the rollout operator already drains a live store and waits 30-60 minutes for it to go outside the query window, before actually removing the pod, correct? I think that gives enough time for the block builder to drain and flush it's partition as well.

@zalegrala
Copy link
Copy Markdown
Contributor Author

Yes, that's correct, which is why we are using the live-store statefulset here (we picked a) and not the ReplicaTemplate, since the scaledown of the ReplicaTemplate would reflect the replica reduction immediately. We allow changing the target here in case a or b are not always the zones in a cluster.

@zalegrala zalegrala merged commit b68cb4f into grafana:main Mar 10, 2026
24 checks passed
@zalegrala zalegrala deleted the tempoMicroservicesBlockBuilderFollowLiveStoreReplicas branch March 10, 2026 19:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants