Skip to content

Add support for custom tool metrics, implement some for analyzer tools#423

Merged
jakemac53 merged 3 commits intomainfrom
custom-tool-metrics
Apr 2, 2026
Merged

Add support for custom tool metrics, implement some for analyzer tools#423
jakemac53 merged 3 commits intomainfrom
custom-tool-metrics

Conversation

@jakemac53
Copy link
Copy Markdown
Contributor

Now that analysis server starts up lazily, we want to capture how much of any given call went towards that initialization versus actual work in the tool call. This also will capture how much extra time is added in order to apply quick fixes.

Details:

  • Adds elapsed time and boolean for whether the server was started to the withAnalysisServer callback
  • Adds a new customMetrics extension on CallToolResult which uses an expando to store additional analytics information for a given tool call.
  • Adds support to CallToolMetrics to merge this extra information into the analytics data (flat merge).

@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 2, 2026

PR Health

Changelog Entry ✔️
Package Changed Files

Changes to files need to be accounted for in their respective changelogs.

This check can be disabled by tagging the PR with skip-changelog-check.

@jakemac53 jakemac53 merged commit f1cddc8 into main Apr 2, 2026
14 checks passed
@jakemac53 jakemac53 deleted the custom-tool-metrics branch April 2, 2026 19:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants