Add MCP workflow telemetry for AI plugins#2979
Open
glendaviesnz wants to merge 1 commit intotrunkfrom
Open
Conversation
Collaborator
📊 Performance Test ResultsComparing f424ab3 vs trunk app-size
site-editor
site-startup
Results are median values from multiple test runs. Legend: 🟢 Improvement (faster) | 🔴 Regression (slower) | ⚪ No change (<50ms diff) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This adds plugin-aware MCP workflow telemetry for Studio's AI integrations. This is needed so we can track usage of the Studio MCP by external agents
Changes include:
studio mcp --telemetry-group <group>option so different AI plugin integrations can identify themselves when they launch the Studio MCP serverrecord_workflow_eventMCP tool that records workflow milestones liketheme-build-started,theme-build-completed, andtheme-build-failedThis is designed to support plugin-grouped telemetry such as:
codex-plugin+theme-build-startedclaude-code-plugin+theme-build-completedTesting
Automated
npm test -- apps/cli/ai/tests/tools.test.tsManual
studio mcp --telemetry-group codex-pluginrecord_workflow_eventtool is available.workflow: theme-buildstage: startedcompletedandfailedstages and with another workflow such assite-build.studio mcpwithout--telemetry-groupand confirm the tool reports that workflow telemetry was skipped because no plugin group was configured.Notes
npx tsc -p apps/cli/tsconfig.json --noEmit, but it still reports an existing unrelatedmemfstest typing issue inapps/cli/lib/tests/snapshots.test.ts.