test(fix-bot): add Slack notify job#28249
Conversation
There was a problem hiding this comment.
Pull request overview
Adds Slack notifications to the nightly fix-bot workflow by emitting per-task JSON summaries from the publish step, aggregating them in a new notify script, and posting a consolidated run overview (including approximate LLM cost) via a Slack webhook.
Changes:
- Rename
ReportSchema→AnalysisReportSchemaand addSlackFixSummarySchemafor Slack-oriented per-task output. - Generate and upload per-task
slack-fix-summary-*.jsonartifacts (plus analyzer cost artifact) and add a newnotifyjob to aggregate/post to Slack. - Improve fix-bot process exit codes and standardize agent output logging via the shared logger.
Reviewed changes
Copilot reviewed 8 out of 8 changed files in this pull request and generated 3 comments.
Show a summary per file
| File | Description |
|---|---|
| packages/e2e-utils/src/fixBot/schemas.ts | Renames analysis report schema and introduces Slack summary schema/types. |
| packages/e2e-utils/src/fixBot/publish.ts | Writes per-task Slack summary JSON and includes LLM cost; improves robustness around project assignment. |
| packages/e2e-utils/src/fixBot/notify.ts | New aggregator that builds a Slack message from the analysis report + per-task summaries and sends it via webhook. |
| packages/e2e-utils/src/fixBot/fix.ts | Updates schema import and ensures numeric exit code. |
| packages/e2e-utils/src/fixBot/common.ts | Switches agent output diagnostics to shared logger; sanitizes inherited env var. |
| packages/e2e-utils/src/fixBot/analyze.ts | Updates schema import and ensures numeric exit code. |
| packages/e2e-utils/package.json | Adds fix-bot:notify script entry. |
| .github/workflows/test-suite-nightly-fix-agent.yml | Uploads/downloads summary & cost artifacts and adds the notify job to post to Slack. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
63a1bdf to
1d523ea
Compare
|
✅ Previously successful run of [Test] PR Suite Web e2e tests workflow has been found. |
|
✅ Previously successful run of [Test] PR Suite Desktop e2e tests workflow has been found. |
Adds aggregation of summaries from all jobs and send this overview to slack channel.
🔍 Currents Test Results
🔍 Suite desktop test results: View in Currents
🔍 Suite web test results: View in Currents
🔒 Quarantined E2E Tests
Trezor Suite (web) — 9 test(s)
Updated: 2026-06-01T18:49:11.175Z • 9 test(s) total
Trezor Suite (desktop) — 4 test(s)
Updated: 2026-06-01T18:47:34.047Z • 4 test(s) total
🌐 Preview deployments
🌐 Suite Web preview: https://dev.suite.sldev.cz/suite-web/nightly-agent-fixer-10/web/