Skip to content

test(fix-bot): add Slack notify job#28249

Open
Vere-Grey wants to merge 1 commit into
developfrom
nightly-agent-fixer-10
Open

test(fix-bot): add Slack notify job#28249
Vere-Grey wants to merge 1 commit into
developfrom
nightly-agent-fixer-10

Conversation

@Vere-Grey
Copy link
Copy Markdown
Contributor

@Vere-Grey Vere-Grey commented Jun 1, 2026

Adds aggregation of summaries from all jobs and send this overview to slack channel.

🔍 Currents Test Results

🔍 Suite desktop test results: View in Currents

🔍 Suite web test results: View in Currents

🔒 Quarantined E2E Tests

Trezor Suite (web) — 9 test(s)
Test Type
Account metadata > dropbox provider 🤖 auto
Passphrase with cardano > verify cardano address behind passphrase 🤖 auto
Cardano > Basic cardano walkthrough 🤖 auto
Public Keys > Check ada XPUB 🤖 auto
Account types suite > Add-account-types-non-BTC-coins 🤖 auto
Quarantine test: "Onboarding - create wallet,Success (basic)" 🙋 manual
Quarantine test: "Database migration,Db migration between: release/22.5/web => develop/web" 🙋 manual
Quarantine test: "Multiple sessions,Session overtaken by another" 🙋 manual
Quarantine test: "Recovery T2T1 - dry run,Recovery after partial recovery" 🙋 manual

Updated: 2026-06-01T18:49:11.175Z • 9 test(s) total

Trezor Suite (desktop) — 4 test(s)
Test Type
Passphrase with cardano > verify cardano address behind passphrase 🤖 auto
Account types suite > Add-account-types-non-BTC-coins 🤖 auto
Onboarding - create wallet > Success (basic) 🤖 auto
Quarantine test: "Multiple sessions,Session overtaken by another" 🙋 manual

Updated: 2026-06-01T18:47:34.047Z • 4 test(s) total

🌐 Preview deployments

🌐 Suite Web preview: https://dev.suite.sldev.cz/suite-web/nightly-agent-fixer-10/web/

Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds Slack notifications to the nightly fix-bot workflow by emitting per-task JSON summaries from the publish step, aggregating them in a new notify script, and posting a consolidated run overview (including approximate LLM cost) via a Slack webhook.

Changes:

  • Rename ReportSchemaAnalysisReportSchema and add SlackFixSummarySchema for Slack-oriented per-task output.
  • Generate and upload per-task slack-fix-summary-*.json artifacts (plus analyzer cost artifact) and add a new notify job to aggregate/post to Slack.
  • Improve fix-bot process exit codes and standardize agent output logging via the shared logger.

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 3 comments.

Show a summary per file
File Description
packages/e2e-utils/src/fixBot/schemas.ts Renames analysis report schema and introduces Slack summary schema/types.
packages/e2e-utils/src/fixBot/publish.ts Writes per-task Slack summary JSON and includes LLM cost; improves robustness around project assignment.
packages/e2e-utils/src/fixBot/notify.ts New aggregator that builds a Slack message from the analysis report + per-task summaries and sends it via webhook.
packages/e2e-utils/src/fixBot/fix.ts Updates schema import and ensures numeric exit code.
packages/e2e-utils/src/fixBot/common.ts Switches agent output diagnostics to shared logger; sanitizes inherited env var.
packages/e2e-utils/src/fixBot/analyze.ts Updates schema import and ensures numeric exit code.
packages/e2e-utils/package.json Adds fix-bot:notify script entry.
.github/workflows/test-suite-nightly-fix-agent.yml Uploads/downloads summary & cost artifacts and adds the notify job to post to Slack.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread packages/e2e-utils/src/fixBot/notify.ts
Comment thread packages/e2e-utils/src/fixBot/notify.ts Outdated
Comment thread packages/e2e-utils/src/fixBot/publish.ts
@Vere-Grey Vere-Grey force-pushed the nightly-agent-fixer-10 branch from 63a1bdf to 1d523ea Compare June 1, 2026 20:44
@trezor-bot
Copy link
Copy Markdown
Contributor

trezor-bot Bot commented Jun 1, 2026

✅ Previously successful run of [Test] PR Suite Web e2e tests workflow has been found.
⏭️ Skipping tests for this run.
💡 If you are unsure about your latest changes, please rerun the workflow manually. (Use the Re-run all jobs option)

@trezor-bot
Copy link
Copy Markdown
Contributor

trezor-bot Bot commented Jun 1, 2026

✅ Previously successful run of [Test] PR Suite Desktop e2e tests workflow has been found.
⏭️ Skipping tests for this run.
💡 If you are unsure about your latest changes, please rerun the workflow manually. (Use the Re-run all jobs option)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants