Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle cases where test executor does not return "label" #361

Open
sven-oly opened this issue Dec 18, 2024 · 2 comments
Open

Handle cases where test executor does not return "label" #361

sven-oly opened this issue Dec 18, 2024 · 2 comments

Comments

@sven-oly
Copy link
Collaborator

sven-oly commented Dec 18, 2024

This test driver and the verifier should give information on executor failures in which individual tests are not returned.

Current behavior on a serious executor problem results in many missing tests.

@sffc
Copy link
Member

sffc commented Dec 18, 2024

This is important for overall integrity of the dashboard because missing tests may or may not be noticed. They should be regarded as errors or something. Would be OK marking them with a new color. Maybe purple or brown.

@sffc
Copy link
Member

sffc commented Jan 13, 2025

I think missing tests should show up in the results; should they be classified as failures? Or maybe a new category like missing (black)?

@sffc sffc added this to the 2025 Q1 ⟨P1⟩ milestone Jan 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants