-
Notifications
You must be signed in to change notification settings - Fork 320
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Test execution ordering/filtering extension #1943
Comments
Evangelink
added
the
needs-triage
This item should be discussed in the next triage meeting.
label
Aug 1, 2022
Evangelink
removed
the
needs-triage
This item should be discussed in the next triage meeting.
label
Nov 30, 2022
This is a new feature and won't be implemented, we are focusing on adding new features to Testing.Platform instead. https://aka.ms/testingplatform |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Description
Add an extensibility point to support filtering what tests to run and the ability to control the order in which they run.
There is really two asks here but I think it makes sense to combine them into one extensibility point.
The OneDrive team has a large set of tests which need to run. To accomplish this in a reasonable time period we stripe our tests across multiple machines. We also have custom logic that uses historical test runtime to do this effectively by ordering tests in a smart way (e.g. longer tests run first).
We can accomplish the filtering by using the Translation Layer extension but we rather just run vstest.console.exe directly for various reasons.
The ordering could possibly be accomplished by providing a hard code config but being able to dynamically control ordering provides more flexibility and could possibly integrate with the retry support feature to control the order to run retries.
The text was updated successfully, but these errors were encountered: