Replies: 3 comments
-
@step2yeung has worked on |
Beta Was this translation helpful? Give feedback.
0 replies
-
So far, there hasn't been planned work to take the proof of concept into full implementation. |
Beta Was this translation helpful? Give feedback.
0 replies
-
Putting it here just in case there it is mathematically not completely stupid idea. Just pseudo-code, but I hope it captures the idea. let all_tests = [...]; // each test is given unique ID
let X = ...; // order number of offending test, user will have to provide this (?)
let offending_tests = all_tests; // at start every test can be the problematic one
let N = ...; // number of iterations to go though, user will have to provide this (?)
for(var i=0; i < N; i++){ // repeat only N times
exam.runWithArgs(`--random=${i}`); // run ember exam with new seed each time
if(exam.testFailed(X)) { // if the test we're interested in failed
let failed_after = exam.failedAfter(X); // give me the list of tests that ran *after* my test
offending_tests = array_substract(offending_tests, failed_after); // those tests won't be the problematic ones
}
} |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Sometimes, when a test suite fails in its browser id, it could be caused by a combination of other test suites in the same browser id.
It would be cool to have an option to re-run the browser id replays and remove any test suite that are determined unnecessary for reproducing test failures, so we are left with the minimum amount of tests needed to reproduce the failure.
Beta Was this translation helpful? Give feedback.
All reactions