-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: (Clisk) Catch and log downloadFileInWorker errors #927
base: master
Are you sure you want to change the base?
Conversation
If there was an error in the downloadFileInWorker function, it would cause the whole clisk konnector run to fail Now, the error is caught and a warning error will be visible in the konnector logs. This is also coherent with the behavior of node konnectors.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So the execution is marked as successful, even though we failed to download the file? Right? So we'll have a lastSuccessDate to the date of execution and if we then want to optimize by recovering only what was done after the last success date, we'll be stuck.
If the download has failed we should:
- Retry once or twice
- If after those retries it still fails, then we should throw an error.
I really don't like the fact we don't tell the user that something was not working as expected.
I don't have proposed anything like that ;). I just say that we should throw an error somewhere and don't tell the user that everything was good. There is a lot of possibility here. To move forward:
|
|
In that case, what should we do? Be silent? Throw an error? Let's see with the product team. |
If there was an error in the downloadFileInWorker function, it would
cause the whole clisk konnector run to fail
Now, the error is caught and a warning error will be visible in the
konnector logs.
This is also coherent with the behavior of node konnectors.
Checklist
Before merging this PR, the following things must have been done: