Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate numerous extra log files from toil #236

Open
nikhil opened this issue Jul 14, 2021 · 1 comment
Open

Investigate numerous extra log files from toil #236

nikhil opened this issue Jul 14, 2021 · 1 comment

Comments

@nikhil
Copy link
Member

nikhil commented Jul 14, 2021

TOIL seems to be outputting a bunch of extra log files (presumably from each worker) in the working directory. Can we disable this/ Is this useful?

@ionox0
Copy link
Member

ionox0 commented Jul 15, 2021

I think those are the -eo and -oo err and out files from lsf. They can be useful for determining the EXIT_REASON for a job without using bjobs. For example for TERM_MEMLIMIT and TERM_RUNLIMIT.

Those are errors that are normally harder / impossible to decipher from the worker / leader logs. I think they will just get cut off if lsf kills the job, or they will say User defined error 2

If there is some way to make a subfolder for them maybe that would help keep the tmpdir more organized

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants