Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SLURM: Option to join stdout and stderr #58

Open
sjackman opened this issue Jan 19, 2018 · 3 comments
Open

SLURM: Option to join stdout and stderr #58

sjackman opened this issue Jan 19, 2018 · 3 comments

Comments

@sjackman
Copy link
Contributor

If SLURM's bsub -e option (standard error file) is not specified, the default is to join stdout and stderr, which is my preferred behaviour.
See http://www.glue.umd.edu/lsf-docs/man/bsub.html

@sjackman
Copy link
Contributor Author

Is there a way to achieve this behaviour by modifying QsubArgs, without adding an option to biomake?

@sjackman
Copy link
Contributor Author

sjackman commented Feb 2, 2018

You have saved my 🥓. I have run 2,344 jobs in the last week with biomake -Q slurm, and I never would have been able to keep them all straight or get the analysis done in time if I had been scheduling them manually. ❤️ 👏 🤗

@sjackman
Copy link
Contributor Author

sjackman commented Feb 2, 2018

Could biomake -Q poolq optionally redirect joined stdout/stderr to .biomake/poolq/out/$@? I'd also find it quite useful to write the PID of active processes to .biomake/poolq/job/$@. I've fallen in love with using pstree and pv -pd $! to inspect and monitor active processes. If you haven't encountered pv -pd $! before, check it out! It's amazing.
http://www.ivarch.com/programs/pv.shtml

@ihh ihh changed the title SLURM: Option to join stdout and stderr [feature request] SLURM: Option to join stdout and stderr Jun 29, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants