Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Single threaded but uses pysam, so not single threaded #322

Open
schultzm opened this issue May 18, 2020 · 0 comments
Open

Single threaded but uses pysam, so not single threaded #322

schultzm opened this issue May 18, 2020 · 0 comments

Comments

@schultzm
Copy link

Hi,
Thanks for the package. I'm using PyVCF to parse out some VCFs from snpEff. It's a simple task, reading in some text (i.e., the vcf) and building a table and printing to stdout. As far as I can tell, at the initial parsing step (vcf.Reader(open(sys.argv[1], 'r'))), PySam is being used. Hence, this apparently single-threaded action is really multithreaded under the hood. I would like to run this package using gnu parallel, but this is causing problems on our 72 core 320GB server since I have no way to control the upper CPU limit. Each process (i.e., one read of a VCF file) is using upwards of 500% CPU (5 cores). I didn't ask it to do that and I can't prevent PyVCF from doing this. Is this a PySam problem?

Thanks.

@schultzm schultzm changed the title Single threaded but uses pysam so not single threaded Single threaded but uses pysam, so not single threaded May 18, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant