Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory issues #15

Open
silenus092 opened this issue Jun 21, 2024 · 2 comments
Open

Memory issues #15

silenus092 opened this issue Jun 21, 2024 · 2 comments

Comments

@silenus092
Copy link

Hi

I have a memory problem. For example, When I use the Mpoxvirus reference sequence to align with a partial genome or specific coding sequence. The program used 62 GB+ of RAM, and the OS killed the process before it finished the alignment.

I've come across https://github.com/smarco/BiWFA-paper which seems to offer a solution with lower memory usage. Additionally, I've noticed the presence of low-memory modes in the code (WFA_wrap.pxd).

Will you plan to integrate these features in the Python interface pyfwa to enable the BiWFA algorithm or select memory strategies, or is there an alternative way? Please feel free to suggest me.

I also changed the heuristic functions (adaptive and Xdrop ), but they didn't help in my case.

@silenus092 silenus092 changed the title ็How to enable ultra Memory issuse Jun 21, 2024
@silenus092 silenus092 changed the title Memory issuse Memory issues Jun 21, 2024
@kcleal
Copy link
Owner

kcleal commented Jun 21, 2024

Hi @silenus092,
It would be nice to add BiWFA, for sure. However, I don't have much time to add this. Perhaps in a month or two I might take a look.

@JosephLalli
Copy link
Contributor

I've just implemented this option in my fork here: https://github.com/josephlalli/pywfa

Very experimental, no idea how exposing this option affects accuracy or introduces other complications.

To use, when initializing your WavefrontAligner, specify memory_mode 'biwfa'.

from pywfa import WavefrontAligner

a = WavefrontAligner(memory_mode='biwfa')

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants