Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MemoryError seen on expire_distros execution #240

Merged
merged 1 commit into from
Nov 14, 2024

Commits on Nov 13, 2024

  1. MemoryError seen on expire_distros execution

    When the beaker_expire_distros hourly cron job ran, the
    MemoryError is seen on the lab controller as well as Server.
    This same error is seen when executing the bkr CLI
    'bkr distro-trees-list --limit=8000 --labcontroller=hostname |
    grep "ID:" | wc -l'
    As it turns out, expire_distros is calling the same underlying
    get method.  The error is sporadic.  It is likely due to
    difficulty attaining a contiguous memory chunk for
    a lot of data.  The solution is to get smaller chunks.  Similar
    filters as the cli distro-trees-list are now allow thru
    expired_distros.py which passes them to the same get operation.
    These filters also allows for more variation for beaker_expire_distros.
    Stepping thru architectures seemed to be the best choice of filters
    for the chunks.  When --arch=all, the expire_distros.py code knows
    to step thru a list of arch to perform removal instead of trying
    to do it all at once. So the cron job is updated to include --arch=all.
    cbouchar committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    f53f2ce View commit details
    Browse the repository at this point in the history