Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Auto-download files from the staging directory to output #500

Draft
wants to merge 15 commits into
base: main
Choose a base branch
from
Draft

Auto-download files from the staging directory to output #500

wants to merge 15 commits into from

Commits on May 9, 2024

  1. use download queue

    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    25e17a5 View commit details
    Browse the repository at this point in the history

  2. rename Download tables, use mp.quque directly without a wrapper

    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    3fc2cc0 View commit details
    Browse the repository at this point in the history

  3. Remove DownloadTask data class, use DescribeDownload for both queue a… 

    …nd db records
    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    7abdf27 View commit details
    Browse the repository at this point in the history

  4. propagate redownload, use download_id in get download

    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    56f095d View commit details
    Browse the repository at this point in the history

  5. def initiate_download_standalonefunction and use it in DownloadManage… 

    …r and ExecutionManager
    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    ba44f7c View commit details
    Browse the repository at this point in the history

  6. add traitlets-configurable downloads_poll_interval

    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    381dcae View commit details
    Browse the repository at this point in the history

  7. refactor output files creation logic into a separate function for cla… 

    …rity
    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    a723337 View commit details
    Browse the repository at this point in the history

  8. remove download records associated with job on job delete

    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    92a4574 View commit details
    Browse the repository at this point in the history

  9. clarify comments

    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    bc4bc88 View commit details
    Browse the repository at this point in the history

  10. fix existing pytests

    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    551561e View commit details
    Browse the repository at this point in the history

  11. Force Process spawn, not fork in in JobFilesManager

    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    1cb9c84 View commit details
    Browse the repository at this point in the history

  12. force multiprocessing start method to be "spawn" at the start of exte… 

    …nsion,
    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    4c2b558 View commit details
    Browse the repository at this point in the history

  13. test that Process is called only once

    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    a6b75ed View commit details
    Browse the repository at this point in the history

  14. fix pytest tests

    @andrii-i
    andrii-i committed May 9, 2024
    Configuration menu
    Copy the full SHA
    9d41103 View commit details
    Browse the repository at this point in the history

  15. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed May 9, 2024
    Configuration menu
    Copy the full SHA
    88e7b0b View commit details
    Browse the repository at this point in the history