Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

lots of changes #48

Draft
wants to merge 25 commits into
base: main
Choose a base branch
from
Draft

lots of changes #48

wants to merge 25 commits into from

Commits on Jun 4, 2024

  1. Update Alliance genome URL and delay in UI test

    The URL for the fungal category of the Alliance genome has been updated for accuracy. The delay in the UI testing code has been increased to accommodate changes in page loading times. Screenshots will now be saved in the SGD directory improving file organization.
    nuin committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    fface9a View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. Add new SGD test configuration file

    This commit adds the new test configuration file config.json for the SGD test suite. The configuration file details various server endpoints and their database records for testing purposes. It includes both main and fungal databases, each with their specific URLs and nucleotide and protein sequences.
    nuin committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    969904f View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. Add new test case and refine UI testing

    Added a new test case for FB2024_02 in the UI testing config and made enhancements to the testing scripts. Improvements involve adding extra failure tolerance in element interaction and storing screenshots in organized output directories. Also updated the utilities to fetch and print unique sorted list of items from the URL for better clarity.
    nuin committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    32e63e6 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2024

  1. changes on test

    nuin committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    94c1895 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Refactor imports and remove unused route53_check

    Consolidated import statements for readability and removed an unused function call to `route53_check` to streamline the code. This improves maintainability and reduces potential confusion for future modifications.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    194ec4b View commit details
    Browse the repository at this point in the history
  2. Refactor FASTA validation and add DB list function.

    Refactored `validate_fasta` to remove Biopython dependency, using a manual method to validate FASTA files. Added `list_databases_from_config` to list database names from YAML or JSON config files. Cleaned up `create_blast_db.py` by removing redundant comments and improving error handling for JSON processing.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    7fc3a98 View commit details
    Browse the repository at this point in the history
  3. Update dependencies and packages in poetry.lock

    Upgraded multiple dependencies to newer versions, including attrs to 24.2.0, black to 23.12.1, boto3 to 1.35.46, and boto3-stubs to 1.35.46. Adjusted package extras to align with the new versions and ensure compatibility.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    6814042 View commit details
    Browse the repository at this point in the history
  4. Add needs_parse_seqids function and integrate with makeblastdb

    Introduced a new utility function, needs_parse_seqids, to determine if the -parse_seqids flag is needed for BLAST. Updated create_blast_db.py to use this function and include the flag conditionally in the makeblastdb command based on FASTA header analysis.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    60dcdea View commit details
    Browse the repository at this point in the history
  5. Add FASTA file processing and database creation functions

    Introduce several new utilities for downloading, storing, and processing FASTA files, such as process_entry and process_files. Enhanced makeblastdb integration and error handling, code cleaning, and modularization for improved maintainability.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    e3ab993 View commit details
    Browse the repository at this point in the history
  6. Add mod-based MD5 check conditionality and reformat process_entry

    Introduce a conditional check to skip MD5 verification for ZFIN in both FTP and HTTP file downloads. Also, refactor the process_entry function for better logging and flow control during checks.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    96dc177 View commit details
    Browse the repository at this point in the history
  7. Refactor FTP/HTTP file handling and format output strings

    Refactored the logic for handling FTP and HTTP file downloads for clarity by breaking long lines into multiple lines. Additionally, adjusted string formatting for output status to improve readability.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    f974ca9 View commit details
    Browse the repository at this point in the history
  8. Add keep-files option to retain FASTA files after processing

    Introduce a new CLI option `--keep-files` to control whether downloaded FASTA files are retained after processing. Also, refactor import statements and add a new helper function `process_entry` for better code organization.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    bfc45d4 View commit details
    Browse the repository at this point in the history
  9. Refactor utils and create_blast_db, remove keep_files option

    Removed the `keep_files` option from the `create_dbs` function and associated code. Refactored the imports and adjusted the code formatting in `utils.py` for clarity and consistency. These changes help to streamline the code and improve readability.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    fc9a1fc View commit details
    Browse the repository at this point in the history
  10. Simplify utils.py functions and clean up create_blast_db.py imports

    Removed redundant comments and excessive logging in utils.py functions
    for clarity. Also, improved import statements in create_blast_db.py
    to enhance readability. The refactoring maintains existing functionality
    while making the code easier to read and maintain.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    75eaefd View commit details
    Browse the repository at this point in the history
  11. Refactor utils and create_blast_db for better readability

    Reorganized imports and added missing newlines for readability in `utils.py` and `create_blast_db.py`. This improves code structure and ensures consistency with Python PEP8 standards.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    5c3cd07 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    0039210 View commit details
    Browse the repository at this point in the history
  13. Enhance logging and file handling in utility functions

    Refactor utility functions to include comprehensive logging and error handling. Improved the logging format for better traceability and added optional file storage during downloads. Streamlined functions by removing unused imports and redundant checks.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    d7d9f40 View commit details
    Browse the repository at this point in the history
  14. Add support for FASTA file cleanup after processing

    Introduced optional cleanup of FASTA files in processing functions and command-line arguments. Modified logging to include the new parameters and ensure continuation even if errors occur during cleanup. Enhanced type hinting in `src/utils.py` and related files in `src/create_blast_db.py`.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    2428d3d View commit details
    Browse the repository at this point in the history
  15. Add genome browser mapping function.

    Introduced an `update_genome_browser_map` function to manage genome browser mappings in Ruby and JSON formats. Integrated this function into the BLAST DB creation process to ensure mappings are updated if relevant configuration data is present.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    86960d0 View commit details
    Browse the repository at this point in the history
  16. Refactor logging and progress display

    Replace console output with `terminal.py` module functions for consistent logging and progress tracking. Add enhanced progress and summary display for JSON entry processing, and reorganize code structure for better readability and maintainability.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    32f329b View commit details
    Browse the repository at this point in the history
  17. Enhance logging and user feedback; refactor file operations

    Refactor logging and status updates to use `print_status` for better user feedback. Introduce comprehensive error handling and add progress bars for cleanup operations. Streamline imports and improve functionality for Slack message sending and file downloading.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    3a57502 View commit details
    Browse the repository at this point in the history
  18. Add functions to copy config files and update genome browser map

    Implemented `copy_config_file` to manage configuration files and enhanced `update_genome_browser_map` for better logging and file handling. Updated `process_json_entries` and `process_entry` to integrate new functions, perform unzipping, and handle config file management more efficiently.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    e1361df View commit details
    Browse the repository at this point in the history
  19. Refactor genome browser mapping & handle makeblastdb errors

    Refactored the update_genome_browser_map function to improve readability and directory structure. Enhanced error handling and logging during the makeblastdb process for better operational visibility.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    42f5d29 View commit details
    Browse the repository at this point in the history
  20. Remove extra blank lines in test files

    This commit cleans up unnecessary blank lines in `tests/UI/utils.py` and `tests/CLI/test_cli.py` for better readability and consistency. These changes do not affect the functionality but improve code quality.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    6859a5f View commit details
    Browse the repository at this point in the history
  21. Enhance genome browser map logging and error handling

    Refactored `update_genome_browser_map` function to include improved logging and error handling. Added real-time feedback using both logger and rich print to display messages, including debug information about current operations and handling of file writes. Streamlined directory and file creation process, and ensured robust reading and writing of JSON and Ruby files.
    nuin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    61a01b4 View commit details
    Browse the repository at this point in the history