Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

0.5.5 #134

Merged
merged 93 commits into from
Sep 1, 2023
Merged

0.5.5 #134

merged 93 commits into from
Sep 1, 2023

Commits on Jun 16, 2023

  1. added ruff

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    402faea View commit details
    Browse the repository at this point in the history

  2. autofix with ruff

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    e2b821e View commit details
    Browse the repository at this point in the history

  3. added codecov to test gh action

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    133473f View commit details
    Browse the repository at this point in the history

  4. added ruff to toml

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    62cd264 View commit details
    Browse the repository at this point in the history

  5. fixed unused loop variable in for loop

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    5f0732d View commit details
    Browse the repository at this point in the history

  6. fixed errors identified by ruff in multilabel_pipeline

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    3944e40 View commit details
    Browse the repository at this point in the history

  7. fixed ruff identified errors in factory_data_load_and_split

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    b3908c2 View commit details
    Browse the repository at this point in the history

  8. fixed ruff error in factory_model_performance

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    50ee694 View commit details
    Browse the repository at this point in the history

  9. fixed minor ruff identified errors in factory_predict_unlabelled_text… 

    … and sentiment_pipeline
    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    a252b19 View commit details
    Browse the repository at this point in the history

  10. adding precommit

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    bea9387 View commit details
    Browse the repository at this point in the history

  11. added folders to exclude in precommit

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    5aa23b2 View commit details
    Browse the repository at this point in the history

  12. fixing test GH action yaml

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    c0a6627 View commit details
    Browse the repository at this point in the history

  13. updated precommit yaml

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    237bc4f View commit details
    Browse the repository at this point in the history

  14. added test_sklearn_pipeline_sentiment

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    6f240ab View commit details
    Browse the repository at this point in the history

  15. added ruff to GH action

    @yiwen-h
    yiwen-h committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    9aa28a6 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2023

  1. modified workflow yaml so upload to codecov only happens once

    @yiwen-h
    yiwen-h committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    badc9ac View commit details
    Browse the repository at this point in the history

  2. added more tests for factory_pipeline

    @yiwen-h
    yiwen-h committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    773e812 View commit details
    Browse the repository at this point in the history

  3. added test_process_data

    @yiwen-h
    yiwen-h committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    200dd0b View commit details
    Browse the repository at this point in the history

  4. removed tf pipeline and functions

    @yiwen-h
    yiwen-h committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    470bafc View commit details
    Browse the repository at this point in the history

  5. added test_create_sklearn_pipeline

    @yiwen-h
    yiwen-h committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    b25864e View commit details
    Browse the repository at this point in the history

  6. added test_search_sklearn_pipelines

    @yiwen-h
    yiwen-h committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    d6c8596 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. added more tests for factory_pipeline

    @yiwen-h
    yiwen-h committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    437e6d1 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #114 from CDU-data-science-team/104-75_linting_and… 

    …_tests

104 75 linting and tests
    @yiwen-h
    yiwen-h authored Jun 20, 2023
    Configuration menu
    Copy the full SHA
    cc0762d View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2023

  1. added tests for factory_model_performance

    @yiwen-h
    yiwen-h committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    2a4c160 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. Merge pull request #116 from CDU-data-science-team/75_pipeline_tests 

    added tests for factory_model_performance
    @yiwen-h
    yiwen-h authored Jun 27, 2023
    Configuration menu
    Copy the full SHA
    0b9e304 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2023

  1. started basic framework for dockerizing sentiment endpoint

    @yiwen-h
    yiwen-h committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    8556d2b View commit details
    Browse the repository at this point in the history

  2. working docker container - cant use Alpine

    @yiwen-h
    yiwen-h committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    243c69b View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2023

  1. got docker container to mount data folder, accept filename as argument

    @yiwen-h
    yiwen-h committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    3ad8e6b View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2023

  1. added test_sklearn_pipeline

    @yiwen-h
    yiwen-h committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    7885fcc View commit details
    Browse the repository at this point in the history

  2. parametrized target for sklearn pipeline. wrote svc pipeline test

    @yiwen-h
    yiwen-h committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    4fdd06c View commit details
    Browse the repository at this point in the history

  3. added tests for bert pipeline

    @yiwen-h
    yiwen-h committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    b8f7ef7 View commit details
    Browse the repository at this point in the history

  4. added test for two_layer_sklearn pipeline. finished multilabel_pipeli… 

    …ne testing
    @yiwen-h
    yiwen-h committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    3360bcb View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2023

  1. added test_sentiment_sklearn

    @yiwen-h
    yiwen-h committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    4a0a835 View commit details
    Browse the repository at this point in the history

  2. sentiment_bert test added

    @yiwen-h
    yiwen-h committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    4120193 View commit details
    Browse the repository at this point in the history

  3. finished testing for sentiment pipeline

    @yiwen-h
    yiwen-h committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    3bfcea8 View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2023

  1. json input file now deleted if NOT run locally

    @yiwen-h
    yiwen-h committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    64fe780 View commit details
    Browse the repository at this point in the history

  2. Predictions now outputted as json file in data_out folder

    @yiwen-h
    yiwen-h committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    86414f2 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2023

  1. added label to dockerfile

    @yiwen-h
    yiwen-h committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    b726388 View commit details
    Browse the repository at this point in the history

  2. added most tests for docker_run

    @yiwen-h
    yiwen-h committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    6ab83a3 View commit details
    Browse the repository at this point in the history

  3. added phase2 data for permitted trusts plus readme

    @yiwen-h
    yiwen-h committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    aca3601 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2023

  1. added more readme info

    @yiwen-h
    yiwen-h committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    a47da37 View commit details
    Browse the repository at this point in the history

  2. added larger json file - about 8000 comments

    @yiwen-h
    yiwen-h committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    da605dc View commit details
    Browse the repository at this point in the history

  3. Merge pull request #120 from CDU-data-science-team/119_datasets 

    119 datasets
    @ChrisBeeley
    ChrisBeeley authored Jul 19, 2023
    Configuration menu
    Copy the full SHA
    8ea5ca0 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. Merge pull request #121 from CDU-data-science-team/75_pipeline_tests 

    75 pipeline tests
    @ChrisBeeley
    ChrisBeeley authored Jul 20, 2023
    Configuration menu
    Copy the full SHA
    f8c87cc View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. retrained with multilabel_230719 data

    @yiwen-h
    yiwen-h committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    c57357a View commit details
    Browse the repository at this point in the history

  2. fixed svcpipeline not taking additional_features = False

    @yiwen-h
    yiwen-h committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    2a23864 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #124 from CDU-data-science-team/122_230719_data 

    retrained with multilabel_230719 data
    @ChrisBeeley
    ChrisBeeley authored Jul 25, 2023
    Configuration menu
    Copy the full SHA
    43c5622 View commit details
    Browse the repository at this point in the history

  4. Merge pull request #125 from CDU-data-science-team/123_svcpipeline_bu… 

    …gfix

fixed svcpipeline not taking additional_features = False
    @ChrisBeeley
    ChrisBeeley authored Jul 25, 2023
    Configuration menu
    Copy the full SHA
    852b569 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. testing increasing prob of class if certain words are present in text

    @yiwen-h
    yiwen-h committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    525f754 View commit details
    Browse the repository at this point in the history

  2. moved rules to params for more flexibility

    @yiwen-h
    yiwen-h committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    72d673a View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. added rules to pipeline. testing with test_rules.py

    @yiwen-h
    yiwen-h committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    f62ba5b View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. finished rules_dict (subject to tweaking)

    @yiwen-h
    yiwen-h committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    0902caa View commit details
    Browse the repository at this point in the history

  2. added rules to bert predictions

    @yiwen-h
    yiwen-h committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    f0a023e View commit details
    Browse the repository at this point in the history

  3. get_multilabel_metrics now uses predict_multilabel_bert

    @yiwen-h
    yiwen-h committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    cca07bd View commit details
    Browse the repository at this point in the history

  4. added probs_dict for variable probabilities too

    @yiwen-h
    yiwen-h committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    669fdf0 View commit details
    Browse the repository at this point in the history

  5. moved test_rules out of tests folder, reran coverage

    @yiwen-h
    yiwen-h committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    de20e3a View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. Merge branch 'development' into 117_rulebased_model

    @yiwen-h
    yiwen-h authored Aug 3, 2023
    Configuration menu
    Copy the full SHA
    b3d2969 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. Merge pull request #130 from CDU-data-science-team/117_rulebased_model 

    117 rulebased model
    @yiwen-h
    yiwen-h authored Aug 4, 2023
    Configuration menu
    Copy the full SHA
    0d366e9 View commit details
    Browse the repository at this point in the history

  2. wrote get_y_score function

    @yiwen-h
    yiwen-h committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    e853659 View commit details
    Browse the repository at this point in the history

  3. prediction dfs now include probabilities as well

    @yiwen-h
    yiwen-h committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    9f135e6 View commit details
    Browse the repository at this point in the history

  4. prediction dfs now include probabilities for sklearn multilabel

    @yiwen-h
    yiwen-h committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    439dece View commit details
    Browse the repository at this point in the history

  5. added macro roc auc score to model summary

    @yiwen-h
    yiwen-h committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    78632fc View commit details
    Browse the repository at this point in the history

  6. write_model_preds now uses probabilities from predict_multilabel df o… 

    …utput
    @yiwen-h
    yiwen-h committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    db180e0 View commit details
    Browse the repository at this point in the history

  7. added model_performance.additional_analysis which calculates confusio… 

    …n matrix and auc_roc scores for labels
    @yiwen-h
    yiwen-h committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    6eb5259 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. confusion matrix info and roc_auc_score now in model analysis

    @yiwen-h
    yiwen-h committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    42b5ec6 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2023

  1. Replaced macro roc_aoc score with average_precision_score in perf ana… 

    …lysis
    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    368f9d8 View commit details
    Browse the repository at this point in the history

  2. renamed "support" column to be more userfriendly

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    bfb6dca View commit details
    Browse the repository at this point in the history

  3. fixed ruff complaining about == instead of isinstance in tests

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    40a3cfd View commit details
    Browse the repository at this point in the history

  4. fixed ruff complaining about == instead of isinstance in test_factory… 

    …_pipeline
    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    f1256ed View commit details
    Browse the repository at this point in the history

  5. some broken dependencies causing test to fail, trying to fix pyprojec… 

    …t.toml
    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    301c8b7 View commit details
    Browse the repository at this point in the history

  6. Merge pull request #131 from CDU-data-science-team/126_ROC 

    126 roc
    @yiwen-h
    yiwen-h authored Aug 9, 2023
    Configuration menu
    Copy the full SHA
    c815088 View commit details
    Browse the repository at this point in the history

  7. started basic framework for dockerizing sentiment endpoint

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    18bf54d View commit details
    Browse the repository at this point in the history

  8. working docker container - cant use Alpine

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    d4f0831 View commit details
    Browse the repository at this point in the history

  9. got docker container to mount data folder, accept filename as argument

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    784c306 View commit details
    Browse the repository at this point in the history

  10. json input file now deleted if NOT run locally

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    98c1846 View commit details
    Browse the repository at this point in the history

  11. Predictions now outputted as json file in data_out folder

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    72c5a24 View commit details
    Browse the repository at this point in the history

  12. added label to dockerfile

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    1a30581 View commit details
    Browse the repository at this point in the history

  13. added most tests for docker_run

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    dfe0907 View commit details
    Browse the repository at this point in the history

  14. added larger json file - about 8000 comments

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    f3549b0 View commit details
    Browse the repository at this point in the history

  15. added cache removal to dockerfile in bid to reduce size

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    12a0f79 View commit details
    Browse the repository at this point in the history

  16. fewer layers, slim-debian, for smaller size

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    eb94f9a View commit details
    Browse the repository at this point in the history

  17. updated dockerfile to reduce size

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    866154c View commit details
    Browse the repository at this point in the history

  18. mocking load_model in test_predict_sentiment

    @yiwen-h
    yiwen-h committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    ca2e483 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2023

  1. Merge pull request #132 from CDU-data-science-team/118_distilbert_API 

    118 distilbert api
    @yiwen-h
    yiwen-h authored Aug 10, 2023
    Configuration menu
    Copy the full SHA
    5894def View commit details
    Browse the repository at this point in the history

  2. updated packages using poetry to address dependabot security issues

    @yiwen-h
    yiwen-h committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    c3a0c7f View commit details
    Browse the repository at this point in the history

  3. updated api requirements to match 0.5.5 package requirements

    @yiwen-h
    yiwen-h committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    f35e007 View commit details
    Browse the repository at this point in the history

  4. added proper reqs file to api folder (with dev group)

    @yiwen-h
    yiwen-h committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    71ece91 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2023

  1. Merge pull request #133 from CDU-data-science-team/security_fixes_16_… 

    …17_25_26

Security fixes 16 17 25 26
    @ChrisBeeley
    ChrisBeeley authored Aug 11, 2023
    Configuration menu
    Copy the full SHA
    0c0e7e5 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. added more docstrings

    @yiwen-h
    yiwen-h committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    60e1415 View commit details
    Browse the repository at this point in the history

  2. updated docs for API page and sentiment_pipeline

    @yiwen-h
    yiwen-h committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    44ac72b View commit details
    Browse the repository at this point in the history

  3. added tornado^6.3.3 to address security issue #27

    @yiwen-h
    yiwen-h committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    955e42f View commit details
    Browse the repository at this point in the history

  4. updated version to 0.5.5

    @yiwen-h
    yiwen-h committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    bf43ede View commit details
    Browse the repository at this point in the history

  5. fixed ruff complaining about isinstance

    @yiwen-h
    yiwen-h committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    c7806c3 View commit details
    Browse the repository at this point in the history