Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable option to train on huggingface datasets. #17

Merged
merged 8 commits into from
Oct 17, 2023
Merged

Enable option to train on huggingface datasets. #17

merged 8 commits into from
Oct 17, 2023

Commits on Oct 16, 2023

  1. Remove unused imports from example script

    @harrykeightley
    harrykeightley committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    c283653 View commit details
    Browse the repository at this point in the history

  2. Downgrade torch version to fix missing cuda dependencies

    @harrykeightley
    harrykeightley committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    97c0046 View commit details
    Browse the repository at this point in the history

  3. Allow Jobs to be constructed from dictionaries

    @harrykeightley
    harrykeightley committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    4c21ff8 View commit details
    Browse the repository at this point in the history

  4. Set seed before training and log when train/eval are skipped.

    @harrykeightley
    harrykeightley committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    e05981c View commit details
    Browse the repository at this point in the history

  5. Update clean_text parameters to be more general (punc -> char)

    @harrykeightley
    harrykeightley committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    a097692 View commit details
    Browse the repository at this point in the history

  6. Allow creation of datasets from huggingface. Run cleaning and sample 

    constraints on constructed datasets.
    @harrykeightley
    harrykeightley committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    12e2b41 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. Allow training on hf datasets

    @harrykeightley
    harrykeightley committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    2f0df2f View commit details
    Browse the repository at this point in the history

  2. Black formatting

    @harrykeightley
    harrykeightley committed Oct 17, 2023
    Configuration menu
    Copy the full SHA
    b8d49bb View commit details
    Browse the repository at this point in the history