Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds cml train yml action #33

Open
wants to merge 41 commits into
base: staging
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 11 commits
Commits
Show all changes
41 commits
Select commit Hold shift + click to select a range
ae0b077
Merge pull request #21 from Amharic-STT/staging
Azariagmt Aug 4, 2021
b796d3c
Merge branch 'staging' of https://github.com/Amharic-STT/STT-engine i…
jedisam Aug 6, 2021
a58de09
Merge branch 'staging' of https://github.com/Amharic-STT/STT-engine i…
jedisam Aug 6, 2021
c262e1d
data:track
jedisam Aug 6, 2021
631ae5c
Merge branch 'staging' of https://github.com/Amharic-STT/STT-engine i…
jedisam Aug 6, 2021
23c1278
adds initial pickle objects
jedisam Aug 7, 2021
7cca17f
Merge branch 'staging' of https://github.com/Amharic-STT/STT-engine i…
Azariagmt Aug 7, 2021
bac1d0e
Merge branch 'staging' of https://github.com/Amharic-STT/STT-engine i…
Azariagmt Aug 7, 2021
7a5712e
Merge branch 'staging' of https://github.com/Amharic-STT/STT-engine i…
Azariagmt Aug 7, 2021
a9b09be
saved the trained model
rasyosef Aug 7, 2021
be181de
saved the character encoder
rasyosef Aug 7, 2021
0e4263d
sets up cml training on own server
Azariagmt Aug 7, 2021
54d80f9
Merge branch 'staging' into dev-azaria
Azariagmt Aug 7, 2021
2e3ed8f
Merge branch 'staging' of https://github.com/Amharic-STT/STT-engine i…
Azariagmt Aug 7, 2021
fa85a9b
Merge branch 'dev-yosef' of https://github.com/Amharic-STT/STT-engine…
rasyosef Aug 8, 2021
4bd688d
data loading and preprocessing modules
rasyosef Aug 8, 2021
6661467
encoding module and saved encoder
rasyosef Aug 8, 2021
14b08a6
data loading and preprocessing modules
rasyosef Aug 8, 2021
ca5fd46
modified feature extraction functions
rasyosef Aug 8, 2021
682aff2
moved model creation to models,py
rasyosef Aug 8, 2021
97e6b63
modular version of Amharic_STT
rasyosef Aug 8, 2021
085c304
mlflow parameter logging
rasyosef Aug 8, 2021
1b80b44
mlflow parameter logging
rasyosef Aug 8, 2021
352c459
Merge branch 'dev-yosef' into integration
Azariagmt Aug 9, 2021
174d174
modified preprocessing functions
rasyosef Aug 9, 2021
9cf2cf8
modified training notebook
rasyosef Aug 9, 2021
31ab1b6
modified requirements.txt
rasyosef Aug 9, 2021
34bc7ed
modified readme
rasyosef Aug 9, 2021
fbc29cb
.
rasyosef Aug 9, 2021
e3e82c1
added batch training
rasyosef Aug 9, 2021
ede46fd
added mel spectrogram saving function
rasyosef Aug 9, 2021
cd221db
added model training python file
rasyosef Aug 10, 2021
87e7ccd
better model
rasyosef Aug 10, 2021
3b9b95f
fixes configuration to run on server
Azariagmt Aug 11, 2021
eb52f05
untracks .pyc files
Azariagmt Aug 11, 2021
c85655c
Merge branch 'dev-yosef' into dev-azaria
Azariagmt Aug 11, 2021
7672431
Merge branch 'integration' into dev-azaria
Azariagmt Aug 11, 2021
1b2e776
setsup dvc pipeline
Azariagmt Aug 11, 2021
1116fd5
modifies requirements and untracks .pyc files
Azariagmt Aug 11, 2021
1107474
setsup github actions for training
Azariagmt Aug 11, 2021
69b689d
removes tensorboard plugin from requirements
Azariagmt Aug 11, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 0 additions & 20 deletions .github/workflows/cml.yml

This file was deleted.

18 changes: 18 additions & 0 deletions .github/workflows/train.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
name: train-my-model

on:
push:
branches:
- "train-model"

jobs:
train:
runs-on: [self-hosted, cml, gpu]

steps:
- uses: actions/checkout@v2

- name: cml_run
run: |
echo 'Hi from CML!' >> report.md
cml-send-comment report.md
6 changes: 3 additions & 3 deletions data.dvc
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
outs:
- md5: bc8108ef9de98e206b7cfcc971293348.dir
size: 387974316
nfiles: 1958
- md5: 6b2b462332409ffcf3cb6fc90d1861d6.dir
size: 4526191427
nfiles: 11248
path: data