Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add try except around datasets to train on broken datasets #2

Draft
wants to merge 36 commits into
base: main
Choose a base branch
from
Draft
Changes from 1 commit
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
8222dc0
add try except around datasets to train on broken datasets
odulcy-mindee Jan 5, 2024
e6faaf6
fix in collate_fn
odulcy-mindee Jan 6, 2024
b5a41bd
Problems with augmentations involving _gaussian_filter
odulcy-mindee Jan 6, 2024
fbef2cf
from https://github.com/mindee/doctr/pull/1444
odulcy-mindee Feb 1, 2024
c350bd7
send message on slack (pytorch script)
odulcy-mindee Feb 6, 2024
f16b192
exclude l1_loss in db model
odulcy-mindee Feb 6, 2024
9b0ae92
send_on_slack tf
odulcy-mindee Feb 13, 2024
2036599
Revert "fix test"
odulcy-mindee Feb 13, 2024
c02a477
fix
odulcy-mindee Feb 14, 2024
2602a5d
Display pbar before starting training
odulcy-mindee Feb 19, 2024
578d9b8
temp eval with cord funsd from felix
odulcy-mindee Mar 6, 2024
ccf19d9
try_except on sec_evaluate
odulcy-mindee Mar 8, 2024
a5a6101
pbar on evaluate fn
odulcy-mindee Mar 8, 2024
cc795f6
pbar on sec_evaluate
odulcy-mindee Mar 8, 2024
34e32eb
apply patch from https://github.com/felixdittrich92/doctr/commit/27bc…
odulcy-mindee Mar 11, 2024
2e90794
stop using custom ds for val
odulcy-mindee Mar 20, 2024
e6d393b
train_pytorch_orientation send_on_slack
odulcy-mindee Apr 15, 2024
05a6779
feat: :sparkles: orientation dataset walk
odulcy-mindee Apr 15, 2024
bd18864
(32, 32) -> (128, 128)
odulcy-mindee Apr 16, 2024
ea58710
(256, 256) -> (512, 512)
odulcy-mindee Apr 16, 2024
1049fab
train_tensorflow_orientation.py: size for crop
odulcy-mindee Apr 16, 2024
9c68b21
Merge branch 'main' into try_except
odulcy-mindee Apr 19, 2024
53aa99b
slack display args on train_pytorch_orientation
odulcy-mindee Apr 22, 2024
6688c6f
Merge branch 'main' into try_except
odulcy-mindee Apr 26, 2024
4d751f1
pbar `train_tensorflow_orientation`
odulcy-mindee Apr 30, 2024
9f034cb
Frankenstein script to train TF model with Torch DataLoader
odulcy-mindee May 22, 2024
483eed3
Merge branch 'main' into try_except
odulcy-mindee May 22, 2024
e56b7c0
fix send_on_slack
odulcy-mindee Jun 5, 2024
983e815
upd
odulcy-mindee Jun 5, 2024
5fd3355
Merge branch 'main' into try_except
odulcy-mindee Jun 6, 2024
32d699f
Merge branch 'main' into try_except
odulcy-mindee Jun 12, 2024
163db75
Merge branch 'main' into try_except
odulcy-mindee Dec 17, 2024
1efc8ee
revert few changes
odulcy-mindee Dec 17, 2024
536b93e
Merge branch 'main' into try_except
odulcy-mindee Dec 17, 2024
3fda58e
Merge branch 'main' into try_except
odulcy-mindee Dec 18, 2024
46c41b7
Merge branch 'main' into try_except
odulcy-mindee Dec 20, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix send_on_slack
odulcy-mindee committed Jun 5, 2024
commit e56b7c07d9f46baa289bbc352e10826fd7cf9bb2
2 changes: 1 addition & 1 deletion references/classification/train_tensorflow_orientation.py
Original file line number Diff line number Diff line change
@@ -146,7 +146,7 @@ def fit_one_epoch(model, train_loader, batch_transforms, optimizer, amp=False):
if current_progress - last_progress > interval_progress:
send_on_slack(str(pbar))
last_progress = int(current_progress)
send_on_slack(f"Final training loss: {train_loss.item():.6}")
send_on_slack(f"Final training loss: {train_loss.numpy():.6}")


def evaluate(model, val_loader, batch_transforms):