Skip to content

Commit

Permalink
Disables check for packing by the te_helper util since not all dataset
Browse files Browse the repository at this point in the history
configs use packing (CV/Multimodal)
  • Loading branch information
terrykong committed Aug 27, 2023
1 parent d250182 commit 985ff36
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions t5x/te_helper.py
Original file line number Diff line number Diff line change
Expand Up @@ -179,6 +179,8 @@ def update_fp8_metas(grad_accum, flax_mutables):

@staticmethod
def check_dataset_cfg(config):
if not hasattr(config, 'pack'):
return
assert not config.pack, \
"Transformer Engine does not support dataset.packing, please turn it off."

Expand Down

0 comments on commit 985ff36

Please sign in to comment.