bugfix: support use_distributed_optimizer
bugfix: fix dynamic ckpt bug
bugfix: num of img * 256 > num of img token
add: convert ds_weight to hf fast script
yqyaopushed 1 commit to dev • 7e5c5dd…4a774de • on Aug 16, 2024
feat: add 910b npu support
yqyaopushed 13 commits to dev • 78fca30…7e5c5dd • on Jul 25, 2024
bugfix: fix transformer_engine import
fix: refactor npu to cuda
bugfix: fix qkv reshape bug
Force push
LitPriceforce pushed to 910b • ffbf6d2…456a2ac • on Jul 5, 2024
feat: add deeplink rms norm and adamw
feat: add npu adamw & fix some bugs
yqyaopushed 1 commit to dev_hjh • 2722024…cb49366 • on Jul 5, 2024
yqyaopushed 1 commit to dev_hjh • 3451745…2722024 • on Jul 5, 2024
refactor: support npu and dipu
yqyaopushed 1 commit to dev_hjh • 40cee66…3451745 • on Jul 5, 2024
yqyaopushed 1 commit to dev_hjh • 093b973…40cee66 • on Jul 4, 2024
bugfix: fix qkv reshape bug
LitPricepushed 1 commit to 910b • 191a505…ffbf6d2 • on Jul 2, 2024
yqyaocreated dev • 78fca30 • on Jul 1, 2024
yqyaocreated 910b • 191a505 • on Jun 28, 2024
add: internlm2 pretrain bin config
yqyaopushed 41 commits to main • f31bf1c…f3d21df • on Feb 24, 2024
yqyaopushed 6 commits to main • 96e759a…f31bf1c • on Dec 29, 2023
update: update the hf runner benchmark
yqyaopushed 2 commits to main • 20aea50…96e759a • on Dec 18, 2023
style: update convert_bin.sh
yqyaopushed 28 commits to main • 45a7211…20aea50 • on Dec 17, 2023
yqyaopushed 6 commits to main • b813cb9…45a7211 • on Nov 30, 2023
yqyaoforce pushed to main • 4765d4c…b813cb9 • on Nov 26, 2023
feat: add general chat prompt
yqyaocreated main • 4765d4c • on Nov 26, 2023
You can’t perform that action at this time.