Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

这个微调代码不能直接用来baichuan-13B模型的微调?在13B一直报错 #38

Open
DaiJitao opened this issue Jul 13, 2023 · 2 comments

Comments

@DaiJitao
Copy link

File "baichuan_lora_tuning.py", line 142, in
main()
File "baichuan_lora_tuning.py", line 134, in main
trainer.train()
File "/data01/conda_pkg/envs/baichuan/lib/python3.8/site-packages/transformers/trainer.py", line 1664, in train
return inner_training_loop(
File "/data01/conda_pkg/envs/baichuan/lib/python3.8/site-packages/transformers/trainer.py", line 1940, in _inner_training_loop
tr_loss_step = self.training_step(model, inputs)
File "/data01/conda_pkg/envs/baichuan/lib/python3.8/site-packages/transformers/trainer.py", line 2735, in training_step
loss = self.compute_loss(model, inputs)
File "baichuan_lora_tuning.py", line 45, in compute_loss
return model(
AttributeError: 'tuple' object has no attribute 'loss'

@beyondguo
Copy link
Owner

每个模型结构可能会有不一样,代码应该需要小的改动。近期我抽空调试一下

@kunden0612
Copy link

每个模型结构可能会有不一样,代码应该需要小的改动。近期我抽空调试一下

现在支持baichuan-13b的模型吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants