Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

recommended that you use use_reentrant=False #14

Open
sandyis opened this issue Jan 2, 2024 · 1 comment
Open

recommended that you use use_reentrant=False #14

sandyis opened this issue Jan 2, 2024 · 1 comment

Comments

@sandyis
Copy link

sandyis commented Jan 2, 2024

I see below warning in logs when running a LoRA training , can this be ignored ?

/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants. warnings.warn(
image

settings used
Text: (Service_API.txt) has 1604 blocks (Block Size 256 tokens)
[Batch Size: 7, Epochs: 3.0, Gradient Accumulation: 1]
Total number of steps: 690
Steps per each Epoch: 230
Suggestions:
Checkpoints: Save every 69 - 138 steps (Current: 192)
Warmup steps: 69 (Current: 96)

@FartyPants
Copy link
Owner

It could be ignored. I thought I disabled the warning... have to check

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants