Skip to content

Issues: OpenLMLab/LOMO

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

28 Open 42 Closed
28 Open 42 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Serious conclusion: LOMO does not significantly reduce GPU memory usage！
#72 opened Jan 3, 2024 by misonsky
17
实测LOMO++ deepspeed zero2 7b qlora llama 显存占用 感觉比正常的qlora + deepspeed zero2 显存占用大1倍
#70 opened Dec 26, 2023 by zlh1992
1
Can you provide detailed dependency versions?
#69 opened Dec 23, 2023 by misonsky
adalomo在使用chatglm2模型出现错误
#68 opened Nov 7, 2023 by JorunoJobana
2
adalomo 试图在 llama 2 70b 模型训练时出现 NCCL communicator 这类超时的错误
#67 opened Nov 7, 2023 by HappyLynn
5
eval environment for opencompass
#65 opened Oct 31, 2023 by KaiLv69
4
Runtime error on 2nd epoch, trying lora only
#56 opened Oct 3, 2023 by wasifferoze
a bug found in save_model of LOMOTrainer
#54 opened Aug 30, 2023 by DingQiang2018
@KaiLv69
10
LlaMA-7B + LoRA在16GB的V100上OOM
#53 opened Aug 30, 2023 by zhenqincn
2
Customized loss value
#52 opened Aug 22, 2023 by ZN1010
4
请问自定义Dataset只能是classification的数据集吗
#51 opened Jul 31, 2023 by Tonystark64
1
小学习率问题
#50 opened Jul 31, 2023 by wpcool
1
选取bloom-1b7作为model和wic作为数据集出现IndexError: tuple index out of range
#49 opened Jul 28, 2023 by Tonystark64
1
CLIP梯度和梯度overflow的影响
#48 opened Jul 21, 2023 by tzjtatata
2
为什么LOMO并没有火起来呢？
#47 opened Jul 21, 2023 by Flywolfs
5
Memory Usage continues to grow
#45 opened Jul 18, 2023 by Jetcodery
5
关于代码理解和显存占用的问题
#41 opened Jul 15, 2023 by anbyaa
1
How to calculate the used GPU memory for each part as in the paper?
#36 opened Jul 6, 2023 by liming-ai
2
about torch.stack(self.grad_norms)
#30 opened Jun 30, 2023 by jinzitian
3
llama-33B/llama-65B均报OOM，8*V100跑不起来怎么回事呢？
#28 opened Jun 29, 2023 by alisyzhu
7
Some confusion about the method of the paper
#27 opened Jun 29, 2023 by JorunoJobana
3
Memory consumption first grows up then falls down.
#26 opened Jun 29, 2023 by zhenqin96
@KaiLv69
3
Performance Model after Full Fine-tuning by LOMOTrainer
#25 opened Jun 28, 2023 by dat-browny
9
更充分实验，与Adam的实验效果进行比较
#21 opened Jun 26, 2023 by yangjianxin1
6
Is LOMO capable of pre-training a LLM from scratch as well?
#20 opened Jun 26, 2023 by YuxingLu613
2
ProTip! Type g i on any issue or pull request to go back to the issue listing page.