Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Great work！ and can this work with deepspeedzero? #75

Open
laoda513 opened this issue May 22, 2023 · 0 comments
Open

Great work！ and can this work with deepspeedzero? #75

laoda513 opened this issue May 22, 2023 · 0 comments

Comments

@laoda513
Copy link

laoda513 commented May 22, 2023 •
edited
Loading

great work.
seems more efficient than pp in my machine (8*2080ti 22g)
I am thinking about if this can work with zero or, forexample to combine 2 gpu to 1, than use zero to combine the 4 groups of gpu..
@laoda513 laoda513 changed the title great work！ Great work！ and can this work with deepspeedzero? May 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@laoda513