Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Are there any difficulties in implementing gemm-allreduce? #20

Open
Rainlin007 opened this issue Jul 15, 2024 · 2 comments
Open

Are there any difficulties in implementing gemm-allreduce? #20

Rainlin007 opened this issue Jul 15, 2024 · 2 comments
Assignees
@zheng-ningxin
Labels
enhancement New feature or request

Comments

@Rainlin007
Copy link

Rainlin007 commented Jul 15, 2024 •
edited
Loading

  1. In some projects, Gemm+AllReduce needs to be used. I would like to know whether Gemm+AllReduce can be implemented? and possible methods and issues. thanks.

#7
@zheng-ningxin zheng-ningxin added the enhancement New feature or request label Jul 16, 2024
@zheng-ningxin zheng-ningxin self-assigned this Jul 16, 2024
@zheng-ningxin
Copy link
Collaborator

@kongroo

@wenlei-bao
Copy link
Collaborator

@Rainlin007 Technically yes, but depends on priorities we haven't consider this case yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zheng-ningxin zheng-ningxin

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@Rainlin007 @zheng-ningxin @wenlei-bao