Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Actual value seems to be the same as theoretical value (instead of much smaller than it) #6

Open
fzyzcjy opened this issue Nov 3, 2024 · 0 comments

Comments

@fzyzcjy
Copy link

fzyzcjy commented Nov 3, 2024

Hi thank you for the great benchmark as well as the videos explaining papers!

Currently the table/explanations says that actual matrix multiplication value is much smaller than theoretical one. But after asking in https://forums.developer.nvidia.com/t/why-is-matrix-multiplication-quite-slow-and-all-hardware-seems-to-be-only-half-used/312013, Curefab explains that it is indeed almost the same. Thus I create this tiny issue as a little reference.

@fzyzcjy fzyzcjy changed the title Actual value is indeed the same as theoretical value (instead of much smaller than it) Actual value seems to be the same as theoretical value (instead of much smaller than it) Nov 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant