Skip to content

Retuned CK GMM fp8/bf16 with perf fixes #3851

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

zjing14
Copy link
Contributor

@zjing14 zjing14 commented Mar 19, 2025

Summary:

  • Fixed launch bound for grouped gemm
  • Retuned fp8 gmm

Differential Revision: D71140320

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

Copy link

netlify bot commented Mar 19, 2025

Deploy Preview for pytorch-fbgemm-docs ready!

Name Link
🔨 Latest commit 94cd6da
🔍 Latest deploy log https://app.netlify.com/sites/pytorch-fbgemm-docs/deploys/67e498364d03ec00089f31ac
😎 Deploy Preview https://deploy-preview-3851--pytorch-fbgemm-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

zjing14 added a commit to zjing14/FBGEMM that referenced this pull request Mar 26, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D71140320

mxz297 pushed a commit to mxz297/FBGEMM that referenced this pull request Mar 27, 2025
Summary:
Pull Request resolved: pytorch#3851

X-link: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Differential Revision: D71140320

Reviewed By: mxz297
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 5a1b835.

q10 pushed a commit to q10/FBGEMM that referenced this pull request Apr 10, 2025
Summary:
X-link: pytorch#3851

Pull Request resolved: facebookresearch/FBGEMM#941

- Fixed launch bound for grouped gemm
- Retuned fp8 gmm
- Retuned fp8/bf16 GMM for 17Bx16/128 with auto-gen instances (D71528034)

Reviewed By: mxz297

Differential Revision: D71140320

fbshipit-source-id: 3da0ec9935bb5edfe854a3084d3660f7d2abb4ec
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants