Implement `enable_gqa` in aten::scaled_dot_product_attention #1802

Open

Open

Implement enable_gqa in aten::scaled_dot_product_attention#1802

titaiwangms
openedon Aug 13, 2024

We should follow https://pytorch.org/docs/main/generated/torch.nn.functional.scaled_dot_product_attention.html to implement enable_gqa

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Assignees

No one assigned

Labels

contribution welcometopic: torch_lib

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests