Skip to content

Conversation

@abcdabcd987
Copy link
Member

Fix bugs introduced in #554

  1. Function signature change for chain_speculative_sampling() pybind in aot.
  2. packbits() uses a str default value, which is not supported by PyTorch 2.4. This PR added a workaround.
  3. For Pytorch < 2.4, the two decorators (register_custom_op() and register_fake_op()) should return identity function instead of None.

@abcdabcd987 abcdabcd987 requested a review from yzh119 October 26, 2024 23:19
@yzh119 yzh119 merged commit 9d2996d into flashinfer-ai:main Oct 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants