Skip to content

Comments

[BugFix] fix BF16 support error for ipc handle import#89

Merged
peaceforeverCN merged 1 commit intotaco-project:mainfrom
Luis-xu:bugfix/memory_handle_fix
Jan 28, 2026
Merged

[BugFix] fix BF16 support error for ipc handle import#89
peaceforeverCN merged 1 commit intotaco-project:mainfrom
Luis-xu:bugfix/memory_handle_fix

Conversation

@Luis-xu
Copy link
Contributor

@Luis-xu Luis-xu commented Dec 26, 2025

  1. Supports constructing corresponding K/V tensors from IPC handles based on offsets, when allocating from a contiguous CUDA memory pool using cudamalloc.
  2. Resolving the issue of BF16 not being supported when importing IPC handles.

feiqiangs pushed a commit to feiqiangs/FlexKV that referenced this pull request Jan 28, 2026
Copy link
Collaborator

@peaceforeverCN peaceforeverCN left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

approve

@peaceforeverCN peaceforeverCN merged commit 267204c into taco-project:main Jan 28, 2026
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants