[Feature] AIBrix KVCache common

[DwyaneShi]

Pull Request Description

This PR introduces the foundational setup and core modules for the project:

Key Changes

• Project Initialization – Basic project structure, setup, and dependencies.
• Common Module – Logging, nvtx annotation, async utils.
• Memory Module – Tensor pool allocator, memory region and reference counted object.
• Spec/Status/Cache Handle
• Unit test for tensor pool allocator

Related Issues

Resolves: #[Insert issue number(s)]

Important: Before submitting, please complete the description above and review the checklist below.

---

Contribution Guidelines (Expand for Details)

We appreciate your contribution to aibrix! To ensure a smooth review process and maintain high code quality, please adhere to the following guidelines:

Pull Request Title Format

Your PR title should start with one of these prefixes to indicate the nature of the change:

• [Bug]: Corrections to existing functionality
• [CI]: Changes to build process or CI pipeline
• [Docs]: Updates or additions to documentation
• [API]: Modifications to aibrix's API or interface
• [CLI]: Changes or additions to the Command Line Interface
• [Misc]: For changes not covered above (use sparingly)

Note: For changes spanning multiple categories, use multiple prefixes in order of importance.

Submission Checklist

• PR title includes appropriate prefix(es)
• Changes are clearly explained in the PR description
• New and existing tests pass successfully
• Code adheres to project style and best practices
• Documentation updated to reflect changes (if applicable)
• Thorough testing completed, no regressions introduced

By submitting this PR, you confirm that you've read these guidelines and your changes align with the project's contribution standards.

[Jeffwan]

Here, we need a separate package python/aibrix_kvcache/aibrix_kvcache. corresponding usage would be pip install aibrix-kvcache

another option is python/aibrix/aibrix/kvcache. kv cache package doesn't have interactions with other components, technically, it can be a standalone one, I think make it as a submodule also works. What's your preferred way? this is related to publish.

[DwyaneShi]

I initially considered making kv cache as a submodule. But since kv cache has many more dependencies than the aibrix runtime (e.g., torch, redis, infinistore) and their dependencies do not have too much overlap, I decided to make it as a separate project. Therefore, when user installs aibrix runtime or kv cache, only needed dependencies would be downloaded and installed, which makes more sense to me.

[Copilot]

Pull Request Overview

This PR establishes the core framework for the AIBrix KVCache project by introducing foundational modules, test infrastructure, and configuration updates. Key additions include test fixtures and helper functions, core modules for status, spec, memory, and caching functionality, as well as standardized project configuration and CI workflows.

Reviewed Changes

Copilot reviewed 22 out of 24 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
python/aibrix_kvcache/tests/conftest.py	Introduces tests and fixtures for KVCache with helper functions to manage cache environments.
python/aibrix_kvcache/tests/init.py	Adds license headers to test files.
python/aibrix_kvcache/scripts/check_aibrix_header.py	Provides a script to verify and add required AIBrix license headers in source files.
python/aibrix_kvcache/pyproject.toml	Sets up project configuration, dependencies, and linting configurations.
python/aibrix_kvcache/aibrix_kvcache/status.py	Implements a generic status mechanism for success/error handling.
python/aibrix_kvcache/aibrix_kvcache/spec.py	Defines specifications for cache blocks and tensor configurations.
python/aibrix_kvcache/aibrix_kvcache/memory/*	Adds memory management modules including tensor pool allocator and ref-counted objects.
python/aibrix_kvcache/aibrix_kvcache/common/*	Introduces common utilities such as async base, nvtx profiling, object pool and logging.
python/aibrix_kvcache/aibrix_kvcache/cache_handle.py	Establishes cache handle abstraction and its memory-region based implementation.
python/aibrix_kvcache/README.md	Provides an overview and quick start instructions for using the framework.
python/aibrix_kvcache/LICENSE	Specifies the project license under the Apache License 2.0.
.github/workflows/*.yml	Updates CI workflows to test and lint changes within the designated subdirectories.

Files not reviewed (2)

• python/aibrix_kvcache/.gitignore: Language not supported
• python/aibrix_kvcache/scripts/format.sh: Language not supported

[Jeffwan]

I did review the detail code in this PR.

Let's get all the work merged and then kick off the code review in parallel.

[Jeffwan]

check release pipeline, we need to upload to pypi as well for each tags.

[Jeffwan]

rest version are aligned with aibrix repo tags. we may consider the version strategy here.