feat(datasets): add DatasetMetadataClient for pure DB-backed metadata management#1171
Open
jake11-oho wants to merge 1 commit into
Open
feat(datasets): add DatasetMetadataClient for pure DB-backed metadata management#1171jake11-oho wants to merge 1 commit into
jake11-oho wants to merge 1 commit into
Conversation
jake11-oho
force-pushed
the
feat/datasets-sdk-v2
branch
from
July 1, 2026 03:39
b57f4bc to
2958c3b
Compare
jake11-oho
force-pushed
the
feat/datasets-sdk-v2
branch
2 times, most recently
from
July 1, 2026 05:25
8398ecc to
2c62b01
Compare
jake11-oho
force-pushed
the
feat/datasets-sdk-v2
branch
2 times, most recently
from
July 8, 2026 08:41
230644f to
d35e66f
Compare
… management Introduce a pure DB-backed metadata client decoupled from the server package. ORM models (Dataset, Instance, Image, Permission, AuditEvent) are defined in rock/sdk/envhub/datasets/database.py with their own Base, eliminating the import chain through rock.envhub that pulled in fastapi, nacos, redis, and ray. Key changes: - DatasetMetadataClient as user-facing SDK entry point - DbDatasetRegistry with connection pooling, engine dedup, batch upsert - pool_pre_ping parameter, create_all dedup per db_url - Split table with task_count, tags on Instance, timestamp fields - Sorting support (default: org+name ASC) with SortField/SortOrder enums - DatasetInfo.splits returns list[SplitInfo] with full metadata - source field on Dataset for tracking data origin - 63 unit tests covering all CRUD operations, sorting, and edge cases fixes alibaba#1170 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
jake11-oho
force-pushed
the
feat/datasets-sdk-v2
branch
from
July 10, 2026 02:40
05e22fb to
41899d8
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
引入纯 DB 元数据客户端
DatasetMetadataClient,与 OSS 文件操作彻底解耦。DbDatasetRegistry:PostgreSQL CRUD + SQLite 方言支持DatasetMetadataClient:面向用户的元数据 SDK架构设计
DB 管元数据,OSS 管文件,两者独立使用:
fixes #1170
Test plan
DatasetMetadataClient(dataset/instance/image/permission/audit CRUD)🤖 Generated with Claude Code