Skip to content

refactor: fetch resources from HuggingFace#34

Closed
Sonorous281 wants to merge 1 commit into
RLinf:mainfrom
Sonorous281:refactor/fetch-resources-from-hub
Closed

refactor: fetch resources from HuggingFace#34
Sonorous281 wants to merge 1 commit into
RLinf:mainfrom
Sonorous281:refactor/fetch-resources-from-hub

Conversation

@Sonorous281

@Sonorous281 Sonorous281 commented Jul 22, 2026

Copy link
Copy Markdown
Collaborator

Move the 'resources/' tree out of git and host it on HuggingFace, fetched on first use.
https://huggingface.co/datasets/RLinf/RPent-memory

@Sonorous281
Sonorous281 force-pushed the refactor/fetch-resources-from-hub branch from 80dbcfa to 4a50430 Compare July 22, 2026 11:41

@jx-qiu jx-qiu left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here are some minor suggestions.

Comment thread docs/source-en/rst_source/development/memory.rst Outdated
Comment thread docs/source-en/rst_source/development/memory.rst Outdated
Comment thread rpent/utils/resources.py
Comment thread rpent/utils/resources.py
Comment thread rpent/utils/resources.py Outdated
Comment thread rpent/utils/resources.py Outdated
@Sonorous281
Sonorous281 force-pushed the refactor/fetch-resources-from-hub branch 3 times, most recently from 45bd0f6 to 362da2a Compare July 22, 2026 12:56
The resources/ tree (per-env memory snapshot and read-only seed-0
reference corpora) is now hosted on the RLinf/RPent-resources dataset
and synced from there instead of being vendored in git.

- add rpent/utils/resources.py with ensure_resources(), which incrementally
  syncs the env subtree each run; set HF_HUB_OFFLINE=1 to use the local copy
  only. Memory is optional: a missing env or a failed sync is non-fatal
- cli: sync resources before building the planner
- gitignore resources/ and drop it from tracking
- document memory maintenance and its permission model; publishing to the
  dataset stays a controlled maintainer step with no in-repo upload path
@Sonorous281
Sonorous281 force-pushed the refactor/fetch-resources-from-hub branch from 362da2a to a2f8b85 Compare July 23, 2026 02:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants