Skip to content

refactor fetching resources from huggingface#47

Merged
Sonorous281 merged 5 commits into
RLinf:mainfrom
Sonorous281:refactor/fetch-resources-from-hub
Jul 23, 2026
Merged

refactor fetching resources from huggingface#47
Sonorous281 merged 5 commits into
RLinf:mainfrom
Sonorous281:refactor/fetch-resources-from-hub

Conversation

@Sonorous281

Copy link
Copy Markdown
Collaborator

Move the resources tree out of git and host it on HuggingFace.
https://huggingface.co/datasets/RLinf/RPent-memory

The resources/ tree (per-env memory snapshot and read-only seed-0
reference corpora) is now hosted on the RLinf/RPent-resources dataset
and synced from there instead of being vendored in git.

- add rpent/utils/resources.py with ensure_resources(), which incrementally
  syncs the env subtree each run; set HF_HUB_OFFLINE=1 to use the local copy
  only. Memory is optional: a missing env or a failed sync is non-fatal
- cli: sync resources before building the planner
- gitignore resources/ and drop it from tracking
- document memory maintenance and its permission model; publishing to the
  dataset stays a controlled maintainer step with no in-repo upload path
…urces-from-hub

# Conflicts:
#	pyproject.toml
#	rpent/cli/main.py

@jx-qiu jx-qiu left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note: this PR is re-opened from #34.

@Sonorous281
Sonorous281 force-pushed the refactor/fetch-resources-from-hub branch from c2147b8 to 12d1722 Compare July 23, 2026 08:35
Comment thread rpent/cli/main.py Outdated
@Sonorous281
Sonorous281 force-pushed the refactor/fetch-resources-from-hub branch from bf8c62c to 95015e9 Compare July 23, 2026 09:24
@Sonorous281
Sonorous281 merged commit 3906b97 into RLinf:main Jul 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants