-
Notifications
You must be signed in to change notification settings - Fork 178
Caching huggingface models in GH actions #602
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
PR Summary
Modifies GitHub Actions workflow to address HuggingFace API rate limiting issues by implementing model caching while reducing Python version test matrix.
- Added caching for HuggingFace models in
.github/workflows/test.yamlto prevent repeated downloads across CI runs - Reduced Python version testing from multiple versions (3.9-3.11) to only Python 3.12, which significantly decreases test coverage
- Removed macOS-specific exclusions from test matrix as macOS testing was already commented out
- These changes may help resolve the 429 Too Many Requests errors but introduce potential version compatibility blind spots
1 file reviewed, no comments
Edit PR Review Bot Settings | Greptile
|
Codecov ReportAll modified and coverable lines are covered by tests ✅
❗ Your organization needs to install the Codecov GitHub app to enable full functionality. Additional details and impacted files@@ Coverage Diff @@
## main #602 +/- ##
==========================================
- Coverage 79.85% 79.42% -0.43%
==========================================
Files 43 43
Lines 3489 3489
==========================================
- Hits 2786 2771 -15
- Misses 703 718 +15 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
|
This adds some support for caching huggingface models for the CI pipeline:
This should reduce the required download of the models. |
Attempt to reduce traffic to huggingface to get rid of errors like:
Attempt is to cache the hf models to avoid redownload every run.
This adds some support for caching huggingface models for the CI pipeline:
This should reduce the required download of the models.