Skip to content

Comments

Feature/custom test suite#2

Merged
Hiepler merged 4 commits intomainfrom
feature/custom-test-suite
Feb 1, 2026
Merged

Feature/custom test suite#2
Hiepler merged 4 commits intomainfrom
feature/custom-test-suite

Conversation

@Hiepler
Copy link
Owner

@Hiepler Hiepler commented Feb 1, 2026

Description

Fixes #(issue)

Type of Change

  • 🐛 Bug fix (non-breaking change which fixes an issue)
  • ✨ New feature (non-breaking change which adds functionality)
  • 💥 Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • 📚 Documentation update
  • 🎨 Style/UI change
  • ♻️ Refactoring (no functional changes)
  • 🧪 Test update
  • 🔧 Configuration change

Checklist

Code Quality

  • My code follows the project's coding standards (Biome)
  • I have performed a self-review of my code
  • I have commented my code, particularly in hard-to-understand areas
  • My changes generate no new warnings

Testing

  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes
  • I have tested my changes in multiple browsers (if applicable)

Documentation

  • I have updated the documentation accordingly
  • I have updated the README if needed

Accessibility (if UI changes)

  • My changes are keyboard accessible
  • My changes work with screen readers
  • Color contrast meets WCAG 2.2 AA standards

Screenshots (if applicable)

Additional Notes

Add ability for users to upload custom test data files (.csv, .json) for bias testing instead of using default CrowS-Pairs datasets.
- Add helper to detect cloud models via ':cloud' suffix
- Skip logprobs capability test for cloud models (not supported)
@codecov-commenter
Copy link

Welcome to Codecov 🎉

Once you merge this PR into your default branch, you're all set! Codecov will compare coverage reports and display results in all future pull requests.

ℹ️ You can also turn on project coverage checks and project coverage reporting on Pull Request comment

Thanks for integrating Codecov - We've got you covered ☂️

@Hiepler Hiepler merged commit ced80ac into main Feb 1, 2026
5 checks passed
@Hiepler Hiepler deleted the feature/custom-test-suite branch February 1, 2026 23:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants