Add evaluation harness and config presets for RAG tuning #5

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Draft

crd wants to merge 1 commit into main from codex/create-fine-tuning-configuration-framework

+930 −66

Owner

crd commented Nov 7, 2025

Summary

centralize runtime defaults in a typed config loader and update ingest/chat to consume it
add synonym-driven query expansion plus configurable presets for balanced, high-recall, and fast profiles
provide an evaluation harness, datasets, and documentation so users can benchmark configurations locally

Testing

pytest


          Add configuration presets and evaluation harness

cae50f1

crd added the codex label

— with

ChatGPT Codex Connector

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels