v0.1.1 - Fix prompt for RaftCorrectness

What's Changed

• Update RaftCorrectness judge to use f-string for user_prompt by @fjlanasawhoop in #28

New Contributors

• @fjlanasawhoop made their first contribution in #28

Full Changelog: v0.1.0...v0.1.1

v0.1.0 - Updated LLM client and docs

What's Changed

• Consolidate LLM client to instructor by @freddiev4 in #25

NOTE: this is a breaking change in that you must pass the provider along with the model name, whereas previously you could pass just the model name for some providers.

Full Changelog: v0.0.12...v0.1.0

v0.0.12 - Add `judges` CLI

What's Changed

• CLI for judges by @alewarne in #26

Full Changelog: v0.0.11...v0.0.12

v0.0.11 - Fix formatting in `ZeroShotClassifier` and add `HypoEval`

What's Changed

• Fix erroneous format string in ZeroShotClassifier by @alewarne in #23
• Add HypoEval evaluators to judges.graders by @itea1001 in #24

New Contributors

• @itea1001 made their first contribution in #24

Full Changelog: v0.0.10...v0.0.11

v0.0.10

What's Changed

• Freddiev4/litellm import by @freddiev4 in #22

Full Changelog: v0.0.9...v0.0.10

v0.0.9 - Fix broken imports

What's Changed

• Create mirror.yml by @waldnzwrld in #17
• Rename query_quality..py to query_quality.py by @alewarne in #20
• Move instructor import by @freddiev4 in #21

New Contributors

• @waldnzwrld made their first contribution in #17
• @alewarne made their first contribution in #20

Full Changelog: v0.0.8...v0.0.9

v0.0.8 - Loosen dependencies and add examples

What's Changed

• Loosen Version Restrictions by @njbrake in #15
• enhancements: examples directory with example files to try out, and minor fixups by @pk-lit in #16

New Contributors

• @njbrake made their first contribution in #15
• @pk-lit made their first contribution in #16

Full Changelog: v0.0.7...v0.0.8

v0.0.7 — ReliableCIRelevance prompt fix

Fixes a bug in the ReliableCIRelevance judge prompt #14 by @jimthompson5802

Bug fix for integer conversions

What's Changed

• Fix issue with int conversion to lower() by @freddiev4 in #12

Full Changelog: v0.0.5...v0.0.6

v0.0.5 - Addition of `AutoJudge`

What's Changed

• Update README.md ToC for "pick a model" by @freddiev4 in #10
• Add new AutoJudge class for custom judges by @freddiev4 @jamesliounis #11

Full Changelog: v0.0.4...v0.0.5