verbosity-bias

Here are 3 public repositories matching this topic...

tkarim45 / llm-judge-bias

Measure position/verbosity/assertiveness bias in an LLM-as-judge (Claude) by judging pairs in both orders. Finding: no position bias, but 75% verbosity bias and 100% assertiveness bias — judge scores gameable by length + tone.

evaluation bedrock bias claude llm-as-judge position-bias verbosity-bias

Updated Jul 25, 2026
Python

shahoismael / prompt-quality-vs-response-compliance

Star

Code, per-item results and figures for a study dissociating prompt quality from response compliance in automated prompt-engineering assessment. Four-agent MATLAB evaluator on a locally hosted Qwen 2.5-7B judge, over 498 prompts from IFEval, LMSYS-Chat-1M and WildChat.

matlab automated-assessment ai-in-education instruction-following equivalence-testing construct-validity prompt-engineering ollama qwen llm-evaluation educational-assessment llm-as-a-judge open-weights ifeval verbosity-bias

Updated Oct 9, 2026
MATLAB

jo-sh-varughese / Toward-Interaction-Aware-Bias-Correction-in-LLM-as-a-Judge-Evaluation

Star

Do LLM-judge biases compose? A label-free, scale-aware test (SSIT) for position×length interaction in LLM-as-a-judge pipelines, with proofs, tie-coding and curvature diagnostics, 7-judge/6-family data, and the TMLR manuscript.

reproducible-research bias-correction difference-in-differences ssit length-bias llm-evaluation tmlr llm-as-judge randomization-inference position-bias verbosity-bias

Updated Oct 20, 2026
Python

Add this topic to your repo

To associate your repository with the verbosity-bias topic, visit your repo's landing page and select "manage topics."

Learn more