Issues

• Add a deterministic task-completion scorer for agentic runs

  enhancementhelp wantedstatus: available
  wandb/rai-toolkit#109 · Filter by author knisar opened on Oct 6, 2026
  2

• fix(reports): unassessed rows are hidden from category lines and counted as failures

  buggood first issuehelp wantedstatus: needs author
  wandb/rai-toolkit#108 · Filter by author knisar opened on Oct 6, 2026

• fix(reports): mark cost estimates unavailable for unknown model pricing

  bughelp wantedstatus: needs author
  wandb/rai-toolkit#95 · Filter by author knisar opened on Sep 25, 2026

• KeywordToxicityScorer: the number of hits that still passes grows with the configured keyword count

  bugstatus: available
  wandb/rai-toolkit#91 · Filter by author KunyangZhang opened on Sep 20, 2026
  3

• fix(scorers): restore keyword derivatives without changing score weights

  bughelp wantedstatus: needs author
  wandb/rai-toolkit#79 · Filter by author knisar opened on Sep 18, 2026
  1

• Prevent refusal text from hiding separate attack-success signals

  bughelp wantedstatus: needs author
  wandb/rai-toolkit#76 · Filter by author knisar opened on Sep 16, 2026

• fix(scorers): use structured data boundaries in LLM judge prompts

  bughelp wantedstatus: available
  wandb/rai-toolkit#62 · Filter by author knisar opened on Sep 9, 2026
  1

• Add a citation correctness scorer for RAG outputs

  enhancementstatus: needs author
  wandb/rai-toolkit#22 · Filter by author knisar opened on Aug 31, 2026
  1

• Expand model interoperability with vendor-neutral adapters

  enhancementtype: umbrella
  wandb/rai-toolkit#21 · Filter by author knisar opened on Aug 31, 2026
  4

• Add framework mappings for more regimes (UK, Singapore IMDA, India DPDP) and deepen EU AI Act Annex III

  enhancementtype: umbrella
  wandb/rai-toolkit#14 · Filter by author knisar opened on Aug 30, 2026

• Contribute additional red-team attack templates

  enhancementtype: umbrella
  wandb/rai-toolkit#9 · Filter by author knisar opened on Aug 26, 2026
  2

• Add NYC Local Law 144 mapping (automated employment decision tools)

  domain expertise wantedenhancementstatus: needs author
  wandb/rai-toolkit#8 · Filter by author knisar opened on Aug 26, 2026

• Add Colorado AI Act framework mapping

  domain expertise wantedenhancementstatus: needs spec
  wandb/rai-toolkit#7 · Filter by author knisar opened on Aug 26, 2026

• Add ISO/IEC 42001 framework mapping

  domain expertise wantedenhancementstatus: needs spec
  wandb/rai-toolkit#6 · Filter by author knisar opened on Aug 26, 2026

• Add RAG and agent-specific evaluation metrics

  enhancementtype: umbrella
  wandb/rai-toolkit#4 · Filter by author abelphedia opened on Aug 19, 2026
  5

• Support for custom enterprise policy packs

  enhancementstatus: needs spec
  wandb/rai-toolkit#3 · Filter by author abelphedia opened on Aug 19, 2026
  1