Skip to content
#

hallucination-detection

Star

Here are 24 public repositories matching this topic...

Language: All
Filter by language
All 24 Python 14 Jupyter Notebook 7 JavaScript 2
Sort: Recently updated
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated
verifAI

nikolamilosevic86 / verifAI

Sponsor
Star 19

VerifAI initiative to build open-source easy-to-deploy generative question-answering engine that can reference and verify answers for correctness (using posteriori model)

nlp machine-learning natural-language-processing deep-learning verification pubmed openai medline nlp-machine-learning opensearch biomedical-data-science nli bioasq qdrant llm qlora mistral-7b hallucination-detection scifact
  • Updated Nov 14, 2024
  • Jupyter Notebook

aimonlabs / aimon-python-sdk

Star 9

This repo hosts the Python SDK and related examples for AIMon, which is a proprietary, state-of-the-art system for detecting LLM quality issues such as Hallucinations. It can be used during offline evals, continuous monitoring or inline detection. We offer various model quality metrics that are fast, reliable and cost-effective.

continuous-monitoring guardrails instruction-following llm generative-ai hallucination-detection
  • Updated Nov 12, 2024
  • Python

serhanylmz / pas2

Star 0

PAS2: A Python-based hallucination detection system that evaluates AI response consistency through paraphrasing and semantic similarity analysis. Features include response evaluation, similarity metrics, visualization tools, and a web interface for interactive testing.

visualization nlp benchmarking artificial-intelligence openai semantic-similarity gpt gradio nlp-machine-learning paraphrase-detection openai-api hallucination-detection
  • Updated Nov 11, 2024
  • Python

NishilBalar / Awesome-LVLM-Hallucination

Star 22

up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources

mlm hallucination large-language-models llm mllm large-vision-language-models multimodal-large-language-models hallucination-evaluation hallucination-detection vision-language-models lvlm hallucination-mitigation hallucination-survey hallucination-research hallucination-benchmark multimodal-language-model
  • Updated Nov 5, 2024

uptrain-ai / uptrain

Star 2.2k

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

machine-learning monitoring evaluation experimentation jailbreak-detection autoevaluation root-cause-analysis prompt-engineering llmops openai-evals llm-prompting llm-eval llm-test hallucination-detection
  • Updated Aug 18, 2024
  • Python

deshwalmahesh / PHUDGE

Star 48

Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute, relative and much more. It contains a list of all the available tool, methods, repo, code etc to detect hallucination, LLM evaluation, grading and much more.

nlp ai evaluation ml pytorch judge feedback-collection sota custom-dataset finetuning hallucination llm llm-evaluation hallucination-detection phi-3
  • Updated Jul 10, 2024
  • Jupyter Notebook

Improve this page

Add a description, image, and links to the hallucination-detection topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the hallucination-detection topic, visit your repo's landing page and select "manage topics."

Learn more