Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

CSH Evals, the modern way.

The fastest java expression compiler/evaluator

Python client library for improving your LLM app accuracy

ARGAEL is an open-source Java desktop application designed to maximize the experience and efficiency of the process of annotating and evaluating arguments in large text corpora.

IELTS listening, speaking, reading and writing modules practice and evaluation with IELTS band calculation based on speech and text analysis and evaluation.

This library implements various metrics (including Kaggle Competition, Medicine) for evaluating ML, DL, AI models, and algorithms. 📐📊📈📉📏

Evaluations for homeschoolers

You can build a robust opinion mining and website evaluation system on AWS. The combination of data collection, preprocessing, sentiment analysis, and rating calculation ensures that you can efficiently analyze user feedback and generate meaningful insights to evaluate websites.

The official repository for the paper "Paraphrase Detection: Human vs. Machine Content".

NLP tool for wide-range model reliability evaluations

A framework to build scenario simulation projects where human and LLM based agents can participant in, with a user-friendly web UI to visualize simulation, support automatically evaluation on agent action level.

Official Python client for the Mandoline API

Machine learning algorithms applied to explore Enron email dataset and figure out patterns about people involved in the scandal.

Program made for the second evaluation of object-oriented programming

Official Node.js client for the Mandoline API

3cb: Catastrophic Cyber Capabilities Benchmarking of Large Language Models

LLM evaluation framework

The TypeScript LLM Evaluation Library

A functional chess game implemented in python, with pygame as a supporting graphics module.