A lightweight testing suite for AI applications to ensure your generative outputs behave as expected.
This repository contains multiple related packages:
| Package | Description |
|---|---|
| aissert | Core library for AI metrics and assertions |
| aissert-cli | CLI tool for running AI security tests |
| example-pkg | Example package demonstrating aissert usage |
| pytest-aissert | Pytest plugin for AI testing |
| qa_bot | Example QA chatbot with AI testing |
This project uses uv for dependency management.
# Install UV
curl -LsSf https://astral.sh/uv/install.sh | sh
# Install all workspace dependencies
uv sync --dev
# or via Makefile
make installCommon development tasks are available via the Makefile:
# Install dependencies
make install
# Run linting and formatting
make lint
# Run all tests
make test
# Run tests for specific package
make test-pytest-aissert
make test-qa-bot
make test-example-pkg
# Clean build artifacts
make cleanWe welcome contributions! Please see our Contributing Guidelines for details on how to get started.
For information on reporting security vulnerabilities, please see our Security Policy.
This project adheres to the Contributor Covenant Code of Conduct. By participating, you are expected to uphold this code.
This project is licensed under the Mozilla Public License 2.0 (MPL-2.0). See the LICENSE file for details.