🔍 DataLint-ml

📖 Overview

DataLint-ml is the core machine learning engine powering the DataLint ecosystem. This repository contains advanced ML models and algorithms designed to automatically detect, analyze, and report data quality issues inside datasets.

🔧 Pre-requisites

• Python 3.12+
• pip or conda
• uv (package manager, optional but recommended)
• Virtual Environment (recommended)
• GPU (recommended)

See pyproject.toml for a complete list of dependencies.

🚀 Installation

1. Run commands to set up the environment and install dependencies:

./scripts/setup-env.sh

2. If you are using a GPU, ensure that you have the appropriate CUDA toolkit installed.

🧪 Code quality

Unit Tests available

To run unit tests and ensure code quality, run the following commands:

./scripts/run-pytest.sh

Linting available

Linting is done using ruff. To check for linting issues, run:

.scripts/run-ruff.sh

Formatting available

Code formatting is done using black. To format the code, run:

./scripts/run-black.sh

🤝 Contributing

We welcome contributions to enhance the capabilities of DataLint-ml.

🔗 Related Projects

• DataLint - Main DataLint platform