Skip to content

[REMINDER] Submit to DevNetwork [AI + ML] Hackathon 2026 #14

Description

@MukundaKatta

Reminder for DevNetwork [AI + ML] Hackathon 2026

Days until deadline: 11.4

Submit URL: https://devnetwork-ai-ml-hack-2026.devpost.com/

Action needed: open the URL above, register if needed, and submit using the package below. Close this issue once submitted (the master routine will skip future reminders for this hackathon).


DevNetwork [AI + ML] Hackathon 2026

URL: https://devnetwork-ai-ml-hack-2026.devpost.com/
Deadline: May 28, 2026
You are already registered (visible on your Devpost dashboard).


Project name (60 chars)

ragvitals: 5-dim RAG drift agent

Elevator pitch (≤200 chars)

Autonomous agent that watches your RAG for 5-dimensional drift and acts when retrieval quality degrades, before users notice. Rust core, Python wheel, ships everywhere.

About the project (markdown)

## Inspiration

Most RAG systems break quietly. The retrieval gets a little worse, the model starts paraphrasing more, citations stop matching the source, and nobody notices until a user complains. We wanted an agent that watches the system itself and acts before that complaint lands.

## What it does

ragvitals monitors a production RAG pipeline across five drift dimensions:

1. Data drift: distribution shift in the source corpus
2. Embedding drift: shift in the vector space (MMD with RBF kernel, sliced Wasserstein)
3. Response drift: shift in answer style and length
4. Confidence drift: shift in the model's self-rated certainty
5. Query drift: shift in the kinds of questions users are asking

When any dimension crosses threshold, the agent explains which one drifted, recommends the next action, and writes a short incident summary the on-call engineer reads.

## How we built it

Math in Rust, ergonomic facade in Python.

- `ragdrift` (Rust crate): the numerical core. ndarray, rayon, MMD with median heuristic, sliced Wasserstein-1, KS, PSI, k-means cluster assignment shift.
- `ragdrift-py` (PyPI wheel): PyO3 + maturin, abi3-py310 so one wheel covers Python 3.10 to 3.13.
- Storage adapters: OpenSearch, pgvector, Pinecone.
- Metric exporters: CloudWatch, Prometheus, Datadog.

## Challenges

Getting the Wasserstein math fast and explainable. Real corpora throw ragged batch sizes, near-empty distributions during cold start, and embedding-space rotation that looks like drift but is not. The Rust core handles a check in roughly 3 ms.

## Accomplishments

- Five drift dimensions in one library, not five separate tools.
- v0.1.3 on both crates.io and PyPI, MIT/Apache-2.0 licensed.
- Production-ready storage and exporter coverage out of the box.

## What we learned

Drift detection is the part of RAG ops most teams skip until it bites them.

## What's next

A second agent that auto-applies the recommended fix in shadow mode and waits for human approval to promote.

Built with

rust, python, pyo3, maturin, ndarray, rayon, opensearch, pgvector, pinecone, cloudwatch, prometheus, datadog, github-actions

Try it out / repo URL

https://github.com/MukundaKatta/ragdrift

What you still need

  • Demo video (YouTube or Vimeo URL): to add
  • Live demo URL: to add — could be the dev.to post that demos the lib
  • Cover image: optional, skip is fine
  • Tracks: pick whichever AI/agent track best matches

Notes

  • DevNetwork hackathons are co-located with AI DevSummit. Reasonable cred for being a finalist.
  • Same project base as GCP Rapid Agent. You can reuse the video and most fields verbatim.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions