Retention policy workflow

[rugeli]

Problem

What is the problem this work solves, including
closes #41

Solution

What I/we did to solve this problem

• add retention policy configs, like retention periods, and collection names
• add github action workflow to remove old docs daily
• add cleanup script to be called by the cleanup workflow

Type of change

Please delete options that are not relevant.

• New feature (non-breaking change which adds functionality)

Steps to Verify:

• manually run bun run scripts/cleanup.ts and then verify the documents in staging database

---

[github-actions]

PR Preview Action v1.6.2
Preview removed because the pull request was closed.
2025-08-07 23:24 UTC

[rugeli]

I removed batch deletion related configs for now, as they feel overkill for our current doc size, for 1-100 docs, Promise.all() handles deletion faster, plus we run cleanup daily so batching isn't necessary at the moment.