Skip to content

argon-chat/KineticaFS

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

8 Commits
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

KineticaFS

KineticaFS is a region-aware file lifecycle manager for S3-based storage. It tracks file usage across regions, migrates hot files closer to clients, and safely removes unused ones using reference-counting and GC.

✨ Features

  • πŸ“¦ S3-compatible: Works with any S3-compatible storage backend (AWS, MinIO, Wasabi, etc.)
  • 🌍 Region-aware: Detects file access patterns and migrates "hot" files closer to clients
  • 🧠 Smart pointers: Tracks file references in your system to prevent premature deletion
  • ♻️ Garbage collection: Removes unreferenced or expired files safely and automatically

πŸ“ˆ Roadmap

  • File reference tracking API (CreateRef, DeleteRef, ListRefs) πŸ”₯
  • File upload πŸ”₯
  • Scylla Cassandra Support πŸ”₯
  • Migration logic
  • Per-region heatmap tracking
  • GC for unreferenced files πŸ”₯
  • Basic observability (logs, metrics)
  • Public and expiring file links
  • Optional TTL per reference
  • Support for batch import/export
  • Multi-tenant support
  • NATS hook for event-driven GC
  • Custom metadata indexing
  • Integration with Prometheus / Grafana
  • WASM hooks for file filters / pre-upload logic
  • Admin panel / metrics endpoint
  • K8s Operator
  • PgSql Support
  • Dotnet Client Library πŸ”₯

πŸ“œ License

KineticaFS is licensed under the GNU Affero General Public License v3.0 or later (AGPL-3.0-or-later).
This ensures that all improvements and deployments based on this code must remain open source.

See LICENSE for the full text.

About

Region-aware file service with smart pointers and built-in garbage collection for S3.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published