Archival and Restoration for databases in the Cloud

State-of-the-art web crawler 🔱

A selfhostable service for automatically downloading YouTube channels, playlists and videos. It's like Sonarr, but for YouTube.

Golang library for dealing with 7-zip archives

Automatically optimize files uploaded to Immich in order to save storage space

Read and write WARC files in Go

Golang WARC (Web ARChive) Library

tiny multiprocessing utility for file backups

Checksums with Merkle trees and concurrency

A toolkit makes it easier to archive webpages to IPFS

A limited go-billy filesystem implementation based on siva.

Twitch stream and vod archiving proof of concept

command line tool that downloads your liked coubs for archival purposes

Golang package implementing the CDXJ file format used by OpenWayback 3.0.0+ to index web archive contents

Data redundancy generator for archive files

Upload Datasets to S3 from the browser

SHA256 file verification for consistency check purposes

Downloader for archiving files from CCAN and Clonk-Center

A tool for downloading web pages, snapshots from the Wayback Machine and creating into a ZIM file.

Small cross platform backup program