📧 CLI to deduplicate mails from mail boxes
A command-line tool for deduplicating entries in a file or stream.
Sift duplicate whitespaces away!
CloneReaper is a high performance deduper/deduplicator for Windows, and Linux. With hardlink/symlink support, it enables you to keep files in the same place while saving space. Supports reporting in TXT, JSON, and CSV with optional emails.
Analyse 2 paths to found identical files and hard link them to save space
Project to take two similar zipfiles, and to dedupe files that have the same tiemstamp in the older file.
Duplicate file finder and de-duplicator. A tool that detects duplicate files and replaces them with symlinks to a shared file in a special shared files folder.
A NiFi processor that deduplicates incoming data using an existing Redis connection pool service.
File de-duplicator written in Rust.
A web app that finds and removes duplicates in your Spotify playlists.
GraphQL response deduplication by mapping entities.
Automatically identifies and refactors duplicate code patterns across a codebase, suggesting consolidation into reusable functions or classes
A Python pipeline that scrapes news headlines, removes duplicate stories, clusters related articles, and ranks them to produce a clean and relevant news feed.
A free tool for scanning image folders and identifying potential duplicates against a variety of user selectable criteria including Visual Similarity, Exact Hash, GPS Location, Dates & Time etc. Once identified the duplicates can be moved to a separate folder for archiving and/or deletion by the user (outside of the app)
Utility for automatic Git repository deduplication
Add a description, image, and links to the deduplicator topic page so that developers can more easily learn about it.
To associate your repository with the deduplicator topic, visit your repo's landing page and select "manage topics."