Identifying and removing near-duplicate images using perceptual hashing.

ECMAScript proposal for Deduplicating method of Array

File Integrity Manager -

JS script that allows you to remove duplicates from your Last.fm scrobbles library.

Go implementation of Facebook's DataLoader with 200+ lines of code.

Efficient Deduplicate for Anime Video Frame Interpolation

A funny extension that integrates image-browsing , downloader , deduplicate , cluster , can quickly collect, classify and process your images. | 一个有趣的扩展，整合了 图库，下载，去重，聚类 ，可以快速搜集、分类、处理你的图片。

Refine your file collections using Rust!

makes any request idempotent across nodejs frameworks like nestjs, express, fastify

A command line tool for sorting photo's from the Synology DSPhoto auto-upload tool

Benchmarking javascript array operations

Smart caching for promises. Like memoization, but better.

动漫一拍N自动识别算法

Deduplication/backup tool with extremely high 'compression' rate

Deduplicate data by creating reflinks between identical files.

Package uniq provides primitives for getting the first unique elements of (aka deduplicate) your existing sorted sort.Interface.

A C++ reimplementation of Near Duplicate Video Detection - Get a 64-bit comparable hash-value for any video (Video Hash).

A command-line tool for deduplicating entries in a file or stream with constant memory usage

General deduping engine for JDBC sources with output to JDBC/csv targets

Command line tool that counts unique lines FAST.