#deduplication (24 Repositories)
Ranked open-source repositories tagged with #deduplication, scored by pull request acceptance likelihood and maintainer engagement velocity.
42.6%
22.3h
24 repositories tagged #deduplication
karanhudia/borg-ui
Replace complex Borg Backup terminal commands with a beautiful web UI. Create, schedule, and restore backups with just a few clicks.
PlakarKorp/plakar
plakar is a backup solution powered by Kloset and ptar
borgbackup/borg
Deduplicating archiver with compression and authenticated encryption.
benseverndev-oss/goldenmatch
Zero-config entity resolution feeding a durable identity layer: messy records from any source become stable golden entities, a Customer 360 with provenance, merge/split and audit. Fellegi-Sunter beats hand-tuned Splink. Arrow-native/Rust, 250M rows in 11.2 min. Python + edge TypeScript (WASM), SQL-native in Postgres & DuckDB, 97 MCP tools + REST.
zinggAI/zingg
Scalable master data management, identity resolution, entity resolution, and deduplication using ML
kopia/kopia
Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
prometheus/alertmanager
Prometheus Alertmanager
rustic-rs/rustic
rustic - fast, encrypted, and deduplicated backups powered by Rust
nlfiedler/fastcdc-rs
FastCDC implementation in Rust
sahib/rmlint
Extremely fast tool to remove duplicates and other lint from your filesystem
restic/restic
Fast, secure, efficient backup program
fcorbelli/zpaqfranz
Deduplicating archiver with encryption and paranoid-level tests. Swiss army knife for the serious backup and disaster recovery manager. Ransomware neutralizer. Win/Linux/Unix
MinishLab/semhash
Fast Multimodal Semantic Deduplication & Filtering
netinvent/npbackup
A secure and efficient file backup solution that fits both system administrators (CLI) and end users (GUI)
zouzias/spark-lucenerdd
Spark RDD with Lucene's query and entity linkage capabilities
CarlosZ16420/hamster-archiver
Windows local-first file organizer and media catalog with MCP tools for AI assistants. Verified batch archiving. 本地文件整理、媒体建库与可校验批量归档，支持 AI 通过 MCP 调用。
NevermindNilas/TheAnimeScripter
A high-performance tool for video upscaling, interpolation, depth estimation, and more. Available as a CLI and Adobe Extension.
cargo-limit/cargo-limit
Productivity improvements for Rust ecosystem: warnings are skipped until errors are fixed, LSP-independent Neovim integration, etc.
007revad/Synology_enable_Deduplication
Enable deduplication with non-Synology SSDs and unsupported NAS models
borgmatic-collective/borgmatic
Mirror of borgmatic: Simple, configuration-driven backup software for servers and workstations
Siddhant-K-code/distill
Context intelligence layer for LLM agents: persistent memory with write-time dedup, sensitivity tagging, conflict detection, and hierarchical decay. ~12ms. No LLM calls. MIT.
openvenues/libpostal
A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.
cupcakearmy/autorestic
Config driven, easy backup cli for restic.
dpc/rdedup
Data deduplication engine, supporting optional compression and public key encryption.