Topics / #deduplication

Deduplication projects on GitHub

Backup tools with content-defined data deduplication.

As of , the most-starred Deduplication projects on GitHub are restic (36.7K stars), kopia (14.4K stars) and borg (13.9K stars). GitHub.Locker tracks 7 Deduplication repositories with 70.5K stars combined. The fastest-growing on October 18 was ProxyNodeHub, with +20 stars in a day.

7Projects
70.5KStars in total
+69Stars in a day
Browse in the catalog →github.com/topics/deduplication ↗

Hot right now

Most stars gained in a day · Oct 18

+20

ProxyNodeHub

wanvfx/ProxyNodeHub · ★ 515

ProxyNodeHub is a Windows desktop tool that scans GitHub for active free proxy node repositories, scores their activity, deduplicates the nodes it finds, and outputs a ready-to-use subscription link with one click.

+19

lap

julyx10/lap · ★ 4K

Lap is an open-source, local-first photo manager for macOS, Windows, and Linux that lets you browse family albums, find old photos quickly, and organize large personal media libraries entirely offline.

+17

restic

restic/restic · ★ 36.7K

restic is a command-line backup program that is fast, secure, and efficient, supporting Linux, macOS, Windows, FreeBSD, and OpenBSD.

+9

kopia

kopia/kopia · ★ 14.4K

Kopia is an open-source backup and restore tool that creates encrypted, compressed, deduplicated snapshots of your files and directories and saves them to remote, cloud, network-attached, or local storage.

The all-time top

7 projects · by stars

  1. #1 · restic/restic

    restic

    restic is a command-line backup program that is fast, secure, and efficient, supporting Linux, macOS, Windows, FreeBSD, and OpenBSD.

    36.7K
  2. #2 · kopia/kopia

    kopia

    Kopia is an open-source backup and restore tool that creates encrypted, compressed, deduplicated snapshots of your files and directories and saves them to remote, cloud, network-attached, or local storage.

    14.4K
  3. #3 · borgbackup/borg

    borg

    BorgBackup is a deduplicating backup program that supports optional compression and authenticated encryption. It's designed to let you run efficient, secure daily backups since it only stores changed data.

    13.9K
  1. 4

    lap

    4Kjulyx10/lap · Vue

    Lap is an open-source, local-first photo manager for macOS, Windows, and Linux that lets you browse family albums, find old photos quickly, and organize large personal media libraries entirely offline.

  2. 5

    hypoarena

    555OpSafari/hypoarena · Python

    hypoarena is a fully offline workbench that decomposes the generate-debate-evolve 'AI co-scientist' pipeline into individually testable mechanisms: a citation-bearing hypothesis-evidence graph, a synthetic literature factory, grounding verification, pluggable agent adapters, Elo tournaments, paraphrase dedup, and Bayesian evidence accumulation.

  3. 6

    mr-boxington

    525jdx/mr-boxington · Rust

    mbx is a build cache for Rust projects. Cargo still resolves dependencies, plans builds and runs your tools; mbx restores matching compiler outputs from one shared store and only compiles the rest.

  4. 7

    ProxyNodeHub

    515wanvfx/ProxyNodeHub · C#

    ProxyNodeHub is a Windows desktop tool that scans GitHub for active free proxy node repositories, scores their activity, deduplicates the nodes it finds, and outputs a ready-to-use subscription link with one click.

Often tagged together