#duplicate #finder #find #directory #applications #duplicated

bin+lib duplicate-finder

Simple program to find duplicated files in a filesystem

5 releases

0.0.23 Oct 5, 2019
0.0.22 Sep 8, 2019
0.0.21 Aug 15, 2019
0.0.2 Aug 15, 2019
0.0.1 Aug 4, 2019

#1637 in Filesystem

MIT license

40KB
1K SLoC

Duplicate Finder Build Status

This application searches for duplicate files in input directory and its subdirectories. It is intended to be fast and simple, and use a few dependencies.

Install

Use rustup and cargo as usual.

Usage

USAGE:
    duplicate-finder [FLAGS] [OPTIONS]

FLAGS:
    -h, --help           Prints help information.
    -n, --no-progress    Disables progress bar.
    -v, --version        Prints version information.

OPTIONS:
    -o, --output=OUTPUT  Output type, `plain` and `json` are available, `plain` is default.
    -p, --path=PATH      Sets path to process.

How Does it Work?

Duplicate finder uses siphasher algorithm to determine files uniqueness and, as such, depends heavily on disk speeds for performance.

Work In Progress:

  1. Tests.
  2. Rewrite to asyncs and understand, what is better, futures or rayon.

duplicate-finder

Dependencies

~1.9–3MB
~64K SLoC