#duplicate #finder #duplicates #find #subdirectories

bin+lib duplicate-finder

Simple program to find duplicated files in a filesystem

5 releases

0.0.23 Oct 5, 2019
0.0.22 Sep 8, 2019
0.0.21 Aug 15, 2019
0.0.2 Aug 15, 2019
0.0.1 Aug 4, 2019
Download history 1/week @ 2022-03-03 15/week @ 2022-03-10 21/week @ 2022-03-17 25/week @ 2022-04-28 25/week @ 2022-05-05 80/week @ 2022-05-12 21/week @ 2022-05-19 26/week @ 2022-05-26 47/week @ 2022-06-02 5/week @ 2022-06-09 2/week @ 2022-06-16

85 downloads per month

MIT license

39KB
1K SLoC

Duplicate Finder Build Status

This application searches for duplicate files in input directory and its subdirectories. It is intended to be fast and simple, and use a few dependencies.

Install

Use rustup and cargo as usual.

Usage

USAGE:
    duplicate-finder [FLAGS] [OPTIONS]

FLAGS:
    -h, --help           Prints help information.
    -n, --no-progress    Disables progress bar.
    -v, --version        Prints version information.

OPTIONS:
    -o, --output=OUTPUT  Output type, `plain` and `json` are available, `plain` is default.
    -p, --path=PATH      Sets path to process.

How Does it Work?

Duplicate finder uses siphasher algorithm to determine files uniqueness and, as such, depends heavily on disk speeds for performance.

Work In Progress:

  1. Tests.
  2. Rewrite to asyncs and understand, what is better, futures or rayon.

Crates.io link

duplicate-finder

Dependencies

~1.9–2.8MB
~60K SLoC