Very Computer

 Hello,

How can I find all identical files (identical - 'cmp' command returns 0)
from one directory tree?

I already have a solution for that: 3 scripts, first one finds (using
find) files in the directory and calls the second one with the name of
the find it found (-exec option), the second one does the same and
executes the third one, which in turn compares the files and returns the
result.

I suppose that it is not the best solution (a lot of forks), so if
somebody have any ideas how to improve it - let me know, please

CY,
Alexander Sclearuc

Sent via Deja.com http://www.deja.com/
Before you buy.

I wrote a perl script to identify disk hogging files; it shows _possible_ dups
based on name and size [short of identifying links or running cmp] but you may
find it helpful anyway:

    http://www.phys.uni-paderborn.de/~stern/filestat/filestat
    http://www.phys.uni-paderborn.de/~stern/filestat/filestat.sample

Regards,
--
Michael Sternberg                        | Uni-GH Paderborn
http://www.phys.uni-paderborn.de/~stern/ | FB6 Theoretische Physik
phone: +49-(0)5251-60-2329   fax: -3435  | 33098 Paderborn, Germany
"Who disturrrbs me at this time?"  << Zaphod Beeblebrox IV >>     <*>

Quote:> Hello,

>How can I find all identical files (identical - 'cmp' command returns 0)
>from one directory tree?

>I already have a solution for that: 3 scripts, first one finds (using
>find) files in the directory and calls the second one with the name of
>the find it found (-exec option), the second one does the same and
>executes the third one, which in turn compares the files and returns the
>result.

>I suppose that it is not the best solution (a lot of forks), so if
>somebody have any ideas how to improve it - let me know, please

What I would do is:

find <directory> -type f -print | xargs sum /dev/null | sort > tempfile

Then find all the lines with the same checksum (they'll be adjacent because
of the sort) and cmp the two files.  An awk script would be appropriate for
this step.

--

Genuity, Burlington, MA
*** DON'T SEND TECHNICAL QUESTIONS DIRECTLY TO ME, post them to newsgroups.
Please DON'T copy followups to me -- I'll assume it wasn't posted to the group.

On Wed, 03 May 2000 19:12:43 GMT,

Below is what I've used.  Its basic algorithm is to look at
file sizes and then only do a compare on files of the same
size (since files of different sizes will never cmp the same).

                --Ken Pizzini

#! /usr/bin/perl -w

# find-eq-files -- find files that are equal
# Ken Pizzini, 1999-02-09, based on a sh+awk+sed version by
# Carlos Duarte, 990131/990201
# updated (simplified) 1999-09-18, kpp

# usage: find-eq-files [dirs] [find options]
# example: find-eq-files ~/tmp ~/sources

use File::Find qw(find);
use File::Compare qw(compare); # from CPAN
use strict;

my %files_by_size = ();

for my $to_check (values %files_by_size) {




            if (compare($first, $other) == 0)

            else

        }


    }

Quote:}