Differences

This shows you the differences between two versions of the page.

--- ubuntu:file:delete_duplicate_files [2020/02/01 14:33] – created peter
+++ ubuntu:file:delete_duplicate_files [2022/06/13 10:22] (current) – removed peter
@@ Line 1: / Line 1: @@
-====== Ubuntu - File - Delete duplicate files ======
-<code bash>
-find . -regex '.* ([0-9]).*' -delete
-</code>
-----
-<code bash>
-find "$@" -type f -print0 | xargs -0 -n1 md5sum | sort --key=1,32 | uniq -w 32 -d --all-repeated=separate | sed -r 's/^[0-9a-f]*( )*//;s/([^a-zA-Z0-9./_-])/\\\1/g;s/(.+)/ls \1/'
-</code>
-----
-<code bash>
-</code>
-----
-===== Using rdfind =====
-**Rdfind** stands for redundant data find; and is a free and open source utility to find duplicate files across and/or within directories and sub-directories.
-It compares files based on their content, not on their file names.
-Rdfind uses ranking algorithm to classify original and duplicate files.  If you have two or more equal files, Rdfind is smart enough to find which is original file, and consider the rest of the files as duplicates.
-Once it found the duplicates, it will report them to you.  You can decide to either delete them or replace them with hard links or symbolic (soft) links.
-<code bash>
-rdfind -deleteduplicates true ~/.
-</code>