Fdupes Remove Duplicate Files
Fdupes is another CLI tool that I use frequently to remove duplicate files. It does this by generating and comparing the md5sum of the files in the specified path. I believe this is the fastest duplicte file checker that I have ever used.
Installation
sudo apt-get install fdupes -y
Common Usage
fdupes -rd /path/to/dir/to/check
The -r switch stands for "recursive" which means that it will loop through all subdirectories. Remove this if you do not want it to do that
The -d switch stands for "delete", which means that for every duplicate it finds, you will get a menu option to choose which of the duplicates you wish to keep, and it will delete the others. If you cant make your mind up, you can type "all" to keep them all.
download file now