DIGIT-ARC read-only archive · snapshot: July 23, 2026

DIGIT-ARC / Software / Software Q&A

Plz suggest good duplicate file finder

6 posts · originally from https://geek.digit.in/community/threads/plz-suggest-good-duplicate-file-finder.161785/

C
coldhart Original post #1
Aug 15, 2012 at 4:44 PM
Frnds plz suggest good duplicate file finder, which not limited upto mp3 or images.
Os
Windows 7 ultimate X64 SP1

thanks in advance
msn
msn #2
Aug 15, 2012 at 5:15 PM
Duplicate Finder will find duplicate photos, songs, documents, spreadsheets, MP3 files, and more.
nbaztec
nbaztec #3
Aug 15, 2012 at 7:03 PM
If you're looking for some out of the box solution, I recommend trying this script I wrote long ago:

Save the following code as filedup.ps1, somewhere.
Code: 
param
(
	[string]$root = $null,
	[switch]$verbose
);
  
#----------------------------------------------------------------
function filedup()
{	
	$dupfiles = @{}
	$hashAlgorithm = new-object -TypeName "System.Security.Cryptography.MD5CryptoServiceProvider";
	$files = @(Get-ChildItem -Path $root -recurse -ErrorAction SilentlyContinue);
	foreach ($file in $files)
	{
		#"MD5($($file.PsIsContainer))"
		if(!$file.PsIsContainer)
		{
			$stream = $file.OpenRead();
			$hashByteArray = $hashAlgorithm.ComputeHash($stream);
			$stream.Close();
			
			$md5StringBuilder = New-Object System.Text.StringBuilder
			
			$hashByteArray | % {[void] $md5StringBuilder.Append($_.ToString("x2"))}
			$md5h = $md5StringBuilder.ToString()
			if($verbose)
			{
				"Processed $($file.Fullname) with hash $md5h"
			}
			if(!$dupfiles.ContainsKey($md5h))
			{
				$dupfiles[$md5h] = @()
			}
			$dupfiles[$md5h] = $dupfiles[$md5h] + ($file.Fullname);		
		}


		# Ensure stream is closed if exceptions occurred.
		trap
		{
			if ($stream -ne $null) { $stream.Close(); }
			break;
		}
	}
	""
	"Showing duplicate files:"
	foreach ($item in $dupfiles.GetEnumerator())
	{				
		if($item.value.length -gt 1)
		{
			"------------------------"
			foreach($f in $item.value)
			{				
				"	$f"
			}						
		}		
	}
	"------------------------"
	}

filedup -root $root -verbose $verbose;

You need to specify Set-ExecutionPolicy Unrestricted on your PowerShell (in elevated mode), and use (since running scripts is disabled by default, lol?):
Code: 
     C:\path-to-filedup> filedup [path]

Sample Output:
Showing duplicate files:
------------------------
M:\Android\data\com.sonyericsson.advancedwidget.photo\cache\876841530
M:\Android\data\com.sonyericsson.advancedwidget.photo\cache\2053167327
------------------------
M:\DCIM\.thumbnails\1343033167966.jpg
M:\DCIM\.thumbnails\1342765585552.jpg
------------------------
M:\DCIM\.thumbnails\1343033170957.jpg
M:\DCIM\.thumbnails\1342720605743.jpg
------------------------
M:\DCIM\.thumbnails\1343033168904.jpg
M:\DCIM\.thumbnails\1343033168427.jpg
M:\DCIM\.thumbnails\1342969542076.jpg
M:\DCIM\.thumbnails\1342969542668.jpg
------------------------
M:\Android\data\com.imangi.templerun\files\ALT_recordmanager.dat
M:\Android\data\com.imangi.templerun\files\recordmanager.dat
------------------------
M:\Android\data\com.google.android.apps.maps\cache\cache_its.m
M:\Android\data\com.google.android.apps.maps\cache\cache_its_ter.m
------------------------
M:\DCIM\.thumbnails\1343033169664.jpg
M:\DCIM\.thumbnails\315965723744.jpg
------------------------
M:\Android\data\com.sonyericsson.gallery\cache\local-video-thumbs\local-video-thumbsindex
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\picasa-thumbsindex
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\facebook-thumbsindex
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\facebook-external-thumbsindex
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\local-skip-cacheindex
------------------------
M:\DCIM\.thumbnails\1343033172059.jpg
M:\DCIM\.thumbnails\1342760458147.jpg
M:\DCIM\.3d_thumbnails\1342760457748.jpg
------------------------
M:\etc\vcf\165.jpeg
M:\etc\vcf\69.jpeg
------------------------
M:\openfeint\webui\manifest.db-journal
M:\openfeint\webui\.nomedia
M:\Android\data\.nomedia
M:\Android\data\com.sonyericsson.gallery\cache\local-video-thumbs\DiskCache-1846414157.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-video-thumbs\DiskCache1626353870.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-video-thumbs\DiskCache-1365806458.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-video-thumbs\DiskCache-488892092.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-video-thumbs\DiskCache414606222.tmp
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\DiskCache-1860964188.tmp
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\DiskCache-918256541.tmp
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\DiskCache-336822090.tmp
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\DiskCache-986136113.tmp
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\DiskCache-1390951967.tmp
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\DiskCache710368691.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-476832466.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1074568624.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-197269216.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache1360638136.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1617356993.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache137293844.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1886669858.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache755762041.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache221800308.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1157825444.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache646965425.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-281113941.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1677706542.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache903623688.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache353946614.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache2055979548.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache648323188.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1591143989.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1361172682.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1416938626.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache712610374.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache753130979.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-506294499.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-506592007.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache1863474300.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache797419049.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-1204633699.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-1900551467.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache528775514.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-366279902.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-1718019842.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache805728803.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache1585624781.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache1103719878.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache1307194636.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-2111001672.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache179172769.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache1229544147.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-835005131.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache1760002341.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-2118075359.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-1977954009.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-846127180.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache540583917.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-711115542.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-650040929.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-2100792832.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache335316934.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache1732910097.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache1869392582.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache1147087655.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-929308634.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache385740157.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache261008572.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-58505230.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-457520109.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-1142166614.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache688636638.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-161464925.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache427114200.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-582455047.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-1249363929.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-1102890385.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache1128820084.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache983514924.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-1398346286.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache1985618740.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-1026246859.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-903508065.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-1917144530.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache2111392572.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache1250655684.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache986260249.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-215086520.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache722150289.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-1147744311.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-276866338.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache1683258517.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache620729589.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache1180837295.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-image-thumbs\DiskCache1820139299.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-image-thumbs\DiskCache-552667837.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-image-thumbs\DiskCache878653914.tmp
M:\Android\data\com.google.android.apps.genie.geniewidget.news-content-cache\.nomedia
M:\foursquare\cache\.nomedia
M:\tmp\.astro\astro.db-journal
M:\tmp\nx.android.feedreader\feeddigit.dump
------------------------
M:\Android\data\com.google.android.apps.maps\cache\cache_vts_GMM.m
M:\Android\data\com.google.android.apps.maps\cache\cache_vts_labl_GMM.m
------------------------
L
LuiFigo #4
Oct 31, 2012 at 2:54 PM
If you are looking for a good duplicate file finder then i will suggest you to search it on search engines since it gives the best results in series.
gameranand
gameranand #5
Oct 31, 2012 at 7:32 PM
You can use glary utilities for finding duplicate files also. However please be more specific, what do really want to find, images , audio files ???
topgear
topgear #6
Nov 1, 2012 at 5:25 AM
@ Op - use this ;-)
Anti Twin - Duplicate file search (Freeware) - Find and delete duplicate files or similar images
or
Find duplicate files with Auslogics Duplicate File Finder