[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y ] [Search | Free Show | Home]

I wanted to find all the duplicate images on my machine and instead

This is a blue board which means that it's for everybody (Safe For Work content only). If you see any adult content, please report it.

Thread replies: 12
Thread images: 2

File: kawaii~.jpg (70KB, 540x716px) Image search: [Google]
kawaii~.jpg
70KB, 540x716px
I wanted to find all the duplicate images on my machine and instead of downloading some shitty program to do it I just wrote out a shell one-liner to do it in 30 seconds.

find . | xargs -d "\n" md5sum | sort | uniq -D -w 32 > ~/duplicates.txt


Why is unix so comfy?
>>
did you write it in 30 seconds or does it accomplish its task in 30 seconds
your post was very vaguely written and now i'm confused, so i'll assume your software is written in the same fashion
typical freetard garbage...
>>
>>61530061
it takes less than 10 seconds to actually read the command and figure it out
typical wintard brainlet
>>
File: 1403180946565.jpg (72KB, 621x621px) Image search: [Google]
1403180946565.jpg
72KB, 621x621px
>>61529736
>.txt
Also, what about slight variants of the same image?
>>
>>61530232
exact image duplicates are good enough
I found 1853.
>>
my solution uses findimagedupes and eye of gnome to go through the similar enough images.
>>
Feels good. Just wrote one to extract folder full of archives of various types each into its own folder.
>>
>>61529736
>detecting image similarity in current year
>uses md5
>ignores perceptual hashes, which would have made his software better
why are you so fucking retarded?
>>
>>61530156
Stay trolled, angry retard.
>>
>>61529736
Every single one of those commands requires you to memorize it's options and you're even using xargs to make up for unix's arbitrary limit on argument count.

How many years of maintenancing your computer as a goddamn hobby does it take to reach this level of comfort with the command line?
>>
>>61530466
t. Brainlet
>>
Different bash lover here.
>Every single one of those commands requires you to memorize it's options
You're not supposed to memorise options. It's enough to know where to look them up.
$ man command


>>61530466
>you're even using xargs to make up for unix's arbitrary limit on argument count.
$ md5sum * | sort | uniq -Dw 32 > /tmp/dupes.txt

Works on my machineā„¢
Thread posts: 12
Thread images: 2


[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y] [Search | Top | Home]

I'm aware that Imgur.com will stop allowing adult images since 15th of May. I'm taking actions to backup as much data as possible.
Read more on this topic here - https://archived.moe/talk/thread/1694/


If you need a post removed click on it's [Report] button and follow the instruction.
DMCA Content Takedown via dmca.com
All images are hosted on imgur.com.
If you like this website please support us by donating with Bitcoins at 16mKtbZiwW52BLkibtCr8jUg2KVUMTxVQ5
All trademarks and copyrights on this page are owned by their respective parties.
Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.
This is a 4chan archive - all of the content originated from that site.
This means that RandomArchive shows their content, archived.
If you need information for a Poster - contact them.