[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y ] [Search | Free Show | Home]

Best dupe finder for images?

This is a blue board which means that it's for everybody (Safe For Work content only). If you see any adult content, please report it.

Thread replies: 6
Thread images: 1

File: VP.png (419KB, 810x513px) Image search: [Google]
VP.png
419KB, 810x513px
My fellow /g/,

I know that some of you have ten thousands of images.
What tool do you use to keep the dupes to a minimum?

I've been using Visipics for years now but it's a relatively old tool so there may be a better alternative.

Shouldn't crash even on high numbers of images.
Should have some auto or pre-select feature.
And a somewhat friendly UI.
>>
>>59701749
https://www.linux.com/learn/how-sort-and-remove-duplicate-photos-linux
I use FSlint
>>
>>59701749
reasonable no clone
But I'm moving to the hydrus network, one image repository on one drive, one on another, and it should sort dupes for me, here let me give you the flow.

I save an image
It saves to g:\new desktop dump

I have hydrus import from there once every 24 hours, so the images get move to

g:\z h imp\post
g:\z h imp\Already imported
g:\z h imp\Removed

I think the folders tell you what they are for, post is post the day I started using hydrus, I also have a pre folder too, but its untouched.

Everything I save gets dumped here, and I can do a quick reasonable noclone to remove everything, and just straight up delete everything in removed or already imported. hell, already imported has 250mb of images in it already.

I have another folder I have hydrus check every 5 minutes, this is where I move image archives I download so i can process them, getting rid of what I don't like, keeping what i do, because if I download an entire artists image repository, I didn't manually save it like I did with the other setup.
>>
>>59702051
that program is shit and retarded

>>59701749
you're using the best there is, unfortunately. step one is to remove actual dupes with a basic dupe finder (hash+filesize) and then use visishits to get rid of visual dupes
>>
>>59701749
I use Fdupes

https://github.com/adrianlopezroche/fdupes

Works for everything not just images.
>>
>>59703696
you're in the wrong thread
Thread posts: 6
Thread images: 1


[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y] [Search | Top | Home]

I'm aware that Imgur.com will stop allowing adult images since 15th of May. I'm taking actions to backup as much data as possible.
Read more on this topic here - https://archived.moe/talk/thread/1694/


If you need a post removed click on it's [Report] button and follow the instruction.
DMCA Content Takedown via dmca.com
All images are hosted on imgur.com.
If you like this website please support us by donating with Bitcoins at 16mKtbZiwW52BLkibtCr8jUg2KVUMTxVQ5
All trademarks and copyrights on this page are owned by their respective parties.
Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.
This is a 4chan archive - all of the content originated from that site.
This means that RandomArchive shows their content, archived.
If you need information for a Poster - contact them.