[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y ] [Search | Free Show | Home]

I have a massive collection of mostly anime images all with unix

This is a blue board which means that it's for everybody (Safe For Work content only). If you see any adult content, please report it.

Thread replies: 38
Thread images: 9

File: 1481324628227.png (35KB, 420x383px) Image search: [Google]
1481324628227.png
35KB, 420x383px
I have a massive collection of mostly anime images all with unix timestamp filenames and all in one directory.
I want to tag them all, or at least >75% of them.

I tried Hydrus, and not only was it slow as fuck, but it could only tag ~17% of my collection (from multiple smaller samples, importing my entire collection would take waaay too long just to test it), so that was a disappointment.

Illustration2vec is the only option I have left, and it's pretty good at tagging anime images, so it does what I want.
Even better is that I can run it locally for maximum throughput.
There is just one problem - it's way too slow, even when running locally.

Is there any other hope for me or should I just give up?
>>
>>61914038
For the tagging to workz you have both to make sure your tag DB to be up to date and understand as how it's based in the picture hash and not "how the picture looks" that the tagging works. If you don't collect pics from the boorus or sources and take slightly changed pictures (like resized or jpg-shittied) you're fscked.
>>
>>61914104
I know, and yes of course I made sure my tag database was up to date.
And yes, I thought it was a problem with the hashes, but I'm not sure why. I haven't modified any of them, but they're also mostly downloaded from 4chan, so maybe 4chan has changed them somehow, or the people that post them, which I doubt because they're usually posted straight from boorus or whatever.

Also, I assume it uses a hash of the pixel data, not the actual file, so things like changing the headers should not affect it.

Tagging networks like hydrus obviously don't work, so the only option for me is to tag it with neural networks, but I guess I will have to wait until they get a bit faster.
>>
>>61914038
Post your Reisens
>>
>>61914139
I would if I could easily find them.
That's the problem I'm trying to solve.
>>
>>61914130
Prolly picture tags or slight changes in compression for bandwidth.

But yeah, NN tagging seems like a dream. Let's see how it fares.
If you post shit, care to link to the thread?
>>
None of your images are unique or special. Why waste your life categorizing a bunch of redundant junk? Just delete the lot and use google image search.
>>
>>61914160
DESU this also.

For a moment I was interested into sorting my shit. But in the end it was redundant as I had already more or less enough of the pictures I stored for wanks so each time it ended up in simply deleting them.
>>
>>61914179
Wait, is this board filtering the "to be honest" acronym?
>>
>>61914186
Tell me which one isn't
>>
>>61914147
>NN tagging seems like a dream
Not really. i2v does it, it's just that it's too slow for mass tagging right now.
Just have to wait until we get more computing power, or more efficient NN's.
>>
>>61914203
Dunno. Been lurking for years but I haven't got the interest into searching the whole filter list per boards.
>>
>>61914213
Wait ignore that post, I thought you said "pipe dream".
>>
>>61914213
How does it match tags? Learning tags/sets and trying to apply tags by itself or just trying to match the closest tagged picture and slap the original pic's tags?
>>
>>61914160
Because I like collecting images.
I just added your image to my collection.
>>
>>61914215
I mean where have you been during the s m h t b h f a m era?
>>
>>61914234
I don't know, ask someone who specializes in machine learning.
All I can tell you is that the neural network looks for features in the image, and outputs a confidence value for a specific tag. Look up convolutional neural networks, it's probably what i2v uses.
>>
File: 1312838371766.png (29KB, 800x473px) Image search: [Google]
1312838371766.png
29KB, 800x473px
>>61914146
Just post the whole fucking thing
>>
>>61915166
That's going to take ages.
Not doing.
>>
>>61915166
And in case you thought the OP image is 36gb of just reisens, that's my username and /home/reisen is the base directory.
The actual directory is /home/reisen/Images

I'm not posting my entire fucking images folder, and I wouldn't be able to find the reisens that I know are in there.
>>
>>61915241
Wait, so how many Reisen's do you have?
>>
>>61915277
No idea.
But I'm sure there's plenty in there.
>>
>>61915241
>that's my username
Why?
>>
File: 1479633413271.png (242KB, 1399x961px) Image search: [Google]
1479633413271.png
242KB, 1399x961px
>>61915393
It's generic, and undoxable.
Good luck finding anything out about me or any of my accounts by googling "reisen" or anything similar.

And it's cute name, and character.
>>
>>61915337
Have you found them yet?
>>
>>61915950
I'm not even looking.
>>
>>61914038

Switch to Mac
>>
File: 1407126656493.png (114KB, 258x258px) Image search: [Google]
1407126656493.png
114KB, 258x258px
>>61914038
Calculate the md5 of each image and compare to some booru.

I guess u can do it easily with img-grabber.
>>
File: 1501855378617.gif (2MB, 540x540px) Image search: [Google]
1501855378617.gif
2MB, 540x540px
>>61916011
Mean! I've been waiting on your Reisens for 3 hours!
>>
>>61916172
See
>>61914104
>>
>>61916218
oh... u are fucked then
>>
File: 1473283897393.jpg (111KB, 815x720px) Image search: [Google]
1473283897393.jpg
111KB, 815x720px
>>61916329
Anime website buddy
>>
>>61914203
/b/
>>
File: 1481449973776.jpg (997KB, 800x1200px) Image search: [Google]
1481449973776.jpg
997KB, 800x1200px
>>61916213
But I never said I was going to look for them or post them!
But as a reward for waiting so long, I went through and found a reisen, just for you.
>>
File: 1483321158164.jpg (9KB, 250x250px) Image search: [Google]
1483321158164.jpg
9KB, 250x250px
>>61917174
Wow, thanks anon! You're the best!
>>
>>61915241
Host Webserver, Open Port, Point Webserver to your image directory and post ip.
Thanks
>>
>>61917965
No, I don't think I'll do that.
>>
>>61918068
:(
Thread posts: 38
Thread images: 9


[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y] [Search | Top | Home]

I'm aware that Imgur.com will stop allowing adult images since 15th of May. I'm taking actions to backup as much data as possible.
Read more on this topic here - https://archived.moe/talk/thread/1694/


If you need a post removed click on it's [Report] button and follow the instruction.
DMCA Content Takedown via dmca.com
All images are hosted on imgur.com.
If you like this website please support us by donating with Bitcoins at 16mKtbZiwW52BLkibtCr8jUg2KVUMTxVQ5
All trademarks and copyrights on this page are owned by their respective parties.
Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.
This is a 4chan archive - all of the content originated from that site.
This means that RandomArchive shows their content, archived.
If you need information for a Poster - contact them.