[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y ] [Search | Free Show | Home]

I have a somewhat large (~5TB) pornography collection. I'd

This is a blue board which means that it's for everybody (Safe For Work content only). If you see any adult content, please report it.

Thread replies: 32
Thread images: 4

File: database.png (130KB, 1731x2400px) Image search: [Google]
database.png
130KB, 1731x2400px
I have a somewhat large (~5TB) pornography collection.

I'd like to make a database with all the proper tags for easy location of content. I have experience with MySQL, but would PostgreSQL would be better for something like this? What about NoSQL?

I'm thinking about a table for each actress with the vendor ID (ie. AUKG-240) of the JAVs as the primary key, and then a separate table for tags that will be linked as a foreign key for each table. Is this a good idea?
>>
First step is admitting you have a problem.
>>
File: laughing whore.gif (134KB, 340x340px) Image search: [Google]
laughing whore.gif
134KB, 340x340px
>>55490991
>He doesn't have a large pornography folder.

How does it feel by having your masturbatory needs cucked by society?
>>
Surely vendor ID would not be unique, right?
>>
A good idea would be killing yourself.
>>
>>55491028
It is.
>>
Have fun destroying your intimate life and turning yourself into a lifeless zombie
>>
>>55490979
>5tb
>'somewhat large'
No motherfucker, that is excessive.
>>
>Not just putting it in the metadata
>>
>>55490979
>I'm thinking about a table for each actress with the vendor ID (ie. AUKG-240) of the JAVs as the primary key,
You're better off using an AUTO_INCREMENT field for your primary key.

>and then a separate table for tags that will be linked as a foreign key for each table
I should be a tags table and an intermediary jav_has_tag table containing a pair of (fk_tag, fk_jav) foreign keys since you're dealing with a many-to-many relationship here


As for noSQL, you could take a look at RethinkDB which is nice and create one document per JAV that you can modify however you want if you don't want to deal with having a strict schema.
You probably won't need a huge DB anyway, 5TB of jav is what? Less than 10k titles? Even sqlite would be powerful enough to manage that.
>>
>>55491081
It used to be much bigger.

>>55491136
Thank you for the serious answer.
AUTO_INCREMENT is basically just assigns a number to each row, right?
>>
>>55491063
>intimate life

... I don’t follow?
>>
>>55491026
How does it feel not getting laid?
>>
File: 1444534060008.png (41KB, 1314x428px)
1444534060008.png
41KB, 1314x428px
>>55491182
>AUTO_INCREMENT is basically just assigns a number to each row, right?
Right, and it should be unique (but this may depend on your database. RTFM)

Basically you want something like this to have an arbitrary number of tags and actresses assigned to your jav entries. I hope you like joins :^) (note that for the intermediary tables, the primary key is the fk pair)

t. EXPERT DATABASE DESIGNER (has designed over 300+ databases)
>>
You niggers step your game up and use javmoviescraper.jar
Scraped through 4tb of Jav
>>
>>55491284
>How does it feel not getting laid?

You sound like a beta orbiter that's butthurt at the fact someone masturbates or watches porn.
>>
>>55491345
>5TB
See >>55490991
>>
>>55491284

Indifferent and std free.
>>
>>55490979
This is an image database system that lets you view and tag images
https://github.com/r888888888/danbooru

This is an example of the database in action
https://danbooru.donmai.us/posts?tags=danboru
>>
>>55490979
Although it's 5TB of video, I really doubt it's that much in terms of metadata - probably a raspberry pi could handle all of it. Definitely not enough to consider NoSQL retardedness.

Have you thought of using a developed app for it like Plex? Probably what you want without too much effort.
>>
>>55491308
Thanks, anon.
I'm mostly just using as a learning experience.
>>
>>55491308
but... with NoSQL, you can just POST ye JSON.

{
"id": "JAV-007"
"vendor": "MYVENDOR",
"tags": [
"guro",
"gal"
]
}
>>
And i though my near 1TB was huge, you're on a completely different level, you should build a dedicated home porn server at that point maybe even make the jump to a SAN
>>
>>55491308
Do you have nice recommendations (books, tutorials) on DB design and development?
>>
>>55491587
Yes, but if you want to assign a tag to a jav for example then you have no guarantee that you didn't make a typo unless you have a separate table of allowed tags to manually compare your insertions to.
Also a well-structured SQL DB is much more convenient and safe to program things on top of, in my opinion.
I know this is nitpicking but I don't have anything in particular against NoSQL DBs that aren't mongo. Rethink is based.

>>55491656
No, I learned most of this in school.
I found this which looks pretty similar to what my courses looked like.
https://www.youtube.com/watch?v=tR_rOJPiEXc
>>
Why not just use this
https://www.tagspaces.org/
>>
>>55491810
I am not OP but thank you anon, this might come in handy.
>>
>>55491805
Yeah, but that's left to the application to make that validation before writing to the database. Users can also always accidentally create new tags as well.

At least in my experience, most customers never know what they actually want to it ends up being a waste of time spending all that time completely architecting your data model. Just implement something that works - or switch to a RDB later after you have a working prototype that the customer likes.
>>
File: 1440758209861.jpg (8KB, 209x233px) Image search: [Google]
1440758209861.jpg
8KB, 209x233px
>>55490979
>5TB of porno
>>
pretty sure this thread has appeared before.
>>
>>55490979
>>55491136
I think using the vendor ID as primary key was the right idea - the only reason it wouldn't work would be if there were videos without vendor IDs. Int auto_increment is just a good default when you don't want to put too much thought into it.

And yes, use sqlite
>>
>>55490979
>somewhat large
>5TB
Kek
Thread posts: 32
Thread images: 4


[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y] [Search | Top | Home]

I'm aware that Imgur.com will stop allowing adult images since 15th of May. I'm taking actions to backup as much data as possible.
Read more on this topic here - https://archived.moe/talk/thread/1694/


If you need a post removed click on it's [Report] button and follow the instruction.
DMCA Content Takedown via dmca.com
All images are hosted on imgur.com.
If you like this website please support us by donating with Bitcoins at 16mKtbZiwW52BLkibtCr8jUg2KVUMTxVQ5
All trademarks and copyrights on this page are owned by their respective parties.
Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.
This is a 4chan archive - all of the content originated from that site.
This means that RandomArchive shows their content, archived.
If you need information for a Poster - contact them.