[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y ] [Search | Free Show | Home]

Just bought 18TB of hard drives /g/ Which distro should I use

This is a blue board which means that it's for everybody (Safe For Work content only). If you see any adult content, please report it.

Thread replies: 82
Thread images: 5

File: storage fairy.jpg (169KB, 1280x720px) Image search: [Google]
storage fairy.jpg
169KB, 1280x720px
Just bought 18TB of hard drives /g/
Which distro should I use for my new seedbox/media server?
And what fs should I reformat them as?
Also post your storage, 10+ TB only may apply
>>
>>60908786
CentOS for os xfs for fs.
>>
Does it really fucking matter? You'll be running a program to handle the seeds.
Literally anything will do it, even ponyOS.
Unless you want max efficiency, then install Gentoo.
>>
File: TooManyCooks.jpg (141KB, 960x628px) Image search: [Google]
TooManyCooks.jpg
141KB, 960x628px
Incoming Autism Build
>>
File: screen.1497479537.png (33KB, 1032x627px) Image search: [Google]
screen.1497479537.png
33KB, 1032x627px
>>60908903
What do you hoard?
>>
>>60908786
2x6TB mirrored
2x4TB mirrored
1x2TB scratch Drive
1x512GB OS Drive
I'm kinda thinking of shifting the mirrored drives to be external backups instead, but I dunno if that's really a more stable/safe scenario or not. Those drives aren't pushed hard, so performance loss isn't an issue.
>>
>>60908934
Chinese Cartoons
>>
>>60909109
That's it?

Is there anyone on /g/ who has 20TB+ that hoards things that isn't just upscaled anime?
>>
>>60909131
i hoard porn
>>
FreeBSD and ZFS.
Run other OSes under bhyve.
>>
Openindiana with ZFS
True Solaris™ Experience
>>
>>60908903
>not using raid
>>
Windows 8.1
>>
>>60908786
Doesn't really matter but you should at least consider CentOS, Ubuntu Server or even Debian if you're a gypsy.

I only went with Ubuntu Server back in 2014 as it had more mature Docker support when I built it but it has been reliable af and upgrades are ridiculously easy. The array is btrfs.
>>
500GB SSD Internal
1TB Internal
8TB Internal
1TB Internal (connected externally)
120GB External
1TB External
>>
>>60908970
Backups > Raid 1 anytime,
Raid:
+performance
+no downtime
+probably easier to setup for large amounts of disks
-no protection against ransomware, buggy scripts, user error etc(much more common than you think)

None of the benefits apply in your scenario so I'd definitely use them as backups, offline if possible
>>
>>60908903
is pluto actually a real drive
>>
>>60908786
use Debian Jessie
>>
>>60910071
Rude.
>>
>>60908903
>Sun is a quarter of the size of Venus
This triggers me, OP. Fix it.
>>
>>60909131
22+TB and counting. Windows but moving to xpenology.
>>
>>60909990
What model and brand on the 8GB? Thinking about getting two Seagates, dont remember the exact name of the model but it has five years warranty which seems good
>>
>>60910021
Alright, any cautions/recommendations for backup software or external hdd adapters? There's a million and 1 of those SATA to USB3 types.

>brand on the 8GB? Thinking about getting two Seagates
Every seagate I've ever had is loud, maybe not a factor for you, but something to think about.
>>
>>60911885
Oops, the bottom quote and response was meant for this anon.
>>60911517
>>
What do you people even store? 1.5 TB and I'm at my limit
>>
>>60909131
>ebooks that I will never read
>music I will never listen to
>>
>>60908786

Devuan Jessie, fa.m
>>
>>60911885
zpaq, rsync
>>
File: 1493641674451.jpg (178KB, 1024x768px) Image search: [Google]
1493641674451.jpg
178KB, 1024x768px
>>60912035
I store all my porn on an external that is only 1TB but I'm reaching the limit. I imagine if I had 20TB I could be way less selective about which JAVs or western scenes to save. I probably also then wouldnt have to worry about the redundancy of having full JAV movies and having the best clips saved in webm format for /gif/.
>>
Been thinking about building my seedbox/media meme for long time now, but I have no clue about what to do and what would be the cheaper shit.
I'd leave it on the living room in a corner so I don't care about space and noise.
It would be for like a 10~15TB thing. What combo would be the best and where do I mont it, in a NAS or just and old cheap PC? I'd use it as a a server too sometimes, so maybe I'd need some power.
>>
>>60910071
You made my day anon
>>
>>60908786
Devuan, ZFS

# zpool list
NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
store 29T 9.78T 19.2T - 14% 33% 1.00x ONLINE -
>>
Need some advice. I have two servers.

One is a server running openmediavault. It has 24GB RAM and 16 CPU cores. I use this to store HD movies, and stream them to various people over the net.

CPUs8 x Intel(R) Xeon(R) CPU E5606 @ 2.13GHz (2 Sockets)

The problem is, that the server isn't quite strong enough to stream to multiple people at once, full quality. There are lag spikes some times.

That's where my other server comes in - a more powerful server with 144GB RAM, 12xCPUs. x2. (24 cores, two hexacore sockets).

I could set up PLEX on this machine. But then my question becomes, how do I transfer the video from one server to another? Is the network fast enough?
>>
>>60914429
mount via <insert favorite network filesystem here> from the other server and its fine.
>>
>>60908903
Pluto isn't a planet.
>>
>>60908786
I used Debian Jessie + ZFS
>>
>>60914465
Really? It won't be too slow?
>>
>>60914489
come to devuan, its debian without the aids, and you can upgrade in place.
>>
>>60914465
>>60914429
>>60914497
Also, I just found out emby was running at like 200-300% CPU. What a resource hog. Disabled that shit.
>>
>>60914497
I guess if you are on 100 meg, but if you have gig links between storage and plex you should be fine. I have 4 rokus in the house that can stream 1080 simultaneously without issue.
>>
>>60908786
Cent OS.
I only have 60 GB in my laptop.

>tfw ramlet with only 2GB of ram
>tfw corelet with only dual core processor
>tfw storelet with only 60 GB HDD
>>
>>60914527
Nice, going for that.

Is CIFS too slow?
>>
>>60914596
no, I am using CIFS to do it.
>>
>>60914601
Sweet, thanks for the reassurance. I thought I had to at least get some special cables.
>>
>>60914627
I just used cheap cat6 cables from amazon, never had an issue with any of them.
>>
>>60912221
Where do you get your porn?
>>
>>60908903
>no raid
>not even disk pooling software
>naming it sun instead of sol
>>
Freenas, ZFS.
>>
>>60908786
get a life LOSER, you're fucking pathetic
>>
Internal
500gb ssd
2x 1tb
2x 2tb
3tb

External
120gb ssd
3x 320gb
3x 1tb
2x 2tb
3tb
>>
File: zfs-checksum-and-mirrors.jpg (38KB, 512x384px) Image search: [Google]
zfs-checksum-and-mirrors.jpg
38KB, 512x384px
Nas4Free/FreeNas

ZFS mirrored pool for.
(Every drives I/O is multiplexed)
ie your transfer speed doubles for every drive because you have multiple copies of the same file (on seperate physical drives) that can be read

automated snapshots and per bit check-summing incase of bitrot
>>
>>60908786
FreeNAS zfs raid 10
It's cow so it's all good.
>>
>>60914701
>Using normal raid
>Not using RaidZ(ed)

Do you even care about your data?
>>
>>60908786
>Also post your storage, 10+ TB only may apply- 52 posts and 4 image replies shown.
10x4 TB + 10x8 TB each raidz2 on freenas.
>>
>>60914872
this combined with a couple hot-spares and a dedicated cache drive with a dedicated log drive in the zpool and you dont even need to worry about it
>>
>>60914905
What 4tb drives are u using? I'm still using a bunch of 2tb ones
>>
>>60914940
a hotspare in a zfs pool (zpool) will automatically take the role of a drive that fails

if its in a zmirror zpool it will re-silver itself as a mirror and you can add a coldspare (manual replace) when you get a chance

you can have multiple hotspares in a zpool at a time and they go back to being spares after you replace them
>>
>>60914948
HGST Deskstar. The 8TB were extracted from WD externals.
>>
if here any filesystemfag who actually understands filesystem types in these days and can say which is better for which type of storage?
>>
>>60914994
>HGST Deskstar. The 8TB were extracted from WD externals
Hgst drive are nice, and extracting drives from externals is also a good idea if they are cheaper than internals
>>
>>60908786
Proxmox or some other VE platform
>>
>>60908903
>actually having them on your device rather than a server
>>60908786
I personally use openbsd, disks formatted with ufs accordingly
>>
>>60915236
They were much cheaper. $210 per compared to I think $250 minimum for a bare 8TB drive.
>>
>>60915198
theres plenty of evidence and facts in this thread about ZFS

if you want a archival format its literally the best

if you want a performance for general computing use XFS or EXT4

dont use btrfs
dont use raid
dont use raid controllers

use raidz or zmirrors
>>
>>60908901
>Max efficiency, Gentoo
How?
>>
>>60915256
ufs isnt a archival format though
>>
>>60914488
>The Sun is a planet.
>>
>>60908786
OpenBSD
FFS
>>
>>60915285

thank you

i'm now on btrfs and since i do have to balance the system once in a while it pretty sucks

whats so good about zfs?
>>
How can I properly backup and hoard data?
>>
>>60915260
That's a good deal
>>
>>60915285
>don't use raid
Why not?
>>
>>60916655
because consumer raid controllers are not true raid.
>>
>>60908872
This.
>>
>>60908786
>Not 1 petabyte
Scrub
>>
>>60916771
But software RAID is okay?
>>
>>60910299
why install jessie to anything new anymore when stretch works absolutely fine and will be the new stable on saturday
>>
>>60917135
personally as far as mdadm is concerned no, but I fully trust zfs as a raid implementation. my experience with onboard "raid" and mdadm havent been good, but ZFS has never failed me. maybe im just unlucky.
>>
>>60917199
why use debian at all when you can use devuan?
>>
I'm looking for some HDDs for RAID. Saw recently some super cheap (so cheap I'm wondering if that was a mistake on the shop's side) 2TB HGST, but I couldn't afford them at the moment and now they are out of stock. Anyway, since I'm going to make RAID 6 out of them, would some cheap plain Seagates be okay?
>>
Best CAT7 20m cable? The ones at Amazon look like chink shit.
>>
>>60917727
I buy cablematter shit from amazon all the time and they work fine.
Thread posts: 82
Thread images: 5


[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y] [Search | Top | Home]

I'm aware that Imgur.com will stop allowing adult images since 15th of May. I'm taking actions to backup as much data as possible.
Read more on this topic here - https://archived.moe/talk/thread/1694/


If you need a post removed click on it's [Report] button and follow the instruction.
DMCA Content Takedown via dmca.com
All images are hosted on imgur.com.
If you like this website please support us by donating with Bitcoins at 16mKtbZiwW52BLkibtCr8jUg2KVUMTxVQ5
All trademarks and copyrights on this page are owned by their respective parties.
Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.
This is a 4chan archive - all of the content originated from that site.
This means that RandomArchive shows their content, archived.
If you need information for a Poster - contact them.