[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y ] [Search | Free Show | Home]

>it's a Linus refuses to use established storage solutions

This is a blue board which means that it's for everybody (Safe For Work content only). If you see any adult content, please report it.

Thread replies: 80
Thread images: 5

File: file.png (589KB, 861x547px) Image search: [Google]
file.png
589KB, 861x547px
>it's a Linus refuses to use established storage solutions and instead comes up with a homebrewed mess that will certainly fail at some point in the future
Over under on "our archive server is dead/lost all our data" video within 6 months
>>
>>58966712
What's wrong with zfs?
>>
>>58966724
Nothing really, but he's running a petabyte of disks split across two hosts and he's probably going to fuck it up
>>
Why do people care what some dumb nigger does on YouTube? Boy, someone's life must be soo boooring.
>>
>>58966762
>he says on the site that still cares what Stallman says/does
>>
>>58966724
http://louwrentius.com/the-hidden-cost-of-using-zfs-for-your-home-nas.html
tl:dr it's absolutely fine, and possibly even optimal, provided you never need to expand. The moment you do ZFS becomes a pain in the ass.
>>
>>58966712
he said to based Wendell that he is probably going to get a pro in to set everything up, either way, I want to see another 'its all gone' video for the funnies
>>
As a sysadmin, I have a hard time even being aware of these videos, nothing he does is best practice.

If he really really wants to avoid tape, he should get something like amazon glacier.

Why doesn't he just offsite all of his videos to tape once a year and send that shit to iron mountain? I don't understand that.
>>
>>58966908
Damn is tape cool again?
>>
>>58966980
Tape has never been not cool. It's basically the best possible long term off-site storage that exists.
>>
>>58966980
tape has always been cool - it's the goto for long-term backups
>>
>>58966753
>but he's running a petabyte of disks split across two hosts

Gluben is excellent and has been around for years for exactly this purpose. It's not some unsafe, untested variable.
>>
>>58967064
>>58966753

>Gluben

What the fuck autocorrect. Gluster
>>
File: backup-tape_media_sales.jpg (84KB, 500x311px) Image search: [Google]
backup-tape_media_sales.jpg
84KB, 500x311px
>>58967031
>>58967040
Then why was there a very steep sales drop in tape? I also was reading how facebook refuses to use tape for cold storage, and that was a just a few years ago.
>>
>>58966980
Tape historically has always been used for archival and still is today with LTO Ultrium.

Right now you can get LTO-7 tape cartridges that hold up to 6TB of data.
>>
File: Google.jpg (499KB, 1333x2000px) Image search: [Google]
Google.jpg
499KB, 1333x2000px
>>58966980

Tape has always been cool. It has an insanely good price to storage ratio so long as you can both store it properly and don't need to be reading the data constantly.

Pic related, Google's automated tape backup warehouse
>>
>>58966908
>amazon glacier.
https://medium.com/cogapp/avoiding-a-10-000-aws-trap-1ef88a554c70#.88dkrcvdp
>>
>>58967084
facebook does a lot of things that are retarded
>>
>>58967040
Yep for sure.

My offsite schedule:

Once a week - file level backups of the fileserver's most important documents, like finance, legal, etc, as well as our source code.
Once a month - files on the physical hosts, like the itanium box or the aix box stuff like that
Once a quarter - our entire virtual infrastructure
Once a year - Snapshot of state of the companies documents

The once a week schedule was on a 8 week rotation, the once a month schedule was on a 4 month rotation, the once a quarter was on a 2 quarter rotation.

This is completely separate from the nightly backups to the backup server.

I could basically recover my company from a complete DC failure to a reasonably recent state.

Not even to mention the fact that the fileserver was replicated to 3 other file servers across the globe. (this was also all tested on a regular basis)
>>
>>58967086
How slow is data transfer to tape?
>>
>>58967084
Because tapes have a huge capacity now and it only takes one fucking tape to backup every single document a company generates as long as they don't do something stupid like embed video files.
>>
>>58967122
~1TB/hour per tape drive
>>
>>58966712
>those earrings
>that HIV emaciation
could this guy be more of a gay bathhouse bottom?
>>
>>58967122
it takes a long time, I usually run the tape backups overnight or over the weekend for big jobs.
>>
>>58966980
>cheap
>reliable
What's not to like, it's not like you'll be needing to access tapes every day.
>>
>>58967131
he also neutered himself
>>
>>58967129
That's actually really good. I didn't even realize that its still in use today.
>>
Linus doesn't know what he's doing, at all. He is literally an advertising shill.
>>
>>58967149
obviously that's under ideal conditions but yeah

the other big benefit is tape does not degrade over time (or if it does we're talking centuries). disks do.
>>
>>58967158
>your great grandchildren will see your porn history
>>
File: watch?v=sRN-TdegmtI.00:00:22.jpg (161KB, 1280x720px) Image search: [Google]
watch?v=sRN-TdegmtI.00:00:22.jpg
161KB, 1280x720px
in related news, louis is growing a beard
>>
>>58967099
For historical data that is very reasonable. When I need to restore shit from a tape that is at iron mountain, depending on the urgency, it will take from next day to next week with the next drop off.

No reason to put 10TB of shit you will likely restore at some point. It mostly should be used as a disaster recovery, with onsite backups that you will restore from.
>>
>>58967149
>>58967158
disk to disk to tape, I've noticed gives the best performance.
>>
What does it mean when it says
>Capacity 1.5TB Native/3.0TB Compressed
for tapes
Because $20 for 3TB of storage would be sweet
>>
>>58967189
It means what it says
but the tape recorder is where the real cost it
>>
>>58967199
So if I wanted a backup of my movies in case my raid array fails, I would be able to fit 3TB on the tape? I'm not sure what it means by 1.5/3.0TB
>>
>>58967189
Current gen tape drives are about $2k
>>
>>58967171
Yup. Offsite tape should generally be thought of as "the building just burned down" scenario. It's a backup for a full DR. For minor fires onsites are best (like always be able to recover for the last 30 days or something).

>>58967180
Makes sense, that way the disk you're reading from when writing to tape isn't also busy with writes like the live production disk would be.

>>58967189
Highly dependent on your data. In practice it's very rare that you can actually compress EVERYTHING by 50%. Think of making zip files - for some things you can shrink the data quite a bit, for some you can't shrink it at all.
>>
>it's a linus has his server in the bathroom episode
>electronics and power cables in the sink
>didn't even shut the mains water off to that room


it's kind of bizarre that companies give him so much free shit to advertise because he inevitably breaks it and that doesn't make the product look good at all.
>>
>>58967212
>Highly dependent on your data. In practice it's very rare that you can actually compress EVERYTHING by 50%. Think of making zip files - for some things you can shrink the data quite a bit, for some you can't shrink it at all.


Yeah and there is a lot you can do with deduping and shit like that, but it all depends on how many CPU cycles you want to put into that.
>>
>>58967210
for how much storage tho?
>>
>>58967210
FAKE NEWS
https://www.tapeandmedia.com/hp_lto_5_tape_ultrium_5_tapes.asp
>>
File: Fidgeting KyoAni.png (391KB, 800x480px) Image search: [Google]
Fidgeting KyoAni.png
391KB, 800x480px
>>58966980
Someone please enlighten me on tape and their drives. I looked for some info a few years ago, but decided to drop it due to prices. What should be my goto? Buy a used tape drive and go from there? I have about 10TB of storage I'd like to backup.
>>
>>58966753
4chan uploads 1 petabyte of CP to linux's new toy when?
>>
>>58967150
>Linus doesn't know what he's doing, at all.
That's really the only reason anyone watches anymore.
>>
>>58967253
>>58967244

he said drive
>>
>>58967253
>https://www.tapeandmedia.com/hp_lto_5_tape_ultrium_5_tapes.asp

LTO 5 is pretty old, I think it is up to 7 now.


>>58967244
I had a library that held 40 tapes, our larger office had a library that held 80 tapes.
>>
>>58967253
LTO 7 is current gen, LTO 5 is very outdated.
>>
>>58967244
Cheap senpai, if you know someone with a tape drive, or you can get an older gen cheap (just check you can use it, some have weird ports) then it might be worth it.

The older gens have lower capacity tapes.


>>58967253
>implying the drive is the tape itself
>>
>>58967169
I'd like to see louis land sponsorship deals then watch his head implode as he has to shill for them and eventually just spergs out ranting about how bad there and then gets sued and loses his business and eventually buys a gun to shoot up apple HQ.
>>
>>58967283
>>58967286
you're both right, but LTO 7 is only about $120/tape

Also I was wrong about transfer speeds - apparently it's up to 2.7TB/hour
>>
>>58967291
Stars wearing gfuel hat, razor keyboard and mouse,

i would pay to see this
>>
>>58967253
He is talking about the drives, not the tapes you fool.
With tape, you need a drive to put the tape in.
>>
>>58967084

Tape capacity scales faster than its price. A company can get a 2TB tape for cheaper than 2 1TB tapes. This makes the overall market look like it's decreasing, but it's really just the per unit value. The use of tape in general is still there.
>>
>>58967320
yup, cheapest LTO 7 drive (SAS connection) is ~$2k. cheapest tape drive in general is ~$500-$600 but is going to want a SCSI connection, and good luck with that on consumer hardware.
>>
>>58966980
It's widely used still in corporations. New tapes drives are being developed all the time. It's the best way to archive data for large amounts.
>>
>>58967271
I don't know if you can buy tape drives outside of bulk sales. They aren't meant for consumers at all. They mostly sell to enterprise but you could email a company and get a quote.
>>
DNA storage when?
>>
>>58966724
Just oracle beeing a cunt
>>58967275
Yesterday
>>58966777
As much as GPL advanced
free SL outside of academia, RMS is still a beacon of digital privacy and to some extend security.
He also is very meme friendly.
>>58967128
>Rule 54
They do.
>>58967118
Isn't consistency more important than 3 fileserver across the globe, when you already have tape+nightly backups.
>>
>>58967271
Unless you have a ridiculous amount of never ending critical data that needs to be backed up constantly, you should avoid LTO Ultrium because it's really fucking expensive.

Doing this is basically burning money because you aren't an enterprise with enough data to justify the purchase or make it worth while having in the first place.
>>
>>58966712
is he on drugs?
>>
>>58967497
he's just your average canadian family man
>>
>>58966712
he makes money for being retarded
>>
is he transitioning?
quite qt desu.
>>
>>58967549
Nah, he is just canadian.
>>
>>58967084
Facebook uses DVDs because it's cheaper when they work at the scale that they are working at. For 99% of companies, DVDs doesn't make sense.
>>
>>58967574
That's actually pretty cool. transfer speeds must be pretty bad though, reading one 100gb disc at a time. if you ever actually had a shtf scenario and needed to restore a back from severl racks it would take forever.
>>
>>58967519
So the kids aren't his?
>>
>>58967574
Storage engineer at a Facebook-scale company here. (Not Facebook.)

The limiting factor is almost always throughput. We use tape for offsite backup (shitloads of tape), and the biggest problem we had was the goddamned tape robots burning out because nobody expected us to run them at max capacity 24/7.

We may start using shingled disk at some point, but stranding the spindles just doesn't make sense right now.
>>
>>58967659
>>58967757
Original poster here. I actually interned there for two summers and I'm starting a job there pretty soon. Facebook has MUCH more cold data than warm data (surprisingly), but that data does actually have to be accessed quite frequently for many reasons.
>>
>>58966712
you forgot the word "episode" btw
>>
>>58966712
>Over under on
what
>>
>>58967497
Also gay with yellow fever, not to mention his sexual induendo.
>>
>>58967099
>my gluster setup is a backup
Stopped reading.
>>
What as actually preventing him from getting the whole petabyte on one server?
>>
>>58968072
Himself.
>>
>>58968072

Lack of rack space, and also needing more drives because the formatted PB vs PiB thing.
>>
>>58967497
why does his shitty channel need a PB of storage
>>
how the fuck did this guy invent linux
>>
>>58967757
Fucking robots, man, I glad they are not consumer tier, imagine how many problems people would have with them, they are nastier than printers. Little faggots constantly jamming, can't read cassette, get stuck physically and by their own stupid algorithms, also sticking tapes on wrong drive(that's rarely for sure) or just not properly sticking them in. One stupid faggots somehow managed to break tape by sticking it wrongly
Thread posts: 80
Thread images: 5


[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y] [Search | Top | Home]

I'm aware that Imgur.com will stop allowing adult images since 15th of May. I'm taking actions to backup as much data as possible.
Read more on this topic here - https://archived.moe/talk/thread/1694/


If you need a post removed click on it's [Report] button and follow the instruction.
DMCA Content Takedown via dmca.com
All images are hosted on imgur.com.
If you like this website please support us by donating with Bitcoins at 16mKtbZiwW52BLkibtCr8jUg2KVUMTxVQ5
All trademarks and copyrights on this page are owned by their respective parties.
Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.
This is a 4chan archive - all of the content originated from that site.
This means that RandomArchive shows their content, archived.
If you need information for a Poster - contact them.