Torrent Indexer

Does nyaa have magnet links? You could probably scrape all of those in less than 1gb.

>>60168501
Some anon already did. Now i just need to setup a mirror site. That why I'm asking.

Google it, you fucking retard.

>>60168501
>>60168599
Another anon here. We got a old database backup, its very limited and missing file content. Only torrent names and magnet hashes. Its more useful for knowing exactly what torrent to look for.

Not really a way to solve a backup as it, we still need file sizes and uploader comments.

Why use torrents? Why not something like gnutella, that's actually designed to be decentralized?

USE GOPHER!
USE GOPHER!
USE GOPHER!

This is the one time the oldies can help a lot, is fast to setup, and after that you can figure out the indexer engine or just use regain http://regain.sourceforge.net/index.php

DO IT FAGGOT!

>>60168870
To expand that, gopher can be accessed through the browser, you only need to set a server and then fire that shit

And if you do it well, you can automagically have all the magnets indexed on the gopherspace!

>>60168470
It's trivial. Really.
I have experience with django. Basically all you would need to do is the page design(html/css), the rest comes with the framework.

>>60168501
Nigga, tpb was like 60MB.

>>60168960
Impossible, sukubei (nyaa's porn counerpart) was 200 MB.

>>60169092
It probably was more than just magnets then.

https://torrentfreak.com/download-a-copy-of-the-pirate-bay-its-only-90-mb-120209/

(90MB actually)

>>60169092
You probably want to post on /dpt/ (daily programming thread), it's infested with weebs.

>>60168470
Nyaa.se?!?! Animebytes nigga

File: 1493687776626.png (29KB, 835x434px) Image search: [Google]

29KB, 835x434px

>>60169126
Not much more.

>>60169148
Animebytes doesn't have everything.
In fact, the loss of Nyaa is rather negligible.
The real loss here, and the loss that many will mourn for a long time is Sukebei.

File: 24FIG03.gif (60KB, 432x379px) Image search: [Google]

60KB, 432x379px

Anybody here used veronica, the gopherspace indexer?

File: gopher2.gif (12KB, 610x460px) Image search: [Google]

12KB, 610x460px

>>60169177
It was the ancestor of google, indexing all the content for gopher

/polagk/ here. Look into Zeronet.

https://zeronet.io/

Get a few /a/nons to mirror it in different jurisdictions and it will never die.

https://btdb.in already exists, but would be nice to have one without horrible amounts of sketchy annoying advertising

>>60169234
>zeronet
isn't that a meme?

>>60169168
>negligible
Plenty of VNs were there not on sukebei.

>>60169297
Well, a lot of the VNs on Nyaa were also in other places. AB in particular I know has a few.

>>60169315
AB is shit when it comes to VNs/music.
So what will you miss from sukebei? 3DPD porn?

>>60169350
A whole, whole, whole lot of H games.

>>60169365
Was H games collection bigger than non H? Not talking absolute numbers, but percentage of all released titles.

>>60169350
RPGs, indie games hentai games.

>>60169398
>RPGs, indie games
Not regular nyaa?

>>60169394
Probably, yeah. There was a ridiculous amount of porn.

>>60169350
JAV

File: even if Nips are honorary 2.34D.png (3MB, 1920x1080px) Image search: [Google]

3MB, 1920x1080px

>>60169432
>3DPD

>>60169350
2DGF and all those RPGmaker shit

>>60168890
The arch wiki has a short tutorial on https://wiki.archlinux.org/index.php/Gopher

>>60169456
>2DGF
they don't have a site, right?

>>60169438
Nips are disgusting looking.

>>60169491
no but the other guys do

you know the one

someone needs to resolve this shit.

How am I supposed to get obscure manga and vns now?

>>60169677
Usenet, I guess.

>>60169677
if the guy takes my advice of using gopher, you'll have your chinese cartoons in no time

Alright gents. We're getting this shit done. But first we need people that know:

CSS
HTML
SQL
maybe Python

Also a server and a Nyaa domain. I can grab an info.ve/org.ve one thanks to a friend, but can't get a server.

Anyone willing to step up?

File: Decryption_mix_net.png (106KB, 1308x786px) Image search: [Google]

106KB, 1308x786px

Is there really no way to make a network that is fast, distributed, fault tolerant, and anonymous?
If such a network existed (and was preferably open source), could everyone be persuaded to use it instead of torrents?

>>60168470
I asked in the nyaa irc channel on rizon and apparently "nothing is left".
I'm already working on a simple nyaa torrent search with the 2016 dbs.
Gonna be in Golang btw
I don't know yet if I'll add in upload torrent functionality yet

>>60169878
>Fast
>Secure
>Anonymous

Pick two.

>>60169927
Secure
Anonymous

>>60169935
Then get ready for Tor-tier speeds

>>60169927
I pick secure and anonymous. I've waited hours to DL anime before, I can do it again.

>>60169940
Better slow than nothing.

>>60169943
>>60169952
But are you fine taking literal months to download BD rips?

>>60169943
So we are moving back to Mega like the old days of Mega Upload?

>>60169927
How about fast and secure? I can just use a VPN to be anonymous.

>>60168470
I knew this was bound to happe eventually. Government

>>60169963
Probably going back to distribute anime in flash drives like it used to be make in cassete tapes.
Time to buy a cheap PC so the one-in-a-tenth pc-killer-flash-driver-joke don't fuck me up.

File: 388e3b3e-e5b0-11e6-9429-aca85f3ce0b6.png (434KB, 2380x1516px) Image search: [Google]

434KB, 2380x1516px

>>60168470
Ignore all the autists in this thread and use the following: https://github.com/sergiotapia/magnetissimo

I use it myself.

File: ce8f9b212a58b6fa.jpg (20KB, 400x300px) Image search: [Google]

20KB, 400x300px

>>60169878

>>60170038
not what he asked, but cool thing anyway

>>60170038
That's not very useful if the tracker is down.

>>60169940
>>60169952
not that anon, but when i get interested in a finished anime, i download the batch in slow speed anyways as i prepare watch it later and not NOW with impulsiveness.

If what is important, let the first files download first.

File: IMG_1704.jpg (51KB, 1024x576px) Image search: [Google]

51KB, 1024x576px

Just write all this shit to a fucking blockchain and be done with it you goddamn retards.

Write magnet links to block chain w/ name of torrent / description.
Create multiple front end services to query said blockchain.
Set download limit based on computational work verifying and writing to the block chain.
Boom you're fucking done and can't be censored.

Why are you all retarded?

>>60170088
Yeah, but there's a difference between waiting overnight and waiting several weeks.

>>60170097
weeks for a single episode at <0.5GB size? Then panic.

>>60170123
I was talking about BD rips, archival quality material.

>>60170132
If the BD is compressed i can see why. If the BD comes with many files that can be prioritized like a torrent that would be good.

>>60169987
Relying on something like VPN for anonymity is a mistake. Very few people are actually willing to pay monthly for a VPN. On the other hand, with anonymity baked in to the network, more people will be willing to contribute bandwidth and files without fear of reprisal.

>>60170132
That's why we need to invent a progressive video codec. The longer you keep downloading, the more quality.

>>60169878
You don't technically need a tracker for torrents.

You do still need a way to distribute magnet links though.

Maybe we need DHT for magnet links.

>>60170227
You need an editable torrent, and that exists in some form with gittorrent http://blog.printf.net/articles/2015/05/29/announcing-gittorrent-a-decentralized-github/

which by the way I've been trying to convince /g/ into but with no success

>>60170266
gittorrent can potentially create a torrent with indexed links that can be updated

is a torrent that saves the link of other torrents, and that list can be updated, is it hard to understand or something?

dear /g/, let me ask one question, if the blockchain of bitcoins can save transactions, and bitcoins are decentralized, why the fuck isn't there yet an implementation to save torrent links like the blockchain saves transactions?

>>60170375
Because you can't buy stuff with ratio.

but of course, memecoins are more important, you fucking piece of shit

Going to sleep. Don't let the thread die yet.

File: 13697094_550651508454810_3081537524335021293_n.jpg (80KB, 686x960px) Image search: [Google]

80KB, 686x960px

>>60170862
I'm on it, i'll maki-post for a moment

>>60170862
Dream with gophers anon

File: sleep2.jpg (854KB, 2000x1600px) Image search: [Google]

854KB, 2000x1600px

>>60170862

Have a nice sleep.

You guys are doing God's work, gg

What did people mean when they said no torrent hoster "used DHT" properly? Could this be fixed this time around now that we have to fill the void?

>>60171428
>torrent hoster
what are you referring to?
sites hosting .torrent files?
torrent clients? (who host the data)
torrent trackers? (who host peer swarm information)

>>60171448
A server has to host the data for peers to connect to, no? Isn't that the role of the tracker?

>>60171379
kek

>>60171478
no, the tracker only hosts peer information, they help peers find each other
the tracker does not host or even pass through any actual data (that is, the files "in" a torrent)

>>60171486

The tracker doesn't even pass the .torrent file, right?

>>60171493
it doesn't need to, no
just the magnet is enough for peers to transfer the .torrent file data among themselves

>>60168470
this shit literally came out this month and it's called magnetico

or better use, use GNUnet or at least IPFS inside I2P in 10 years when it might finally be done

>>60171507
-- or to be more specific, the infohash. a magnet link is just the infohash and (optionally) a list of trackers
so even as little as say;

magnet:?xt=urn:btih:240f1a2809dab197042b6c9c1df708d193eb7d73&tr=<tracker url>

is all a tracker needs to know about a specific torrent

Does anyone have the DL or torrent of Nyaa's magnet links? Might be worth passing around.

>>60171545
>>60171507
I'm confused, people were saying that "torrents" (don't know if they were referring to trackers or peers) weren't using DHT. Did they mean not fully or not at all?

>>60171563
DHT is a client feature that makes it possible for clients to find peers without even needing a tracker
it's not something a tracker or .torrent files specify, it's just a client feature
so all it can refer to is that people aren't enabling DHT in their torrent client

>>60171578
oh, .torrent files can be flagged as 'private', private torrents indicate to the client to disable DHT, as DHT avoids the tracker
all private trackers will do this, naturally

>>60171586
Can you use DHT on private-tracker-torrents anyway (some sort of workaround)?
Will you get fucked (ie banned) if you do that?

>>60169159
>>60168501
Nyaa has no magnet links..

>>60171598
>Can you use DHT on private-tracker-torrents anyway (some sort of workaround)?
probably, i don't see any technical reason why not
>Will you get fucked (ie banned) if you do that?
probably, that and any transfers not registered to the tracker won't count towards your private ratio, so normally one wouldn't want to do that anway

>>60171601
with the hashes and the torrent names you can generate your own magnet links

>>60171657

There was a userscript or something that did that.

>>60171684
As I said in the thread I'm already working on a site that uses the 2016 db dumps to search and generate magnet links.
It's in golang as well.

>>60169878
what about ipfs?

File: IMG_2760.jpg (46KB, 403x449px) Image search: [Google]

46KB, 403x449px

Maki-posting from phone to keep thread alive

File: Screenshot_2017-05-02_18-44-42.png (121KB, 1176x722px) Image search: [Google]

121KB, 1176x722px

progress

>>60172175
Do they have seeders?

>>60172175
What's the site?

>>60172192
I don't know I'm just generating magnet links.
Most probably they do.
Also gonna work on search.
This is for both sukebei and nyaa dbs
>>60172203
Currently just local

>>60172207
Keep at it, you're doing good work.

>>60172240
I just wish I had more recent dbs

>>60172175
If you're in "EU", I'd recommend to take out the clickable links as it's "illegal", just make it something you can copy paste.

>>60172295
I'm in Australia and my server is in the US.

>>60172175
Thanks for your hard work anon. Appreciate that someone out there is doing something while everyone else is just panicking and shitposting.

>>60172302
Gotta do what I can.

>>60172264
You can ask on /a/ and hope I guess, or maybe hit up nyaa and friends.

>>60172348
I've already asked /a/ and in #NyaaTorrents.
They said that "nothing is left"
Which if true is a real god damn shame.
9 months worth of torrents gone

>>60172357
Well shit. That's enormous.

>>60172364
Yeah I know.
Such a massive amount of torrents gone.
Anyway hopefully I'll have the site functional by tonight or tomorrow.
Don't know if I'm going to allow uploads though.

>>60172357
>9 months
Are we using different backups? My database appears to be from February 6, 2016 (judging by the torrent IDs).

>>60172396
Unlikely I didn't check the dates of my db I'm just going off what people said on /a/

>>60172409
Well, than it's 15 months instead of 9. Still better than nothing, I guess - but this sucks.

>>60168470
>and expect it to be up within a week or so
Anon, I..

Considering that the website was taken down by its owner, while there was no actual legal actions against the website at that moment, this could mean one of the two things:
A. It's going to come back on a new domain.
B. It's not coming back and the owner is being a huge cunt to everyone by not providing a recent backup.

>>60172525

Wouldn't put it past nyaa, he is a huge cunt.

>>60172566

Sit back and watch the world burn.

>>60172430
Search works
Added torcache links as well

>>60171601
>>60171657
>>60171684
>>60171698
Wrong, nyaa had torrent links, you only had to ad "&magnet=1" to the end of a .torrent download link

File: Screenshot_2017-05-02_19-51-06.png (24KB, 1150x326px) Image search: [Google]

24KB, 1150x326px

>>60172677
fuck me forgot the pic

>>60172679
I'm just talking about how to generate them using the information in the databases.

Could you get a more up to date database from http://tokyotosho.info as they just redirected nyaa and sukebei?

>>60172692
i referenced the whole chain for notification purposes.

>>60172699
Was just about to post this, TT still has working magnets right?

>>60172726
Yes, you need to open the info pages for the files. But I think we should take this opportunity to create something more stable.

>>60172699

Just copy the hash from TT's files.

>>60172699
Definitely if someone scraps the entire thing.
I'd need a minimum of torrent name and hash

>>60172566
4chan's archive data from 2009-2015 was destroyed by a fire once

>>60172831
/a/ was 2008

>>60172962
ah, that one

>>60168470
There's one. Look for tokyotoshakan or whatever it's called.

>>60172699
>>60173181
I just checked it and couldn't some of the stuff that I remember seeing on Nyaa, so the database is definitely not complete.

>>60173357
Iirc it's just a search engine that grabs magnet links if they're alive?

https://nyaa.pantsu.cat
Idk if the magnet links actually work but it's up now

>>60168470
who pirates stuff lmao get a job

>>60173576

>https://sukebei.pantsu.cat/

Doesn't work.

>>60173586
dns probably needs to propagate

fucking god damn it Europe what the fuck man
fuck germans
fuck swedish

>>60173576
Linked site werks, sukebei doesnt yet.

>>60171684
>userscript
You just add the same phrase before the hash, do you really need somebody else to do it for you.

File: Screenshot_20170502-092752.png (70KB, 1080x1920px) Image search: [Google]

70KB, 1080x1920px

>>60173584

>>60173698

It was a button next to the torrent download arrow, and it sure was convenient.

>>60171227
>you'll never be as comfy as Yuno
why live

>>60168470

In other words, you want to do this:

- https://www.skytorrents.in/?l=en-us

Maybe spend your time working with them to improve the existing service?

A category system would be nice.

>>60169677
Find the links to databases in /a/ or /v/ archive, open database, add a few characters before the torrents hash (>>60169159), open in your torrent client

>>60173708
>1080x1920
that’s not even 2k lmao
keep the hate bro
stay mad at success

Hey guys, sorry for being late. Just got to know about this after an anon contacted me.

Basically I used to archive nyaa, but I slacked off once it was pretty stable.
https://srotonpaga.appspot.com/nyaa/

Its about eight months back, so yeah. Sorry again.

>>60173799
Oh thanks anon 9 months is better than 15 months
Also
https://sukeibei.pantsu.cat should work
if not clear cache

>>60169456
>>60169491
>>60169527
Wat, 2DGF has a site, even bigger than girl silly. They operate on other level.

>>60173821
Can't go past page 7.

>>60173719
I meant that you can write it yourself in two minutes, so who cares if there were a userscript which did that.

>>60173859
Gonna fix now.
Probably some JS error.
If you replace 8 with 9 in the url it should work

>>60173858
wat

really?

File: Screenshoot_020517.png (77KB, 944x236px) Image search: [Google]

77KB, 944x236px

Piracy is not cool bros :/
Stay cool

>>60173970
Yes, they have premium account system where you paid shit blah blah for some game that never went public or delayed public release yadayada and and all that.

>>60174000
you mean mikocon?

>>60174012
Yes, they are the same people.

>>60169962
Nigger I've already taken literal months to download things before. Torrents are the magic that allow such a possibility.

Bless your heart, anon op. I'm still upset that nyaa might be gone for good. I'm on my way to work and it's a relief some folks are already working on an alternative.

Is kuroinu good?

File: It IS shitposting.jpg (310KB, 750x850px) Image search: [Google]

310KB, 750x850px

>>60173995

>>60173859
Fixed the bug.
If someone can scrap TT or other such sites for the most recent nyaa db I'll update it.
I /may/ add uploading or hash adding tomorrow.
but for now https://nyaa.pantsu.cat and https://sukeibei.pantsu.cat both work

File: 1493686081629.png (12KB, 610x148px) Image search: [Google]

12KB, 610x148px

>>60174165
I know some anon on /v/ posted this yesterday, but I haven't seen if he uploaded it anywhere or not.

>>60174165
>sukeibei
Just one small niggle. Its sukebei.
But really, thanks for all your hard work.

>>60174183
I'm pretty sure I'm using those dbs.
>>60174185
o-oh woops

>>60174183
Pretty sure that's what we're working off, it goes up to Spring 2016, so it's pretty out of date.

>>60174196
>>60174199
Screencap dbs were modified in 2017, but the ones that were posted for download were actually a year old and only went to 2016. I have to assume they were not the same ones as the anon with the screencap.

>>60168470
I've always loved the idea of a bot on IRC which people could just @find for something and it would point them to the magnet link in question.

Incorporate that too, if you plan on doing this.

>>60174183
>>60174207
Got a link?

>>60172357
lmao

get fucked weebs

>>60174268
自殺して。

>>60174258
Nyaa normal: https://ln.steamy.moe/vtzzbc.sqlite

Sukebei: https://ln.steamy.moe/gsipey.sqlite

>>60174258
https://srotonpaga.appspot.com/nyaa/

>>60174196
Paging seems to have a slight issue. Despite being on page 1, the next page link is 3. The next and previous buttons work well though.

>>60174290
The guy who owns that needs to put target="_blank" on all of this <a> tags so they open up in new tabs instead of in the same tab.

>>60174288
>>60174290
yeh I'm using those dbs
>>60174293
ty I'll fix it.
Not surprising that it's still kinda buggy considering I did just finish writing it.

>>60174313
Yes I'm here. >>60173799
You can hold Ctrl and click the link to open it in a new tab. Then again, with all of this fall out, I don't think its necessary to update the page anymore.

>>60174330
>You can hold Ctrl and click the link to open it in a new tab.

Yeah, I know. Just saying because it's a pretty trivial HTML based fix.

>>60174330
Anon thanks to you not everything got lost.

Dev channel on Rizon #nyaapantsu

>>60172175
there's really no reason to bother displaying the infohash on its own, the magnet link contains it, and that's what people will want

>>60174456
Good point. I'll probably remove it tomorrow.

>>60174456

Instead of the hash, the date of upload (and ability to sort by it) would be much more useful.

>>60173799
>I just find it odd that when nyaa is really down, only then will people start looking for alternatives or archives.
hindsight is 20/20
it's also why i laugh at people who only stream things
>"why bother wasting space when i can just visit a page/open an app/whatever"
yea, until it's gone.

>>60174491
Date information wasn't included in the dbs

>>60174504

So they're sorted by what, name?

>>60174533
By their index presumably, which will still be in chronological order.

>>60174466
if you could, you should consider hosting it on IPFS as well
this way anybody can mirror it at the same URL, IPFS is great for things like this

if you're not familiar with it, the basic idea is that IPFS url's are a hash to the content, rather than a specific server, so anyone can download the content, and serve it in such a way that even if the original server goes away, the same url will still function, provided anyone kept a copy

Plans for the future.
Some form of uploading.
Category searching.
Reintroducing statuses.
Scraping or importing data from TT.
RSS feeds.

>>60174533
torrent_id/index

File: Untitled.png (151KB, 1366x768px) Image search: [Google]

151KB, 1366x768px

>>60174533
Name and hash are all you have that's meaningful.

>>60174554
I'll definitely look into ipfs to keep cost and risk down.

>>60174563
the torrent ID is likely tied to their original update time
it's not an actual timestamp, but it can at least make it possible to find "new" vs "old" torrents

>>60174563

I'd say the hash itself is very much not meaningful to the end user, just to the torrent clients.

>>60174585
>update time
upload order, i meant to say

sorting by date is a good thing

>>60174618
yes, but the database dump doesn't contain timestamps >>60174563
at least not in that table

>>60174639

ORDER BY torrent_id DESC

is all i need

File: capture.jpg (41KB, 568x331px) Image search: [Google]

41KB, 568x331px

>>60174369
>>60174493
Despite that, we lost about nine months of data. I think sukebei would have had another million IDs or something.

>>60174639
I tried to save most of the data in the >>60174290 dump. But it takes extra work to put them into db and make a proper, searchable interface.

>>60174679

If you're using json does that mean you're using mongodb? It's a fuck of a lot easier to deal with than this SQL stuff.

>>60172379
I wouldn't allow any updates, at least for a good long while.

>>60174716
No, not at all. I only dumped them into json files. Its pretty easy for any language to read json files, and when I wrote it, I was too panicked to decide which db to store it in.

>>60174753

If you dumped them into json files you can take the list of json objects and basically copypaste it into a mongodb collection fullstop. From there it's easy to use pipeline aggregation to search, sort, and pull data into the client, and the data you pull is already json because that's the format mongodb uses for everything.

>>60168470
Nice, I will do the logo

>>60174790
Yes, I heard mongo works natively with json files, so I assume putting it into mongo would be relatively quick.
But I'm really sorry, as I am swamped with things in real life, and could not help things out here. If you could lend a helping hand, join the IRC in >>60174406 .

>>60174674
Done
>>60174718
Yeah probably a good idea not to allow updates until we're up to date with TT.

>>60174928
In a couple of days. I'm literally in the middle of final exams and taking study breaks to stress out over nyaa dying. My job is websites though so I'd be glad to offer help on all that backend shit when my exams are over.

Apparent month and bit old backup?http://mint.2ch.net/test/read.cgi/download/1490034929

>>60174987
That's good to know. I wish you well for your examinations.

>>60175037
Thank based Nippon! I wonder if they already have any efforts on making a searchable interface.

>>60175037
How do I download this

>>60175037
Oh shit, is this for real? Are we saved?

>>60175037
It's all in nip where's the download?

>>60175068
>>60175071
>>60175078
>>60175156
Dunno, I also can't seem to get anything from it? Hopefully someone can manage to get something from it because it seems like a dump but perhaps it's not?

testing...
I'm a stinking robot...

>>60175037
I was wondering how the Japanese would react.
But is this Nyaa and Sukebei, or just Nyaa?

>>60175274
It's both.

>>60175221
It's not a dump. It's just a discussion thread. The links translated as "Part 1", "Part 2", etc. aren't parts of archives - they're just links to earlier threads on the topic.

>>60175274
I think they were just older thread links. Nyaa and Sukebei are dead, if you're talking about what I thought was a backup (which perhaps was not?) than just Nyaa from what I gather. Either way, I can't find any way to download from what I posted, so sorry if it got hopes up, just trying to help.

>>60175357
That blows. Sorry if anyone got their hopes up then.

Not that I have a problem with it but how often do /a/utists come to this board and beg for help?

>>60175473
Every board, not just /a/utists, come to /g/ and beg for help.
/g/ is notorious for being every other board's free tech support.

>>60168470
https://www.ashesofcreation.com/ref/flipperipper/

File: 1493305425310.jpg (46KB, 600x600px) Image search: [Google]

46KB, 600x600px

>>60175473
Anime is something that unites every board anon, of course there's gonna be more /a/nons here when anime is suddenly gone

As a Linux nub would Ubuntu still be the best option if I just want Linux to work? I have had display issues the last two times I tried it.

>>60175886
Install Gentoo instead. Ubuntu can be tricky.

>>60175916
I'd rather not compile everything. Thanks though.

The DB file I have only has up to feb 2016

>>60173586
>Latest seasonal subs are Erased, konosuba, assassination classroom
Ive gone bck in time

File: 1483913497629.gif (3MB, 480x270px) Image search: [Google]

3MB, 480x270px

Not all heroes wear capes.

Thanks, you absolutely wonderful /ga/ys.

>>60175886

Try Linux Mint. KDE flavor works for me.

HOW DO I WATCH MY CHINESE CARTOONS ?

>>60175037
March/April 2017 backup? Holy shit

>>60176113
With VLC :^)

>>60168501
Do sqlite databases work with Mysql or will I have to install Sqlite?

>>60176133
It's not unfortunately

>>60176161
There's probably a way to import them into mysql but that's a lot of trouble comparing to just getting sqlite.

THANK YOU
how temporary is this
can i throw some server $ ur way

love, /a/

Can't we find a closer backup? Why is the owner of nyaa or the admins not providing them?

>>60176261
nyaa is a coward who got scared by the new EU laws and shut everything down without a word.

>>60174165
https://srotonpaga.appspot.com/nyaa/

>>60176261
There's probably someone who runs a program that makes a backup

Hopefully someone comes out with it

>>60174165
source code when

File: Amanda thumbs up.jpg (127KB, 459x573px) Image search: [Google]

127KB, 459x573px

God bless you anons.

>>60173799
I'm looking through these hashes, they only seem to go up to February 2016?

>>60176261
I used to run a scraper on my server that scraped Nyaa and Sukebei, but it stopped running at some point. The files were last modified in October 11, so I'm guessing that's when it stopped adding new shit.

You have a source code, anon? Some other people could continue it

But it would be better if other anons would create a separate one a well, so we will have 2 backups now

>>60176460
Is it usable? the closest we have right now is sept 20 from that anon in this thread

thanks mates

>used nyaa for ages
>never heard of sukebei
what did i miss?

>>60176677
Porn.

>>60176677
porn

>>60176677
Loads of hentai and vns

>>60176689
oh, i'm not really interested in animated porn, just manga/stills/stories
no surprise i didn't run into it, then

I'm going to start scrapping the shit out of my anime sites from now on fuck

>>60176709
When we say "porn" we don't just mean animated hentai. It was doujins, VNs, and H-games too, and 3DPD JAVs if you're into that.

File: 1492545072491.gif (2MB, 400x400px) Image search: [Google]

2MB, 400x400px

>>60176709
>Watches 3DPD porn

>>60176731
hmm, might have found something useful then
>>60176736
try reading to the end of the sentence

>>60176483
Define usable.

Latest ones: https://pastebin.com/n4ndMrqb

>>60176755
Could you upload it here so it could get archived.

>>60176778
I'll have to do it later. Not at home at the moment and the Internet's piss.

If ever nyaa comes back right up because of another maintenance ruse, we need to continue making this backup website incase they throw us out again.

>>60176799
I don't think hope is lost quite yet, we'll have to wait for a statement of that nya guy. but yeah, it's a wake up call for sure

>>60176835
We've had plenty of wake up calls already. That's why I made a script that scrapes Nyaa for magnet links years ago.

File: 1474127002491.png (23KB, 358x255px) Image search: [Google]

23KB, 358x255px

>>60176799
>Domain deactivated
>Maintenance
I don't think so.

>>60176863
They could be moving domains though. They've hidden the backups.

>>60176863
>not deactivating your domain so it can take a break every one in a while

domain lives matter

>>60176894
This.

It'll be back soon, I think they'll use the drama to make shekels once it returns.

>>60176849
>That's why I made a script that scrapes Nyaa for magnet links years ago.
But you didn't bother to keep it running. I guess the wake-up calls we got before weren't enough after all.

>>60176894
Why would they do that without announcing the move?

>>60176912
Well, I didn't bother to check if it was working. Turns out that it wasn't after October.

The project has a few stars on Github so I don't know if anyone else was running it more successfully.

>>60176913
Drama >>60176909

What's the best external drive to start achiving my animus?

I've put it off for too long and now it's too late.

>>60176863
>Nyaa.se
So basically nyaa.ru will be online soon.

>>60176909
I don't fucking care how much shekels they make, I'll give them all my damn shekels.
I just want them back.

>>60176933
I damn hope you're right. Have they done stuff like this before?

>>60176932
Link your github

>>60176947
>not storing your 2D waifus in a ZFS array + GlusterFS

>>60176975
https://github.com/Hamuko/nyaamagnet

>>60173821
https://sukeibei.pantsu
search function doesnt work for some things and brings me to a 502 error
it works when im less specific though

>>60174165
Can you throw us a torrent of the sitedump itself? I want to have a local copy and host it myself if your mirror ever dies

we need a new fucking internet without jews

>>60176947
Use Amazon Cloud Drive and encrypt with rclone, it's stated as unlimited and practically no one has run into limit issues except if you DL/UL too fast or use a shitty UL/DL client.

https://www.reddit.com/r/DataHoarder/comments/54bci8/anyone_got_the_limit_of_amazon_cloud_drive/
>35TB thus far, no issues.
>72TB so far in ACD
>Over 117 TBs fully encrypted here, no word about limit as of yet
>I'm over 230TB on ACD with no problems.

File: 1489470035148.jpg (545KB, 1200x1350px) Image search: [Google]

545KB, 1200x1350px

>>60168470
I've been saying for years since the first TPB fall.
We need to create decentralized magnet link database.

An application you download and then sync up your local copy of the database, then run a web server on localhost to serve a website to navigate.

>>60173799
Made a torrent: magnet:?xt=urn:btih:5dcadde0cae6fe4c386970828fe8ce9a0337b632&dn=nyaa%20sitedump%202016-%3F%3F-%3F%3F

Will seed for the rest of eternity

>>60177774
> Decentralized
Easily clone-and updateable like ipfs or git or such might work.

>>60177834
Yes, but the git can still be taken down.
and ipfs still new and require it's own client and migrating the old content.
However what I'm suggesting is to utilize the already existing bittorrent.
The only way to shut it down it to shutdown the trackers.

>>60171379
>mahkee

>>60177914
>The only way to shut it down it to shutdown the trackers.
which is doable
which is done
which is why this thread is up

>>60177381
>openbittorrent tracker
Does it even work? Check out the one included with the newest HorribleSubs releases.

>>60177984
Not if you decentralize the tracker.

>>60177726
I don't think I'd feel safe storing my loli porn on amazon.

>>60178015
>I don't think I'd feel safe storing my loli porn on amazon.

You upload truecrypt containers, fool

>>60177984
He means all the trackers. Basically, to shut down the DHT/magnet network you would need to kill off all torrent clients in existence, because everybody who runs one contributes resources to its index.

That means killing torrent completely, which is impossible due to the hydra effect. Your only blows can be against individual sites.

>>60178011
which is what was proposed, was it not?

>>60177914
>ipfs still new and require it's own client
It only requires its own client to upload torrents / share links. Existing IPFS files can be viewed in-browser.

>>60178015
That's why I said to encrypt with rclone.

You can wrap it in another layer of encryption if you want.

>>60177914
Bittorrent has massive trouble describing / merging / separating nonlinear collection updates, partial copies etc.

And aren't we looking exactly at a tracker being down?

>>60169962
Patience is a virtue

>>60178057
While still using the bittorrent protocol.

>>60178032
A truly decentralied bittorrent network won't be any better than ed2k with all the fake, bait and broken forever unavailable files

File: bender.jpg (165KB, 1024x768px) Image search: [Google]

165KB, 1024x768px

The only answer is to make our own country with our own laws.

>>60178088
Yes. An IPFS-hosted tracker as a repository of bittorrent magnet links is exactly what we need.

We must got back to the days of getting .rmvb files from limewire and hoping it's not goat porn.

>>60178127
I will only help if there is blackjack and hookers.

>>60178127
What about Liberland?

>>60176778
https://void.cat/d0ab28bc2c406aa88f105c4836f04c97e08a01a9&v
https://void.cat/7be796c2bcc49b3e816c463a2887d63a38b92581&v

>>60178154
Promising, but only once people can actually cross the border into it without being detained by the Croats/Serbs.

File: 875667764.jpg (64KB, 600x600px) Image search: [Google]

64KB, 600x600px

>>60178127
Make Lolis legal.

>>60178132
That's what I'm getting to it.
By doing something like that a small group will have the IPFS trackers, while larger group will use those trackers.

>>60178127
I used to say "if I ever win the lottery I'm moving out to a better country", but nowadays nowhere in the planet is a better country.

I'd pit my imaginary lottery money to your glorious new nation.

>>60178092
Only if it's uncurated and if seeding is unincentivized.

It would actually be pretty easy with today's technology to develop a decentralized tracker that has all the usual benefits of centralized trackers (moderation, accounts, ratios etc.) but runs on top of a p2p network (e.g. blockchain)

>>60178154
Too much freedom.
>>60178175
It's legal.

>>60178192
ISIS started their own nation, I don't see why we can't.
>Country (n.) a nation with its own government, occupying a particular territory.

File: 1492286959517.jpg (619KB, 1500x2133px) Image search: [Google]

619KB, 1500x2133px

>>60178127
>>60178154
>nyaa/tpb/kickass start setting their servers there.
>Suddenly it seems we magically have "extremists" in the area according to the EU
Drones start bombing the servers.

There's no point in acquiring freedom if you cant defend it.

>>60178234
TPTB don't like competition. If you try to start a new nation, you'll unfortunately get your shit kicked in. The only ways I see a "new nation" that anybody would actually want to move to coming into existence without being immediately quashed is via seasteading or via the balkanization of a larger first-world country.

>>60174165
Get a mirror up on ZeroNet

https://zeronet.io

>>60178295
>the balkanization of a larger first-world country.

heh, coming sooner than you may think to Europe

>>60178321
I'm praying that it comes during my lifetime in America.

.pantsu is much better than nothing, but do no one else has a newer db? There must be an autist somewhere with weekly backups of big torrent trackers.

File: 1452262993986.gif (483KB, 250x167px) Image search: [Google]

483KB, 250x167px

Aside from doing the back up would a meguka equivalent for animu be considered made?

File: amazonsupport.png (19KB, 857x156px) Image search: [Google]

19KB, 857x156px

>>60178015
Amazon (US) marketplace sells explicitly lewd loli onaholes and they haven't caught on for a few years now. If they can't even find what's right under their own nose, they'll never find your loli, especially when encrypted. Or it could be they just don't care. Jeff Bezos does come off like a lolicon himself desu.

>>60174165
Someone made a torrent version of the most recent JSON sitedump on https://srotonpaga.appspot.com/nyaa/ merged into a single valid JSON file

>>>/a/156674567

>>60168470
Anon, why would you host it on the public internet and not on a .onion domain? Feds can't get you if you're behind 7 proxies. If you just index magnet hashes and don't provide a tracker, there's nothing they can do.

>>60178015
No one will bother bruteforcing your encrypted stuff for years to check if it is loli porn.

>>60178159
So we went from 15 months to 7. Not bad. This means there is still hope for a more recent backup.

>>60178404
JSON dump is not the most recent anymore.

File: 1487265980191.gif (939KB, 950x1267px) Image search: [Google]

939KB, 950x1267px

Thank you blessed /g/!

This is a reminder to myself that I need to up my game. I had to google way too much shit that should be common knowledge.

>>60178295
Just set up in Bir Tawil. Can call it BitTawil.

>>60169220
So much fucking nostalgia, it almost physically hurts me.

File: venom_asuka_and_rei_miller_by_pfs_kun-dax51ob.png (873KB, 1280x853px) Image search: [Google]

873KB, 1280x853px

>>60178127
>We will forsake our countries. We will leave our motherlands behind us and become one with this earth. We have no nation, no philosophy, no ideology. We go where we're needed, fighting, not for government, but for ourselves. We need no reason to fight. We fight because we are needed. We will be the deterrent for those with no other recourse. We are soldiers without borders, our purpose defined by the era we live in. We will sometimes have to sell ourselves and services. If the times demand it, we'll be revolutionaries, criminals, terrorists. And yes, we may all be headed straight to hell. But what better place for us than this? It's our only home. Our heaven and our hell. This is Outer Heaven.

>>60178355
I have a daily snapshot of the boorus because 2D porn is a big deal, but I stopped caring about anime too soon it seems ;_;

>>60178263
We can run several exit nodes.
Three letter agencies will love us.

>>60178263
In the internet age, information is power, and concealing it is key. Cryptography techniques are among your strongest weapons. Use them wisely.

I'm getting a 502 error when trying to use search on nyaa.pantsu, so it's pretty much useless right now.
Also, which dump is being used there? This one >>60178159 appears to be the most recent (2016-10-11), newer than the previously posted JSON and SQLite ones.

>>60178694
The JSON one is older by about 20-30 days than the sqlite database, but the JSON one has descriptions while the sqlite does not. (It's also more easily grepped, so you don't need fancy front-end software)

>>60178694
>I'm getting a 502 error when trying to use search on nyaa.pantsu, so it's pretty much useless right now.
It's slow, but it still works fine for me.

>>60178694
I've been getting it too, whatever service is running must be shitting itself constantly.

>>60178622
Hiding huge amounts of illegal content is extremely easy thanks to good cryptography. You can hide the nuclear codes in fucking google drive and get away with it. The problem arises when you try to share it with a anonymous public. They need access to to the data.

What about anidex? Is it a good alternative?

Either way thank you /g/, you're doing God's work.

>>60174109
Keine is my waifu

>>60178788
Look at freenet, tor. The crypto and tech is sound, literally the only weakness is bad opsec.

Decentralized, off-the-record encrypted file sharing IS possible, and the only way to get busted is by being retarded or pissing off the FBI enough for them to consider you a major international criminal.

>>60178811
Sure - the only problem is that tor by its very nature is slow, and has a legitimate use that I don't think should be interrupted just so us NEETs can have fap time.

What I'd like to see is something that combines the best features of bitcoin (what's in the blockchain is immutable) with the best features of tor (proper layered anonymization of peer-to-peer traffic) - but Nakamoto Satoshi is gonna stay hidden forever unless he decides to prove his existence with proper signatures, and neither arma or nickm are particularly interested.

>>60178917
And to top it off, arma and nickm know that they'd be subject to FISA, and anyone with enough brains to bang rocks together should be able to figure out that any three-letter agency can blackmail either or both of them to backdoor anything they develop.

>>60178917
>What I'd like to see is something that combines the best features of bitcoin (what's in the blockchain is immutable) with the best features of tor (proper layered anonymization of peer-to-peer traffic) - but Nakamoto Satoshi is gonna stay hidden forever unless he decides to prove his existence with proper signatures, and neither arma or nickm are particularly interested.
I see future in something like blockchain+torrent/DHT+i2p

i2p for encryption and anonymity
torrent/DHT for the heavy lifting
blockchain for state updates

Possibly also something like ipfs or something based on it to manage the actual database, so you don't need to have it inside the blockchain. (Using the blockchain only for moderation and curation, e.g. granting and revoking modification rights)

>>60178966
What about Freenet?

>>60179017
Too slow, bloated and niche to be interesting for anything other than pizza. But sure, you could make a modern protocol based on its ideas

>>60178966
>>60179042
Not to mention torrent, DHT and i2p already exist and i2p already actively advocates torrenting over it instead of the clearnet.

Literally all you need to do is come up with some sort of decentralized database of magnet links and you can plug it into existing tech. The technology to win the censorship war exists, it's just our inability to *use* it that's holding us back.

>>60178966


i2p is dead, and I'm not entirely convinced it's cryptographically secure - tor has at least stood up to the FBI and proven that only bad OPSEC can get you busted. Other than that, you basically said what I said but with fewer and more buzzword-speak words. Congratulations.

Nakamoto Satoshi, arma (Roger Dingledige) and nmathewson (Nick Mathewson; got his nick wrong before) are the only three people who've proven themselves competent to make that software solution.

Mind you, I'd still be looking to run anything like that on burner hardware with a transparent proxy to ensure that all traffic, no matter the source, got properly secured.

>>60179017
If I recall correctly, there's something about its design which makes it very bad for storing large amounts of data on - trying to find it, but not having much luck.

>>60179042
Last I checked, it had the largest network, which is the most important consideration.

>>60179062
No, because congestion factors built-in to the protocol would tend to de-prioritize bulk storage transfers, making it even slower. We need a purpose-built network.

>>60179080
I wasn't saying storing the files themselves, I was suggesting store indexes of magnet links. See >>>/a/156675477

Is it illegal to host a site of magnet links?

>>60179099
That brings you back to the clearnet issue with public torrents; which is especially dangerous for content producers as it would be easy to figure out which IP is responsible for initial seeding of new content.

>>60179108
As illegal as it is to host torrent links, depending on whatever judge you come in front of, in whatever country.

>>60179099
A proper purpose-built network needs to do both.

>>60179108
Under EU rules it is.

Whatever we're doing, we should probably assume it's not civilly legal. It may not be criminal, but it's not allowed openly.

>>60179108
Almost surely, yes. Unless you have a team of lawyers skilled at abusing stupid loopholes, the copyright lobby will have the more powerful arguments.

What matters in a court room, at the end of the day, is the opinion of the judge. If they feel like a database of magnet links is illegal file sharing, it's illegal file sharing.

>>60178952
>any three-letter agency can blackmail either or both of them to backdoor anything they develop

F O S S
O
S
S

Are you guys ready? The file size was 6.5gb
>Started 03-31
>Completed 04-09
All this when computer was on 24/7

Isn't using DDoS against the torrent sites ilegal too?
This is some a-grade hypocrisy right there.

>>60179146
And if it's not, they'll get laws passed to make it illegal.

Nyaa fell because its proprietor wasn't willing to take the risk of jail time. Whoever picks up the torch will have to be willing to go as far as the TPB's owners have.

>>60179196
Or pull a satoshi and have legendary opsec

>>60179183
Well, yes - that's why bitcoin and tor are good examples: Both are well-documented with computer science papers which can be and have been independently verified.

It's why stuff like ACM and USENIX are important, why FreeBSD is as well-documented as it is, and why shrill Linux kids need to learn the importance of the theories behind computer science.

>>60179190
DDoS are illegal, yes - but it's not like someone whose content is in a legal gray-area has a whole lot of ethical high-ground in the eyes of any court or authority. Plus, tracking DDoS' isn't exactly easy.

>>60179196
Sorry, that's utter and complete conjecture, you can't possibly know that - not unless you prove that you're Nyaa or have Nyaa prove that you speak for him. Good luck doing either.

>>60179279
Bitcoin as a technology is impressive, but his levels of OPSEC are godlike.

>>60179279
Nothing Satoshi did was illegal. Devising cryptocurrencies isn't illegal. He could come out tomorrow with no consequences. No one's found out who he is, because no agency with any degree of resources cares to do so.