/nrg/ - Nyaa Replacements General

Friendly reminder of the superior nyaa.si

>>61354530
>Supporting non-open source bullshit

Why are there very little people making PRs ;-;

>>61354559
>supporting non-free bullshit while lying that it's free

>>61354496
is the scrapper working

>>61356204
Technically yes but if nothing gets scraped, it's as good as not working.

https://nyaa.pantsu.cat/view/955578
???

>>61357217
>Scraped From: https://nyaa.si/view/938378
>404 Not Found

why is dev on 502 bad gateway

https://nyaa.pantsu.cat/view/955158
https://nyaa.pantsu.cat/view/955157
there are some violations in live action category

what if upload page add rules block for selected category, and add an option "I think this torrent is appropriate", if uploader select NO, torrent will still be uploaded, but send a message to moderator.

>>61357817
Who the fuck would select no if they want their torrent uploaded in the first page you retard.

>>61354496
>the quad comments thing is getting fixed guise
It's been over a month now since I read that here.

Is the access to nyaa:refactor restricted? I want to make a PR, or do I have to wait for it to be pushed in dev?

Also Miao do you still have plan for this? >>61270187

>>61358419
you can make PR to dev / refactor (do it in refactor) all you want, but akuma or ewhal will have to merge it

>>61358470
So when will akuma become the lead dev?
Ewhal is so slow and unresponsive.

>>61357980
https://www.ted.com/talks/dan_ariely_on_our_buggy_moral_code

Let them sign some moral code, then they will cheat less

>>61358493
he doesn't even want access to dev servers so don't count on it
he already is the lead dev although it's nothing official, as ewhal has been pretty dead the past weeks

>>61358419
Yes im working on it, however if anyone has suggestions for it please let me know.

>>61354496
Pantsu will die just as this thread, enjoy your time before nyaazi supremacy.

>>61354496
REN CHON

>>61354496
How soon is reliable scraping?

Fuck this stupid site war. If it wasn't for the stupid bantz from you guys and them acting like pissy faggots with agendas, both sites could've been working together to create something better than what nyaa was.
This is why we can't have nice things.

>>61363363
>to create something better than what nyaa was.

But that's literally what Pantsu is trying to do.
Both sites have different goals in mind.
.si aims to be the next Nyaatorrents (which is bound to die one day like the late NT did) while Pantsu aims to create a Nyaa replacement anyone can deploy.

>>61363455
>next Nyaatorrents (a stable and convenient stie)
>a Nyaa replacement that even its devs can't deploy properly
ftfy

>>61358419
It's on https://dev.pantsu.cat and you can just do git checkout refactor.
You can make a pr for refactor.
>>61357416
Should be fixed.
>>61356204
Kinda still need to get it whitelisted.
>>61354684
Not a lot left to do for refactor which needs to be completed before we start working on other things.
>>61357506
Removed.
>>61363363
>>61363455
As anon said the whole goal of pantsu is to make something much better than nyaa.se.
Pantsu still has pretty active development overall and we're continuously improving the site.
>>61362209
Hopefully today or tomorrow.

>>61363455
>But that's literally what Pantsu is trying to do.
>>61364451
>As anon said the whole goal of pantsu is to make something much better than nyaa.se.
Yes I know, but the problem is you have no content unless you scrape nyaa.si and they won't let you cause both parties are autistic. You with your bantz and pissing them off and them being retarded dramafags. That's the whole problem all along. If you didn't go overboard with your bantz, you would be scraping them by now.

>>61363455
decentralization is a meme

>>61364520
I actually have something in mind with regarding that.
Probably going to make a separate program that'll use blockchain sqlite db.
Might add in other functionality to make it more useful to regular users.
>>61364499
Well we scraped them just fine until they increased their cf protection level and we should be whitelisted by them soon.
Sukebei is nearly completely user uploaded content.

>>61364540
>Well we scraped them just fine until they increased their cf protection level
Yea, just to fuck with you. Same thing with the HS scraping. And it's all because you triggered them with your bantz. Don't forget, you're dealing with autists here, if you scream at them, they'll scream back and now they'll forever be hostile towards you.
>and we should be whitelisted by them soon.
Until they decide to fuck with you again.

File: aqua crying.gif (2MB, 400x400px) Image search: [Google]

2MB, 400x400px

PANTSU IS DOWN

>>61364728
Had some issues with ES.
Should be fixed.

>>61364720
Unfoundedly repeating over and over that they can't do anything against scraping them is in no way a bant - it's just a pure self-complacent stupidity.

>>61365053
I'm talking about very early on when nyaa.si just launched and both sites were shitposting each other in these threads every single day.

>>61365098
Yeah, I remember that there was a rich and diverse shitflinging, but that statement was like a cornerstone of pantsu side beliefs that they can do it with absolute impunity. And though the HS spam cooled down some hot heads, it wasn't until recently when they finally began to understand how strongly pantsu depends on nyaa.si content and their goodwill allowing to use it.

>>61365339
Pantsudev was retarded but nyaa.si is to blame too for being so autistic about it. Basically both sides are childish and won't grow up. They're both at fault.

>>61354496
are all of these nyaa's still plying for free parking on other trackers or are they tracking what they index finally?

>>61364540
blockchaining is a meme

>>61365477
Totally agreed, but what do you want when anime is for manchildren by design. When nyaa.se owner finally grew up, he just shut down his site.

what does cartel mean?

>>61365634
>wiped out content created by other people for years
>grew up
Funny joke.

It's over, the cartel won.

whats the point of this general just use nyaa.si -_-

>>61367038
>centralising

>>61365785
Actually competent people.

>>61367255
>>61365785
samefag

Daily reminder of the superior nyaa.si

File: pic.png (49KB, 1920x936px) Image search: [Google]

49KB, 1920x936px

>>61368990
but can it do THIS
https://boards.pantsu.cat

>>61369170
run trash garbage meguca? yea so can a 6 year old

>>61369170
I thought the plan was to create a textboard.

>>61369546
yeah agree pls do textbox

>>61354559
Isn't it literally on github?

>>61369170
yeeeeaaaahhh, another place for shitposting!!

>>61369170
Finally, that means these threads can cease existing and you can move to your own board pantsufags

>>61369669
no it's part of decentralization

what's the bump limit for the boards?

The nyaapantsu app is finally in fdroid.
>>61370041
No clue.
>>61369574
>>61369546
Yeah just haven't changed any settings yet.

>>61369170
>>61370280
I'll check it out after it becomes a textboard.

>open boards.pantsu.cat
>see lewd korean drawings

guess its not SFW :/

File: 2017-07-14-084035_873x810_scrot.png (875KB, 873x810px) Image search: [Google]

875KB, 873x810px

I kinda wish the user styles looked and worked better.

>One tumblr post and the board dies...

More dmca's have recently been sent by Comeso and DMM, i haven't replied to them but they are available at https://transparency.pantsu.cat/

>>61370633
>>61370789
Don't bother with it until it becomes a textboard like was originally planned.
>>61371314
Don't reply to them, it's getting pretty cringe worthy.

>>61370280
so we'll have to fork the board software, rip out images, redo some of the css themes, and probably some userscript for user customization like 4chanX

>eromanga being posted on nyaa
>again
When will you guys sort this out.

https://boards.pantsu.cat
https seems like broken
NET::ERR_CERT_COMMON_NAME_INVALID

>>61370280
>>61371314
Good job on the refine button on dev.pantsu.cat but it's still using # to # days old instead of DATE to DATE released. Fix please.

File: Capture.png (89KB, 1067x720px) Image search: [Google]

89KB, 1067x720px

>>61371909
I get 404 loli not found

>>61371909
>>61371945
Fixed, sorry.

did ewhal go to sleep

>>61354496
>>61364540
Any progress on the AniDB integration? Is the issue with the torrent contents fixed?

You could use proxies, or just make it forward the captcha when it fails. What happens if you just scrape every 10 minutes or so?

>>61372872
Probably.
It's almost 3 in the morning where he lives.

>>61373056
what a retard

>>61373072
Easy there, sport.
Sure, ewhal may be a bit slow, but a retard? That's taking it too far.

>>61371314
"Hello <NAME>,
Neither the Republic of Iraq nor the Kurdistan Region is a participant in the Berne Convention or any other treaty on copyright with the United States as of 2017-07-14.
Best Regards,
Miao"
For best results, have someone translate it into Kurdish and/or Arabic. You're not lying, since you've never said Nyaa is operating out of Iraq/Iraqi Kurdistan (which would probably be quite easy to solve however, just ask someone to set up a non-profit there and have them own the DNS)

>>61373112
>oh yeah there's that thing that you want to fix but need ftp access for
>yeah i'm gonna give you ftp access to you
And then he goes to sleep two hours later

>>61373238
On second thought, you should write Democratic Federation of Northern Syria (Rojava), since Iraq is a member of the WIPO.

How do these companies get the IP behind cloudflare? do they just contact cloudflare about it? I was wondering this when pantsu was still behind cloudflare but never bothered to ask.

>>61373631
We are not behind cloudflare anymore.

>>61373631
Also even if we used cloudflare, cloudflare sends the DMCA notices to the providers.

>>61373660
>when pantsu was still behind cloudflare
I understand that but I was just wondering what their tactic was.

pantsu is never going to be good unless it has bots combing the big sub groups releases

>>61373991
>the big sub groups

Fansubbing has been dead for years.
What are you talking about?

>>61373991
Then code one. Community scrapers would be cool, since you can't block them.

>>61374219
I wish I meant only fansubs. There are some still, like Asenshi, that should be up on the site as quickly as possible, but the big and obvious one is Horriblesubs. It takes too long right now for them to go up.

>>61374253
>but the big and obvious one is Horriblesubs

Horriblesubs is not a sub group though.
Ironically they scrape everything themselves.

>>61374298
Is HS purposefully blocking pantsu or is it just some anti-spam filter?

>>61374298
They're a source for subs, which is all I really meant

>>61374313
>HS is muh cartel
>They don't like pantsu for multiple reasons
Yes, they block it on purpose since day one anon.

>>61374313
they spammed the scraper filling pantsu with 50+ pages of spam results

>>61374367
What a bunch of assholes. Alright, I'll just be a human scraper, then, since I have little to no life. Gonna go put up everything that's missing right now

>>61374359
Can't you just have users participate in the botnet? Even easier, just use Tor exit nodes/random proxy lists.
>>61374367
What did they spam it with? Junk data?
>>61374407
Easier:
https://torrentproject.se/?t=HorribleSubs&orderby=latest
https://www.tokyotosho.info/rss.php?submitter=hs&entries=750&cat=1
Why use a proxy when you can have someone else be your proxy~

>>61374492
Fake results telling people to go to kissanime.ru there was a picture posted ages ago but that was a month or two ago so maybe another anon has one

>>61374544
Can't you download the torrent and check if it contains HorribleSubs in the title? Or just use a proxy, you can find large lists of them and just pick a random one until you get a result.

To protect against spam, you could scrape all the RSS feeds and only get the union of them.

TorrentProject HS RSS - https://torrentproject.se/rss/HorribleSubs/
Proxy list - http://www.proxy-listen.de/Proxy/Proxyliste.html

What is an acceptable delay? 10 minutes?

>>61374633
The current delay is often more than a day, so that would be more than fine

>>61374698
That's neat

>>61374698
I like the look of that anon but how much javascript does it use?

>>61374633
You should ask ewhal that as he is in charge of the scraper, but I hate how slow he is when people have suggestions/questions.

I know he is not online all day and I'm sure he's got a life of his own, but even when he is on it can take hours before he responds.

>>61356204
No. I just checked, and HS is not updated. I now use .si.

>>61374719
I don't plan on making it work without because i do not have the skill to make it work without
Maybe someone will do it afterward? Hopefully.

File: 2.png (2MB, 960x540px) Image search: [Google]

2MB, 960x540px

>>61374544
>>61374367
>>61374359
What a bunch of assholes. Can't pantsu just scrap it from some other domain/source so the cartel has a harder time to block it?

>>61374721
It's because he's an aussie so he's asleep when all the questions are being asked

>>61374741
I know he lives in Australia.
Even when accounting for that he is slow as shit.

>>61372144
Have you range banned some IPs? I can't access the site, when I write the address in new tab and press enter nothing happens, it loads for a sec but then it remains on new tab. It happens only with boards subdomain and with dev subdomain.
I can access nyaa, sukebei, status and transparency subdomains like always.

>>61374367
The scraper was shit to begin with

>>61370280
are the settings on github? I would like to see if there is a bump limit like >>61370041

Why does tor browser get out of CF captcha challenge but torsocks curl doesn't?

http://x4torrentjjjjuxy.onion/rss/HorribleSubs/ tor compatible URL for HS

>>61374698
>>61374731
This is pointless. Don't add javascript just to add shit like this. No one is asking for this.

>>61367255
>>61368587
for real though.
it obviously doesn't have to do with drugs

>>61374810
I'm almost sure that is related to your computer/browser, however we haven't blocked any ip's at all.

>>61375623
Do you have any idea why I can access page X with Tor Browser fine but not via torsocks -i curl? I send the same UA and everything.
Is nyaa.tracker.wf an open tracker?

>>61375724
Thats weird, but we have our own tor addresses if ya wondering, just need to set it up for the boards as well.
Nyaa-TOR: uvjje43rnr7fh4tc.onion
Sukebei-TOR: 2jv2t3infp7peuoo.onion

nyaa.tracker.wf is from nyaa.si i believe, i don't think its an open tracker.

Why is it that nyaa.si torrents barely have any seeders?

>>61375818
Yes, but for scraping HorribleKikes.
Good. So if the infohash is present at the nyaa tracker, it's official?
Then you can just scrape the torrentproject onion rss. Or would they bother making, publishing, and announcing fake torrents?

>>61375496
It's definitely useful for long torrent titles to know how it'll be cropped, and where it will cut
If your torrent name is long enough to be on two lines, and it often is, you want to make sure the most important informations are on the first lines

>>61375893
>>61374698
Better idea: move the name field so it's the same size as the torrent. You could even put the category choose dropdown there and format it so it looks like a torrent (accuracy depends on if js is enabled)
[language dropdown] [category dropdown] [name field] [12.6MiB] 0 0 0 [current date]

>>61375496
>no javascript
>no HorribleSubs
>no stability
It's like pantsufags literally orgasm when they lack something. Fucking masochists.

>>61375970
Even better idea: stop using shitty bold typeface for torrent names that eats up half of the available space.

>>61376046
This so much. Bold font is retarded.

Managed to get a very ghetto script working to fetch HS RSS with proxies.
https://pastebin.com/mpRMf8y5 - horriblesubs RSS, updated every 10 minutes, sends wrong mime type
(cucked by the spam filter)

>>61376706
You should probably post that in #nyaapantsu-dev.
ewhal seems to respond faster when you post shit on IRC.

>>61376785
Post it there then, Rizon doesn't allow Tor.

>>61376706
>ghetto script
that's an interesting way of putting it

>>61376706
Bus is it spammable?

>>61376830
It shuffles a txt list of proxies, does some string parsing, then uploads it to ipfs
>>61376863
They can spam their own RSS, but then everyone using RSS will suffer. It rotates between some proxies I found. You can validate the torrents by checking if they're uploaded on nyaa.si, or by checking if they're tracked on nyaa's tracker.

>>61376891
I doubt they would care if anyone else suffered.
(desu they wouldn't give a single shit)

>>61376934
> desu
shait im having a seizure already, that wasn't supposed to go there.

>>61376891
but when they spammed the RSS before they spammed only the everything RSS because nobody uses it without it only for certain anime so if it just scrapes everything then it the RSS scraper that will most likely be the only one affected.

>>61376962
hownew.ru

>>61376962
t.b.h(without dots) is filtered to desu

>>61376934
>>61376962
Now that's just shitposting, I don't think "they don't care if anyone else suffered"

>>61376934
>>61376964
Should I get the front page instead? You can parse out the magnet links with regex or something.

Do you want the script? It might be a good idea to not make the proxylist used public at least.

>>61376983
that explains a lot :^) thx, thought i was having some brain issues or something.

>>61377040
But you are.

>>61376985
That's just a self-conceit - pantsufags unironically think their shitsite is this important.

>>61377040
Holy fuck how new are you?

>>61377040
When they spammed the RSS, did they do so by limiting it to your IP or everyone? Were the magnet links valid?

>>61377125
everyone, i think magnet links were recognized by client but not valid so as if you clicked on it it would be as if there were no seeders

>>61376985
I'm pretty sure they wouldn't care, no matter what they do they are used a lot so its not like it would make a difference to their reputation, might even get them some extra free advertising points if they spammed everything. Anyway i pretty much hate them like i said before and they can fuck off for all i care. >>61377062
Probably.
>>61376991
They could most likely also spam there i suppose, but it would probably be a good idea, anyway ill inform Pantsudev, or you can tell him on IRC too.
>>61377117
Pretty new, as in, i have known 4chan for quite a long time but i have only used it because of Nyaapantsu.
>>61377125
Its probably better to ask Pantsudev instead since im not sure but i believe it was everyone. Not sure about the hashes.

>>61377154
Can't they just check with a tracker before using them then?

>>61377163
Rizon blocks Tor, no?

>>61377163
Why not scrape nyaa.si then?

File: 1497248130376.png (249KB, 583x440px) Image search: [Google]

249KB, 583x440px

>>61377205

>>61377212
What did he mean by this?

>>61377163
>i have known 4chan for quite a long time but i have only used it because of Nyaapantsu.

Off to Reddit with you.

>>61377205
Yeah, we all remember how ewhal assured they can't do anything against it.

>>61377311
What did they do? Why not scrape tokyotosho?

>>61377181
Don't know, never tried it.
>>61377205
I'd prefer if we didn't scrape anything at all, sure there would be the problem with horriblesubs but id prefer to just replace them with a new group that im going to make that ill talk about another time when i have things more planned out.
Anyway scraping nyaa.si has advantages and disadvantages.
1- If they suddently get mad at us we can't do anything about it
2- We get quite a bit of content.
3- Uploaders don't have to bother uploading to pantsu.cat if they upload to nyaa.si
4- If they don't upload to pantsu it pretty much just makes us an index, and makes us have to rely on another site. Id rather just have the uploaders themselves upload to both and not rely on any other site at all.
>>61377273
Never been to Reddit either :^)

>>61377254
We call that "el beso del payaso", that is "the clown's kiss".

>>61377456
>1- If they suddently get mad at us we can't do anything about it
You can use proxies.
>4- If they don't upload to pantsu it pretty much just makes us an index, and makes us have to rely on another site. Id rather just have the uploaders themselves upload to both and not rely on any other site at all.
You can use it to filter only for certain release groups.

Why not tokyotosho? It's trivial to scrape the HS index (horriblesubs.info/lib/latest.php) instead of the RSS, they're not going to spam themselves.

HS just rips from CR. What would be interesting would be a script that downloads HS torrents, demuxes the .ass file, and generates a torrent with only the .ass file to use with raws.

>>61377456
It's idiotic not to have HS. If the long term plan is not to get them consistently on the site I will just switch to nyaa.si. They make up the vast majority of files each week.

>>61377516
Even HS themselves recommended pantsu audience to use kissanime instead.

>>61377516
Like i said id prefer to replace them with a new group that releases more or less as fast as them. If i can't do it or at the very least while i can't do it i suppose its alright to have their content scraped to nyaapantsu.

>>61377592
Why?

>>61377592
That's just a waste of effort. You'd be starting a new group for the sole purpose of having two scraped versions of shows, and that really makes no sense.

>>61377500
Yeah i suppose scraping certain groups would be nice, however i'd still prefer them uploading directly on nyaapantsu instead. Could do something similar to what you suggested about CR, but its still on hold for now.

>>61377622
Not really a waste of effort, and obviously it won't be to just the same exact thing, its supposed to better. One of the features could be have someone or a few people fix translation issues and i want suggestions on what could be improved as well.

>>61375869
Piracy is dead, buy Netflix

>>61377592
>>61377631
If you have chapters you'll be infinitely better than HS.

>>61377698
>>61377738
agreed simply adding chapters would be enough

>>61377631
This should work:
>install deluge
>add plugin "execute"
>make directory /subtitles/
>create following script

[ ${2: : 14} = "[HorribleSubs]" ] && [ ${2: -3} = mkv ] && ffmpeg -i $3/$2 -c:s copy -f ass /subtitles/${2: : -11}.ass && rm $3/$2
ipfs publish -k subtitles $(ipfs add -Q -r /subtitles/)

>use it as "upon torrent complete"
>add as RSS autodl the 720p RSS
(it's insanity to use torrents for this, they're like 30kb)
I unfortunately don't own a VPN so I can't try it out.

>https://boards.pantsu.cat/pantsu/
Hey now that you guys have your own board can you fuck off /g/? Thanks.

>>61373660
>dig +short NS pantsu.cat
>nina.ns.cloudflare.com.
>rodney.ns.cloudflare.com.
Cloudflare NS
>dig +short A nyaa.pantsu.cat
>104.27.146.235
>104.27.147.235
Cloudflare IPs

Hello???

>>61378058
Accidentally activated cloudflare sorry.
We moved to cloudflare dns again since we don't have our dns servers yet.

>>61377738
>>61377768
Would people still use it if they were missing for EP01 of each series? It would be trivial to manually find the image used before commercial breaks and use that for chapters.

>>61378206
It would usually be a fade out somewhere midway in the episode

>>61378225
But they usually have a title card you can scan for. Or is it even at the exact same time?

>>61377163
>>61377456
"lol calm down senpai" x3
Content is content, if you have to scrape every single little tracker that is having content uploaded, then so be it... It doesn't really matter if pantsu seems more like just an index by then. Why? Because (and I'm allowing myself to be a little optimistic here, but you did that too) if the local client, stability, distribution, and aniDB integration end up working out, then what pantsu offers will vastly make it worth it, and it will totally be something better than a nyaa.se replacement... It doesn't really matter if it ends up having just a minority of things uploaded directly, it should still aim that way and even add some others scraped sites to it list. Because the important thing is the content and its availability, and if you follow that path and it -somehow- ends up working out, then you can focus on things much more important like augmenting (and maybe even securing) the lifespan of torrents, giving a hand to the whole anime/manga/music/etc. communities, and maybe even revitalizing some of them (like the fansubbing community, or some regional anime communities that were dimmed in the last years)...
Are you gonna lose all of that from sight, just to encourage a few uploaders to use more than one site?? Sorry, but that doesn't make any sense... Even though I totally understand you being mad at some assholes, that is no reason to deprive pantsu of a kawaii future. It's enough already with how little chances we have of achieving all that... Hope & dreams, my man...

>>61378371
All accurate

>>61378371
This. Tokyotosho is a great website despite being 99.9% scraped content. If aniDB integration works out, you could make something like popcorn time.

File: file.png (196KB, 545x543px) Image search: [Google]

196KB, 545x543px

fonts looks so fucking ugly compared to nyaa.si

>>61378563
Nyaa.si's whole ui is revolting. I can't bring myself to use it, I hate looking at it

>>61378563
Agree to disagree

>>61378371
dis preacher man have all a di truth inna his words BOMBOKLAT

>>61378371
I suppose you are right in a certain way, im just giving my opinion about it also, what you are saying does make sense and could in the long term work for nyaapantsu better than my idea, but still, i don't really look at nyaapantsu has having little chances of achieving a kawaii future, to be completely honest i believe it has a fair amount of chances, maybe not in the short run but im sure we can make this all work out in the long run. Server upgrades, new features, community, etc will certainly help with bringing a bright future to nyaapantsu, i just hate the fact of having to rely on other sites to get our content, its not that i hate nyaa.si, each of us is following our own path. Also i do have a few ideas, maybe like rewards in exchange for seeding old torrents or maybe private seedboxes that automaticly start seeding old torrents that are loosing its popularity. (or both)
I welcome any idea or suggestion for this, me and everyone in the nyaapantsu staff will do their best.

>>61378670
No, IPFS is better for that.
Run a script that automatically extracts subtitles from all major release groups, see >>61377907, and make it available over HTTP and IPFS. Then use the aniDB integration to automatically tag every single anime torrent, so you can browse them instead of searching. These two would be vast improvements to the state of the site. One is trivial to implement, the other one is marginally harder but still easy (if you have all the torrent files)

>>61378670
Seedboxes for old torrents is a bad idea. Better to spend those resources on hashing them and uploading them to IPFS. Or persuade the aniDB devs to include IPFS hashes among crc32, md5, sha2. IPFS in general has a longer retention rate, since two copies of the same file always has the same hash, and you can seed your entire anime hard drive without keeping the folder structures.

>>61378670
me again.
That second idea... I will mention something I said a lot of threads ago: It would work better if instead of seedboxes being guided by popularity, they were focused on a couple groups with VASTLY proven quality, specially already inactive ones (because their content may be a little harder to get and secure otherwise). Then, if the process, stability, and expenses of it all is working well; you start adding other releasers to the program, one by one, and keep it going for as long as it is possible. A well planned project, you know...

>>61379115
I have no clue of how to set up IPFS, though. So if everyone thinks it would be a better way...

>>61379115
Won't most groups have XDCC bots? An ambitious project would be to write some program that watches some thousand torrents and dynamically seeds from XDCC.
>>61379141
You don't need to set it up, the binary is statically linked. You download it, then run

ipfs init

to generate keys. What do you want to do with it?

>>61379395
Also, you can ask the community to run some script that automatically pins (downloads and keeps seeding) some fraction of the nyaapantsu approved endangered torrents.

>>61378814
>browsing torrents
I didn't even know that was something I wanted until you mentioned it.

>>61379395
>Won't most groups have XDCC bots?
Not really, most groups handle different ways of trying to secure their content: some use XDCC, others upload to private trackers too, and others save copies and reseed on request; but not all of them do something about, and I think their content is actually important. For example, a button, two personal favourites: kiwamin's Kagura, and the russians Salender. There are a lot of music and manga releasers in this condition, too...

File: 1473143646137.png (605KB, 960x520px) Image search: [Google]

605KB, 960x520px

>>61379505
You could also build something like popcorn time for anime.
>inb4 anime tab
It's unfinished and will be for a very long time.
>>61379536
>and others save copies and reseed on request
Why don't they just leave it seeding all the time?

>>61379561
I was considering doing something like popcorntime + taiga for the local client.
That'd encourage users to adopt it and ensure the db has a ton of copies for it.
Our mobile app already uses the popcorntime library for streaming support.

Well, at least we have ideas... :')

>>61379592
No, add AniDB support on the server and then have the client interface with the server.

Is it illegal to distribute subtitles (subtitles only) for anime?

>>61379708
That's the plan but I wouldn't mind expanding the functionality to increase how many people use it to ensure that the dbs are never lost.
>>61379738
Not that I know of.

>>61379561
>Why don't they just leave it seeding all the time?
I don't know!!!!... ( -_-)

What's the official pantsu tracker address?
udp://tracker.doko.moe:6969?

Please get seasonal anime faster.
I check panstu first, but it's hard to not get it elsewhere if they have it.

>>61379998
Yep. The first and most important thing is content.

Which RSS feed has the fastest HS releases?

>>61377163
>Anyway i pretty much hate them like i said before and they can fuck off for all i care
Keep holding that grudge as well as admitting it publically is just asking for them to fuck around with you. Stop saying stupid shit when you're tripfagging, you're going to bring more trouble to the thread and site. Grow the fuck up already, since you know they're not going to, you have to be the better man.

>>61378371
This guy gets it. This is pantsudev's vision. This is what pantsu is sopposed to be doing all along. Don't fuck it up because you're mad at some autists miao. >>61378670

>>61379998
>>61380034
It's not just seasonal anime. Pantsu is lacking alot of content on nyaa. I dunno where miao gets the idea that it's not. If you stop scraping other sites, you're just going to lose more users.

>>61379953
Yes
>>61380815
>>61379998
>>61380843
Well I contacted nyaa.si about whitelisting the scraper in cf.
>>61380163
The horriblesubs.info one.

>>61380889
>Well I contacted nyaa.si about whitelisting the scraper in cf.
That seems unlikely to work

>>61380901
They said they'd do it if we put "scraped from" on all torrents that we scrape including anidex.

>>61380901
baby steps

>>61380761
>is just asking for them to fuck around with you
That's the whole plan - to pass the buck to HS for not being presented at pantsu. They can't directly forbid their releases or overtly refuse to try scraping them - that'd be too much even for most autistic pantsutards. But to make HS do something that'd effectively achieve this goal and then just blame them for their evilness sounds like a perfect psy op.

>>61380920
Why anidex too? Are the admins of .si the same admins from anidex? What's with the collusion?

>>61380889
Just use proxies to scrape.

>>61380941
They're just being dicks to be honest.

>>61380920
That's a stupid caveat, but it's clearly your decision. There are other ways to consistently scrape HS

>>61380941
Because they don't try to promote only their site like this, but rather teach pantsu some courtesy common for the pirate community.

File: 1498730385124.png (208KB, 298x311px) Image search: [Google]

208KB, 298x311px

>>61381005

>>61381005
While I agree that there should be at the very least a scrapper's bot user and in the best circumstances links to the scrapped content, I think .si request to put also Anidex links is stupid and kind of saying "fuck you".
>teach pantsu some courtesy common for the pirate community.
yeah sure... Don't be a hypocrite.

That being said, I think both .si and Pantsu should link to each other, maybe something like "friend sites" or some old school shit like that.

>>61380941
>>61380985
>>61380952
I've been considering using proxies + captcha bypassing service to scrape nyaa.si but really it's all a pain to do.
CF actively flags public proxies as well.

>>61380985
Lack of HS isn't the main issue - there are many more different releasers who don't and won't upload to pantsu directly.

>>61381072
I don't think it's a hypocrisy to acknowledge their much deeper than pantsu newbies' understanding of the scene and its norms regarding credits. And their zero tolerance to racism only approves their moral high ground.

>>61381232
Please stop baiting, there aren't enough people in this thread

>>61381232
You can do better than this, shitposter-kun.

>And their zero tolerance to racism only approves their moral high ground.
what did he mean by this

>>61381077
Use CGI proxies. Google for "Powered By Glype" with quotes or search for CGI proxy list. I have a (very, very, extremely ghetto) shell script you can use, you want me to upload it anywhere?

>>61381357
Yeah sure that'd be good.
Thank you anon~

>>61380920
>They said they'd do it if we put "scraped from" on all torrents that we scrape including anidex
Yeah no, fuck that. They're just trying to be dicks about it.

>>61380985
This >>61381082
You can get HS releases from the HS sites itself, no problem. It's the content that's being uploaded to nyaa.si and nowhere else that pantsu is lacking.
Even tokyotosho and anidex are lacking stuff that is only uploaded to nyaa.si. The only way to get it is to scrape nyaa.si or ask the uploaders directly to upload on pantsu. That or find some way to consolidate DBs with other tracker sites so all uploads to any site can be backed up.

>>61381366
proxylist - my.mixtape.moe/uqerkp
script.sh - my.mixtape.moe/iaakfo.sh
getting new proxies is easy but cloudflare probably won't care so the only obstacle is if they manually blacklist the ip
saves it to rss.html in current directory

>>61381379
>trying to mask the lack of own uploaders with foreign content
>not being dicks

>>61381454
Scrape nyaa.si, or scrape one of the trackers they use. You can filter for some anime tags on torrentproject.se, they allow tor scraping.

>>61381464
>still pushing this site war bullshit
It's like everyone forgot what happened to .se and instead of working together, both sites are fighting each other. This is why we can't have nice things.

>>61381464
These are sites literally designed around large numbers of people illegally downloading the work of others. I, personally, am not concerned about the pseudo-ownership nyaa.si claims over these torrents.

>>61381545
It's not about the ownership of torrents - no one claims it. It's about paying as little respect to the work of others as to put a small reference to the site which contents some other site uses thoroughly and extensively. No wonder that immature pantsufags really can't grab this simple concept that's a common sense for more socialized people.

File: hs.png (35KB, 1497x816px) Image search: [Google]

35KB, 1497x816px

>>61381645
That's why they make sure and note somewhere on nyaa.si where they scraped the sub from originally, right?

>>61381670
Nyaa.si doesn't scrape anything, it's HS themselves who upload this. At least address your claim to them and not nyaa.si if you want to make it look valid.

You guys could just use nyaa.si if you want seasonal anime so badly

>>61381898
>implying one could use pantsu if he wants BDs

I've managed to get a script working which downloads HS torrents from RSS, demuxes subtitles, then throws them away. If it works consistently by tomorrow I'll upload the folder to IPFS and try to bulk import torrents.

>>61382040
>demuxes subtitles, then throws them away.
w-why?

>>61382054
Because they're garbage anyway?

>>61382117
But what's the point of getting rid of them? Raws are already easily attainable.

File: font.png (249KB, 778x594px) Image search: [Google]

249KB, 778x594px

>>61378563
Try installing the Noto fonts.

>>61382040
why go through all that effort when you can already turn off softsubs

>>61382282
try shooting yourself

>>61382337
please give me an example of how to do it

File: 1498610339806.jpg (61KB, 1024x669px) Image search: [Google]

61KB, 1024x669px

>>61382352
begone with your shitty mascot

>>61382040
>>61382147
This. If you're dling HS for their raws, you might as well use actual nip tv raws, since they tend to contain end cards that certain HS raws remove. And by HS I obviously mean CR etc.
The better thing would be the reverse, get the subtitles from HS so you have something to edit off of. Although this will have problems of it's own depending on how accurate the subs are in the first place and might require and entire rewrite, which you're better off just doing from scratch instead.

>>61380889
>>61380920
>>61381366
So how long until the scraper gets whitelisted? or how long until you get the CGI proxy scraping implemented?

>>61381898
Except they're missing seasonal shit too

>>61354530
Unfortunately true. Solve your dupes issues already.

File: 1499488152711.png (257KB, 501x239px) Image search: [Google]

257KB, 501x239px

Someone tl;dr me why it's so hard to scrape shit from nyaa.si.

Can't you just fetch the frontpage once in a random while from 3-4 different IPs on a rotation, then upload to pantsu after a random delay? How is that detectable? Assuming you copy useragent and save tracking cookies it would look any different from a regular user browsing the site.

>>61386198
We need more information than just the frontpage.
Nyaa.si doesn't have a scraping api that's similar to pantsu where it displays the json of x number of torrents that you request e.g https://nyaa.pantsu.cat/api
We currently have to scrape the first page for ids then an individual request for each and every torrent.
So for 50 torrents it's 51 requests.
The increased CF protection also means that CF is super happy to flag the ip and constantly give you captcha.
Also finding working unflagged proxies is a pain since CF also scrapes the internet for open proxies.
An anon may have solved the problem for us though with his scripts.
>>61383491
Hopefully tomorrow.
>>61381455
Thank you anon~

>>61386283
Weren't they supposed to whitelist you because you added the "scraped from" text?

>>61386283
>We need more information than just the frontpage.

Like what? Frontpage has the name, the date and the magnet link.

>>61386510
uploader name, website link, description

>>61382147
>>61382313
>>61382520
No, I'm throwing away the video.

>>61386283
Why not use a proxy for your proxies? Web.archive.org gets a free card for nearly anything, just have them scrape it. You could also scrape something else which in turn scrapes nyaa.si, such as tokyotosho (description is visible on first page). Consider some automatic description generation. If a large fraction is HS, you could just autofill "#[email protected] Join us in our IRC channel for XDCC bots and discussion of your favorite ANIMES. Please leave a message / notify us if you discover a video corruption issue. Thanks." "http://www.horriblesubs.info" for each trusted torrent starting with [HorribleSubs].

>>61387350
I don't think TT scrapes nyaa.si, it doesn't have all the torrents.

>>61387411
The fair majority. If you scrape HS from their website, then get what you can from TT and anidex, then you can make much fewer requests to nyaa.si.

ipfs.io/ipns/h.allsubs.ru
(It gets all the latest HS torrents, but it doesn't have any old ones)

>>61387596
There's still a few uploaders only uploading to nyaa.si, not even TT and anidex have them.

>>61387706
Yes, but if you decrease the request rate by 70% you decrease the proxy burn rate by 90+%

Just as a side note... I found a couple chink releasers that use and recommend pantsu...
But that is no excuse to stop scraping some other sites, Mikolaj-senpai... :)

How can the chink rippers be faster than raws groups?

>>61387935
Based chinks.

>>61387935
Asians love Pantsu, sukebei is 90% them

File: screenshot7.png (6KB, 503x139px) Image search: [Google]

6KB, 503x139px

how do I magnet RSS? ´ω｀

>>61387987
the chinks are the raws groups
pls link me some chinks

File: Capture.jpg (21KB, 517x150px) Image search: [Google]

21KB, 517x150px

>>61389355
I get that same error message, looking more closely though it seems some torrents only have magnet links available, and no torrent file, even when they display a button to download torrent file. So RSS won't work with these.
I got this message with the 720p release of Centaur no Nayami by HS, so I guess there are some issues with torrent files in general. Is there a way to set up RSS reliably with magnet links?

>>61389487
use the + new subscription to add the RSS page

>>61389645
Is that on the latest update of qbittorent? I'm still on 3.3.11. The + new sub button is there, it's what I've always used to add rss feeds

>>61389487
check the archives, someone posted a magnet rss a few threads back, i think it had &magnet in there or something

>>61389701
Alright, I'll give it a look and see what I can find. I'll post it up here if I find it

>>61389719
>>61389355
Alright, I managet to get it. Take your RSS url with whatever filters you want to use, say :
https://nyaa.pantsu.cat/feed?c=_&s=0&limit=50&userID=0&q=centaur+no+nayami+horrible

And add "/magnet" after where it says feed. Example would then look like this:
https://nyaa.pantsu.cat/feed/magnet?c=_&s=0&limit=50&userID=0&q=centaur+no+nayami+horrible

It seems to work for creating an RSS feed with the magnet links, but qBittorent still won't download them giving me the same error as before.

>>61389832
The exact same one, with "pantsu.cat/download/XXX"? THen you have the same rrs probaby

>found out the hs scraper and subtitle extractor wasn't actually downloading any torrents
BRAVO
If anyone want loose subtitles, https://pastebin.com/tcDXtr8Q (spam filter REALLY doesn't like ipfs links)

Thanks to Vocaloids, Japan is producing more musical compositions by itself than the sum of the whole world outside of Japan since 2007.

I want to launch a website that allow to anonymously submit&review scientific articles. that could result
the same break-through as the Vocaloids resulted in the Japanese music industry. We will produce more scientific articles by itself than the sum of the whole world outside of Japan.

Although I am going to launch it in Japanese and other East-Asian languages, but if Westerners have interests too, you could join to the project.

Thoughts?

>>61390148
>I want to launch a website that allow to anonymously submit&review scientific articles
So like sci-hub?

File: 1.jpg (6KB, 213x237px) Image search: [Google]

6KB, 213x237px

>61390156

It will guarantee all useful functions that Sci-Hub does, but I need a Vocaloid and Niconico, not a Sci-Hub or libgen

>>61390156
I think he meant something more like a board or booru

I would love to shitpost articles on how diamond is the hardest metal known to man.

I need foreigners to join the project. if Japan will produce more scientific articles by itself than the sum of the whole world outside of Japan in, nobody can stop us anymore and the world will be destructed. Help!

>>61390453
beg for hosting on pantsu or your project can gtfo

>>61390743
don't bully him pls

I'm trying to change my e-mail but no mail has been sent to it yet, is it broken?

>>61390767
I want him to do the thing already

Is ewhal ded again

Help! (´･ω･`)

>>61390743
>beg for hosting on pantsu

Hm, If you join to this project, okay, Why not?

I need someone who can code

>>61391252
you're in the wrong place buddy

>>61390453
Just find proper translators, then they will spread the project themselves (after they get enough insight) and the side communities will build on that, from there... But you really need to properly organize your ideas first, procedures before goals... Anyways, you came here just looking for a few thoughts and maybeee someone interested, right? Because otherwise, I don't really understand what are you doing here, pal...

>>61391252
And yeah, we can't code for the love of us...

>>61391282
>>61391299

Eh, May I was misguided?

>>61389444

>you should try this thread anon: >>61354496 → because people there actually program and produce working code.

Okay then where should I go now? Ideas?

>>61391419
Get on IRC and talk to us about your idea, query me on Rizon, Im Miao

>>61390148
I don't get how this is related to chinese cartoon piracy or pantsu in general though? And I'm not refering to vocaloid but the scientific articles. Just because you use vocaloid as a comparison, it doesn't make it relevant.

>>61391472

Tanks, please wait for a minute, I have never used IRC yet

File: soon.webm (2MB, 1600x800px) Image search: [Google]

2MB, 1600x800px

soon™

>>61392980
Don't do it man, just put the regular text box there if you have to

>>61392980
Go away kilo

>>61392980
>adding useless features instead of fixing up the site

>tfw nyaa is shit and bakabt went private
JUST

>>61393035
it's still there

>>61393095
fixing up what exactly you retard?

>>61393244
Make the regular text box look like the torrent name field with bold text and so. You could put cat/flag dropdown to the left of it too. JS is a fucking cancer which should only be used for minor aesthetic improvements.

>>61393235
Anime piracy is dead, buy a CR sub.

>>61393235
bbt isn't so good though

Hey /g/ are there any homebrew designs for a NAS that can handle 24TB or more of storage space? I'm planning to archive as much anime as I can for the next shutdown.

I'd like to also archive as much hentai as I can but I don't want to get too ambitious. Also, I have the old mangatraders archive from summer 2014, is there a more recent archive with newer scanlations available?

>>61381320
>>60650254
>>60650267

>>61393442
So, he had an alt-right website? What does that prove?

>>61393262
Oh that,i haven't tried yet but yeah that could works. Although i would personally dislike it

>>61393392
You want some form of software RAID 1 (mirror), so that makes up to at least of 48 TB of HDD space. Either 12x 4TB HDDs or 6x 8TB. That would require quite a big case. For so much storage, it's advisable to have around 1 GB of RAM per TB of storage, so 24~48 GB of RAM in your case. You also need to have enough SATA ports to connect this many drives, but you can use SATA splitters for that.
Consider the costs first. You would need quite a big box for that. At least 2U server or a big tower.

>>61393392
Just get a server and connect 3tb hdds to it.
>>61393629
Why RAID 1? RAID 6 is more than enough.

>>61393572
That he's a fan of DRUMPF and thus LITERALLY HITLER and extremely PROBLEMATIC

>>61393721
I still don't get why it's relevant, if you read the archived thread you posted, it's clearly irrelevant what political belief he has. Miao is the host of the project after all.

>>61393694
RAID 6 (and 5) is an abomination that should not exist. For that you will need a heavy duty CPU, not something you want to use for NAS.

>>61393244
How about the scrapers which keeps dying constantly, especially on sukebei.

>>61393826
redundancy is a thing to save your data from malfunctioned hard drive

>>61393985
But PantsuDev is in charge of the scraping.

>>61393787
It's been rumored that ewhal is a member of the infamous Alpha Beta Omega student society, which is a front end for the secret nazi society ABOABO (i.e. "abolish the aborigens").

What happened to kipukun?
Is he dead?

>>61393985
And how the fuck am i gonna fix that?
Are you gonna teach me to do it?
You fucking retard

>>61394615
>these are the people behind pantsu

>>61394635
ewhal4 made pantsu, not me
he's behind pantus, not me
idiot

>>61394615
Calm down, kilo.

>>61394672
>arguing semantics
>meanwhile stuff on the site is still broken
>these are the people working on pantsu

>>61394697
fix it yourself faggot, you're behind pantsu after all

>>61394708
Patches welcomed :^)

>>61392980
>adding useless bloat to the site that no one asked for
What is even going on anymore?

>>61394823
A desperate attempt to lure in more uploaders by providing "convenience".

>>61394823
>>61394860
This is not a project put together by a clear manager. When it's just people volunteering their time, they do what they think is interesting or what they'd like. If you want something specific, the only way to guarantee it happens is to do it yourself

>[01:26] (@ewhal4) anidex does have an "other" category

Oh fug, he's awake.

>>61393392
You're looking at approximately $2500 for the main setup (if you want any kind of performance), and perhaps another $1300 for a low performance safety mirror.
ECC RAM in both, ZFS filesystem.

>>61393235
>what is tokyotosho
>what is torrentproject.se
>what are the release groups' own sites