This thread is for the discussion of the possible replacement/mirror of the late Nyaa.se (which also hosted Sukebei); taken down for reasons still under speculation.
Previous Thread Recap of last thread: >OP looking for tools to create a new site >An AMAZING user creates a backup site using some old (17 months old) databases of nyaa and sukebei. >Another user was archiving nyaa and sukebei database, but it is still 7 months behind due to being too confident and stopped making backups. >Discussion back and forth of what to use to host the new site.
How do i go about setting up a daily backup? I have tons of raspberry pis and know some Linux (bash, cron) but don't know web stuff
Jonathan Flores
Poll: strawpoll.com/6eabdyg Use whatever proxies you got. Hopefully it will all even out.
Ian Campbell
bumpObump
Benjamin Adams
Would hosting on .onion be feasible if it's just a place to get magnets? Tracker is dead but DHT still works (well enough).
Lincoln Young
Both nyaa pantsu and sukebei pantsu are down right now. What's going on?
Hudson Sanchez
Maybe someone can help me out here. I'm trying to seed what I've got and at first DHT works, however after about half a day, my DHT nodes drop to 0. Restart uTorrent (2.2.1) and the DHT nodes come back. Then they eventually all drop off again. How do I keep my DHT nodes alive? I'm using a Socks5 proxy.
Cooper Wright
Pretty sure deluge RSS plugin doesn't work over tor
Robert Martinez
migration done on nyaa.pantsu.cat and sukeibei.pantsu.cat will correct url issue soon
Oliver Lopez
Nazis from Brussels, user.
So we scrap RSS functionality. Keep it bare bones but at least up-to-date. (unlike TT)
Matthew Morgan
I think the owner is fixing the typo he had on sukebei.
Carter Brooks
Dht will never die, read how it works. As long as somebody is seeding and you know the hash, you can get it.
I wrote a python dht crawler but its really fucking slow - i get thousands of unique hashes a day, very few actually lead to a working torrent.
Brayden Russell
The first thing is we need someone with a backup that's not so old the US had a different president when it was made.
Ayden Hill
Not sure if nyaa had an API, so you'll probably have to scrape the HTML for the metadata you want to store yourselves. Shouldn't be too hard with something like BeautifulSoup, I've used that to great success for a similar purpose. You could try monitoring new torrents through their RSS.
Nicholas Long
They're both up right now and the typo is indeed fixed so that could've been it.
Easton Richardson
Also, fuck whoever decided to set several of the torrents to disable DHT. Why would you do that. Now they are just completely dead.
Gavin Martin
You only need BeautifulSoup if the HTML is messed up. lxml is faster and easier to use.
Kevin Harris
This.
Kayden Ross
I know how DHT works.
Fuck. Well. What about original owner? Prepared to share?
Aaron Price
not use animetosho you morons.
Lincoln Bailey
Right now we can't even get ahold of him. Who knows if we'll ever?
Asher Brown
>tfw nyaa was run by Julian Assange
RIP
Sebastian Peterson
I'm pretty sure I tried using that at first, but for some reason I got tons of compiler errors when trying to install it through pip.
Lucas Thomas
It's one season back. That's not awful considering almost everyone thought it was untouchable.
The real dream is that the site owner will show up with the full db.
Alexander Hall
Beautifulsoup can use lxml as the back end for speed and dunno but the bs4 api is well, fucking beautiful
Aaron Sanchez
How many nodes are you spawning to crawl the DHT?
Robert Bennett
Oh shit is the second kristallnacht.
So i guess it's best to wait a while for him to make an appearance.
Parker Moore
You need specific tooling to compile and run lxml, its a PIA. a lot easier to just get some nix os, works out of the box
Nicholas Bailey
On Windows there's some magery that you have to go through involving VisualStudio to get things to compile. There's a website that has 64 bit MSI installers that are pre-compiled.
No, I think we'll call it M/a/y Day.
Gabriel Green
Nyaa hasn't even made a public statement himself about why the site went down, I think giving the db is above him.
Adrian Hill
All you fucking newfags don't even know about tt/at.
Wyatt Myers
Just a few. Thats probably the issue. Also, is there an irc for this shit, id join tommorow, its fucking late.
Dominic Thomas
ITT: butthurt weebs scramble to keep their animated pedophilia piracy alive
Luke Gonzalez
I have some of the newer uploads, but no databases backed.
Andrew Kelly
More importantly, what will the logo be? Will J-List still sponsor?
John Peterson
I got TT, but that still doesn't solve the problem. It just meant (((their))) work isn't done yet.
Joshua Jones
Really? I had issues with BeautifulSoup even when using lxml as the backend as opposed to using lxml directly. This was last year when I tried to collect a list of links and it never returned the correct amount. I then did the same thing with lxml and got the proper amount of links.
Hudson Powell
How does it not solve the problem?
Dominic Watson
I'll do the logo
Charles Scott
Is the search function on sukebei pantsu broken for anyone else?
Because the problem we have is the same one I've been saying we have had for years: a few single points of failure. We need to create something robust, before the copyright hounds get more maulings in and the bleeding increases.
Elijah Robinson
Dunno, worked fine for me. Used it half a year ago. These days i prefer scrapy, it hides a lot of magic from you, you pretty much only have to write a parser and some rules what to get.
Adrian Cooper
That's already been done. Nyaa existed, and tokyotosho and animetosho are both mirrors of it.
All you're doing is creating yet another point of failure if you're trying to make it anything more than a mirror.
Brody Barnes
Weird. It works for some phrases, but for some it doesn't. Is the issue here on my side on or the site's side?
Well I'll be releasing source of nyaa.pantsu.cat later today and some user was planning on using ipfs for it. So we could use ipfs. Probably still buggy. What phrases don't work?
Christopher Barnes
Only if you're talking about a plain HTTP website. These protocols under discussion cannot be taken out by DMCAs or operators pussying out.
Josiah Reyes
you both gotta stop misspelling sukebe
Ryder Collins
>Probably still buggy. What phrases don't work? Tried some random fragments of hentai and eroge titles. "Boku no Pico" worked, "Discode" worked but didn't search for the right thing (I was searching for "Discode: Abnormal Sexuality"), "Life with a slave" returned no results.
Jeremiah Flores
Sure they can. All that matters is the part where people can actually find them. You take out that, and whatever you set up is worthless as anything more than that super secret thing you and someone else have written down in a notepad.
All you're doing is no more valuable than the magnet links that already exist for nyaa stuff.
It's a minor issue but is it only me that page begin with page 3 or 4.
Nicholas Brown
Before we move that to a new infrastructure, we also need to rebuild the latest season. Everyone who still has .torrent files from then, run them through torrent2magnet.com/ and start collecting the magnet links.
Anonymous P2P clients can use a meshed network to find things. Bootstrapping is the only issue, and Sup Forums can probably serve that role, if so needed.
Carter Morris
>and some user was planning on using ipfs for it. That was me but since your site uses server-side programming so I'll do my own thing since IPFS can only serve static content. But first I'll do something else ( ). Not now though, I've been up since nyaa was shut down.
Lincoln Jenkins
To add to that: searching for anything on sukebei pantsu only returns one result when it works, usually the wrong one.
Jordan Miller
Yeah people love still using mule.
All the other super awesome Sup Forums projects are totally still run. haha remember the times Sup Forums tried to just run mirrors of Sup Forums. Those are still going, right?
Noah Cruz
All I really need are file name and hashes. Odd I'll look into it for you. yeh I know I'm just waiting to gen a new ssl cert.
Hunter Walker
>So we scrap RSS functionality. At that point, I'd rather use XDCC.
Luis Sanchez
Be sure to read , too. It seems to be a serious bug with the searching.
Jaxson Edwards
That works too, I guess. One step at a time.
Anyway, I got to go. Might be back later, dunno. Keep working though. Ganbatte!
Spam filter thinks that magnet link is spam for some reason.
Connor Walker
I beg you gentoomen, save us, save anything you can. Please. Don't let it end like this.
Wyatt Davis
Nothing's ended. The mirrors still exist.
Aiden Robinson
How big? I'm on phone for a bit
Michael Sanchez
Whoever posted this in the last thread - how recent is your backup?
Caleb White
142MB
Nathaniel Nguyen
...
Oliver Taylor
Cool, will seed soon™
Logan Wilson
Reminder to host the new site in the middle of Antarctica
Leo Carter
Nope, me as well.
Ryder Cruz
It's not just Nyaa that get this problem either. So many torrent uploaders trip into this basic mistake. One tracker + disabled DHT = single-point failure for your torrent.
Angel Young
>[RAW] Attack on Titan 08 Super old, most likely. Like, at least a year plus some. I'm just guessing off the the actual release date of that episode though.
Jose Cox
What about using the gopher protocol, or something else suitably ancient and dis-used that no one knows about?
