Data Hoarding General

With the repeal of net neutrality, I want to prepare as much as possible for the worst scenarios where it's no longer possible or economical to access lots of information. What are some easily ingestible sources of data we can archive amongst ourselves? Wikipedia archives, image collections, full site rips, torrents, etc.

Any and all links are appreciated. Let's help each other expand our collections.

Other urls found in this thread:

g.sicp.me/books/
meta.m.wikimedia.org/wiki/Data_dump_torrents#English_Wikipedia
pastebin.com/5921UFFQ
drive.google.com/drive/folders/0B8ywa01FmhL4V3lkOFd0ZG9Genc?usp=sharing
pastebin.com/gxfm3J7b
the-eye.eu/public/WorldTracker.org/
archive.org/download/MangaTraders
newegg.com/Product/Product.aspx?Item=9SIA5AD3BN8891
pastebin.com/DgXt9dPL
twitter.com/SFWRedditGifs

Gentoomen library, programming textbook collection: g.sicp.me/books/

English Wikipedia archives: meta.m.wikimedia.org/wiki/Data_dump_torrents#English_Wikipedia

Is there a torrent for everything on libgen? Wanna get that as well as a bunch of collections from Sup Forums share threads.
archive.org has full romsets of everything 5th gen down, with in progress sets for 6th and 7th gen. Too lazy to link but you need an account. Searching "no-intro" (for cartridges) and "redump" (for disc stuff) should give you something.

Nice.

Glad I wasn't the only one preparing.

dont start over again. the cripplechan had some internet preservation project going on in case of TPP was going to happen. I have not checked the status of the project but you should check them

lmfao, pathetic

>making savings on your account
>pathethic
pick one

I secretly am hoping that everything goes tits up so that people will hang out with me like the old copy parties in the 90s.

That sounds awesome - got a link to this?

kek

Ask their Sup Forums to know more. Also google (8ch and tpp)


I'm not spamming you piece of shit

Holy fuck your life must be a mess.

Its not great for sure.

Your setup looks based

Current storage server with 21TB of space - I have a lot of bays empty still and would like to increase this to 30TB within the next few months. Current array is about 80% full. I archive a lot of my own photos and video at the moment but I'd like to move into archiving whole sites and collections

Have 5 of these. Am I doing it right?

Not really senpai, invest in something you can at least run in RAID, and make offsite backups to those drives you already have

Thanks. I am currently running around 72TB raw on my main array, around 60TB after parity stuff (ZFS Z3), with a few more 10-15TB arrays scattered around that store VMs etc. Right now I mostly need to upgrade my network. I'm using an old Poweredge R210 as a router with PfSense, and I am getting thrown under the bus when they force AES-NI. How do you like the MikroTik? I am also looking to put in some 10GbE hardware, although I can't really afford it at the moment. Right now I am just running LAGGs over 1000BaseT.

The MikroTik is fantastic, really can't say enough good things about it. I had considered a Ubiquiti but I find their Vyatta based software extremely confusing - maybe I'm just a retard but RouterOS makes so much more intuitive sense to me. My connection is only 50mbit symmetrical and the LAN just plain gigE over CAT6

I posted a massive collection of cybersecuirty ebooks on every subject. I posted it on /t/ via mega but I lost the password. I'll try to re upload all of it again sometime in the next 24 hrs, in case no one has it.

I would be interested in seeing that if you make a torrent.

>mikrotik
mein neger

I think I will pick myself up one for Christmas. I also tried the Ubiquiti stuff, but I agree that Vyatta/VyOS is not optimal for home and SOHO.

tanks
i've got another couple TBs open, what else would be the most important to get?

I'm pretty small-time. 12x3TB drives in mirror vdevs, which gives just under 16TB usable. I have a few TBs left before I have to start adding bigger drives.

me too, user, me too.

I've got that same style/make case. Gonna put it to use during the next server upgrade cycle. I'm "small" time to, just got 12TB total capacity with little over 10TB used atm. Right now server is housed in atx mid tower with 4x3TB in Raid 5 and 2x2TB in Raid 1. 1TB drive is for os/client backups/few videos.

How is powering all those drives with that 500W PSU working out?

holee shit that's a nice fucking desk you got there

"No longer economical"
So shit that will never happen?
pastebin.com/5921UFFQ

Thanks man

I was thinking that too. I gotta get me something like that.

You paranoid autists are hilarious.

go suck dick elsewhere

ok

Kek, I thought u were trap poster for a moment but your legs are too hairy

My legs are sexy as hell and you know it

is there anyone seeding that torrent? i'd like to get it, but it doesn't look like theres anyone uplading

bro i'm downloading from 37 of 45 peers rn

I fucking wish.

Sneakernets are dope and I've had the same inclination.

How can I get into data hoarding? I have so many spare computers and spare drives and no idea what to store on it all.

I'm into emulation and have nearly complete romsets for older systems, but beyond that I don't have any idea of what to keep.

oh fuck
maybe I just wasn't patient enough, whoops.
looks like i'm downloading now

Nice stuff, would be a dream to have something similar one day.
Still fucking around here with a basic openWRT homerouter and an old desktop + NAS.

and get into some private trackers

I'm interested.

What kind of case is that? 4U? I like the idea of having a rackmount chassis with my consumer pc parts inside

What case is that, and how much did it cost?

Also would you mind telling me what model that Supermicro is? I bought something similar, but for some reason it only recognizes 2TB HDDs.

Do it, I'm interested as well.

Looks like a supermicro fat twin chassis

Somewhere around the 5k to 10k range if I remember right.

I meant the rack holding the supermicro.
The only decent ones I found that could fit that depth and weight were around $500

I don't know why people think data hoarding somehow means you're 'messy' or disorganized. Quite the opposite.

It's no different than being the owner of a file host like DropBox or Mega. Only difference is the data is yours, so better personalized care is taken to make sure its easily accessible and organized.
Once you build scripts to automate everything, there's really not much extra work involved either outside of manually finding said content.

...

to me ebooks are kind of the lowest priority for hoarding, they're tiny so the fear of throttling connections doesn't really apply and they're shared all over the internet and can be accessed easily through IRC channels. to me the more pertinent things to hoard would be videos and software

drive.google.com/drive/folders/0B8ywa01FmhL4V3lkOFd0ZG9Genc?usp=sharing

In case nobody feels like reading that entire thread, someone mirror'd the torrent on GoogleDrive.

pastebin.com/gxfm3J7b

Another mirror:
the-eye.eu/public/WorldTracker.org/
If you want to wget your way out (;

seems like a lot of the stuff is pretty silly, there's a whole section on 'free energy'

I know that feel.

free as in freedom

HAHAHAHA
I got freedom energy
HAHAHAHA

What should I name my new server? Nothing weeb and no memes.

>no weeb
>no meme
>no fun allowed
Why did you come here?

i'm doing my best to hoard pornographic art. 7 million files, all periodically site ripped from various sites, tagged and organized via hydrus network.

a lot of my favorite artists are on patreon, which makes it a pain in the ass to automate and archive because each one posts their content differently.

I like you and your pretty UI
What is it?
Is it a server or your personal computer?

and it's all only 5TB.
If I did a dupe search it'd probably be reduced to around 4.5TB.

>Don't be a bandwidth hog. Limit bandwidth usage to around 50kbps or less. Or you'll get booted and your IP might get banned.
50kbps? what the fuck

>Wait 30 minutes between file downloads.
sure, if I want to finish in 10 years.

i think that refers to DDLs only.

it's a 600, you just can't see the first number well. And its fine, I've plugged it into a kill-a-watt and it only pulls about 230W from the wall while it's scrubbing.

Yeah, Rosewill makes em. I got it on Newegg for like $90. There's also a shorter-depth version with no middle fans and with only eight 3.5 bays (but with some 5.25s), and a version with 12 hot-swap bays for rather more money. Watch out though, it doesn't come with rails. I used a generic istar rail kit, it works okay. Also it'll accept any normal PC component except 120mm tower heatsinks, those are too tall, you have to get a 92mm one.

I only have 250 GB but would like to data horde, how can I join?

Find all the hard drives you can and put things on them in an organized way.

images, text files, ebooks, really old game ROMs. But no really, buy more hard drives. I used to get refurb 3TBs off newegg for $60 a pop, I think they still have em.

download as much literature as you can find, for maximum density.
is a bad idea since it seems to be mostly uncompressed.
wikipedia, gutenberg, and would be a starting point.

You surely can find more hdd and do a raid 5
2tb are cheap so...
Use linux and everything will come afterward

>wikipedia archives
I don't understand, you're saying you need to archive wikipedia?
can someone explain how net neutrality affects wikipedia
>t. dummy

>repeal of net neutrality

Found the fake news shill.

Honestly i don't care about net nutrality
What happen if you dont have internet?
No wikipedia?
No documentation?

Alot of things can happen in a small time, if you got a backup, you'll always be safe

I'm currently torrenting the GentooMan Library, Probably going to DL the survival stuff, don't know about Wikipedia as that seems rather large.
Have another 250 GB hdd but I don't have a USB to SATA.
I'm probably gonna get bitched at for it but, link?

I've been hoarding anime (even hentai) for 2 months and I've reached almost 100 GB. Should I start hoarding YouTube videos?

I'd say yes

english wikipedia is ~15gb compressed.

Uncompressed and poorly organized.
Uploaded by a winfag who held it on a single disk and actually uploaded the system volume info hidden folder in NTFS.

Many multitudes of disgust desu senpai

My friend i got what you need!
archive.org/download/MangaTraders
Have Fun!

Which link? the torrent or one of the others?

looks like a Synology NAS

the multistream torrent, which is the recommended one.

OK Anons do we have more links?

I see. Thank you user.
How do I DL all the files from pssurvival?

>pssurvival
i'm trying the linked magnet, and it's looking pretty dead, but we'll see.

The torrent is dead my friend

geez aniki, you really are helpless..
newegg.com/Product/Product.aspx?Item=9SIA5AD3BN8891

S-sorry senpai

I'm hoarding milk in case Congress doesn't pass Cow Neutrality. Then the supermarkets could all just refuse to sell milk for less than $100 per gallon. Which means they will, like, next week.

Oh and something something India racism.

Yeah, I just uploaded 5gb of net neutrality thread archives. I'll upload the other half tomorrow.

General question
Should i make a torrent about this:
pastebin.com/DgXt9dPL

>pastebin.com/DgXt9dPL
seems a little excessive

wellllll i only printed the dirs but yea it is!

Why not?

I name mine after Greek/Norse gods, except my VM server because it's a fucking beast so I named it Grendel after the monster in Beowolf. My other servers are prometheus (db server,) heimdall (log server,) apollo (file/plex server) and then my laptop is Loki.

I guess it might be early to tell but it seems that there's only 36% availability on that cd3wd torrent

a 6 core connected to a bunch of drives good enough for a basic file server?