What're you hoarding anons?

In my opinion, I seriously doubt shit like anime and movies will be censored anytime soon, and if they do, there are millions of weebs that will begin selling copies of their stashes.
Instead, I change my priorities.
Right now I'm torrenting the "every book ever made" torrent, the science fiction archives, political documents, textbooks, manuals, etc.
Weapons and warfare guides and manuals, survival manuals, maps, guides, directions, etc.
Wartime videos, documentaries, etc.
Sensitive shit like political manifestos and writings, etc.
I also download shit-tons of webpages from 2002 - 2012 to preserve what the internet looked like during this period.
So far 1.5TB of this shit.
What do you hoard user?

Do not use windows to hoard data.
Bit me in the ass until I got fed up with files becoming corrupt.

The pathologies of data and HDDs are many and microsoft couldn't give a shit if you want to archive your valuables.

Pool your storage and use BTRFS or ZFS and have a backup that's checksummed.

It's not the cold war anymore, Vladimir.

I don't usually bring up reddit but r/datahoarder (or r/datahoarders I forgot) is a great community of people. Although the big players often have 500TB+ (one of the mods has like 2.5PBs I think) and some of their advice may not apply to you.

Also, do you have the magnet to that every book ever made thing and how big it is?

>implying the cold war ever ended

empty space

1.4 tb of anime

500GB user, here it is.

Why not use ext4?

It cannot detect outside forces modifying the disk's contents and it makes checksumming harder than it needs to be.

You can't even tell when certain things are corrupt. HDD ECC is rather rudimentary and more than willing to pass along bad data in some cases to prevent the OS from halting.

7.6TB of porn.
Mostly JAV.
Lots of siterips or entire collections of actress' works.
It never stops growing.

I did have around 3 TB of animu, but then the RAID failed. I have a feeling it might just be a couple of bad SATA cables, but we'll see.

10TB G Drive. Anime, media and other shit

External forces?

What raid were you running? If you were smart and ran raid 1 or 6 your data should be fine.

Bits flip, head crashes, dust, radiation.
Weird shit can go wrong with data.

I have a HDD from 15 years ago with family pictures 1/30 of them are shredded fiercely from some outside corruption.

Pony pics. I tag them(that's why there's only one folder) and I wrote a couple of programs to assist me with that.

Ah right. I thought cosmic radiation was only an issue with ram and ssds?

Either way i see what you mean. I still prefer to use ext4 with off line backups

Man that reminds me the folder of pics i save from Sup Forums is about 50gb

I've been using a NAS with 2 TB of storage for the past 6 years, I laugh when people say "you can buy more really cheap"; well yeah, but it's also uselessly sitting there, being hoarded without reason.

Having a limit is very sane, you just delete old shit you know you won't watch/hear again.

RAID 5, 4x2TB. I had two drives report as failed simultaneously.

Are you heading DB downloader?

I can use that to pull json from the site and tag stuff.
I have the json for all the stuff I want, I've yet to use bash to strip them into the appropriate hashes so I can import them.
I don't suppose you use hydrus, do you?

Check out BTRFS.
You can easily convert a volume into a fully checksummed version of itself.
Good for backups as even years down the line you can know what's not right by a quick scrub.

>discussing hoarding
>has only ~3.2TB of storage
wewlad..

Meme aside, if you are serious then to hoard those eBooks you will need ~20-25 TB of storage. Few years of dedication as you won't them in one place and even if you did there will be limitations, take LibGen for example.

Personally I hoard shows and music and have about 16TB of storage atm. Sadly, only few GB's left.

>Are you heading DB downloader?
No, I handpick everything from multiple sources.

Only if you think you can't usefully fill mote than 2TB, which is really little.

Granted, somewhere between that and 200 TB (20x 10tb drive array, maybe you'd also use 14tb drives) it might start to be a good idea to delete some, but I can't see why you'd already start at 2 TB.

Seems extremely conservative to me.

I have 500 GB of music which is a lot, and I've ended up with like 500 GB of movies, even though I've downloaded like 15 TB or more of series and movies. After some years, I noticed I don't miss that deleted stuff.

I wanna start hoarding something so that I can get REALLY good at categorization, sorting, etc.
I'm think of building a massive database of free STEM resources that I just add to over time with literally anything I find, even if I don't read it.
I would like to categorize and document so much recorded information and store it somewhere safe for the next generation in case shit hits the fan.

And thats why you dont use raid 5.

This is why you don't use windows & hardware RAID.
If one disk drops out for even a moment on bad SATA, kiss your data goodbye.

>dat torrent tho
I wanna read ALL of it.
How long would that take?

I recently had a raid 10 I made on a 9 year old lsi raid card fail only 3 weeks after I built the array.

I had just finished moving my back up of 4tb of anime, movies and flacs and 3 of the 4 drives died.

4tb of data all up in smoke...

What a shitty raid card then.

Even my own photos (compressed RAW) are >1.2TB by now, and my cameras so far only do 1/2 or less of the resolution of a higher end model and I don't actually use it all the time.

Then another few TB for just the backups of my machines. I'm generally not too clever about what I backup exactly, which has turned out to be way more robust a backup scheme than trying to be minimal and forgetting that stuff I ultimately needed but -in hindsight- lost.

It'll be more soon, since I decided to likely also retain VMs and containers for two years or more.

Basically, my own stuff is easily more than 2TB already without getting to staggered backup schemes, drive redundancy (if we count physical drive space rather than logical). Or the other copy to be safe. And before getting to downloads and media and fun stuff.

I figure our needs vary quite much though, not calling you particularly special about your own scheme, but my own idea of "too much storage" is much higher.

It's not hoarding. It's a collection. It's organised and I really love organising it.

If the drives actually still work, see and switch to Linux mdadm ASAP before it happens again.

'cause some intermittent drop of one or two drives should NOT irrepairably wreck a mdadm array, even if it might trigger a rebuild.

I think you're not hoarding, since that sounds like important stuff and that can't be downloaded later (like the stuff I have in my NAS). I could lose it all tomorrow and it won't be a big deal.

Actually, I'm far more likely to just install the drives into a standalone NAS and have them accessible through the whole network 24/7, not just when my main system is on.

If you install them into a standalone NAS in a typical RAID5/6 configuration, that will actually basically be mdadm RAID on Linux.

At least if it's some QNAP, Synology, Zyxel or the other usual suspects.

I haven't quite decided on a specific model yet, but that's the idea. Switching to Linux on the system that currently holds the drives is not attractive. The only things lost were things I can download again with little effort. The more important files like photos and documents are backed up on multiple drives and machines, though I really should drop one off at my mom's house some time so I have an off site copy as well.

>though I really should drop one off at my mom's house some time so I have an off site copy as well
Shouldn't be hard. Various of the prebuilt NAS actually have an easy to configure option to replicate themselves to another NAS or external drive already built in.

And some other options as add-on-package... owncloud, bt sync and so on. Of course you could also sync them "externally" with one machine just running rsync, scp, or whatever between the two boxes.

A few also may support syncthing or such.

> Switching to Linux on the system that currently holds the drives is not attractive.
Very often the case for things that run 24/7.

Even if you buy a NAS or DIY a new machine to get to that 20W or less power consumption (with a SBC or an onboard x86 or even a lower end Xeon or whatever), the power cost saving may economize it pretty quickly vs some 80-150W idle load desktop machine. Power costs of course vary, but a rule of thumb for the US average is 1W during 24/7 operation = ~$1 per year...

That's what you think, Schlomo.