Data Hoarding #2

Last thread:
rbt.asia/g/thread/63932575

Talk about your data hoarding projects. Share you code. Talk about how big your NAS is.

Other urls found in this thread:

shop.kobol.io/
crowdsupply.com/gnubee/personal-cloud-1
crowdsupply.com/gnubee/personal-cloud-2
twitter.com/SFWRedditVideos

Bump

Im adding another 72TB after my Christmas bonus clears. That will bring me up to a rae 150TB. Thinking of experementing with Ceph as well.

what drive you using?

Why?

I was thinking about picking up a LTO-5 drive
used LTO drives ok?

instead of bragging about how much space you have, show us what you're actually doing with it

your electricity bills must be insane

120TB of camwhore porn. Not proud of it but it is what it is.

Drives? A big mix. Mostly Toshiba X series and WD Reds. Im running such high level of RAIDs with a lot of spares so drive failure is not as big of a deal as price.
Because im autistic and I dont have anything better to do.
Included in rent. I bet they are insane for someone for sure.
I have a LTO5 library and an LTO stand alone drive. Pretty cost effective media if you can find a cheap reader.

This is mine: (Everything is connected to UPS)
OS : Windows Home Server 2011 (2008R2 based)
CPU: AMD FX 8300 3.30Ghz
RAM: 8GB (4gbx2)
HDD: 1TB (OS/Client Backups/Few Videos)
9TB Raid 5 (1997 - Sep 2017 Data)
2TB Raid 1 (Oct - Dec 2017/2018 Data)
Zyzel NAS 540 - 12TB Raid 5 (Full Server Data Images+ file/folder image of videos on D:\ drive)
Zyzel NSA320s - 4TB Raid 0 (2nd copy of Movie/Music Collection)
3TB External USB - Server Sys image/Client Backups Backups/2nd copy of X-rated/E-book Content
I use Macrium Reflect to manage server data backup jobs.Both NAS units and External Drive is shutdown when not in use. Can restore server + data volumes with it if the worst happens

I fucking told you last tine you need to update your OS. Home Server 2011 isn't getting security patches any more, and you are open to some serious security vulnerabilities. If you get unlucky a bot will end your entire datastore. I hope you have good backups.

did you purchase that LTO drive new or used?
I'm wondering if something inside (the drive) needs to be regularly replaced or maintained cause there's "cheap", used LTO-5 drives in my area

Uh, not trying to argue but since it based on 2008r2 I can apply all server 2008r2 security patches to it. I just applied the Dec security patch not to long ago. The WHS bits just "ride" on top of server 2008, they use all 2008 under pinning to function.

I got both from work for free, although I have been tempted to buy a replacement for the LTO3 machine on eBay. As for maintanance, sometimes the heads need to be cleaned, and there are special tapes for that, but I have never done so and I haven't had any issues.

Besides even if someone managed to figure out the remote access user name/password they couldn't do anything destructive. That account is especially designated for remote access and it is limited to read only rights to most shares. Certain shares/folders are off limits due to the nature of the contents. The only way to do anything destructive is if you are physically connected to the network and you manage to figure out the Administrator account credentials. Even then safeguards are in place, (Previous Versions/Shadow copies) so I can restore files/folders without having to touch the main backup. Most core shares other than User Folders are limited to read only for every user on the lan. So even if you logged in physically as a regular user you couldn't do anything except to the contents of your own folder.

You guys could get a bunch of these cute little NASes.

They're small and very uwu. good for smaller secondary hoards

no worries, man. We all got our vices

forgot the links
shop.kobol.io/
crowdsupply.com/gnubee/personal-cloud-1
crowdsupply.com/gnubee/personal-cloud-2

Don't feel bad, anyone says that they ain't looked at porn online at some point is lying there asses off. I've got 1.40/1.50TB collection myself, mix of porn doujins and hentai. Gonna put a cap on it on Dec 31st though for a few reasons. One I'll be 35 soon, two, what passes for porn now is kinda lame.Three, seems the trend anymore is girls with loads of tats/piercings/ and jumbo inflated fake tits. Four, most of the porn stars I like are all retired or close to that age. Brazzars for example; they had a nice few scenes while back that they ended to early. (Sister Swap for ex). Had a perfect opportunity to take it to the next level, say scene 3, mm/ff orgy or the two dudes plowing one sister or two sisters taking on one dude, you get the point.

I hope you're seeding

Not for that price, are you on crack?

You know it nibba, I have 800 symetrical, if you have ever used AB you probably leeched from me.

>are you on crack?
never tried it. what's it like?

>nibba

I dont know myself but I imagine it something like thinking spending $250 on a $30 board and $10 worth of plastic and screws is a good idea.
you can literally go to lowes right now and get everything to make the case for that thing and have it done in 20 minutes.

>I got both from work for free
where the fuck do you work

What RAID are you using,and what OS?

Are 1TB 5400rpm 2.5” Sata drives worth it if theyre

according to the last 2 threads, most of the anons with 50TB+ space arent really doing anything with it, atleast none that interest me.

>Sup Forums archive
boring

>anime
boring

Theyre at his house now, lets just go there instead

Where?

Is your data hoard public or private?

Not a hoarding project as such, but this year I released a multi-GB megapack of Gumball reaction images, Sup Forums memes/art, storyboards, etc.

I'm glad at least one user is regularly making use of it. Feels weird having someone else post with the same file names as in your reaction folder though.

I am currently hunting a NAS
>4k constant footage
>from 2-6 cameras
>also audio from 3-5 sources
>at least 4-6hrs every week shooting
>can handle that load of bandwidth
>future upgradeable
>rack is preferable
any suggestions?

from a mutual friend of mine

fuck off linus

I have something similar but do it the cheap way:
1080p 30fps from 4 security cameras goes to 2TB raid. Enough space for ~2 weeks. Also since they're 15 minute segments, ever 15min a script is set to upload the latest footage to my google drive unlimited account. It works great. 90% of footage reviews won't be for something older than 2w so you have instant access, and just in case google drive is there for that or if raid explodes

Nigga.

You gotta shift your shit off windows and hardware solutions.

It is astoundingly cancerous for hoarding.
I lost shit to my RAID5 when it started rotting without recognizing that it could just check pairty and rebuild the bad block. The entire disk had to fail outright for any sort of rebuild to take place.
Lost damn near 400GBs which I later managed to retrieve by painfully redowning everything.
It just shot my RARs full of holes at which point it became apparent I needed to use TAR with layered compression to have any hope of recovery again.

You can also snag some ECC memory and force the kernel module in linux with your FX CPU to actually use it AMD had some foresight on these CPUs. Works on my FXs'.

does ZFS really need 1000:1 RAM?

Im hip with the kids lingo yo
I used to work for IBM. They dont really do the big iron stuff that I was qualified to engineer anymore though.
ZFS Zx and TahoeLAFS, on top of FreeBSD systems mostly.

How much of that is loli porn?

No.

No.
I use it on my laptops.
The memory doesn't integrate well with the linux kernel and ARC doesn't exactly reveal itself as evictable cache but will attempt to do so when it can. A little messy but works well enough.
You end up with stuff like launching a VM and it complains about low RAM because ZFS was soaking up some for cache but then instantly releases it and it won't appear as yellow in htop (mifs me a bit).

Dedup is a T R A P (for most datasets).
This is what catches most people off guard, they think
>Oh shit, space saving is good, turn that on!
And then find that their CPU goes under heavy load reading gigabytes of dedup tables from memory causing high latency reads and writes.

Just stick with LZ4, the default record size, standard sync and you'll be fine.

The best way to setup your datasets are no mount on the root pool and all the sub datasets go where you'd like them.
It's clean and snapshotable easy to backup individual datasets and drop nonessential ones.

Not good
Trying to locally store em cuz ISPs are crap

And why aren't you sharing it
The Sup Forums ones at least

That shit is more expensive than a real one or a cheapo homeserver you turd

I was looking into non-NAS external 4 slots USB3 boxes but the cheap ones only support 8-12TB of total size.
Are there any brands that support up to 24TB on a single 4 slots USB3 box that costs less than 130 USD?
Not NAS to be clear, just external USB3 boxes with 4 slots, or more slots if the price is good as long as the total supported size is 24+ TB.