Data Hoarding

What's Sup Forums's stance on data hoarding?

I've been basically carting around the same poorly sorted folders and files for 15 years now, and decided that I was going to get drastic and (over some time) delete every single thing that I no longer care about, or can't even think why I saved in the first place.

Has anyone else ever done this? Do you hoard data? Are your folders organised?

Other urls found in this thread:

bestbuy.com/site/wd-easystore-4tb-external-usb-3-0-hard-drive-black/5792400.p?skuId=5792400
hnb.sourceforge.net/Features/
twitter.com/AnonBabble

I feel as long as you're organized it's okay.

I have a 1TB drive that is almost full and I have no idea what to get rid of because it's a hot damn mess. Tools like Windirstat can't even help narrow it down.

This is my problem as well. Everything is so poorly sorted that it's going to be a nightmare to ever make any sense of it. So it's either just say "fuck it" and throw the lot out after saving a few things I really want to keep, or do the long thing I said and go through each folder.

But there's hundreds of thousands of files I've accumulated!

>1TB

Ha! You are like little baby!

I have 2.5TB of useful, sorted data.
>music: high quality, tagged AAC
>movies: medium quality H.264/AAC
>pictures: small JPEGs, except for family photos

Each type has its own folder structure and naming convention.
>music: artist/(year) album/no. title.m4a
>movies: (year) title/short title.mkv + .srt
>pictures: unix timestamp

You have to take your time and organise everything becauerwise it's a useless mess.

This thread should be merged with the home server general, just saying.

>Do you hoard data?
Just porn!

*otherwise

I wish I was more organised at the start. Now having any kind of order or logic would take a million years.

So what I ended up doing is throwing everything on whatever it would fit on, then be more logical going forward.

If you have no order at the start then everything unravels and before you know it you have a mess of half a million files doing god knows what.

I keep my currently used files neatly organized and dump everything onto an external drive. I've only rarely needed to back to the disorganized mess of old files, but it has been invaluable when I have.

It's easy, just name your folders and dump your shit in them.
>anime
>backup
>comix
>documents
>eroge
>h-anime
>h-manga
>manga
>movies
>music
>pics
>pron
>series
>software
>Sup Forums

What kind of data do you have?
Use batch processing programs to move the files into a directory structure specified by their metadata.
You can sort them faster by orders of magnitude with the adequate tools.

"data hoarding" is a catchy term that milleniums employ to justify their dependancy on the cloud.

they don't remeber a time where floppy disks or even cds were used.
people were required to burn/flash their own media and then read it on another device.

they will learn by the next generation though.
we were lucky we still had polariods/tapes and extensive up to date literature in the form of paper.(dictionaries, maps, thesaurus, ect)

as digital media gains bitrot and they lose their family photos/video and songs they will understand.

sites like youtube removing their favorite video and no other sites having a backup.

re-uploads of media degrading in resolution/ratio.

when obscure sites can't pay the bills or get taken offline/censored/hacked and they lose their platform of content...

when you lose your signal and you can't listen to pandora or use your gps...

the day wikipedia dies..
the day that the gov pulls the plug.
the day that piracy ends via DRM.
the day that uncensored news/information is halted.

>just use google cloud they said

nextcloud + nas4free kids.

>"data hoarding" is a catchy term that milleniums employ to justify their dependancy on the cloud.

On Sup Forums it means "I have 5GB of unsorted images in a folder called 'anime titties'."

And besides, there's no way that people could possibly save enough data to make allowances for all of this, or to even do anything with it after they have saved it.

I mean, if a total lockdown of the internet occurs anyone will be able to transfer a file any bigger than a meg or two?

Really the lesson of your post is "stick to plain text that can at least be printed" because nothing says you'll have the ability to play back a certain format in years time.

I'm an avid data hoarder. I wrote my own software for that encrypts, forward error corrects and randomly disperses my data throughout a series of nas devices. This ensures protection against bitrot and easily facilitates the capability of offsite backups. I plan to spread randomized chunks of my data throughout bittorrent with magnet links (after encryption of chunk payload and filenames) and IPFS.

IPFS + forward error correction. People have been backing up youtube content for personal data hoards for almost a decade. That content will eventually make its way back onto IPFS and Zeronet shortly. This prevents degradation, low of data and bitrot entirely.

THIS, I wish it weren't true but I've seen it happen, we all see it happen all the time.

When learning a new programming language I usually write a porn scraper in it. It's a great excercise

IPFS wont work. Data is too big now for people to be able to put aside that many TB of storage for it, and the GB on GB of bandwidth it would use.

Maybe if we still used text and small images it would work, but not in the age of poorly compressed smartphone images that are 10MB when they should be 100KB. And that's not even mentioning 1080p (+) videos.

That doesn't make any sense. IPFS is basically just bittorrent 2.0. The largest data centers in the world are still measured in petabytes. The combined collective hard drives of users in the world are in exabyte levels. If you look at siacoin and the other protocols they already have many petabytes of storage capacity available for sale.... The data that exists in all the data centers world wide is nothing in comparison to the ability for a protocol like IPFS to store it if it is widely adopted. The bandwidth isn't an issue either, particularly since IPFS uses a hash based addressing scheme that uses local sourced first.

I delete everything every year or so and start new.

here

All of this relies on you being allowed to do this by the various companies in control of the infrastructure. Such a thing would massively threaten their dominance, especially giants of data storage and serving.

soon all forms of sneakernet will be dead and offline content will be minimal

we are giving too much control and trust on the internet ie registrars, CDN's, search engines, youtube/reddit/ect

the internet grows smaller every day in the sense that we all pile eggs into one basket

we need to re-create local repositories for all forms of information and media

trade content with friends via usb/sdcard ect

we need to bring it back before we lose our chance.

iphones for example already removed the sdcard requiring you to get stuff via itunes or the apple store

luckily androids can sideload data and have expandable storage

>trade content with friends via usb/sdcard ect

This would require lowering the size of our files, returning to low quality video or even plaintext.

Been there. Use apps to sort everything for you

laptops are still a thing user, as are USB hard drives. I have a 2.5" 1TB one sitting on my desk right now, that's enough space to give you plenty of options.

mindless data storage is stupid
i always delete shit that i wont rewatch of use more than 3-4 times
but i have scrapped so many youtube channels than i know in the future they will probably get deleted so..

but then i have almost 1pb of storage on my 3 ceph servers it wont get filled soon enough not even with the blu ray 4k movies

I know. I'm just trying to make a point that if we want to control our own data we might need to accept it wont be as pretty as it was before. I think this is what the IPFS and ZeroNet people miss, that what they're worried about wont allow them to recreate the web outside their control.

Besides just because something could be deleted doesn't mean it should be saved. Not all data is created equally.

Damn nigga you are awoken

If you have more than 500GB of stuff you need higher standards.

I don't.
every migration I pick the stuff I absolutely need and the rest goes to data nirvana.

Or a bigger drive :^)

I have a 2TB HDD that's not even got to 1/4 used. If you control your urge to CTRL-S everything you see it really doesn't increase in size that much.

Just record the names of the all movies, TV shows, animes, games, and programs you have, then delete them all from your drive. You'll rarely want to re-watch something. And when you want, it's not that hard to torrent or stream online from a Russian or Turkish website.

LIBERATE YOUR DRIVER!

>urge
>comparing music, movies and books to piss
Found your problem

Data is cheap as fuck now who cares.
bestbuy.com/site/wd-easystore-4tb-external-usb-3-0-hard-drive-black/5792400.p?skuId=5792400

>record the names
Good idea, except I don't see a better system than to bookmark imdb game reviews, which is shit.
>You'll rarely want to re-watch something
Happens only if you have a small collection.
>And when you want, it's not that hard to torrent or stream online from a Russian or Turkish website.
Are you fucking crazy, even rutorrent has the risk of being shut thanks to new laws.
>LIBERATE YOUR DRIVER!
Commit sudoku.

Books take up negligible space, as does music even at 320; as for movies, I've already got all the ones I like on DVD back from when digital storage space was limited.

Me, because I'd rather know what data I could lose, rather than be thinking about saving trash while I forget stuff that's worth saving.

>he doesnt advocate the foss 7-zip standard to his normie friends

i bet you still use winrar unregistered

>Good idea, except I don't see a better system than to bookmark imdb game reviews, which is shit.
How about a text file?

i generally don't care, but the hoarding of ratio and data on private torrent trackers is absolutely repulsive and it is really fucking things up and turning everything into pay to win seedbox bullshit.

tfw in your lifetime theres going to be "mules" who exfiltrate data from the "internet" to tor/zeronet/IPFS

these people will be putting it all on the line ie digital coyotes

the new web will be unhindered by outside control but the content will be lacking.

hopefully enough hoarders can hold out till its settled.

i fear theres less and less offline data every day

I have nine terabytes of porn ready for the day when an unholy alliance of SJWs, religious conservatives, and the national-security state conspire to censor the clear internet.

>"data hoarding" is a catchy term that milleniums employ to justify their dependency on the cloud
>lists all the reasons why I hoard data
Who the fuck hoards data online?

>Good idea, except I don't see a better system than to bookmark imdb game reviews, which is shit.
Emacs org-mode or hnb. I lean to hnb as it stores everything in XML hnb.sourceforge.net/Features/

>he thinks porn will be outlawed when its used as a physiological weapon*
>*israel plays porn over captured television stations

I don't worry about the data, just the quality of it. People worry so much about their porn and anime, but far smaller things are often more valuable.

My rip of David Irving's site, while only 700MB, is more valuable than some trash Hollywood movie.

>David Irving

Just git gud OP. One day I decided to sit down and split up my horrific unorganized mess into broad categories. It took some time, but afterwards it was easier to sort further a little bit at a time. Now I even have all my important pictures sorted by taxonomic category.