all 112 comments
navigate by

[–]AutoModerator   [M] [score hidden] stickied commentlocked comment (0 children)

Hello /u/FreneticFrench   ! Thank you for posting in r/DataHoarder.

Please remember to read our Rules and Wiki.

Please note that your post will be removed if you just post a box/speed/server post. Please give background information on your server pictures.

This subreddit will NOT help you find or exchange that Movie/TV show/Nuclear Launch Manual, visit r/DHExchange instead.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[–]esjay86   23 points24 points  (0 children)

An ephemerist, someone who enjoys things that are fleeting, temporary, out of sight and out of mind once they're used.

[–]SuperElephantX   25TB 23 points24 points  (9 children)

Oh, I knew this guy who was the complete opposite of a data hoarder, like, seriously.

I asked him why he acted that way, not even bothering to save photos to his hard drives when he got a new phone. He straight up told me that he despised his past and didn't see any point in dwelling on it. He only had a handful of pictures of his sports car, a few shots of his cat, and not many photos capturing moments with his girlfriend.

Can you believe it? In his mid-20s, he had, like, a maximum of 1GB of precious data to hold onto.

[–]cosmin_c   1.44MB 11 points12 points  (2 children)

He straight up told me that he despised his past

That is so sad :(

I still have all the memories (photos, etc) and when I open them I feel nothing but gratitude because even if they're not so happy memories I learned a lot from those experiences. We are all out past, not just what we like. "All sunshine makes a desert" say the arabs and they're definitely not wrong.

[–]KevinCarbonara   6 points7 points  (1 child)

I don't think it's inherently sad. That is not me by any chance, but I am envious of the experience, in the same way I'm envious of buddhist monks who are happy with nothing.

[–]cosmin_c   1.44MB 1 point2 points  (0 children)

I can respect that 🙏

[–]FreneticFrench   [S] 4 points5 points  (1 child)

Haha love this answer, I think I’m actually interested in the psychology behind all of this. Like, it blows my mind that the (lovely) people in this sub don’t experience overwhelming responsibility over all of their “data possession”. Just like you can’t understand this guy! I guess I’m in between.

[–]SuperElephantX   25TB 6 points7 points  (0 children)

Yeah, I also can't wrap my head around how he could just toss away so many memories like that. Personally, I start forgetting the details of events that took place even just 10 years ago. I'm honestly super grateful that I've gathered enough of those moments. I mean, at least I have those photos to whip out and share, so I can relive those precious times all over again.

Even though memories can sometimes serve as a reminder of the hardships I've endured, they also show me how I've managed to stay resilient and persevere. I'm certain that in another 10 years, the future version of myself would say, "Hey, you should definitely gather even more of these memories!"

[–]humanclock   1 point2 points  (1 child)

Yeah, I once knew a woman who deleted her emails after reading them, back when it was more popular pre social media.

[–]freedomlinux   ZFS snapshot 0 points1 point  (0 children)

IMO this was common in the past because inbox quotas were very small. With many services only allowing users to have ~10-100MB it was critical to delete things (especially attachments).

When Gmail launched in 2004, providing 1GB of mail storage, gradually increasing to 15GB today, people's habits changed. That said, my university email almost a decade later still had a 100MB quota and it was very painful.

[–]OnceUponCheeseDanish   0 points1 point  (1 child)

Damn... where you guys live? Let's make some good memories with him

[–]SuperElephantX   25TB [score hidden]  (0 children)

You know what? I've got these awesome screenshots of some epic online moments with him. We're talking gameplays, chats, and those hilarious "lol" moments. They're like treasures to me, so I'm definitely gonna hold onto them and bring them up in conversations every now and then. They make for some great talking points, like a conversation piece of art.

[–]com2ghz 30 points31 points  (12 children)

Yeah, the ‘you own nothing and you will be happy’ people.

[–]FreneticFrench[S] 9 points10 points  (7 children)

Haha yes, but to me it’s more “you can’t be happy if you have to think about back ups and ever growing amount of data”. It makes me so unreasonably anxious!

[–]ZorbaTHut64TB usable 7 points8 points  (4 children)

Keep in mind that an evergrowing amount of data is honestly not that big of a deal thanks to evergrowing storage systems. I currently have about three million times as much data as I did on my original computer, and instead of fitting on one hard drive it fits on five hard drives.

Keep it below the exponential progression - and frankly we're running out of things to spend bytes on, so that's getting increasingly easy - and keeping it around really isn't that big of a deal.

[–]dinosaurdynasty 1 point2 points  (0 children)

But my 4K HDR Linux ISOs!

[–]alex2003super48 TB Unraid 0 points1 point  (1 child)

I think storage density is plateauing, at least for HDDs. I can't imagine there being much higher density storage without significant compromises in random access rates and/or reliability.

SSDs are a whole different matter obviously. I can see a future where spinning rust is simply an outdated device, and 100 TB flash that can fit in your pocket is as affordable as a 20 TB HDD is today.

[–]NavinF40TB RAID-Z2 + off-site backup 0 points1 point  (0 children)

Why would any serious datahoarder care about those compromises? HDDs are already extremely slow with seek time on the order of 10ms, but software can handle that just fine for streaming Linux ISOs. Meanwhile reliability is way too high (~2% annual failure rate) for anyone that has RAIDz and backups. I would gladly buy drives that failed more often if I could get costs down

[–]KevinCarbonara 0 points1 point  (0 children)

How long is that going to continue? We appear to be in the midst of changing horses from hdd to ssd. Hdds have not been growing in size. Ssds have, but it'll be several years before they catch up. We may well be in the middle of a "pause" when it comes to data storage growth.

[–]vogelke 4 points5 points  (0 children)

if you have to think about backups...

...then you're doing it wrong. Automate the shit out of doing them, checking them, refreshing them, etc.

Western Digital external drives:

  • 4TB for $120
  • 10TB for $220
  • 20TB for $350

I know nobody's made out of money these days, but if you could trade $120 for NOT worrying about your stuff, is the peace of mind worth it?

Do the 80-20 rule: 80% of the benefit comes from 20% of the effort, so do the 20% and hang the rest.

  • Get a drive and copy your stuff to it; Robocopy plus MS FCIV (file checksum integrity verifier) will check the files once they've been copied.

  • Set up a reminder that says "plug me in and click START" once a day / week / month / whatever, depending on how much potential loss you're comfortable with.

  • You've done your due diligence, so relax.

[–]polnyj-pizdiec 0 points1 point  (0 children)

It makes me so unreasonably anxious!

I know exactly what you mean. I collect music and films. It gives me enormous anxiety to know there are albums I haven't listened to yet. Usually I'd get into a record and do a repeat listening until it becomes familiar. Having more than 6 thousand records tells me I will never get to the end of that list - anxiety overload ¯\(ツ)

As for the opposite of hoarding, there's a philosophical position of living in the present moment. For those who follow it, focusing on saving data is just a way of avoiding the real existencial questions they fear to face. As the Buddha said, “Do not dwell in the past, do not dream of the future, concentrate the mind on the present moment.

[–]cosmin_c1.44MB 7 points8 points  (1 child)

I was just about to write you can spot them because they use spotify and netflix and other streaming services almost exclusively and if you ask them where that document is they have no clue and retrieve it from Excel's history.

[–]ErynKnight64TB (live) 0.6PB (archival) 1 point2 points  (0 children)

This makes me uneasy. I have colleagues like this. They have 40 open tabs, and none of their desktop icons are even in a grid... With stuff literally overlapping.

I call these desktops a "Layer 8 collage".

[–]devilpants -2 points-1 points  (0 children)

There are a lot of people like this. It’s probably not bad. Less to clutter your mind if it doesn’t bother you.

[–]OnceUponCheeseDanish 0 points1 point  (0 children)

Right before I got into archiving data I was doing my best to get away from technology and needless things that I "rely on" in general.

Now I'm more reliant on the Internet and technology than ever 🙃

[–]cakee_ru60TB 7 points8 points  (3 children)

I always hope the Pied Piper guy will come and I will be able to fit it all in one hand. One day, one day..

To answer you - don't be a martyr of your data. Find a balance. I chose to save everything, but compress the hell out of it. I.e. I save all photos from my phone, but compress them to 1080p and <= 1MB Jpeg. Because I don't need the tiny details from photos, I just want to keep memories.

[–]Beanconscriptog14TB 4 points5 points  (0 children)

Oppenheimer 2160x webrip

[–]FreneticFrench[S] 3 points4 points  (1 child)

Thanks for the answer. I see you have 60TB, what led you to start archiving so much, if that ok to ask? I'm genuinely curious about all of this!

[–]bg-j38 0 points1 point  (0 children)

I have about 60TB of storage right now spread across a number of drives. Definitely don't have 60TB of data though. I have a couple older 8 and 10TB external drives, an 18TB external I recently got, a couple 5 TB 2 1/2" externals, and a few 4TB external SSDs. I live a pretty mobile lifestyle so I live on my laptop. I don't even have a desktop. Basically the 5TB drives were meant for travel. One that lived in my backpack and a mirror of that at home. The smaller full sized externals are mirrors of that data and other lower priority stuff that I don't want with me at all times. The 18TB is the master archive that contains everything and is backed up into a few places. The 4TB SSDs are meant to replace the 5TB drives. Three of them weigh as much as one of the 5TB drives and I feel more comfortable having them bounce around in my backpack. Though I'm amazed that the 5TB I've been carrying around for four or five years still works.

As far as data, in total it's around 15TB or so. I have a huge collection of technical documents (I run a document archive, though that's only a small portion of what I have). I have around 4TB of comic books. My music collection is a little over 2TB with probably 500GB more that needs to be sorted. Toss in there a bunch of digital books that I've mirrored over the years. A big collection of pulp magazines. An old time radio archive. A shit ton of game ROMs from mostly 1970s to 1990s systems. And a small video archive maybe approaching 1TB. I do have a lot of video stored on a friends server. Maybe 4TB that I haven't bothered keeping locally.

So there you go! Do I need it all? Probably not. But it's nice to have it in case I do.

[–]Beowoden 17 points18 points  (0 children)

Destroyer Of Worlds

[–]FishSpoof 17 points18 points  (0 children)


[–]marvelmon 4 points5 points  (0 children)

Data consumer.

[–]antsam9 5 points6 points  (2 children)

My pandemic project was to get a hold on my data and preserve it.

I got all my hdd from multiple locations into one spot some as old as 20 years, new hdd, setup freenas on hardware with ecc ram. I extracted everything into fresh RAID. I seriously had IDE HDD, SATA HDD and SSD, micro sd, and random cloud uploads that mix.

It was like, 10 tb.

Then, one particularly long weekend alone, I looked over it all, and I started deleting...

I didn't need system backups for hardware I don't even have

I didn't need old torrent downloads under 720p, they hurt my eyes tbh

I didn't need backups of steam folders

I didn't need research and downloads and homework for high school and college

I was down to 6tb

Then I got serious: incomplete seasons, movies that I didn't see myself watching again, non-sentimental files over 10 years old, all the ISOs for software I can't even run in modern windows or have found modern software to replace.

down to 4tb

I put music on one hdd, and everything else (photos and file) I wanted to save, and it came out to 1 tb. I uploaded that archive to a cloud, and a local copy, and a cold storage copy, and I immediately regretted doing everything I did to setup a FreeNAS on purpose built hardware. It wasn't worth all that for 1tb of data. However, now I see that if I hadn't done all that, I wouldn't have everything I wanted to keep in a safe place.

I recently moved and got new hardware, I downloaded that archive and updated it with the new files and pictures I wanted to keep, and reuploaded it. Done, and I don't have data anxiety anymore.

[–]progfrog 0 points1 point  (1 child)

I downloaded that archive and updated it with the new files and pictures I wanted to keep, and reuploaded it ?

[–]antsam9 0 points1 point  (0 children)

Thanks! I'll def incorporate this

[–]imzeigen 3 points4 points  (0 children)

This is my wife. Until we married my wife would even save sms. Would clean everything she hated to have stuff particularly in her phone. It wasn’t until I showed her the benefits of having something like Google photos to easily search for things

[–]DocMadCow 3 points4 points  (9 children)

There sure are and you see it in the video piracy community all the time. You have guys that love giant episodes, and then people download the same episode at the same resolutions that is 1/10 the size! I can't imagine watching a 200 to 300mb episode of a 44 minute show. Personally I would rather watch something on BluRay most of the time over streaming due to the low quality of so many movies on major streaming providers.

[–]alfred725 4 points5 points  (7 children)

theres usually reasons.

First, people may still be used to getting charged insane amounts of money for internet bandwidth. Download limits and overage charges are a real problem, especially for phones.

Download speeds. Downloading a 4k movie can take hours where the 1080p could be a few minutes.

People may not have a ton of storage space. The choice is between one 4k movie, or ten 1080p movies.

There's no need for retention. You're downloading a movie for yourself, not for archiving. There's no need for the HD version.

Tech. If you don't have a 4k monitor, the 4k resolution is wasted.

Quality. Just because the file is bigger doesn't mean it's higher quality. If the show was produced at 1080p, upscaling it to 4k doesn't actually increase the quality. I've downloaded 4k anime that was upscaled from 1080p and it actually was worse quality because it had a few corrupted artefacts. Corruption on a couple frames throughout the movie because the upscaling wasn't done perfectly and you wouldn't catch it unless you sat to watch the whole thing.

[–]NavinF40TB RAID-Z2 + off-site backup 1 point2 points  (0 children)

If you don't have a 4k monitor, the 4k resolution is wasted

This is usually incorrect in practice since 1080p uploads rarely have enough bitrate to match a 1080p monitor. Resolution is not that important, but bitrate is

[–]DocMadCow 0 points1 point  (4 children)

Preaching to the choir. I've spend ages playing with different encoders and settings to nail down what I like, and I am constantly changing my opinions to get better quality.

[–]ErynKnight64TB (live) 0.6PB (archival) 0 points1 point  (3 children)

You'd hate me... My HEVC encoders run from 10 years of fine tuning. Now they're indistinguishable from source at a 10th of the size.

[–]DocMadCow 2 points3 points  (2 children)

You'd hate me... My HEVC encoders run from 10 years of fine tuning. Now they're indistinguishable from source at a 10th of the size.

Awesome I am always playing just found some great software for my fine tuning. Working on settings for Rick and Morty right now and this is a life saver video compare . I take it you use all kinds of different settings based on the content type?

[–]ErynKnight64TB (live) 0.6PB (archival) 0 points1 point  (1 child)

Actually... And this is the bit where you'll hate me (I omitted it before to gain your trust... Bwahahaha)...

I use the same settings for animation, film, and even grainy stuff shot on 16mm.

The only variable, is the bitrate. I'm a set and forget type, that runs my encoders directly off my solar panels. I set up my queues at night and then when the panels hit 2kw, the WoL fires up the encoders. The queses load up and start running until the sun starts setting. Then everything turns off for the night. Sometimes I'm home, sometimes I'm not.

It's Handbrake all the way for me. I have studio NLEs and such. Paid for thousands of pounds worth of software licences and plugins, yet none of them have ever matched Handbrake.

That said, I use a hardware deinterlacer and reverse pulldowns first. I am getting into AI though, and definitely had fun with Topaz.

This is still my current project, a year in and nearly finished season 1.

I'm doing it frame by frame to split on twos (animated at 12fps, edited and VFX'd at 24fps, with the opening credits done at 29.97fps post 2:3 (WHAT!?))

[–]DocMadCow 0 points1 point  (0 children)

Ayeee count me out. But I totally disagree about the same settings for everything. I'm testing several anime guides against Rick and Morty and using Video Compare and honestly I can see a difference between what the different guides say. For grainy stuff like Fringe I use would absolutely use different settings than a cartoon.

[–]nurseynurseygander35TB 1 point2 points  (0 children)

I mean, I have shit eyesight and I grew up with videotape then DVDs. Visually sumptuous things like House of the Dragon, yes, I want that in 1080p, I can appreciate the difference enough for that, but 720p seems perfectly serviceable to me for ordinary things. (I have finally tracked down and replaced my very old 480p shows, though).

[–]Thinking-Guy 3 points4 points  (1 child)

To borrow a term from the Wikipedians: "Deletionist"

[–]DanTheMan82730TB unRAID 2 points3 points  (1 child)

There are people who will format and reinstall their os without copying any data… and they don’t have any backups

[–]SuperElephantX25TB 1 point2 points  (0 children)

True, just encountered another instance.

[–]458643 2 points3 points  (0 children)

The end user who frequently asks if their data can please please be retrieved

[–]Is-Not-El 2 points3 points  (0 children)

A data loser ? 😂

[–]ptoki 2 points3 points  (1 child)

Every common user is the opposite.

They dont care about their data. They let others care about it for them.They dont check if their emails from 209 are still in their mailbox.

They dont care if the photos from 2020 vacations are in their new phone.

They dont save photos to their computer, ever.

they dont have their songs saved anywhere else than in their spotify.

They dont realize the vidoes on their youtube playlist are gone missing.

They let corpos manage their data and hope thae data will still be there no matter how they dont care personally.

[–]Halos-117 0 points1 point  (0 children)

Such a disgusting way to live...

[–]johandepohan 3 points4 points  (0 children)

Alzheimers patient

[–]schrmm 1 point2 points  (0 children)

My company

[–]neon1415official 1 point2 points  (0 children)


[–]Swallagoon 1 point2 points  (0 children)

Yes, someone who doesn’t data hoard.

[–]dpdxguy 1 point2 points  (0 children)


[–]SmolMaeveWolff 1 point2 points  (0 children)

Data Marie Kondo? Does this Linux ISO spark joy?

[–]mhornberger 1 point2 points  (0 children)

There are people who don't even bookmark web pages. They don't have a Youtube watch later list. If they don't read/watch it now, they'll think of it later. Or not, and it won't matter.

I'm barely a hoarder by the standards of this sub. But I want my movies and music locally, so that imposes some necessity.

[–]0x4C554C 1 point2 points  (0 children)

There are people who constantly pay for movies, music, and other data but constantly lose it or don't keep track of it. Only to buy it again and again. They also subscribe to multiple streaming services.

[–]MikeTheMic81 1 point2 points  (0 children)

The data minimalist is going to be so bored when the zombie apocalypse/crash of the economy/Mad Maxx in real life starts and they don't have a PB of TV Shows and movies to keep them entertained over the next 80-100 years. Lol

[–]RICHUNCLEPENNYBAGS 0 points1 point  (0 children)


[–]UnlikelyAdventurer 0 points1 point  (0 children)


[–]SamSausages301TB, Unraid, ZFS, EPYC 7343 0 points1 point  (1 child)

What has prompted your interest in data hoarding?

Censorship and Memory-holing

[–]ErynKnight64TB (live) 0.6PB (archival) 1 point2 points  (0 children)


[–]VenomXTs 0 points1 point  (0 children)

Minimalist, or just poor planner?

[–]CryptoVictim 0 points1 point  (0 children)

A data eschewer

[–]Neodarlek 0 points1 point  (0 children)

Someone who has everything in the cloud, except for their OS, so their device requires the absolute minimum of storage

[–]timewarp33 0 points1 point  (0 children)

Data Disposer

[–]imnotbis 0 points1 point  (0 children)

Data retentive and data expulsive personality?

[–]Agreeable-Pirate-886 0 points1 point  (0 children)

My mom has her few documents and photos in Google's cloud and nothing on her computer but bookmarks. She thinks it's safer because she's had a hard drive fail. I've told her Google can zap her account at any time.

I collect data I would miss if it were gone.

AI photo classification has nearly reached the point where we no longer have to manually organize our photos. I'm counting on it to save my bacon after years of procrastination on that organization.

[–]WraithTDK14TB 0 points1 point  (0 children)

    My whife has similar issues with her photos. She has hundreds of thousands. She takes thirty photos of everything "so she can get the right shot," but can never find the time to sort through them. She keeps running out of space on her phone's msd card, and just getting a new one and putting the old one away. She six terrabites of mostly photos on my desktop (I gave hear a hard drive in it so she could use it for Photoshop) and none of it is organized.

    I can only give you the same advice I give her: you need to curate, and that means you need a system. A good system/protocol/routine should allow you to keep your data sorted and organized, and I strongly suspect that once you know exactly what you have and where it is, you'll feel a lot better.

    If your concern is storage, if you are not consciously data hoarding (in other words, you're not going out and looking for entire runs of magazines, TV shows etc.); a good curation system will ensure that while yes, your data collection may continue to grow consistently, I doubt very much that it will grow at a rate that makes it unfeasible to manage.

    If I might make a suggestion to begin with: /r/datacurator

[–]VelvitHippo 0 points1 point  (0 children)

People who have every streaming service out there.

[–]marwood0+200TB scattered around the house 0 points1 point  (0 children)

There's a thing called Obsessive-Compulsive Spartanism (a form of OCD) that could be applied to data or anything else. The presence of things seems to cause a nagging anxiety which leads to them trying to free themselves from things. This isn't minimalism per se. In extreme cases someone may buy something, say a toaster, then throw it away, then find they need a toaster and buy another one. My spouse has some of those tendencies and I am always saving things from the trash and sometimes even backing up her office computers that she doesn't even own.

Then there's us folks here. There's a theory that some of us have an innate belief that resources are limited and we must take advantage of the opportunity to get what we can now. Our anxiety comes from the fear of losing our stuff and not having a backup. This may seem perplexing to some because we devote so much of our resources to getting and keeping that stuff. For me it only becomes a problem when I know I have it but can't find it. Or realizing maybe I do have a problem when I find a brand new 16TB drive in a pile of computer parts that I don't remember buying, then a week later finding another one.
There's also the data curators here that find gathering and organizing beautiful and calming. Many of us here are bits of both.

[–]blazinfastjohny 0 points1 point  (0 children)

Normal modern people are the opposite; everything on cloud no data on hand, except maybe photos and videos captured on phones.

[–]cortesoft 0 points1 point  (0 children)


[–]atiaa111.44MB 0 points1 point  (0 children)

Digital minimalist

[–]Revolutionalredstone 0 points1 point  (0 children)

A Virgin.

[–]Tim-the-second2TB 0 points1 point  (0 children)

Chromebook user (no shade lol)

[–]the-egg2016 0 points1 point  (0 children)

people who use streaming

[–]Kevalemig 0 points1 point  (0 children)

I'd use a term like 'non-collector' which I work with a lot of people who just go home and watch streaming services, some even play videogames on subscription services like Xbox Game Pass and don't actually buy anything to own. At all.

They spend their money on food and travel, and don't collect anything. I guess that's the opposite of us?

[–]KyletheAngryAncap 0 points1 point  (0 children)

Wouldn't that be most people? Casually consuming media and just downloading onto their one laptop every once in a while.

[–]michaelmalak 0 points1 point  (0 children)

A long-time Wikipedia editor

[–]fernatic19 0 points1 point  (0 children)

You should rest easy then knowing that at any moment the drive could break and lose everything. It will delete stuff for you.

[–]ArcticCircleSystem 0 points1 point  (0 children)

It's called Every archivist on the Internet gets Vietnam War flashbacks whenever one of their websites shows up in the news.

[–]dwkindig 0 points1 point  (0 children)

I use TailsOS as my daily driver, with persistent storage disabled.

[–]4thelulzgamer 0 points1 point  (0 children)

I am not sure whether there's an official term for it (though dataphobe comes to mind, but it seems a little off), but there are a lot of minimalists when it comes to data. Probably the kinds of people that handle info that are sensitive and has to be purged frequently. Well, that or the person doesn;t really care about the files and only keeps what s/he needs.

As much as it's a goal of mine to hoard, I kinda do not have as huge as the storages of the other people here, but I tend to keep free indie games I could find, even demos sometimes, and some obscure alternative software for certain paid apps. Usual reason for the hoard is for offline use; I do not want a cloud-only environment.

[–]ErynKnight64TB (live) 0.6PB (archival) 0 points1 point  (0 children)

Yeah, my cousin, who deleted pictures she doesn't like off the SD card directly... Accidentally formatting the card instead.

They're data shredders.

[–]disguy2k 0 points1 point  (0 children)

DataPurger. I like to save the meaningful/useful stuff, but I don't keep everything for the sake of it. I try to have an efficient workflow during content creation, and purge the unwanted stuff straight away.

[–]dunnmad 0 points1 point  (0 children)

I’m 72, I would have loved the convenience of photos that we have today. Have some photos of youth, but cameras, film, developing, cost, etc was a pain. And even then quality of photos weren’t that great.

[–]AntiProtonBoy1.44MB 0 points1 point  (0 children)

A Buddhist. Everything is in a state of impermanence.

[–]seanthenry 0 points1 point  (0 children)

A cloud storage user.

[–]worst-coast [score hidden]  (0 children)

A Marie Kondo script.