8
submitted 11 months ago by gerardit04@alien.top to c/main@selfhosted.forum

For now my server doesn't have very important data most of it are your "Linux isos" I can just download again and I'm thinking of starting to move my file and photos to the server but in afraid. What if I get a ransomwarei don't realize and all my backups get encrypted too? Or if the backups are corrupted and my disks breaks? But also I'm afraid about cloud because I've seen some posts about people getting their google accounts closed without notice for breaking TOS (maybe they did something wrong maybe not).

top 50 comments
sorted by: hot top controversial new old
[-] Malossi167@alien.top 4 points 11 months ago

It is impossible to fully eliminate the risk but with a decent backup system in place it is somewhat unlikely to lose all of your data.

The 321rule should be used as a baseline. Your local backup should be snapshotted and somewhat hardened against ransomware (pull backups instead of pushing them, do not mount the backup volume to other machines). Cold backups also help.

Can I construct scenarios in which I lose all my stuff? Sure. But in those, we are either in deep shit anyway (CME, some big astroid) or it is pretty unlikely (targeted hacking)

[-] Cybasura@alien.top 1 points 11 months ago

I'm too poor for a 321 lol

[-] Malossi167@alien.top 1 points 11 months ago

My backups are tiered. Some stuff gets no backup at all, some gets even more than 3.And I tend to reuse HDDs that got replaced in my main machine due to size for my backups. Power consumption hardly matters when it only runs for a few minutes a day.

[-] mirokra@alien.top 1 points 11 months ago

How much value does the data have for you?

If it's of very low value, that it doesn't even justify the costs of doing proper backups, then it's not so important to worry about it either.

load more comments (1 replies)
load more comments (1 replies)
[-] hadrabap@alien.top 4 points 11 months ago

I'm more scared of online services being discontinued and/or being getting vendor locked and forced to pay ransom on a regular basis. Therefore, I host and back up everything on my own.

[-] Treczoks@lemm.ee 3 points 11 months ago

A) Make backups B) take them offline.

[-] bobj33@alien.top 3 points 11 months ago

Aren't you scared about loosing your data?

No. I still have files from 1991. I've got files that have migrated from floppy disk to hard drive to QIC-80 tape to PD (Phase Change) optical disk to CD-RW to DVD+RW and now back to hard drives.

What if I get a ransomwarei don't realize and all my backups get encrypted too?

Then you need to detect the ransomware before you backup. I use rsync --dry-run and look at what WOULD change before I run it for real. If I see thousands of files change that I did not expect then I would not run the backup and investigate what changed before running the rsync command for real.

Or if the backups are corrupted

I have 3 copies of my data. Local file server, local backup, remote file server.

I also run rsnapshot on /home every hour to another drive in the machine. I also run snapraid sync to dual parity drives in the system once a day.

I generate and compare stored file checksums twice a year across all 3 copies to detect any corruption. Over 300TB I have about 1 failed checksum every 2 years.

and my disks breaks?

If one of my disks breaks I buy a new one and restore from backups.

But also I'm afraid about cloud

I don't use any cloud services because I don't trust them.

load more comments (1 replies)
[-] qwertyvonkb@alien.top 3 points 11 months ago

Follow the 3-2-1 principle and there is less reasons being scared of loosing data.

load more comments (1 replies)
[-] kring1@alien.top 2 points 11 months ago

Paranoia is the reason I self host. Clouds can kick you out or lose your data at any time.

[-] speaksoftly_bigstick@alien.top 2 points 11 months ago

Not as many years ago as I would prefer given my professional experience, I was running a lot from home. Most of it for myself to learn more (so nothing my home itself was dependent on) but a percentage of it was for storage of pictures, home videos, digitalized documents, emails, etc.

I ran my own exchange server for years (utilizing my own TLD that I bought in 2008).

I was in the process of migrating data from a couple of older hosts to the newer ones I had setup in the garage; basically from two cobbled together Dell T series poweredge servers in my hall closet to a small stack of R series poweredge in a 42u cabinet rack in the garage.

My whole stack was setup across the two hosts including backups from veeam from one to the other and copies.ofnthe backups stored on an external. Due to the size of the backups and where I was on my life financially, anything hosted up in cloud space was just a little out of my budget. Anything I could afford was suspicious at the time.

This too long story ends basically by me not paying attention to what I was doing and ended up destroying the raid on both of the original hosts without having finished moving all my data.

I lost years of emails from my exchange server, all the pictures and home made videos of my daughters life from birth to that point in time, and my backup data.

All from my own mistake(s).

I did everything I was "supposed" to do to keep stuff protected until I messed it up.

My daughter passed away this year in February at 16 years old. I'd give anything to have those pictures and videos back.

My point is, you can plan and execute and throw money at it if you're able. And you'll likely be fortunate enough to never really lose anything that's valuable to you. But even planning and implementing, you can still lose stuff just by oversight and human error.

That's the game, man. 🤷

[-] SceneAcceptable9176@alien.top 2 points 11 months ago

I’m really sorry to hear about your daughter.

[-] gerardit04@alien.top 1 points 11 months ago

I'm sorry for your loss. Thats the type of scenario I fear about, I can have the 321 backup but errors happen like not configuring you backup correctly, or destroying the raid... also I dont have a lot of money to buy drives and most of them are refurbished and I dont know if I can trust them.

[-] adamshand@alien.top 1 points 11 months ago

The thing is, these sorts of losses aren't limited to selfhosting. Selfhosting introduces some new risks and reduces some other risks.

Digital data is inherently fragile. It takes active work to preserve it.

That's one of the reasons my wife and I make an actual physical photo book each year of our favourite photos.

load more comments (2 replies)
[-] Tiwenty@alien.top 2 points 11 months ago

I used to regularly backup my photos to an external drive, but it'd still be in my house. Recently I just opened a cold object storage bucket at OVH and rclone to it every night. So even if they fail, the chance they fail at the same time as I do is pretty minimal. And I pay like 0.75€ a month for ~400GB

[-] gerardit04@alien.top 1 points 11 months ago

that very cheap I will check it

[-] BakGikHung@alien.top 2 points 11 months ago

You SHOULD be scare of losing your data. In fact it's a very likely outcome if you're storing data and you don't know what you're doing. This is true of every electronic storage format. If you're not ready to lose everything, you have periodically practice recovery from backup.

Over the years, i've met tons of novice computer users who tell me "I'm worried my files will get hacked if I store them on dropbox / cloud". I always set them straight: the number one risk for you is losing your own data, not data theft, unless somehow your files contain industrial secrets worth hundreds of millions of USD.

I consider myself an experienced computer user and developer, having had various roles that border on sysadmin. I don't trust myself to run my DIY NAS. For the stuff that matters, you should fear complexity as it 's a source of errors. You should doubt yourself at every step. Practice recovery. This is true for everything. I messed up my pfSense router config this weekend, it wouldn't boot. I took the opportunity to practice recovering from backed up config (I should have done that much earlier).

[-] EndlessHiway@alien.top 1 points 11 months ago
[-] ice-h2o@alien.top 2 points 11 months ago

Have multiple copies of the data. Use snapshots, they don’t get encrypted by a ransomware because they are read only and can’t be accessed via samba or nfs. It’s only a problem when the attacker gets root access to your NAS. Use a cloud provider like backblaze and backup your data encrypted. If you are really scared that ransomeware data will overwrite your backups use 3-2-1 and Grandfather-father-son backup strategy. But all this comes at a cost.

[-] Plane_Resolution7133@alien.top 2 points 11 months ago

Some data are backed up to a local NAS, some of that data is backed up to cloud (not Google or the big ones).

Most of my data aren’t important. Photo library is both local, in the cloud, and most on offsite DVDs.

~45K lossless music files is local and cloud. Those would suck losing, but I could rip them again.

I’ve been considering tape backup again, it’s like 20 years since I used it at home.

[-] shrugal@lemm.ee 2 points 11 months ago* (last edited 11 months ago)

The key is to do regular backups to a different location, and to keep previous versions as read-only backups for a certain timespan. If something happens to the local data you can just restore from the remote backup, and also pick an unmodified previous version in case of a ransomware attack.

E.g. I do a daily encrypted cloud backup of everything that can't just be downloaded again, and the backup provider keeps previous versions for 30 days.

[-] Simplixt@alien.top 2 points 11 months ago

My backup strategy:

Data:
- Sycnthing with 1x Copy with my Clients and 1x Copy on my Server accessible via Nextcloud
- Daily Push-Backup with of my Nextcloud-Data-Folder via Kopia to Backblaze
- Daily Pull-Backup of my Nextcloud-Data-Folder via QNAP-NAS in the basement

VM:
- Daily Backup of my VM's to a Proxmox Backup Server running on QNAP-NAS
- Daily Backup of my VM's to BackBlaze (but encrypted before)

Still, I'm not fan of having just one Cloud-Backup. So I think I will also get Hetzner Cloud Storage for Borg Backup additional to Kopia.

Goal:
- Different Hardware (Server, QNAP, etc.)
- Different Backup software (Syncthing, Kopia, Borg)
- Different Backup technique (Push, Pull, Snapshots)
- Different Locations

load more comments (2 replies)
[-] WhittledWhale@alien.top 2 points 11 months ago

I loose my data all over the place.

I loose it here, I loose it there, I loose it all over your mother's hair.

As far as losing data, I trust myself and my adherence to 3-2-1 more than I trust a third party solution.

[-] brando2131@alien.top 2 points 11 months ago

ZFS (mirrored) two HDDs. If one HDD fails, then replace it and let it rebuild. Use 3 HDDs mirrored if you really think you could get a failure while the array is rebuilding.

Also have two external backups, one you do regularly at home, and another you keep off-site. When you visit that location (be it your parents, siblings, relatives, friends house) swap out your external backup with their off-site to ensure its kept up to date.

Make sure all disks are fully encrypted of course.

[-] InfaSyn@alien.top 2 points 11 months ago

321 rule - anything super critical also gets off-sited to the cloud.

[-] EspritFort@alien.top 2 points 11 months ago

For now my server doesn't have very important data most of it are your "Linux isos" I can just download again and I'm thinking of starting to move my file and photos to the server but in afraid. What if I get a ransomwarei don't realize and all my backups get encrypted too? Or if the backups are corrupted and my disks breaks? But also I'm afraid about cloud because I've seen some posts about people getting their google accounts closed without notice for breaking TOS (maybe they did something wrong maybe not).

What you're describing sounds like general anxiety. So if you're asking whether I'm suffering from anxiety, then no :P There are risks in life and precautions you can take against them. I'm just as "scared" about losing data as I am about getting run over by a car, that is to say not at all. Both scenarios are horrible, both can be reduced in risk by employing reasonable countermeasures and behaviors. Beyond that it's out of my control so there's no point in worrying.

The only hazy variable in this kind of contemplation is: Am I knowledgeable enough to properly gauge the risks and know the "reasonable countermeasures"? And if you're asking "Do you know enough?" or "Do you spend enough time learning new things?" then my answer would always be an emphatic "No!" because there's no such thing as enough knowledge and competence.

[-] sloppy_diffuser@sh.itjust.works 2 points 11 months ago

I backup to Backblaze b2. I encrypt myself using rclone. Costing me $1-2/mo for about 100Gb that I'm currently using.

API key I use for automated backups is pretty much limited to write only and files are set to hidden when deleted, so not much risk, just an annoyance, if the key were stolen and they defaced my backups.

Once a year I might go delete some history to reduce my usage.

I lean towards scripts to automate setting up a system, so I don't do full system backups. Downloaded video I also mostly skip using mirrored storage. In the event of a real disaster, its an acceptable loss.

[-] HTTP_404_NotFound@alien.top 2 points 11 months ago

No... I have proper, tested backups.

[-] he-tried-his-best@alien.top 2 points 11 months ago

Only thing dear to me is my family photos and videos over the years. They’re backed up to two different cloud providers. Everything else is ultimately downloadable.

[-] dr-avas@alien.top 1 points 11 months ago

Immutability! For some reason nobody here mentioned this! There's only one thing which can protect you against ransomware - backup storage with immutability! It can be S3, custom script setting immutable flag, read-only snapshots and so on...

But... You need to make sure, that your backup storage is properly tightened, so even you, as the owner, cannot change immutable data without physical access to the server.

[-] gerardit04@alien.top 1 points 11 months ago

didn't know this could be done, I will check it for my photo backup as they are not gonna change. Thanks

[-] Zeal514@alien.top 1 points 11 months ago

Currently yes. But in the future, no.

[-] AdmiralPoopyDiaper@alien.top 1 points 11 months ago

Piggyback: anyone using LTO for backup/archival in their homelab?

[-] anturk@alien.top 1 points 11 months ago

I have one server home, one off side, encrypted files in the cloud and for the most important stuff i also have cold storage which i also do checksums once a while. If this gets me fucked up i don't know what to do.

[-] jsaumer@alien.top 1 points 11 months ago

No. I self host 100%. So, I have two separate storage stacks (truenas) that are always in replication.

load more comments (1 replies)
[-] Legitimate_Farm_3095@alien.top 1 points 11 months ago

But also I'm afraid about cloud because I've seen some posts about people getting their google accounts closed without notice

thats why you dont backup important data with google, apple, microsoft, etc. even paid accounts aren't safe with these companies and it's very difficult to talk with a real person if you need help. you use a company whose sole purpose is for backups. i use backblaze

[-] JohnBeePowel@alien.top 1 points 11 months ago

Personally my NAS isn't my main storage. I still use Google Photos and Google Drive for my important stuff, I just need to configure Rclone to download my stuff on it.

The one thing I'm really self hosting only is my music, outside of the couple of CDs and downloading from iTunes, I don't have a proper backup.

[-] sulylunat@alien.top 1 points 11 months ago

I’m currently using just an external drive to backup too, I use cloud storage for all my personal files, but my systems (I run a lot of servers that would be a pain to rebuild and reconfigure) and all my Linux ISOs are backed up nightly to a large external hard drive. However, I appreciate that I’m not covered for the local disaster scenario if my house was to set on fire, so my plan is to also implement Backblaze cloud backups of my server machine so I could have cloud backups of my backups at least.

[-] PFGSnoopy@alien.top 1 points 11 months ago

I'd be more concerned to lose data that is stored in the cloud than on my private network.

The adage "there is no cloud, it's just someone else's computer" is still true.

If you are afraid to lose the data on your clients and servers in your private network, improve your backup strategy and make sure to have one backup off premise (in a safe deposit box if needs be).

It doesn't hurt to improve overall security on your private network, either. 😉

[-] Labeled90@alien.top 1 points 11 months ago

Not really, Anything important I have in multiple locations. Any media I have hosted I'm not worried about because I can just re-download it.

Photos and video I have on both cloud and my server. Anyone getting their google account closed are probably uploading things that aren't allowed.

In the future I want to build an additional, quite server and have it set up at a relatives house out of state so that I have 3 copies of important data.

[-] therealSoasa@alien.top 1 points 11 months ago

Meh you don't really lose your data , do you. I mean , we all know where it is.

[-] lacionredditor@alien.top 1 points 11 months ago

you're chances of being hit by lightning is probably higher than all 3 copies of your data being inaccessible all at the same time for whatever reason.

[-] ratcodes@alien.top 1 points 11 months ago

not scared. it's super unlikely all of your backups will fail at once assuming they're not all the same method attached to the same hardware

[-] DayshareLP@alien.top 1 points 11 months ago

I run Proxmox VE and Proxmox Backup Server on two machines at the same time. I pull the main backups from the main machine, where all the Vdisks are to the second one. Until now it works like a charm. The third of site machine is in the making

[-] Not_your_guy_buddy42@alien.top 1 points 11 months ago

You didn't say how you currently keep your data...

load more comments
view more: next ›
this post was submitted on 26 Nov 2023
8 points (90.0% liked)

Self-Hosted Main

504 readers
1 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

For Example

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

founded 1 year ago
MODERATORS