11

Hello selfhosted !

Continuing my journey of setup up my home k3s cluster.

I’ve been asking myself if Longhorn might be overkill for my home cluster,here’s what i did:

3 machines running k3s each. One of them has a storage in Raid 5 and I dont want to use any storage from the other two.

Thing is, i had to configure replicas to 1 in longhorn for my pv to be green.

Hence my question, since data is already replicated in the array, shouldn’t I just use a NFS storage class instead?

Thanks !

all 12 comments
sorted by: hot top controversial new old
[-] cygnus@lemmy.ca 14 points 11 months ago

I've never heard of this particular "Longhorn" and was very confused as to why Windows Vista was coming up in conversation.

[-] hayalci@fstab.sh 6 points 11 months ago
[-] Burn1ngBull3t@lemmy.world 1 points 11 months ago

Exactly thanks!

[-] Burn1ngBull3t@lemmy.world 2 points 11 months ago

Haha sorry indeed, it’s Kubernetes related and not Windows WeDontSayItsName related 😄

[-] seang96@spgrn.com 4 points 11 months ago

I'm actually swapping from longhorn to rook and ceph right now. Longhorn has given a lot of troubles and it does not like replica of 1 at all. Sounds like you do want a NAS, though high availability is probably over kill for home use, having a NAS makes you have that as a single point of failure. I ended up upgrading all my nodes and keeping replication off 3 since I still wanted the high availability.

[-] Burn1ngBull3t@lemmy.world 1 points 11 months ago

I would guess it doesn’t like replica at 1 indeed.

And using a NAS would be a single point of failure indeed, but how I’m using Longhorn right now already is (my storage node goes down, my cluster would be unstable)

Thanks !

[-] Starbuck@lemmy.world 4 points 11 months ago

Longhorn is basically just acting like a fancy NFS mount in this configuration. It’s a really fancy NFS mount that will work well with kubernetes, for things like PVC resizing and snapshots, but longhorn isn’t really stretching its legs in this scenario.

I’d say leave it, because it’s already setup. And someday you might add more (non-RAID) disks to those other nodes, in which case you can set Longhorn to replicas=2 and get some better availability.

[-] Burn1ngBull3t@lemmy.world 1 points 11 months ago

You are completely right.

However in my mind (might be wrong here) if I use another node, i wouldn’t use the RAID array completely.

While setup up i thought that its either:

  • NAS storageClass attached to the RAID array, no longhorn
  • with longhorn when there is no RAID, but replication at 3

In either case, the availability of my data would be quite the same right ?

(Then there is options to backup my PV to s3 with longhorn and all that i would have to setup again though )

Thanks for your answer !

[-] magikmw@lemm.ee 3 points 11 months ago

Longhorn isn't just about replication (which is not backup, and RAID is not backup either). Also if you only have one replica, is it even different from local storage at this point?

You'd use longhorn to make sure applications don't choke and die when the storage they are using go down. Also, I'm not sure if you can supply longhorn storage to nodes that don't run it. I haven't tried it.

I suspect all pods that you'd define to use longhorn would only go up at the longhorn replica node.

All this is how I understand longhorn works. I haven't tried it this way, my only experience is running it on every node so if one node goes down pods can just restart on any other node and carry on.

[-] Burn1ngBull3t@lemmy.world 1 points 11 months ago

Hello ! Thanks for your response!

Yes RAID is used as availability of my data here, with or without longhorn, there wouldn’t be much difference there (especially since i only use one specific node)

And you would be right, since the other nodes are unscheduled, it will be available only on my “storage node” so if this one goes down my storage goes down.

That’s why i might be overkill with longhorn, but there are functions to restore and backup to s3 for exemple that i would need to setup i guess

[-] citizen@sh.itjust.works 2 points 11 months ago

Sounds like NFS is a way to go in your case. Longhorn adds for your setup unnecessary resource overhead and complexity.

this post was submitted on 02 Dec 2023
11 points (86.7% liked)

Selfhosted

40173 readers
620 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS