this post was submitted on 04 Jun 2025

352 points (100.0% liked)

Fediverse

35392 readers

173 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!

Rules

Posts must be on topic.
Be respectful of others.
Cite the sources used for graphs and other statistics.
Follow the general Lemmy.world rules.

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration)

founded 2 years ago

MODERATORS

ruud@lemmy.world

TragicNotCute@lemmy.world

Xylinna@lemmy.world

MrCenny@lemmy.world

automodbeta@lemmy.world

woelkchen@lemmy.world

352

Slrpnk.net outage (resolved) (feddit.org)

submitted 1 month ago* (last edited 1 month ago) by Kris@feddit.org to c/fediverse@lemmy.world

133 comments fedilink hide all child comments

Edit: unexpectatly we are back online. Will share how we found a solution later. There might be still some federation issues though.

Alt account of poVoq@slrpnk.net here.

Our instance is currently down and I can't get remote access to the servers. It appears that there might have been a hardware failure of the main firewall, which is the one thing I can't work around remotely.

I am still trying a few things, but I am not very optimistic that I can get access.

The really unfortunate part is that just now I am on one of my rare work deployments abroad, so I also can't access it physically during the next few weeks and my usual back up that could restart it is not available either.

As something like that never happened in 3 years operating the servers, I thought I can risk it, but murphy's law seems inescapable 😓

I will try to keep you posted here on any updates, but probably there will not be much I can do for a while. Really bad timing 😥

Edit: we might use this "opportunity" to migrate the instance to Piefed, which has been an idea for quite some time now. I will keep you posted on that.

(page 2) 50 comments

sorted by: hot top controversial new old

[–] bacon_pdp@lemmy.world 10 points 1 month ago

It happens, it’ll be fine. Just remember not to stress out too hard about it and it’ll be fine. The solar punk community knows how to survive a server outage in style.

[–] AlexisFR@jlai.lu 10 points 1 month ago (2 children)

That's unlucky, but is it hosted at someone's home?

load more comments (2 replies)

[–] khaleer@sopuli.xyz 8 points 1 month ago* (last edited 1 month ago)

It looks like there is no enough solar power for solarpunk!

~~no need to show me where doors are, I will find them by myself~~

anyway, good luck with that!

[–] khaliso@lemmy.world 8 points 1 month ago

Thanks for the heads up! My Main account is in slrpnk, so I'll set a reminder in an month to switch back. :)

[–] match@pawb.social 7 points 1 month ago

Ty for the update! slrpnk is my favorite instance that isn't my home instance

[–] tenchiken@lemmy.dbzer0.com 6 points 1 month ago

Sending positive vibes, and passing offer of technical assistance once you get access again.

Hopefully it's an easy fix once you get into things again.

[–] LeighWeighTacoma@lemmy.world 5 points 1 month ago

I appreciate the update was thoroughly confused

[–] PM_ME_VINTAGE_30S@lemmy.sdf.org 5 points 1 month ago

That sucks. Thank you for your time and running the instance. Gonna miss you all like hell while you're gone. 😞

[–] originalucifer@moist.catsweat.com 5 points 1 month ago (1 children)

people hate the big cloud solutions, but this is the kind of thing their HA infrastructure prevents against... hardware failures

i dont enjoy using (or paying for) aws, but i will never have a firewall or disk failure.

[–] drspod@lemmy.ml 7 points 1 month ago

Their HA infrastructure is all built on open source projects. The thing they have that we don't is teams of SREs on-call 24/7.

[–] silence7@lemmy.world 5 points 1 month ago (1 children)

Thanks for letting us know what is going on.

[–] Kris@feddit.org 5 points 1 month ago (1 children)

Sorry that it took so long to get the word out. I guess we relied a bit too much on the xmpp server for internal communication.

[–] silence7@lemmy.world 5 points 1 month ago (1 children)

Even the big operations break in unexpected ways. Facebook accidentally broke the authentication for their door locks when they took the site down a few years back and had to fly people to a datacenter and break down a door to get to servers and restart things.

load more comments (1 replies)

load more comments