this post was submitted on 04 Jul 2023
701 points (98.1% liked)

Lemmy.World Announcements

30479 readers
3 users here now

This Community is intended for posts about the Lemmy.world server by the admins.

Follow us for server news 🐘

Outages πŸ”₯

https://status.lemmy.world/

For support with issues at Lemmy.world, go to the Lemmy.world Support community.

Support e-mail

Any support requests are best sent to info@lemmy.world e-mail.

Report contact

Donations πŸ’—

If you would like to make a donation to support the cost of running this platform, please do so at the following donation URLs.

If you can, please use / switch to Ko-Fi, it has the lowest fees for us

Ko-Fi (Donate)

Bunq (Donate)

Open Collective backers and sponsors

Patreon

Join the team

founded 2 years ago
MODERATORS
 

Status update July 4th

Just wanted to let you know where we are with Lemmy.world.

Issues

As you might have noticed, things still won't work as desired.. we see several issues:

Performance

  • Loading is mostly OK, but sometimes things take forever
  • We (and you) see many 502 errors, resulting in empty pages etc.
  • System load: The server is roughly at 60% cpu usage and around 25GB RAM usage. (That is, if we restart Lemmy every 30 minutes. Else memory will go to 100%)

Bugs

  • Replying to a DM doesn't seem to work. When hitting reply, you get a box with the original message which you can edit and save (which does nothing)
  • 2FA seems to be a problem for many people. It doesn't always work as expected.

Troubleshooting

We have many people helping us, with (site) moderation, sysadmin, troubleshooting, advise etc. There currently are 25 people in our Discord, including admins of other servers. In the Sysadmin channel we are with 8 people. We do troubleshooting sessions with these, and sometimes others. One of the Lemmy devs, @nutomic@lemmy.ml is also helping with current issues.

So, all is not yet running smoothly as we hoped, but with all this help we'll surely get there! Also thank you all for the donations, this helps giving the possibility to use the hardware and tools needed to keep Lemmy.world running!

(page 4) 50 comments
sorted by: hot top controversial new old
[–] ThaijsClan@lemmy.world 2 points 2 years ago

I love the community here and am excited to see it grow. Thanks for giving a report, it awesome how invested y'all are and makes me want to stick with this instance even through the hardships. Keep up the good stuff!

[–] EpicMuellsTime@lemmy.world 1 points 2 years ago (1 children)

Can anyone give me a link to donate to help out? Ever since discovering lemmy I hardly use reddit and would like to contribute to this community more!

load more comments (1 replies)
[–] flamekhan@lemmy.world 1 points 2 years ago

Keep up the great work! We believe in you! Just a reminder to everyone to help sustain lemmy.world by donating in the sidebar! If 1000 people all donated $2/month then that's 24K a year to keep the hardware running! Reddit is what happens when you rely on Corporate Overlords to provide the services you love.

[–] QuentinCallaghan@sopuli.xyz 1 points 2 years ago (2 children)

around 25GB RAM usage. (That is, if we restart Lemmy every 30 minutes. Else memory will go to 100%)

25 GB of RAM????? Looks like your instance is the edge case with Lemmy's scalability, when there's really big amount of active users. Looks like some problems won't fade with really high-grade hardware. But I have to appreciate, that's one gargantuan job!

[–] jpgb@lemmy.world 2 points 2 years ago

I’ve had instances with only a dozen or so Wordpress sites that will chew through 8gb and go into swap when certain tasks were poorly scheduled (like a couple of sites clearing their cache at the same time).

So I’m not surprised they are hitting 25gb but the gradual nature (from the sounds of it) off the memory build up does sound like a leak.

Don’t envy the devs but I’m sure some of them are enjoying it πŸ˜‚

load more comments (1 replies)
[–] popemichael@lemmy.world 1 points 2 years ago

I'm very much so okay putting up with hiccups right now. I know things will improve in the future.

Thank you and everyone for all your hard work!

Using the connect for Lemmy app produces constant Under Maintenance or html code or 504 errors. It seems to load better on Chrome.

[–] SoulKeeper@lemmy.world 1 points 2 years ago* (last edited 2 years ago) (2 children)

Sometimes when I post a comment (without any image) it takes forever to post and sometimes it keeps spinning and I need to cancel and post again. My internet connection is fine (100 Mbps) and it works flawlessly on other websites. Is it happening due to overloading on the lemmy server?

[–] Nocsaron@lemmy.world 1 points 2 years ago (1 children)

I wonder if it's possible you're getting unlucky and are posting when the server is being rebooted

[–] thax@lemmy.world 1 points 2 years ago

I can confirm it blackholes on text only posts more frequently than 30 minutes, so this could be part of the problem it isn't the complete problem.

load more comments (1 replies)
[–] el_cordoba@lemmy.world 1 points 2 years ago

I am sure the stress is unreal, but It is appreciated. You all stepped up when everyone was stepping down (or trying to sellout). I am hopeful this will turn into something great.

[–] smoll_pp_operator@vlemmy.net 1 points 2 years ago

Yall are navigating waters that you probably have little professional experience with. Keep at it and don't get discouraged.

What sort of container orchestration and database tools are you using? Maybe you need some sys admin help?

[–] mintiefresh@lemmy.world 1 points 2 years ago

Thank you. Y'all are doing great.

I'm sure it's stressful but I know I'm here to stay. It's been a blast so far

[–] Cabeza2000@lemm.ee 1 points 2 years ago (2 children)

Keep up the good work!

I created an account in lemm.ee until the issues are fixed. Then I will happily go back to my lemmy.world account.

[–] jandar_fett@lemmy.fmhy.ml 1 points 2 years ago

If I have an account at lemmy.world, but have another instance selected, does that take some of the burden off the admins or do I need to do something more?

[–] ruud@lemmy.world 1 points 2 years ago

Lemm.ee is also a good choice!

[–] Gingerlegs@lemmy.world 1 points 2 years ago (1 children)

It’s a ton better this afternoon! Thank you!!

[–] WaterSword@lemmy.world 1 points 2 years ago

I’ve noticed that too!

[–] neblem@lemmy.world 1 points 2 years ago

I hope hosting all these massive communities is enough a portfolio to land Ruud a crazy job offer one day that pays him stupid levels of money while allowing him plenty of time off to maintain these massive hobby projects.

load more comments
view more: β€Ή prev next β€Ί