lemmony: A better "All" browsing experience for small Lemmy instances (github.com)

submitted 1 year ago* (last edited 1 year ago) by hawkwind@lemmy.management to c/fediverse@lemmy.world

44 comments fedilink hide all child comments

I made this tool to help self-hosters, new admins, or smaller instances have more global and updated content on their instances.

This is the similar to Lemmy Community Seeder but is designed to be run periodically to capture new communities, and include EVERYTHING by default.

EDIT: As noted in the comments, this is an admin tool. Please do not run it as a user if you don't know what you are doing. If you want a better "All," ask your admin first! That said, lemmony in no way constitutes abuse! You can cause a DOS with curl, but that's not what curl was written for. This tool is to legitimately use an API to enhance our experience. Admins that desire to accommodate high volume on a public service will not know this tool is running against, or on their instances. If it causes performance issues, that is unfortunate. They are free to throttle, ban or block API access to their instance in a multitude of ways.

EDIT 2: Donate to your instance/admin if you like Lemmy!

you are viewing a single comment's thread
view the rest of the comments

[-] hawkwind@lemmy.management 2 points 1 year ago* (last edited 1 year ago)

EVERYTHING by default. Also working on "discover only" for searching without the subscribe-to-everything. That said: It's far less than 3GB per day for EVERYTHING I can see, plus: you don't HAVE to keep it forever. Were you doing something that got other than text?

[-] Alfi@lemmy.alfi.casa 3 points 1 year ago

Do you have a link to a documentation concerning retention/cleanup for instances?

[-] hawkwind@lemmy.management 1 points 1 year ago

I don't. I haven't looked yet either because I haven't crossed that bridge. I think there were some admins on matrix chatting about it though. It will become an issue for large instances like near term, so I suspect someone will tackle it very soon, if they haven't already.