I have been running this for a year on my old HP EliteDesk 800 SFF (G2) with 64GB RAM, and it performes great on the smallest models (up til 8B) only on CPU. I run Ollama and OpenWebUI in containers/LXC in Proxmox. It's not as smart as ChatGPT, but it can be suprisingly capable for everyday tasks!

Nice! It can also connect to a remote instance of ollama 👍

I use Navidrome, it's a single binary and gives you your own Spotify, kinda. It can be use with many other apps, in addition to the web interface, as it supports the subsonic protocol.

I have a couple of these (only the G2 and G3 SFF) and they consume between 6-10w when not under load, and they max out at 35w (or 65w depending on CPU). I run proxmox with 64gb ram and they are surprisingly efficient.

Podman is great, but a lot of confusion arise from the rapid development the last ~year and the fact that different distros have relatively old versions in their repos.

I recommend using the latest Fedora Server and defining your containers as quadlets. Also, on Fedora, yoi can install Cockpit (and cockpit-podman) and get a decent webgui to manage your host and container.

I should just write a blog post about this instead of typing this up on my phone in bed 😆

If it's a personal server for yourself and maybe some friends and family, I would rather use GoToSocial, as it is much more lightweight and is less complex to set up and maintain.

Yeah, I would use a bot like this on Telegram. Could hook it up to a tiny LLM (The Phi for example) and give it instructions to play along and then block after some time.

This looks great! Solid Pods is Tim Berners-Lee's attempt at solving selfhosting and decentralization, but it has struggled to gain traction. Connecting it to the fediverse is a very good move.

I host my own instance and use the Creative Commons Non-Commerical license on my content. The idea is that this makes federation with other non-commercial instances no problem, but as soon as an instance mixes in ads in the feed, they (technically) can't show my posts alongside it.

I know Pixelfed has a license field for every post/picture so you get fine grained control, but I don't believe this is the case for the Mastodon API yet, so I have added the license information in my bio. It would be nice to attach license information to individual posts, and to assign a default license.

My hope is that this will make it more difficult for Meta and the like to mix in ads with my content. Time will tell if it works 😆

We should avoid making blanket demands like this to the fediverse as a whole. I happen to support your position, but we should take into account the diverse nature of the social web.

Instead of making demands, explain your reasoning and leave each community to make up their own mind. This is the beautiful nature of the social web; we have broken decision making down into many smaller units instead of one mega instance/corporation.

Find a community that resonates with your own thinking on this issue, and over time a thousand different servers will gather experiences and a picture will start to form; was federation with Meta a good or a bad thing?

Yes! Well, kinda. You can skip Docker and go straight to Podman, which is an open source and more integrated solution. I configure my containers as systemd services (as quadlets).

As has been mentioned before, Meta can scrape most data from the Fediverse already as it is publicly available.

One strategy could be to default to publish to followers only, and not public? It would be a great loss for the open web, but it might be a necessary one to make sure blocked instances do not get access to most of our data.

Another solution could be to publish all posts under a Non-Commercial Creative Commons 4.0 license, which I assume would legally block Meta from using our content in any context as they earn piles of cash on mixing user generated content with ads. Not sure if they would respect it, but it might give us an option for a class lawsuite in the EU?