7
Ollama - super easy to host local LLM
(github.com)
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
For Example
We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.
Useful Lists
There’s also an unofficial web frontend https://github.com/ollama-webui/ollama-webui
Though I can’t get compose to use my gpu