7
Ollama - super easy to host local LLM (github.com)
submitted 11 months ago by Dissk@alien.top to c/main@selfhosted.forum
6 comments fedilink hide all child comments
top 6 comments
sorted by: hot top controversial new old
[-] GammaGames@beehaw.org 3 points 11 months ago

There’s also an unofficial web frontend https://github.com/ollama-webui/ollama-webui

Though I can’t get compose to use my gpu

[-] getgoingfast@alien.top 1 points 11 months ago

Thanks for sharing this. Not an expert, so here goes my dumb questions. Can we potentially train these model with local data kinds of like Stable Diffusion checkpoints?

[-] SnooPets20@alien.top 1 points 11 months ago

I'm thoroughly disappointed by the lack of Obama memes in this repo.

[-] Pi_ofthe_Beholder@alien.top 1 points 11 months ago

Thanks Ollama

[-] SungrayHo@alien.top 1 points 11 months ago

Ollama works great with Big-AGI too, look it up on github.

[-] graveyard_bloom@alien.top 1 points 11 months ago

Ollama is pretty sweet, I'm self-hosting it using 3B models on an old X79 server. I created a neat terminal AI client that makes requests to it on the local network - called "Jeeves Assistant".

this post was submitted on 22 Nov 2023
7 points (88.9% liked)

Self-Hosted Main

504 readers
1 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

For Example

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

founded 1 year ago
MODERATORS
communick@selfhosted.forum