Ollama - super easy to host local LLM (github.com)

submitted 11 months ago by Dissk@alien.top to c/main@selfhosted.forum

6 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[-] graveyard_bloom@alien.top 1 points 11 months ago

Ollama is pretty sweet, I'm self-hosting it using 3B models on an old X79 server. I created a neat terminal AI client that makes requests to it on the local network - called "Jeeves Assistant".

this post was submitted on 22 Nov 2023

7 points (88.9% liked)

Self-Hosted Main

504 readers

1 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

For Example

Service: Dropbox - Alternative: Nextcloud
Service: Google Reader - Alternative: Tiny Tiny RSS
Service: Blogger - Alternative: WordPress

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

Awesome-Selfhosted List of Software
Awesome-Sysadmin List of Software

founded 1 year ago

MODERATORS

communick@selfhosted.forum