Self-hosting

3511 readers

1 users here now

Hosting your own services. Preferably at home and on low-power or shared hardware.

Also check out:

founded 3 years ago

MODERATORS

poVoq@slrpnk.net

sam_uk@slrpnk.net

-5

Idea: Selfhosted Interface for LLMs (lemmy.blahaj.zone)

submitted 2 months ago by not_IO@lemmy.blahaj.zone to c/selfhosting@slrpnk.net

2 comments fedilink hide all child comments

Like SearchXNG but for chatbots.

Acts as a trusted inbetween that takes the hit on all the tracking for you and you need no account.

There would be a self-hosted server with a webinterface, where you can choose which of the popular chatbots or hosted open source models you want to ask.

The not free Accounts could be payed with donations maybe?

Basically like duck.ai but without a big company involved.

you are viewing a single comment's thread
view the rest of the comments

[–] mulcahey@lemm.ee 1 points 1 month ago

I was looking for something like this. The idea is:

Run an open model like LLAMA or Mistral on my home server
Access it from a client on my phone, saving my poor phone's processor and battery.

Does something like this exist?