394
submitted 1 month ago by Cr4yfish@lemmy.world to c/opensource@lemmy.ml
you are viewing a single comment's thread
view the rest of the comments
[-] AliasAKA@lemmy.world 13 points 1 month ago

Is there any interest in getting local models to run using this? I’d rather not use Gemini, and then all the data can reside locally (and not require a login).

I’d be happy to work on this, though I’m a python developer not a typescript one.

[-] Cr4yfish@lemmy.world 6 points 1 month ago

Yeah, good idea. It's possible to do that with WebLLM & Langchain. Once Langchain is integrated, it's kinda similar to the Python Version so should be do-able I think.

[-] AliasAKA@lemmy.world 2 points 1 month ago

Ah interesting — again happy to help out if there’s anything I can contribute to. I can make a feature request on github if there’s interest.

[-] Cr4yfish@lemmy.world 2 points 1 month ago

Please do :). I take any help I can get.

this post was submitted on 03 Nov 2024
394 points (98.0% liked)

Open Source

31712 readers
217 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS