594
submitted 4 days ago* (last edited 4 days ago) by RmDebArc_5@sh.itjust.works to c/technology@lemmy.world

Surprised pikachu face

you are viewing a single comment's thread
view the rest of the comments
[-] mayo@lemmy.world 38 points 4 days ago

Another good resource to help people find models https://llm.extractum.io

[-] Blaster_M@lemmy.world 19 points 4 days ago
[-] utopiah@lemmy.world 9 points 4 days ago

I like Ollama, and recommend it to tinker, but I admit this "LLM Explorer" is quite neat thanks to sections like "LLMs Fit 16GB VRAM"

Ollama just works but it doesn't help to pick which model best fits your needs.

pick which model best fits your needs.

What is the need I have to put the effort in to install all this locally. Websites win in terms of convenience.

[-] morriscox@lemmy.world 2 points 2 days ago

I want to work on my stuff in peace and in private without worrying about a company grabbing my stuff and using it for themselves and to give/sell it to other outfits, including the government. "If you have nothing to hide..." is bullshit and needs to die.

Good point. Everything you feed into chatgpt is stored for future reference.

[-] utopiah@lemmy.world 2 points 4 days ago

I don't think I understand your point, are you saying there is no benefit in running locally and that Websites or APIs are more convenient?

I already have stable diffusion on a local machine. I was trying to find motivation to install a LLM locally. You answered my question in a different response

use cases where customization helps while quality does matter much due to scale, i.e spam, then LLMs and related tools are amazing.

this post was submitted on 14 Sep 2024
594 points (97.7% liked)

Technology

58114 readers
1645 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS