44
What open-source LLMs are you using in 2024?
(lemmy.world)
Welcome to Free Open-Source Artificial Intelligence!
We are a community dedicated to forwarding the availability and access to:
Free Open Source Artificial Intelligence (F.O.S.A.I.)
I would also be interested in Code-Pilot Models that are reaching for same performance like GitHub or Microsofts paid Models.
Currently I use TabbyML but the available Models are by far inferior.
Of all of the code specific LLMs I'm familiar with Deepseek-Coder-33B is my favorite. There are multiple pre-quantized versions available here:
https://huggingface.co/TheBloke/deepseek-coder-33B-base-GGUF/tree/main
In my experience a minimum of 5-bit quantization performs best.
I was pleasantly surprised by many models of the Deepseek family. Verbose, but in a good way? At least that was my experience. Love to see it mentioned here.