13
Gemma 2B vs Phi-2
(lemmy.world)
Decent enough for a model 50 times smaller than ChatGPT. I use orca_mini_3b.
Compile llama.cpp, download a small GGML LLM model and you will have a quite intelligent assiatant running into your phone.
Can we say genocide already?