[-] Jaff_Re@alien.top 1 points 10 months ago

Tesla P40 is a good low budget option, it has 24gb and CUDA cores. I’ve tried running 13b LLMs with 1 and it did well, plus you can afford multiple if you have enough slots

Jaff_Re

joined 10 months ago