this post was submitted on 22 Nov 2023
0 points (NaN% liked)

Homelab

938 readers
54 users here now

Rules

founded 2 years ago
MODERATORS
 

I'm just getting into playing with Ollama and want to work to build some self-hosted AI applications. I don't need heavy duty cards because they probably won't ever be under too much load, so I'm mostly looking for power efficiency + decent price.

Any suggestions for cards I should look at? So far I've been browsing ebay and I was looking at Tesla M40 24GB DDR5's. They're reasonably priced, but I'm wondering if anyone has any specific recommendations.

you are viewing a single comment's thread
view the rest of the comments
[–] dxx255@alien.top 1 points 2 years ago

I installed a Tesla P40 in a R720xd. You just have to carefully select the correct cable for power supply.