Looking for GPU suggestions for a Poweredge R720 (alien.top)

submitted 11 months ago by Jeremiah_K@alien.top to c/homelab@selfhosted.forum

0 comments fedilink hide all child comments

I'm just getting into playing with Ollama and want to work to build some self-hosted AI applications. I don't need heavy duty cards because they probably won't ever be under too much load, so I'm mostly looking for power efficiency + decent price.

Any suggestions for cards I should look at? So far I've been browsing ebay and I was looking at Tesla M40 24GB DDR5's. They're reasonably priced, but I'm wondering if anyone has any specific recommendations.

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here

this post was submitted on 22 Nov 2023

1 points (100.0% liked)

Homelab

371 readers

2 users here now

Rules

Be Civil.
Post about your homelab, discussion of your homelab, questions you may have, or general discussion about transition your skill from the homelab to the workplace.
No memes or potato images.
We love detailed homelab builds, especially network diagrams!
Report any posts that you feel should be brought to our attention.
Please no shitposting or blogspam.
No Referral Linking.
Keep piracy discussion off of this community

founded 1 year ago

MODERATORS

communick@selfhosted.forum

rglullis@communick.news