12
you are viewing a single comment's thread
view the rest of the comments
[-] hendrik@palaver.p3x.de 6 points 3 months ago* (last edited 3 months ago)

4GB to 8GB of RAM? That's not large by any standard?! And a bit less than 2 tokens per second for a 6B parameter model isn't fast at all.

[-] GBU_28@lemm.ee 2 points 3 months ago

Who downvotes this

this post was submitted on 15 Aug 2024
12 points (87.5% liked)

Single Board Computers

1233 readers
3 users here now

A community for the discussion of all single board computers. Raspberry Pi is ok, but there are so many other boards now that get looked over that deserve attention.

Post news, questions, your setups, guides, anything that has to do with SBCs. Server wide rules apply

founded 1 year ago
MODERATORS