-1

submitted 1 year ago* (last edited 1 year ago) by darkeox@kbin.social to c/localllama@sh.itjust.works

0 comments fedilink hide all child comments

Hi,

Just like the title says:

I'm try to run:

With:

Running :

--stream --unbantokens --threads 8 --usecublas normal

I get very limited output with lots of repetition.

I mostly didn't touch the default settings:

Does anyone know how I can make things run better?

EDIT: Sorry for multiple posts, Fediverse bugged out.

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here

this post was submitted on 11 Sep 2023

-1 points (0.0% liked)

LocalLLaMA

2207 readers

4 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS