Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.
Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.
As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.
Rules:
Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.
Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.
Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.
Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.
I think it's just a minor update to the instruct-tuned variant, with the same base model. But I haven't tried it yet.
What do you people think of their practice of just dropping new models? I thought adding the mystery around the new MoE model was alright. But I'm starting to find it mildly annoying that they always just publish the minimal amount of info and description.
It's definitely a little odd.. I'm glad they did any kind of official release for 0.2, but yeah information is sorely lacking and would be nice to have more, especially with how revolutionary the previous one was.. is this incremental? Is it a huge change? Is it just more fine tuning? Did they start from scratch? We'll never know ๐คทโโ๏ธ
Hmmh. I've complained before how Mistral's use of the word 'open' differs quite a bit from my understanding. I mean, I wouldn't care if their models weren't that good and had the impact they have... But I'd really like to know what they updated, what kind of datasets went into Mistral, which languages it speaks... And they're definitely being 'odd'. All the other big players publish the safety evaluations like on biases, truthfulness, ... Just Mistral likes to be intransparent and not tell us anything.
Relevant discussion (without answers): https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2/discussions/2
Is it censored one?
Seems relatively uncensored, willing to answer most questions