Hey, I am currently working on a machine learning project, but LLMs (like ChatGPT that work with natural language) are not my specialty. LLMs generate plausible text. Text that you could read anywhere. It doesn't reason in the sense that it thinks about your question and answers intelligently. Also, "Semantic Vector closeness" (i.e. what word is closest to the meaning of "tomato" without the meaning of "red" in all possible positions is not something people understand as it is very abstract; emulating an AI perfectly is therefore unreasonable.
In my opinion try to do the following (these are not just hallucinations):
- Try to think of a sentence. Change it so it remains plausible but the meaning is altered
- When the AI doesn't know the answer, make something plausible up. For example: If someone asks who invented something, tell them Edison did. There are many sentences out there that name Edison as the inventor of things.
- Whenever you are able to digress because of a previously discussed topic, don't be afraid to digress
- If people get frustrated and try to get a different answer from you, make sure to give them the same answer again but word it differently
- Talk a lot and tell them blatant lies. When they correct you tell them how right they are and change your mind even if it is - again - wrong. Example: "How far is building XYZ away?" "Oh, it is quite a distance. The distance between here and XYZ is 3km" "But I can see the building!" "There are many reasons why you might be able to see the building despite the building being 3 km away. For example if there is nothing in between." "But it is much closer." "You are absolutely right! Good catch! The building is actually much closer than 3 km away." "BUT HOW FAR IS IT?!" "The building is 1 km away; which is much closer than 3 km." (still made up)
Most importantly I think you should come up with your own system prompt. A system prompt can be as simple as "Answer as if you were a professor of computer science!" or as complex as chatgpts and try to stick to that.
These tips are not just for hallucinations as I mentioned, because I think other aspects are equally or more important. In any case: don't try to emulate an AI perfectly. Make it fun for your players to interact with the character, have a few catchphrases and everything else might be unnecessary bloat, but feel free to dig deep.