It is certainly more complex than a predictive text machine

No, it literally isn't. That's literally all it is.

It does seem to understand

Because people are easily fooled, but what it seems like isn't what's actually happening.

but sometimes it thinks it is giving factual information

It's incapable of thinking. All it does is generate a plausible sequence of words.