Yeah, it's a ...weird... word. Can be playful, a term of endearment, a reality check, or a horrible insult. And it depends completely on the context. And some people maybe just have trauma from being bullied and called weird all the time as kids. I'm guessing maybe that dude had experienced something like that.