I agree with the idea that rights are weird. The history of rights is rooted in law. A right is enforced by a state or similar entity. Freedom can exist outside of institutional power but rights historically require it.

That said, most people who advocate for rights are not much concerned about who will enforce those rights. It's often used more as a synonym for freedom. As with all social constructs, there is no material reality behind it