It's a reasonable discussion, but in practical terms I don't know if it's worth differentiating between cats trespassing on property and cats being allowed out at all. It's completely impossible for a cat owner to control where their cat roams if they are allowed outside at all. Maybe we need to think about whether cats should be allowed out, but it seems like that's how the debate should be framed, not like this.
Also, even if all owners kept their cats inside, there is still a massive feral population. Getting that under control will take a lot of time and money.