I also don't want to have to talk to it, so switching to Home Assistant with Zigbee

That's what started it all for me. I have some Hue lights for TV backlighting and started looking for alternatives when Philipps first threatened making their cloud account mandatory.

Threw out the bridge, works like a charm and I have been buying new devices and return everything I cannot setup locally but it's annoying because they don't always tell about their crappy app and cloud accounts on the product info.