it never ruins the fun for me. I remember one campaign I was in and we were talking about the last session and the GM said he didn't plan on us taking a boat. SO he had to quickly move a land encounter to the sea. So yeah he casually mentioned the use of QO and no one in the group cared. It's D&D all roads lead to combat.