Try using a "ground loop isolator". Should get rid of the noise. Worked for my audio mixer and desktop headphones.

But the biggest reason for non removable battery is protection from water damage soo.....

Do these require a subscription to function? Looked like it after a quick google search.