I do agree. That's rather inline with AGPL-like thinking, which sounds like the right approach to me (either all training data for a commercially-marketed model is public-domain and/or licensed for for-profit AI use, or, no money ever changes hands in that branch).

I wouldn't even go that far. What's the line between commercial and noncommercial use? Lots of people commission artists for custom made artwork and reference sheets for their characters; if someone instead uses AI art to replace that, is it still noncommercial even if that person never once makes a dime off the AI art? What if the artist makes a living drawing memes as a way to provide exposure and attract commissioners (rare, but they do exist)?

For me, the only ethical uses are entirely private cases where it's never shared (e.g., an artist throwing out some ideas while looking for inspiration of how to draw something), and cases where it's exclusively augmenting human work--for example, the feature in Photoshop to extend the background of a photo to create a panorama.