I think what it comes down to is intention. Are you intending to mimic someone else's likeness without that person's permission? That's wrong. But if you just like someone's voice and want to use them, and they happen to have a similar likeness, that's fine.

Where OpenAI gloriously fucked up is asking Johansson first. If they hadn't, they would have plausible deniability that they just liked the voice actor's voice. If it reminds them of Johansson, that's even fine. What's wrong is that they specifically wanted her likeness, even after she turned them down.