As a consequentialist this is unironically how I think.
If you save a person, you're responsible for what they do, the same way that you would feel the guilt and consequences of if you killed a person.
That said, if you don't know a person, you have to treat them as you would want to be treated. Save the ones you can.