There's no confusion. People like this just don't think a homeless person deserves anything.
I imagine they take it as an affront, that a homeless man could have the "gall" to take charity from them, while he has a phone "hidden" in his pocket, as if that means he's a con-man, and not really in need at all.
In their mind, if a homeless man owns a phone, then he can't be genuinely destitute. If he was then he should sell that phone to afford his next meal, instead of begging on the street.
Never mind that a phone is probably the single most important tool to in modern life to stay informed and connected, not to mention and entertained and sane.
Never mind that a phone could be the difference between staying homeless for ever, or finding work.
No - if you are homeless then you certainly aren't allowed to own any tools that would help you get out of it.