This morning I experienced this tech going wrong first hand. Someone mentioned and I decided to try a site called pimeyes. It lets you upload a photo, then it will try to find other examples of your photos posted online. Well I uploaded one of my photos. And it returned this:

I am a 38 year old woman. I don't recall using this site before, and I sure as hell have never used it to search for kids. I uploaded another photo, and that one worked. But still, that is a fucked up message to send someone just based on some shitty AI age estimation algorithm. Someone with a different face might always trigger the "minor" filter.

And while this was just for an image search site, it's much more serious on other sites. People do a lot of essential communication on social media platforms. What happens if you're completely shut out of all social media sites because you have a face that the algorithms decide look under 18? What happens if it's something even more important, like your bank's website or a government service page?

It's ridiculous that that they would claim 85% accuracy as some great success. That's a horrible success rate in this context. That means millions of people will be incorrectly flagged as minors and potentially lose access to entire regions of the internet. And how long until they start using this facial recognition, not as proof of age, but as proof of identity? How long til you have to scan your face to apply for government benefits, retirement, or access other government services? And what happens to those people who the face scanning algorithm just fails at? A 15% failure rate is awful. When you're imposing something on the entire population, you shouldn't even consider applying it until the success rate is more like 99.99% accurate. If the tech just isn't that good, then it simply shouldn't be used.

[–] No1@aussie.zone 6 points 2 days ago (1 children)

engaged in activities that involve searching for children

Jesus Christ I read that in a totally different way!

As in "You are a creepy pedo that's been doing searches for children!"

[–] WoodScientist@sh.itjust.works 6 points 2 days ago* (last edited 2 days ago) (1 children)

No, you read it the right way the first time. The site thought I had uploaded the image of a child, and then it accused me of being a creepy pedo that's searching for images of kids. As though I had taken a picture of a random child in public then uploaded it hoping to find more. And it threatened to refer to me to law enforcement. Remember, the site works by uploading an image and then using an AI tool to find other images of the uploaded face that have been posted elsewhere on the net. Their AI thought I had uploaded the image of some kid and was trying to find more of their images posted to facebook or other sites. Effectively, their AI accused me of being a pedophile.

All for uploading a picture of my own face. I honestly don't know whether to be flattered or terrified. Frankly, I feel a little bit of both.

[–] No1@aussie.zone 1 points 2 days ago

That's horrendous AND horrifying!

load more comments (6 replies)