961
you are viewing a single comment's thread
view the rest of the comments
[-] DillyDaily@lemmy.world 54 points 1 week ago

As a visually impaired person on the internet. YES! welcome to our world!

You're lucky enough to get an image description that helpfully describes the image.

That description rarely tells you if it's AI generated, that's if the description writer even knows themselves.

Everyone in the comments saying "look at the hands, that's AI generated", and I'm sitting here thinking, I just have to trust the discussion, because that image, just like every other image I've ever seen, is hard to fully decipher visually, let alone look for evidence of AI.

[-] JackbyDev@programming.dev 23 points 1 week ago

Alt text: a beautiful girl on a dock at sunset with some fugly hands and broken ass fingees

[-] Adalast@lemmy.world 11 points 1 week ago

Honestly, auto generating text descriptions for visually impaired people is probably one of the few potential good uses for LLM + CLIP. Being able to have a brief but accurate description without relying on some jackass to have written it is a bonefied good thing. It isn't even eliminating anyone's job since the jackass doesn't always do it in the first place.

I am so sorry, and i agree with your point, but i really had a good laugh at my mental image of a bonefied good thing :-)

If you know already or it's autocorrect, just ignore me, if not, it's bona fide :-)

[-] SGforce@lemmy.ca 1 points 1 week ago

The models that do that now are very capable but aren't tuned properly IMO. They are overly flowery and sickly positive even when describing something plain. Prompting them to be more succinct only has them cut themselves off and leave out important things. But I can totally see that improving soon.

[-] DillyDaily@lemmy.world 1 points 1 week ago

Unfortunately the models are have trained on biased data.

I've run some of my own photos through various "lens" style description generators as an experiment and knowing the full context of the image makes the generated description more hilarious.

Sometimes the model tries to extrapolate context, for example it will randomly decide to describe an older woman as a "mother" if there is also a child in the photo. Even if a human eye could tell you from context it's more likely a teacher and a student, but there's a lot a human can do that a bot can't, including having common sense to use appropriate language when describing people.

Image descriptions will always be flawed because the focus of the image is always filtered through the description writer. It's impossible to remove all bias. For example, because of who I am as a person, it would never occur to me to even look at someone's eyes in a portrait, let alone write what colour they are in the image description. But for someone else, eyes may be super important to them, they always notice eyes, even subconsciously, so they make sure to note the eyes in their description.

[-] thirteene@lemmy.world 8 points 1 week ago

I've never seen a good answer to this in accessibility guides, would you mind making a recommendation? Is there any preferred alt text for something like:

  • "clarification image with an arrow pointing at object"
  • "Picture of a butt selfie, it's completely black"
  • "Picture of a table with nothing on it"
  • "example of lens flare shown from camera"
  • "N/A" dangerous

Sometimes an image is clearly only useful as a visual aid, I feel like "" (exluding it) makes people feel like they are missing the joke. But given it's an accessibility tool; unneeded details may waste your time.

[-] DillyDaily@lemmy.world 2 points 1 week ago

I guess my question would be, why do you need the picture as a visual aid, is the accompanying body text confusing without that visual aid? and if so, by having no alt text, you accept that you will leave VI people confused and only sighted people will have the clarification needed.

If your including a picture of a table with nothing on it, there's a reason, so yes, that alt text is perfectly reasonable.

Personally I wish there was a way to enable two types of alt text on images, for long and quick context.

Because I understand your concern about unnecessary detail, if I'm in a rush "a table with nothing on it" will do for quicker context, but there are times when it's appropriate to go much deeper, "a picture of a hard wood rustic coffee table, taken from a high angle, natural sunlight, there are no objects on the table."

[-] SaharaMaleikuhm@feddit.org 2 points 1 week ago

Is there no software that can just tell you if it's AI generated or not?

[-] 0ops@lemm.ee 4 points 1 week ago

They exist but none of them are perfect - they can't possibly be perfect. It's a bit of an arms race thing where AI images get more accurate and the detection software get more particular to match, however the economic incentives are on the side of the former.

[-] DillyDaily@lemmy.world 1 points 1 week ago

I think so, but I don't have the mental energy at the moment to sit down and figure out if the AI detection software is accessible either. I know some of my colleagues use programs to check student work for LLM plagerism, but I don't assign work that can be done via an LLM so I haven't looked into that, and that's different from the AI images.

[-] P4ulin_Kbana@lemmy.eco.br 2 points 1 week ago

I'm sorry that you have to go through this stuff.

this post was submitted on 05 Oct 2024
961 points (97.8% liked)

Science Memes

10652 readers
3446 users here now

Welcome to c/science_memes @ Mander.xyz!

A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.



Rules

  1. Don't throw mud. Behave like an intellectual and remember the human.
  2. Keep it rooted (on topic).
  3. No spam.
  4. Infographics welcome, get schooled.


Research Committee

Other Mander Communities

Science and Research

Biology and Life Sciences

Physical Sciences

Humanities and Social Sciences

Practical and Applied Sciences

Memes

Miscellaneous

founded 2 years ago
MODERATORS