122
submitted 1 year ago by L4s@lemmy.world to c/technology@lemmy.world

ChatGPT has a style over substance trick that seems to dupe people into thinking it's smart, researchers found::Developers often prefer ChatGPT's responses about code to those submitted by humans, despite the bot frequently being wrong, researchers found.

you are viewing a single comment's thread
view the rest of the comments
[-] joe@lemmy.world 69 points 1 year ago

A caveat: This user analysis involved just 12 programmers being asked to assess if they prefer the responses of ChatGPT or those written by humans on Stack Overflow to 2,000 randomly sampled questions.

Nothing to see here.

[-] lemann@lemmy.one 11 points 1 year ago

12 programmers? That ChatGPT sample size is way too small to be meaningful IMO

this post was submitted on 15 Aug 2023
122 points (87.7% liked)

Technology

59086 readers
2558 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS