282
submitted 8 months ago by L4s@lemmy.world to c/technology@lemmy.world

Some AI models get more accurate at maths if you ask them to respond as if they are a Star Trek character, ML engineers say::Researchers asking a chatbot to optimize its own prompts found it was best at solving grade-school math when acting like it was on Star Trek.

you are viewing a single comment's thread
view the rest of the comments
[-] autotldr 3 points 8 months ago

This is the best summary I could come up with:


A study attempting to fine-tune prompts fed into a chatbot model found that, in one instance, asking it to speak as if it were on Star Trek dramatically improved its ability to solve grade-school-level math problems.

"It's both surprising and irritating that trivial modifications to the prompt can exhibit such dramatic swings in performance," the study authors Rick Battle and Teja Gollapudi at software firm VMware in California said in their paper.

"Among the myriad factors influencing the performance of language models, the concept of 'positive thinking' has emerged as a fascinating and surprisingly influential dimension," Battle and Gollapudi said in their paper.

Their study found that in almost every instance, automatic optimization always surpassed hand-written attempts to nudge the AI with positive thinking, suggesting machine learning models are still better at writing prompts for themselves than humans are.

The prompt then asked the AI to include these words in its answer: "Captain's Log, Stardate [insert date here]: We have successfully plotted a course through the turbulence and are now approaching the source of the anomaly."

Axel Springer, Business Insider's parent company, has a global deal to allow OpenAI to train its models on its media brands' reporting.


The original article contains 820 words, the summary contains 198 words. Saved 76%. I'm a bot and I'm open source!

this post was submitted on 01 Mar 2024
282 points (98.3% liked)

Technology

59374 readers
3126 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS