ScienceSimple math can predict when AI is about to...

Simple math can predict when AI is about to go rogue, physicists say

[ad_1]

Researchers say they’ve developed a simple mathematical formula that can predict when certain ChatGPT-like artificial intelligence (AI) chatbots will “go rogue,” suddenly switching from helpful responses to potentially harmful ones.

In a new study published Oct. 8 in the journal Patterns, physics professor Neil Johnson and doctoral student Frank Yingjie Huo, both at The George Washington University, show how the order in which a chatbot is given certain prompts can drastically reshape its answers, leading to “tipping points” that can send the chatbot down a rabbit hole of bad advice. However, Johnson and Huo say their formula can easily predict these tipping points.There have been horror stories of AI encouraging users into suicide, helping build lethal weapons, and amplifying violent or harmful points of view. At the same time, researchers at OpenAI and Anthropic, respectively, have repeatedly and openly stated that they don’t really understand why their creations behave the way they do. They have, however, built safeguards that use a variety of tools ‪—‬ including content filtering, reinforcement learning and other technical guardrails ‪—‬ to reduce risks.

[ad_2]

Original Source Link

Latest News

Anthropic mathematician Levent Alpöge says he used Claude to prove the 167-year-old Riemann hypothesis and posts the proof in the Lean programming language (Joseph...

Featured Podcasts Machine Gods: Anthropic's Record IPO + What Kevin Got Wrong About the Company in 2023 The official podcast of the...

MobLand Season 3 Starts Shooting With Tom Hardy, Helen Mirren and Pierce Brosnan

Tom Hardy is officially back on set for “MobLand” Season 3, with cameras rolling this week. The actor, who plays...

Rare Anglo-Saxon sand body in a double burial unearthed at Sutton Hoo

Follow us Add us as a preferred source on Google Newsletter Subscribe to our newsletter Archaeologists have discovered a mysterious "sand body" at...

Fiona the Hippo Died After Eating a Hat. But How Does a Hat Kill a Hippo?

Fiona, the Cincinnati Zoo’s famous hippo who charmed observers around the world, tragically died on Thursday due to medical...

Jon Hamm Gets His Happily Ever After At 55 As Wife Anna Osceola Welcomes Baby Boy! – Perez Hilton

Jon Hamm begins his most rewarding role! According to a new report from People magazine on Thursday, the Emmy-winning Mad...

Must Read

- Advertisement -

You might also likeRELATED
Recommended to you