ScienceSimple math can predict when AI is about to...

Simple math can predict when AI is about to go rogue, physicists say

[ad_1]

Researchers say they’ve developed a simple mathematical formula that can predict when certain ChatGPT-like artificial intelligence (AI) chatbots will “go rogue,” suddenly switching from helpful responses to potentially harmful ones.

In a new study published Oct. 8 in the journal Patterns, physics professor Neil Johnson and doctoral student Frank Yingjie Huo, both at The George Washington University, show how the order in which a chatbot is given certain prompts can drastically reshape its answers, leading to “tipping points” that can send the chatbot down a rabbit hole of bad advice. However, Johnson and Huo say their formula can easily predict these tipping points.There have been horror stories of AI encouraging users into suicide, helping build lethal weapons, and amplifying violent or harmful points of view. At the same time, researchers at OpenAI and Anthropic, respectively, have repeatedly and openly stated that they don’t really understand why their creations behave the way they do. They have, however, built safeguards that use a variety of tools ‪—‬ including content filtering, reinforcement learning and other technical guardrails ‪—‬ to reduce risks.

[ad_2]

Original Source Link

Latest News

Mexico is struggling to attract data centers despite its proximity to the US, hosting just 71 of LatAm's 500+ sites, due to a slow...

Featured Podcasts Sources: Why Airtable's founder is betting on teams of AI agents Candid conversations with the leaders shaping what's next in...

Cannes Condemns Five-Year Prison Sentence Against Iranian Palme dOr Winner Jafar Panahi and Pleads for International Support

The Cannes Film Festival has condemned the latest prison sentence handed down to Iranian filmmaker Jafar Panahi, who won...

Vladimir Putins prized bridge is partially destroyed in Ukrainian strike

“Russia strikes our infrastructure every day, including bridges in Zaporizhzhia, Dnipro, Kyiv, and the Odesa region,” he said. “We...

Grizzlies could thrive in California — so why arent we reintroducing them?

Follow us Add us as a preferred source on Google Newsletter Subscribe to our newsletter Computer models are widely used in ecological research...

Noom Introduces Wearable to Support Obesity Care Programs

Noom, a behavior change company, announced at the HLTH conference on Monday that it is launching a new wearable...

Must Read

The Sunday Morning Movie Presents: The Witch Hunt (1981) Run Time: 1H 29M Plus Bonuses | naked capitalism

Greetings gentle readers and welcome to another installment of...

Microsoft 365 Outage Resolved, Cyberattack Ruled Out

Microsoft said it restored Microsoft 365 services after a...
- Advertisement -

You might also likeRELATED
Recommended to you