A set of puzzles that will challenge even today’s most sophisticated artificial intelligence models, while being relatively easy for people, aims to encourage AI developers to create new techniques. Any AI that solves the puzzles will net its creators a share of a $1 million prize fund.
Companies like OpenAI already claim that their AI models, like GPT-4, exhibit “human-level performance” on real-world tests, such as university admission exams or the bar exam for lawyers. But this isn’t because the models are reasoning intelligently like humans, says Mike Knoop at…