Wenn die KI diesen Test besteht, sollten Sie aufpassen | Die Macher eines neuen Tests namens „Humanity’s Last Exam“ argumentieren, dass wir bald nicht mehr in der Lage sein werden, Tests zu erstellen, die hart genug für KI-Modelle sind.

„If you’re looking for a new reason to be nervous about artificial intelligence, try this: Some of the smartest humans in the world are struggling to create tests that A.I. systems can’t pass.

For years, A.I. systems were measured by giving new models a variety of standardized benchmark tests. Many of these tests consisted of challenging, S.A.T.-caliber problems in areas like math, science and logic. Comparing the models’ scores over time served as a rough measure of A.I. progress.

But A.I. systems eventually got too good at those tests, so new, harder tests were created — often with the types of questions graduate students might encounter on their exams.

Those tests aren’t in good shape, either. New models from companies like OpenAI, Google and Anthropic have been getting high scores on many Ph.D.-level challenges, limiting those tests’ usefulness and leading to a chilling question: Are A.I. systems getting too smart for us to measure?

This week, researchers at the Center for AI Safety and Scale AI are releasing a possible answer to that question: A new evaluation, called “Humanity’s Last Exam,” that they claim is the hardest test ever administered to A.I. systems.“

Got news for Humans.  We are outmoded and no longer necessary to keep society moving.  We’ll just eat shit, and billionaires will live with robot butlers