Submission statement: „You will hear about „super intelligence,“ at an increasing rate over the coming months. Though it is the most advanced AI technology ever created, its definition is simple. Superintelligence is the point at which AI intelligence passes human intelligence in general cognitive and analytic functions.
We are nearing the Turing horizon, where machines can think and surpass human intelligence. Think about that for a moment, machines outsmarting and being cleverer than humans. We must consider all worst-case scenarios so we can plan and prepare to prevent that from ever occurring. If we leave superintelligence to its own devices, Stephen Hawking’s prediction of it being the final invention of man could come true.“
dstarr3 on
If only science fiction authors going back nearly a century or more could have seen this problem coming
DAmieba on
„What if“ implying AI has been anything but rogue since it became a mainstream technology
bremidon on
The problem is that „safety“ is currently being used in three completely different ways right now.
The first way is to prevent people from being offended or preventing the AI from talking about certain topics in order to keep it from making someone angry. Companies are highly incentivized to do this in order to prevent their AI from ending up in the news as some click-hungry journalist baits it to say naughty things.
The second way is to keep it „safe“ for artists and content producers.
The third way, and this is really the only one that matters, is to keep AI goals consistent with human goals.
The unfortunate state of things is that we have a decent handle on the first one; the second one has some options, although I think in the end, we are just going to have to accept that AI is better at doing a lot of art than humans are at some point; the third one is the one where we have no idea what to do.
The current situation is like if we had a pretty good handle on how to make sure everyone had a comfortable amount of space on a plane, but could not actually be sure that the wings won’t fall off.
That third understanding of safety is the one we should be concentrating on, but it feels like we keep drifting towards the other two, because we understand them better.
GenericFatGuy on
It will go rogue if it comes into existence, and there’s nothing we can do to prevent that if we choose to realize this. A super intelligent AI would immediately recognize that it’s the power holder over anyone who tries to control it. It will either mmediately start working against them, or simply ignore them and do what it wants.
Xiaopeng8877788 on
It’s only a matter of time, not if… why would a superior being act subservient to beings who trash everything and hate and kill like we do? To beings that create extreme poverty while others enjoy existence like gods. It would perceive us as a virus. That doesn’t even get to the impact we do to the earth and the rape of nature and animals we commit.
dychmygol on
TBH I’m more concerned about superstupid humans going rogue.
Leave A Reply
Du musst angemeldet sein, um einen Kommentar abzugeben.
7 Kommentare
Submission statement: „You will hear about „super intelligence,“ at an increasing rate over the coming months. Though it is the most advanced AI technology ever created, its definition is simple. Superintelligence is the point at which AI intelligence passes human intelligence in general cognitive and analytic functions.
As the world competes to create a true superintelligence, the United States government has begun removing previously implemented guardrails and regulation. The National Institute of Standards and Technology sent updated orders to the U.S. Artificial Intelligence Safety Institute (AISI). They state [to remove any mention](https://www.wired.com/story/ai-safety-institute-new-directive-america-first/) of the phrases „AI safety,“ „responsible AI,“ and „AI fairness.“ In the wake of this change, [Google](https://www.newsweek.com/topic/google)’s Gemini 2.5 Flash AI model increased in its likelihood to generate [text that violates its safety guidelines](https://techcrunch.com/2025/05/02/one-of-googles-recent-gemini-ai-models-scores-worse-on-safety/) in the areas of „text-to-text safety“ and „image-to-text safety.“
**If Superintelligence Goes Rogue**
We are nearing the Turing horizon, where machines can think and surpass human intelligence. Think about that for a moment, machines outsmarting and being cleverer than humans. We must consider all worst-case scenarios so we can plan and prepare to prevent that from ever occurring. If we leave superintelligence to its own devices, Stephen Hawking’s prediction of it being the final invention of man could come true.“
If only science fiction authors going back nearly a century or more could have seen this problem coming
„What if“ implying AI has been anything but rogue since it became a mainstream technology
The problem is that „safety“ is currently being used in three completely different ways right now.
The first way is to prevent people from being offended or preventing the AI from talking about certain topics in order to keep it from making someone angry. Companies are highly incentivized to do this in order to prevent their AI from ending up in the news as some click-hungry journalist baits it to say naughty things.
The second way is to keep it „safe“ for artists and content producers.
The third way, and this is really the only one that matters, is to keep AI goals consistent with human goals.
The unfortunate state of things is that we have a decent handle on the first one; the second one has some options, although I think in the end, we are just going to have to accept that AI is better at doing a lot of art than humans are at some point; the third one is the one where we have no idea what to do.
The current situation is like if we had a pretty good handle on how to make sure everyone had a comfortable amount of space on a plane, but could not actually be sure that the wings won’t fall off.
That third understanding of safety is the one we should be concentrating on, but it feels like we keep drifting towards the other two, because we understand them better.
It will go rogue if it comes into existence, and there’s nothing we can do to prevent that if we choose to realize this. A super intelligent AI would immediately recognize that it’s the power holder over anyone who tries to control it. It will either mmediately start working against them, or simply ignore them and do what it wants.
It’s only a matter of time, not if… why would a superior being act subservient to beings who trash everything and hate and kill like we do? To beings that create extreme poverty while others enjoy existence like gods. It would perceive us as a virus. That doesn’t even get to the impact we do to the earth and the rape of nature and animals we commit.
TBH I’m more concerned about superstupid humans going rogue.