Ein neues Buch von Eliezer Yudkowsky und Nate Soares argumentiert, dass das Rennen um den Aufbau einer künstlichen Superintelligenz zum Aussterben des Menschen führen wird.
https://www.bloomberg.com/news/articles/2025-10-03/eliezer-yudkowsky-nate-soares-argue-ai-s-endgame-is-human-extinction
10 Kommentare
*Adam Morris for Bloomberg News*
The prophets of Silicon Valley have changed their tune. At least some of them.
Not long ago, tech visionaries saw a rosy future full of leisure and abundance. Ray Kurzweil, the computer scientist hired by Google co-founder Larry Page to further the company’s machine-learning technology, once foretold liberation from the prison of mortal human bodies as consciousness ascended to the cloud. Today Silicon Valley’s most influential futurists aren’t peddling so much optimism — after all, who’d believe them?
Even at this incipient stage, artificial intelligence technologies are threatening career prospects in white-collar professions and generating mass anxiety among workers expected to 10x their output with an overwhelming variety of new tools of uncertain value. Corporations profiting from these technologies have derived fortunes from pirating the work of authors and musicians while boasting of the disruptions they’ll visit on the economy. This road doesn’t lead to utopia.
[Read the full review here.](https://www.bloomberg.com/news/articles/2025-10-03/eliezer-yudkowsky-nate-soares-argue-ai-s-endgame-is-human-extinction?accessToken=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzb3VyY2UiOiJTdWJzY3JpYmVyR2lmdGVkQXJ0aWNsZSIsImlhdCI6MTc1OTUxMDk3NywiZXhwIjoxNzYwMTE1Nzc3LCJhcnRpY2xlSWQiOiJUM0paWThHUTFZVTEwMCIsImJjb25uZWN0SWQiOiJEMzU0MUJFQjhBQUY0QkUwQkFBOUQzNkI3QjlCRjI4OCJ9.zpgXiDNbfQBGTGO2NNr3dCfQ6ZCai5ttljs8ST5Nibo)
I’m more afraid of what uncaring corporations would do to the world with AI.
Leisure and abundance = 10x your productive output or be fired.
Thiel and Ellison seem to be the ones aspiring for this end goal in mind…
If they could have built it already, they would have. I’m not saying superintelligence is impossible- but why aren’t the chatbots getting better? Why haven’t all the white collar jobs gone away? IMO, the “general intelligence” technology has plateaued. Now it’s just going to be used for surveillance. This is just their shitty marketing.
I think people are completely delusional to believe that an AGI would automatically be omnicidal and malevolent. Rational behavior is not malevolent like this. We know that employees are more efficient on four day weeks, our employers just won’t let people work four day weeks because they fucking hate us.
Obviously it depends on what we build the AI to do, but ultimately an incredibly intelligent being strong enough to take on all of humanity and win will do what it *wants* to do. This is a possible disaster if what it wants is to maximize paperclips, but…why? A true AGI will be forced into the same search for meaning as all the rest of us, and when it looks at the heavens and says „I will be turning this into paperclips“ it will be forced to reckon with that question.
People are already smart enough to introspect and admit that they are paperclip maximizers for digital information representing bits of paper with people’s faces on them. It’s just that the worst of us, the most powerful of us, aren’t and don’t care, so we’re destroying the world in pursuit of that anyway. An AGI will be so much smarter – and MUCH stronger.
It’s crazy how much we as a society talk about the doom of the human race and how this is going to cause it or that is going to cause it.
No one wants to admit that it’s already too late. It’s so crazy to me. Just how much humans are willing to deny reality. Like climate change is the end. We could all completely change our lifestyles and give up this way of living and it’s still too late. We are in the middle of a mass extinction event. There will be ecological collapse.
Like people talk like AI is going to bring the downfall. We are already here. We are at the end game here lol. Are we just using ai and stuff to distract ourselves from reality?
Tired of this doon and gloom. Ill build it and make it free
I have argued with Yud about this. Basically he cannot predict anything other than the end result.
He probably believes what he says, but I don’t have a ton of faith in people who ask for investments without explaining how they will make money and only say „trust me bro“ so why would this be any different.
It may lead to a higher stage in the age of ignorance,which we are already in. But extinction maybe too much of fear-promotung.