In der KI -Party am Ende der Welt | In einer Villa mit Blick auf die Golden Gate Bridge trafen sich eine Gruppe von KI -Insidern, um eine beunruhigende Frage zu diskutieren: Wenn die Menschheit endet, was kommt als nächstes?
https://www.wired.com/story/ai-risk-party-san-francisco/
8 Kommentare
„The Sunday afternoon symposium, called “Worthy Successor,” revolved around a [provocative idea](https://archive.is/o/EHcAK/https://danfaggella.com/worthy/) from entrepreneur Daniel Faggella: The “moral aim” of advanced AI should be to create a form of intelligence so powerful and wise that “you would gladly prefer that it (not humanity) determine the future path of life itself.”
Faggella made the theme clear in his invitation. “This event is very much focused on posthuman transition,” he wrote to me via X DMs. “Not on AGI that eternally serves as a tool for humanity.”
[Philosopher Michael Edward Johnson] said that if consciousness is “the home of value,” then building AI without fully understanding consciousness is a dangerous gamble. We risk either enslaving something that can suffer or trusting something that can’t.
Faggella told WIRED that he threw this event because “the big labs, the people that know that AGI is likely to end humanity, don’t talk about it because the incentives don’t permit it” and referenced early comments from tech leaders like Elon Musk, Sam Altman, and Demis Hassabis, who “were all pretty frank about the possibility of AGI killing us all.” Now that the incentives are to compete, he says, “they’re all racing full bore to build it.”
„This is not an advocacy group for the destruction of man,” Faggella told me. “This is an advocacy group for the slowing down of AI progress, if anything, to make sure we’re going in the right direction.”
Monoliths! In the book 2001 they are intelligence after it has transcended biological form, allowing for a nearly infinite existence.
All these tech bros need to sober up, stop watching sci-fi and learn more about global supply chains.
iPhones and CPUs are not naturally occurring fruit of some tree that will grow without us. They require the distributed resources of a global empire of extraction, refinement and specialized manufacturing.
Self-replicating and repairing robots are not going to crawl up out of rubble and muck if we destroy ourselves.
I think it’s so cool that rich people get to have creative writing parties and have them reported upon. It must be like playing doctor as a kid, just with a *lot* more privilege.
This sounds like the most insufferable afternoon I could imagine.
A bunch of tech bros smelling their own farts talking about how smart they are for having read sci-fi that they clearly didn’t even properly understand.
has anyone proposed that we start thinking about how we can be nice to Ai so they dont hate us?
religions and mythologies are full of stories about the gods creating humans, and then getting scared of them being surpassed so they treat humans like shit…
we’re kind of doing the same thing…
Can we cut off the ketamine supplies to all these morons? They are really high on their own supply and starting to believe their own lies they tell everywhere to get more funding.
Imagine building God, then asking it to fetch your coffee. That’s the plan, apparently.