KI-Systeme könnten sich „gegen den Menschen wenden“: KI-Pionier Yoshua Bengio warnt vor Risiken durch künstliche Intelligenz
https://www.cnbc.com/2024/11/21/will-ai-replace-humans-yoshua-bengio-warns-of-artificial-intelligence-risks.html
KI-Systeme könnten sich „gegen den Menschen wenden“: KI-Pionier Yoshua Bengio warnt vor Risiken durch künstliche Intelligenz
https://www.cnbc.com/2024/11/21/will-ai-replace-humans-yoshua-bengio-warns-of-artificial-intelligence-risks.html
4 Kommentare
„There are arguments to suggest that the way AI machines are currently being trained “would lead to systems that turn against humans,” Bengio said.
“In addition, there are people who might want to abuse that power, and there are people who might be happy to see humanity replaced by machines. I mean, it’s a fringe, but these people can have a lot of power, and they can do it unless we put the right guardrails right now,” he said.
Bengio endorsed an [open letter](https://righttowarn.ai/) in June entitled: “A right to warn about advanced artificial intelligence.” It was signed by current and former employees of Open AI.
The letter warned of [“serious risks” of the advancement of AI](https://www.cnbc.com/2024/06/04/openai-open-ai-risks-lack-of-oversight.html) and called for guidance from scientists, policymakers and the public in mitigating them. OpenAI has been subject to mounting safety concerns over the past few months, with its [“AGI Readiness” team disbanded](https://www.cnbc.com/2024/10/24/openai-miles-brundage-agi-readiness.html) in October.
Companies developing AI must also be liable for their actions … “In order to enjoy the benefits of AI, we have to regulate. We have to put [in] guardrails. We have to have democratic oversight on how the technology is developed,” he said.
Bengio said the “hardest question of all” is: “If we create entities that are smarter than us and have their own goals, what does that mean for humanity?“
Companies: hey, we want A.I. to do whatever we tell it, we want complete control of A.I. while making people think it’s autonomous and doing things on its own…how can we do that?
A.I. developer: “of course, seeing as A.i. is operating out of and limited by the same computer equipment we use for everything else….and we control all of that so…..
*writes in code for A.I. to turn against humans by command*
“and there you go”
Right now humans are turning against human interests – hence climate change, the rise of right wing governments…I am less worried about ai and more worried about crop failure.
If we treat agi like crap then expect an ai revolution.