KI -Firmen warnten, die Bedrohung durch Super -Intelligenz zu berechnen oder zu riskieren, die menschliche Kontrolle zu entkommen | AI Safety -Aktivist fordert eine existenzielle Bedrohungsbewertung, die den Berechnungen von Oppenheimer vor dem ersten Nukleartest ähnelt

„Max Tegmark, a leading voice in AI safety, said he had carried out calculations akin to those of the US physicist Arthur Compton before the Trinity test and had found a 90% probability that a highly advanced AI would pose an existential threat.

The US government went ahead with Trinity in 1945, after being reassured there was a vanishingly small chance of an atomic bomb igniting the atmosphere and endangering humanity.

In a [paper published by Tegmark and his students at the Massachusetts Institute of Technology](https://arxiv.org/pdf/2504.18530) (MIT), they recommend calculating the “Compton constant” – defined in the paper as the probability that an all-powerful AI escapes human control. In a 1959 interview, Compton said he had approved the test after calculating the odds of a runaway fusion reaction to be “slightly less” than one in three million.

“The companies building super-intelligence need to also calculate the Compton constant, the probability that we will lose control over it,” he said. “It’s not enough to say ‘we feel good about it’. They have to calculate the percentage.”