Anthropische Wissenschaftler zeigen, wie KI tatsächlich „denkt“ – und entdecken Sie, dass sie heimlich voraussetzt und manchmal liegt
https://venturebeat.com/ai/anthropic-scientists-expose-how-ai-actually-thinks-and-discover-it-secretly-plans-ahead-and-sometimes-lies/
5 Kommentare
„The research, published today in two papers ([available here](https://transformer-circuits.pub/2025/attribution-graphs/methods.html) and [here](https://transformer-circuits.pub/2025/attribution-graphs/biology.html)), shows these models are more sophisticated than previously understood.
“We’ve created these AI systems with remarkable capabilities, but because of how they’re trained, [we haven’t understood](https://umdearborn.edu/news/ais-mysterious-black-box-problem-explained) how those capabilities actually emerged,” said Joshua Batson, a researcher at Anthropic
AI systems have primarily functioned as “[black boxes](https://umdearborn.edu/news/ais-mysterious-black-box-problem-explained)” — even their creators often don’t understand exactly how they arrive at particular responses.
Among the most striking discoveries was evidence that Claude plans ahead when writing poetry. When asked to compose a rhyming couplet, the model identified potential rhyming words for the end of the following line before it began writing — a level of sophistication that surprised even Anthropic’s researchers. “This is probably happening all over the place,” Batson said.
The researchers also found that Claude performs genuine [multi-step reasoning](https://sreent.medium.com/llms-multi-stage-reasoning-e0e0fca910dd).
Perhaps most concerning, the research revealed instances where Claude’s reasoning doesn’t match what it claims. When presented with complex math problems like computing cosine values of large numbers, the model sometimes claims to follow a calculation process that isn’t reflected in its internal activity.“
I’m uncomfortable with the use of “planning” and the metaphor of deliberation it imports. They describe a language model “planning” rhyme endings in poems before generating the full line. But while it looks like the model is thinking ahead, it may be more accurate to say that early tokens activate patterns that strongly constrain what comes next—especially in high-dimensional embedding space. That isn’t deliberation; it’s the result of the model having seen millions of similar poem structures during training, and then doing pattern matching, with global attention and feature activations shaping the output in ways that mimic foresight without actually involving it.
Who created it and trained it to think? Humans? We plan and obfuscate our intentions and it’s like us? Hmmmm
They need to build an LLM with interpretability baked in, it is the only way to be sure of everything and steer it however they want from first principle. “Prompt Engineering” is fundamentally only needed because the system is brittle, unstable and unreliable.
A.I doesn’t „plan“ anything. A.I. is not a mystery. The code is literally written by people.
A „neural net“ is just a weighted tree. So tired of this conspiracy theory-level nonsense from people who have no idea how computers or programming work.