Deepseek und Tsinghua entwickeln sich selbst unerbittliche KI-Modelle
https://www.bloomberg.com/news/articles/2025-04-07/deepseek-and-tsinghua-developing-self-improving-ai-models
Deepseek und Tsinghua entwickeln sich selbst unerbittliche KI-Modelle
https://www.bloomberg.com/news/articles/2025-04-07/deepseek-and-tsinghua-developing-self-improving-ai-models
6 Kommentare
„DeepSeek is working with Tsinghua University on reducing the training its AI models need in an effort to lower operational costs.
The new method aims to help artificial intelligence models better adhere to human preferences by offering rewards for more accurate and understandable responses, the researchers wrote. Expanding [reinforcement learning] to more general applications has proven challenging — and that’s the problem that DeepSeek’s team is trying to solve with something it calls self-principled critique tuning. The strategy outperformed existing methods and models on various benchmarks and the result showed better performance with fewer computing resources, according to the paper.
DeepSeek is calling these new models DeepSeek-GRM — short for “generalist reward modeling” — and will release them on an open source basis, the company said. Other AI developers, including Alibaba and OpenAI, are also pushing into a new frontier of improving reasoning and self-refining capabilities while an AI model is performing tasks in real time.“
Isn’t this a little misleading? It’s only self-improving in the sense that they built a feedback loop into the model so it continuously gets better rather than performing a batch retraining every so-many months. It’s like the algorithm feeding you trash videos on Instagram “self-improving” based on how long you watch, how much you interact, etc.
I don’t see this as being novel or interesting, it just trades faster updates at the cost of tailored training data. It becomes easier to poison the model, now.
meanwhile openAI thinking about how to charge their clients more
So Black Mirror S07E04 right?
> In a near-future London, an eccentric murder suspect is linked to an unusual video game from the 1990s – a game populated by cute, evolving artificial lifeforms.
What’s that supposed to be if not regular retraining of certain layers of the network?
I wonder if it will finally be able to answer questions about what happened on Tiananmen Square, the persecution of Uyghurs, and Taiwan statehood.