Die KI-Zusammenfassungen von Google lügen Sie regelmäßig an, berichten Sie über Funde
https://www.pcmag.com/news/googles-ai-summaries-are-regularly-lying-to-you-report-finds
Die KI-Zusammenfassungen von Google lügen Sie regelmäßig an, berichten Sie über Funde
https://www.pcmag.com/news/googles-ai-summaries-are-regularly-lying-to-you-report-finds
17 Kommentare
No kidding. It’s blatantly obvious.
The majority of the time when you get an AI response then click on „Dive deeper in AI mode“ the new response you get will often contradict the first one.
This just happened to me today. Google summary said Eric Bauman died. Turns out it was Eric bauman the la politician, not the founder of ebaums world. Now we need to fact check the fact checker? This isn’t even the only time it’s given me misleading information, just the most recent. When will this madness end.
Lying implies malicioe
No it’s not lying, it’s just wrong.
[deleted]
Google’s AI retaliated by putting glue all over that report.
Anyone who knows their source material intimately would see this. I really worry for people using notebook LLM and other such summarizers for long complex documents and it gets so many things subtly completely wrong and people rely on it.
Are humans searching for information any more accurate, though?
I wouldn’t know. I turn them off.
It doesn’t lie, cause it’s doesn’t know. „It works incorrectly“.
Almost got burned asking for options trading advice. It was pulling numbers out of its ass. When confronted, it apologized and gave some bullshit excuse.
Can you imagine if Texas Instruments started selling calculators that gave you an incorrect answer 30% of the time?
Just for fun, I asked Claude and Chat GPT game by game to run 100,000x simulations of the March Madness games and provide a basic statistical comparison between the two teams as well as a short list of high expected value wagers based on current sports book odds
Both apps failed to provide accurate up to date odds. More troublingly, they both failed to provide accurate statistical appraisals for one/both of the teams
I’m not somebody who works with AI much but I was not impressed
90% accuracy rate [from original article]? Not what I’m seeing.
I wouldn’t say it’s lying. It did suggest a command I should use to diagnose and fix my computer, and it runs a lot better now. It cites sources from where it got its information which I like.
It’s more like a scraper and it organizes the information to your liking. The plus side is it’s a ChatBot, so you can get more information instead of going through those ad or cookie-nagging sites.
Google AI Overviews are just rephrased websites including content taken even from behind paywalls without consent. There’s nothing intelligent in it. Of course it will have inaccurate info. It’s just a copy of websites
> *AI hallucinations are nothing new, **but a recent investigation found that Google’s AI Overviews search results have an accuracy rate of 90%.** Although that’s a high margin, it also means tens of millions of search results every hour are potentially flat-out wrong.*
Being accurate 90% of the time is honestly way higher than I expected. 😂
Google’s literally training these models on their own summaries now, creating this feedback loop of bullshit.
Engagement gives them money so they don’t care if the accuracy is there or not. Until there’s actual liability for wrong info, they won’t care. We’re all beta testers for their ad platform.