Study: Google’s ‘AI Overview’ Spews False Information on Wide Variety of Topics

Oumi tested 4,326 search results from Google’s Gemini 2 model and an equal number from the more advanced Gemini 3 model. The analysis found accuracy rates of 85 percent and 91 percent respectively. While these percentages might seem relatively high, they become concerning when scaled to Google’s expected volume of over 5 trillion searches in 2026 alone.

The inaccuracies discovered ranged from basic factual errors to more complex misinformation. Examples included incorrect dates for when musician Bob Marley’s home was converted into a museum, wrong information about the death year of former MLB pitcher Dick Drago, and false claims that cellist Yo-Yo Ma had no record of induction into the Classical Music Hall of Fame despite his actual induction in 2007.

The research highlights a growing tension between traditional news publishers and Google. Since AI Overviews began appearing at the top of search results in 2024, traditional links to news websites have been pushed further down the page, effectively reducing their visibility. Publishers have accused Google of using their content to train AI models without providing proper credit or compensation.

The study also revealed that AI Overviews frequently cites questionable sources, including Facebook pages, blog posts, and Wikipedia entries, treating them as authoritative facts. The system appears vulnerable to manipulation, as demonstrated when BBC podcast host Thomas Germain created a blog post jokingly claiming to be one of the best tech journalists at eating hot dogs. Within a day, Google’s AI had incorporated this information and began stating that Germain had gained notoriety for prowess at competitive eating events in the news division.

Study: Google's 'AI Overview' Spews False Information on Wide Variety of Topics

Google's "AI Overview" search results are producing tens of millions of inaccurate answers each hour, according to new research that raises concerns about the reliability of AI-powered information retrieval.

www.breitbart.com

 

[mattfivefour]

I have found numerous errors and outright falsehoods in Google's AI overviews. Don't trust it.

 

[Tall Timbers]

I discount the AI search results completely butt you can't help but see them since they show up first.

I use Bing primarily but often resort to Google when Bing fails me, which is often.

Microsoft's AI dishes ip information that appears to be off to me about 90% of the time. Google AI gives more accurate info more often than that, but like I said I discount the AI results. I'm learning that AI isn't intelligent no matter how much data it has absorbed, and it simply is unwise to rely on what AI dishes up.

The very idea that a pastor would use AI to craft their sermons is disconcerting.

Gen A will grow up with AI. How that will shape them cannot be good.

 

[1LoverofGod]

I discount the AI search results completely butt you can't help but see them since they show up first.

I use Bing primarily but often resort to Google when Bing fails me, which is often.

Microsoft's AI dishes ip information that appears to be off to me about 90% of the time. Google AI gives more accurate info more often than that, but like I said I discount the AI results. I'm learning that AI isn't intelligent no matter how much data it has absorbed, and it simply is unwise to rely on what AI dishes up.

The very idea that a pastor would use AI to craft their sermons is disconcerting.

Gen A will grow up with AI. How that will shape them cannot be good.

I use Duck Duck Go for my search engine. When I bought my new phone. My phone automatically had the AI search active. I went to the settings for Duck Duck Go on the upper right corner and turned off that feature and the AI search was gone.

 

[Tall Timbers]

I use Duck Duck Go for my search engine. When I bought my new phone. My phone automatically had the AI search active. I went to the settings for Duck Duck Go on the upper right corner and turned off that feature and the AI search was gone.

duck duck go primarily relies on bing but includes other search engines and then does its own ranking. The only reason I use bing directly is because Microsoft pays me a small amount for using the search engine.

 

[1LoverofGod]

duck duck go primarily relies on bing but includes other search engines and then does its own ranking. The only reason I use bing directly is because Microsoft pays me a small amount for using the search engine.

I have heard Stargate is a good search.
What do you know about that Search Engine?

 

[Tall Timbers]

I have heard Stargate is a good search.
What do you know about that Search Engine?

First time I've heard of it. Personally, I don't think there's a good search engine out there. Monetization has trumped good search results.

 

[1LoverofGod]

First time I've heard of it. Personally, I don't think there's a good search engine out there. Monetization has trumped good search results.

I think they are All compromised

 

[Tall Timbers]

I think they are All compromised

In one way or another. In the beginning of search engines, it wasn't very good. But it became excellent. Then came monetization followed by greedy monetization followed by purposeful misinformation and indoctrination (propaganda) showing up in the searches.