Working with The Associated Press to provide fresh results for the Gemini app
1–10 of 68 posts
Re: Working with The Associated Press to provide fresh results for the Gemini app
#2As someone who works in the news industry I find it pretty sad that we've just capitulated to big tech on this one. There are countless examples of AI summaries getting things catastrophically wrong, but I guess Google has long since decided that pushing AI was more important than accurate or relevant results, as can also be seen with their search results that simply omit parts of your query.
I can only hope this data is being incorporated in some way that makes hallucinations less likely.
Re: Working with The Associated Press to provide fresh results for the Gemini app
#3There's not a lot of detail in the announcement but I assume this is some kind of RAG system. I wonder if it will cover some short time period (past week, past month?) or if they are trying to cover the whole time period since the knowledge cutoff of the current model.
Re: Working with The Associated Press to provide fresh results for the Gemini app
#4As someone who works in the news industry I find it pretty sad that we've just capitulated to big tech on this one. There are countless examples of AI summaries getting things catastrophically wrong, but I guess Google has long since decided that pushing AI was more important than accurate or relevant results, as can also be seen with their search results that simply omit parts of your query. I can only hope this dat…
Gemini is the leading model with the lowest hallucination rate: https://www.visualcapitalist.com/ranked-ai-models-with-the-l...
I would expect that number to go down from 1.3% to below 1% over the course of the year.
There's always a chance what you're reading is wrong - due to purposeful deception, negligence, or accident.
Realistically, hardly anything is 100% accurate besides math.
Re: Working with The Associated Press to provide fresh results for the Gemini app
#5There's not a lot of detail in the announcement but I assume this is some kind of RAG system. I wonder if it will cover some short time period (past week, past month?) or if they are trying to cover the whole time period since the knowledge cutoff of the current model.
My guess is that they’ll just stuff a few daily headlines into the prompt so that queries about current affairs have some context, rather than re-training the model. Total guess obviously.
Re: Working with The Associated Press to provide fresh results for the Gemini app
#6As someone who works in the news industry I find it pretty sad that we've just capitulated to big tech on this one. There are countless examples of AI summaries getting things catastrophically wrong, but I guess Google has long since decided that pushing AI was more important than accurate or relevant results, as can also be seen with their search results that simply omit parts of your query. I can only hope this dat…
Gemini is the leading model with the lowest hallucination rate: https://www.visualcapitalist.com/ranked-ai-models-with-the-l... I would expect that number to go down from 1.3% to below 1% over the course of the year. There's always a chance what you're reading is wrong - due to purposeful deception, negligence, or accident. Realistically, hardly anything is 100% accurate besides math.
The Gemini models themselves may score well on this, but Google's feature implementations are a whole other thing. AI Overviews frequently take untrustworthy search results (like a fan fiction plot outline for Encanto 2) and turn those into confidently incorrect answers. https://simonwillison.net/2024/Dec/29/encanto-2/
Re: Working with The Associated Press to provide fresh results for the Gemini app
#7As someone who works in the news industry I find it pretty sad that we've just capitulated to big tech on this one. There are countless examples of AI summaries getting things catastrophically wrong, but I guess Google has long since decided that pushing AI was more important than accurate or relevant results, as can also be seen with their search results that simply omit parts of your query. I can only hope this dat…
Journalism is dying, killed by its own excesses and by the internet. Google is offering it life support. The other option is death.
Re: Working with The Associated Press to provide fresh results for the Gemini app
#8As someone who works in the news industry I find it pretty sad that we've just capitulated to big tech on this one. There are countless examples of AI summaries getting things catastrophically wrong, but I guess Google has long since decided that pushing AI was more important than accurate or relevant results, as can also be seen with their search results that simply omit parts of your query. I can only hope this dat…
> I can only hope this data is being incorporated in some way that makes hallucinations less likely.
The key word is "real-time". LLMs can't be trained in realtime, so it's obviously going to call an API that pulls up and reads from AP news, just like their search engine.
Re: Working with The Associated Press to provide fresh results for the Gemini app
#9As someone who works in the news industry I find it pretty sad that we've just capitulated to big tech on this one. There are countless examples of AI summaries getting things catastrophically wrong, but I guess Google has long since decided that pushing AI was more important than accurate or relevant results, as can also be seen with their search results that simply omit parts of your query. I can only hope this dat…
Gemini is the leading model with the lowest hallucination rate: https://www.visualcapitalist.com/ranked-ai-models-with-the-l... I would expect that number to go down from 1.3% to below 1% over the course of the year. There's always a chance what you're reading is wrong - due to purposeful deception, negligence, or accident. Realistically, hardly anything is 100% accurate besides math.
1.3% isn't great. I'd rather just go, and pay, directly to trusted news sources. Everyone has different tolerance for falsehoods and priorities I guess.
Re: Working with The Associated Press to provide fresh results for the Gemini app
#10As someone who works in the news industry I find it pretty sad that we've just capitulated to big tech on this one. There are countless examples of AI summaries getting things catastrophically wrong, but I guess Google has long since decided that pushing AI was more important than accurate or relevant results, as can also be seen with their search results that simply omit parts of your query. I can only hope this dat…
Hallucinations are not a big problem with SOTA models at this point, especially grounded against an actual news article.