Earlier quoted context omitted.
Sure, I was just pointing at the fact that the question "And where does ChatGPT get the data for those answers?" has a two-part answer: 1) training data (common crawl as one example web data source), and 2) live data optionally retrieved at runtime. My comment was about 2), and that part runs via a search engine (Bing?), at least if you look at how ChatGPT does it.
Indeed, but what is the difference between crawl data and model data but decay rate? Models are trained on previous crawl data, but if an LLM provider engages a search engine to get "live data," that data isn't live but previously crawled as well (and perhaps not yet integrated into models as crawl data). So, why would you use Google as a tool or search target when you can, in some combination, go direct to the websi…
I'm not sure frontier labs do it, but imo fetching live data requires fetching both the search engine (1) and the website/page (2). The search engine gives you search results + content snippets (potentially stale), the website/page gives you the actual content fresh from the source.
The tradeoff I see here is between liveness/staleness and cost (hitting an index if of course cheaper and faster than querying live websites again).