Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models
1–10 of 51 posts
Re: Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models
#2[dead]
Re: Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models
#3Do people prefer the new flat style LLMs are producing? I don’t mind it as much as the gradient theme they were pumping out previously.
Re: Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models
#4It still matters, but in the age of good reasoning, tool use, and web search, this is much less of a problem than it used to be.
Re: Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models
#5After Trump's last inauguration, ChatGPT would still tell me that Biden was President of the US. I understand that the training cutoff was before Biden dropped out. But it knew, or should have known, the current date and that there had been an election since its last update, but it didn't qualify the answer. When I asked it to search the web, it got it right. The moral I took away was to always ask for the search whenever I ask about current events. I do that so routinely that I wouldn't know if this problem has been fixed. I suppose that failing to update my priors per individual model release is a form of bigotry against a widely hated class.
Re: Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models
#6After Trump's last inauguration, ChatGPT would still tell me that Biden was President of the US. I understand that the training cutoff was before Biden dropped out. But it knew, or should have known, the current date and that there had been an election since its last update, but it didn't qualify the answer. When I asked it to search the web, it got it right. The moral I took away was to always ask for the search whe…
ChatGPT recently started web searching for for basically every general knowledge question, which I found quite odd. Maybe an overcorrection to the issue you were having?
Re: Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models
#7It still matters, but in the age of good reasoning, tool use, and web search, this is much less of a problem than it used to be.
all the reasoning still comes from pretraining data
Re: Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models
#8I remember when the US captured Venezuelan president Maduro, and when I posed a prompt related to this, the model said that’s pure fiction. I told it to double check. Still didn’t want to entertain the idea. It only acquiesced when I specifically directed it to check Reuters. I haven’t noticed this problem in months. Model cutoff seems to be less of a problem these days.
Re: Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models
#9Depending on the use case certain models very well remain as or more reliable for certain tasks.
Re: Show HN: How Stale Is Your AI? Release age and training cutoff for 20 models
#10Pre-AI internet data is like pre-war steel
The slop would multiply if we keep feeding it to new models in a loop