Hi all, I'm the author of this post (and the CEO/Founder of DuckDuckGo). Happy to take a few questions about how DuckAssist works, but to clarify what I think may be some confusion from the other comments, we're not just asking a LLM to summarize Wikipedia from its training, nor did we train an LLM on Wikipedia -- instead, we use our own Wikipedia index to pull out the relevant sentences, and then ask the LLM to verify the answer is in the sentences and then: if so, output it simply; if not, try to answer a similar question, and if that doesn't exist, then do nothing.
It can still be wrong for a variety of reasons mentioned in the post, but this is a different approach and in our validation testing (using banks of questions with known/unknown answers in Wikipedia) we know it works reasonably well, and have a lot of ideas of how to make it work much better over time. This is a beta after all, and we have plans both for improvements and additional features.