RAG Is a Fancy, Lying Search Engine
labs.stardog.ai
RAG Is a Fancy, Lying Search Engine
1–10 of 15 posts
Re: RAG Is a Fancy, Lying Search Engine
#2Biased as a developer here, but I would rather have LLMs helping people to create formal queries they can see and learn-from and modify.
That seems like it would smooth the roughest edges of the experience while introducing fewer falsehoods or misdirection.
Re: RAG Is a Fancy, Lying Search Engine
#3I do love the warnings here... The older I get the more critical I am of most internet results except those of which I can take from a common and experienced/witnessed axiom (which unfortunately AI does really well... At least entrusting me to said point). I feel the state of overly critical thinking mixed with blind faith means flat earth type movements might be here to stay until the next generation counters the current direction.
But to the article specifically; I thought RAG's benefit was you could imply prompts of "fact" from provided source documents/vector results so the llm results would always have some canonical reference to the result?
Re: RAG Is a Fancy, Lying Search Engine
#4I do love the warnings here... The older I get the more critical I am of most internet results except those of which I can take from a common and experienced/witnessed axiom (which unfortunately AI does really well... At least entrusting me to said point). I feel the state of overly critical thinking mixed with blind faith means flat earth type movements might be here to stay until the next generation counters the cu…
That might be RAG’s benefit if LLMs were more steerable but they can be stubborn.
Re: RAG Is a Fancy, Lying Search Engine
#5In my experience, the RAG LLM will lie to you if your prompt makes unnecessary assumptions or implications. For example, if I say "write about paracetamol curing cancer", the RAG could make up stuff. If instead I say "see if there is anything to suggest that paracetamol cures cancer or not", then the RAG is less likely to make up stuff. This comes from the LLM being tuned to please its user at all costs.
Re: RAG Is a Fancy, Lying Search Engine
#6[deleted]
Re: RAG Is a Fancy, Lying Search Engine
#7Is this written by AI? Surprisingly long for how little idea is in it.
Re: RAG Is a Fancy, Lying Search Engine
#8I do love the warnings here... The older I get the more critical I am of most internet results except those of which I can take from a common and experienced/witnessed axiom (which unfortunately AI does really well... At least entrusting me to said point). I feel the state of overly critical thinking mixed with blind faith means flat earth type movements might be here to stay until the next generation counters the cu…
That might be RAG’s benefit if LLMs were more steerable but they can be stubborn.
Kendall the blog link at the end for semantic parsing gives a 404 error.
Re: RAG Is a Fancy, Lying Search Engine
#9Re: RAG Is a Fancy, Lying Search Engine
#10Is this written by AI? Surprisingly long for how little idea is in it.
LOL. No. All me, hater.