Earlier quoted context omitted.
Supposedly LLMs (especially smaller ones) are best suited to tasks where the answer is in the text, i.e. summarization, translation, and answering questions. Asking it to answer questions on its own is much more prone to hallucination. To that end I've been using Llama 3 for summarizing transcripts of YouTube videos. It does a decent job, but... every single time (literally 100% of the time), it will hallucinate a ra…
for sure, so my use case for example is "using the following documentation to guide you {api documentation}, edit this code {relevant code}, with the following objective: Replace uses of {old API calls} in {some function} with with relevant functions from the supplied documentation" It mostly works, but if the context is a little to long, sometimes it will just spam the same umlaut or number (always umlaut's or numbe…
Re: Phi-3 Technical Report
#131Are you using ollama? Devs said there was a bug that occurs when context is full, they're working on it.