Yeah, it’s fast but almost always wrong. I asked it a few things (recipes, trivia etc…) and it completely made up the answers. These things don’t really know how to say “I don’t know” and pretend to know everything.
Groqchat
11–20 of 131 posts
Yeah, that's raw llama2 for you. Fine tuning, LoRa, that's how you get the nice responses.
Re: Groqchat
#12How is it so fast? Anyone know what they are doing differently?
Re: Groqchat
#13How is it so fast? Anyone know what they are doing differently?
Its not using GPUs. Its using Groq's own HW - LPUs
Re: Groqchat
#14It generates code really really fast.
Re: Groqchat
#15If only I could read that fast!
Re: Groqchat
#16It’s very fast at telling me it can’t tell me things! I asked about creating illicit substances — an obvious (and reasonable) target for censorship. And, admirably, it suggested getting help instead. That’s fine. But I asked for a poem about pumping gas in the style of Charles Bukowski, and it moaned that I shouldn’t ask for such mean-spirited, rude things. It wouldn’t dare create such a travesty.
It told me "Yeehaw Ridem Cowboy" was potentially problematic, which is news to me living out west.
Re: Groqchat
#17Is there any plan to show what this hardware can do for Mixtral-8x7B-Instruct? Based on the leaderboards[0], it is a better model than Llama2-70B, and I’m sure the T/s would be crazy high.
[0]: https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboar...
Re: Groqchat
#18If only I could read that fast!
Reading is one thing, but think about stuff like website generation, searching for information in massive datasets, real-time audio chats that don't sound like the AI misheard everything with a pause, and stuff like that.
Re: Groqchat
#19[flagged]
Re: Groqchat
#20[flagged]