Hi folks, I work for Groq. Feel free to ask me any questions. (If you check my HN post history you'll see I post a lot about Haskell. That's right, part of Groq's compilation pipeline is written in Haskell!)
price plan ?
Groq runs Mixtral 8x7B-32k with 500 T/s
481–482 of 482 posts
Re: Groq runs Mixtral 8x7B-32k with 500 T/s
#482It's only faster sometimes, but when you ask it a complicated question or give it any type of pre-prompt to speak in a different way, then it still takes a while to load. Interesting but ultimately probably going to be a flop