[deleted]
Thefastest.ai
11–20 of 36 posts
Re: Thefastest.ai
#12I don't understanding why would we need to having similar expectations from systems that we have from humans and building a whole theory on it. I can adjust my behaviour around systems. I am not restricted to operate within default values. e.g Whenever a price is listed as $99, I automatically know it is $100. Marketing gimmicks don't work once you know about them or in other words, expectations can be set in a new environment.
Re: Thefastest.ai
#13Been looking a lot for a simple overview like this, I’ve spent too much time benchmarking models/regions myself. Thank you for creating!
Re: Thefastest.ai
#14Another good resource: https://artificialanalysis.ai/
Re: Thefastest.ai
#15Any idea which one Copilot uses? I'm interested in exploring ways to get down autocomplete suggestion latency.
I think Github Copilot itself is GPT-3.5, but Copilot Chat is GPT-4.
Re: Thefastest.ai
#16Groq really has an unfortunate name. (I assume they had theirs before Grok.)
The spelling with a 'k' is more canon (referring to the term from Heinlein) and that was the spelling in the tech culture that borrowed it... what is the reason for choosing a 'q' in theirs, do you know?
Re: Thefastest.ai
#17Couple of things: 1. Filtering by model should be enabled by default. Mixtral-8x7b-instruct on Perplexity is almost as fast as the 7B Llama 2 on fireworks, but are quite different in sizes. 2. Pricing is a very important factor that is not included. 3. Overall service reliability should also be an important signal.
[flagged]
Re: Thefastest.ai
#18Earlier quoted context omitted.
Yeah they're not happy about that https://wow.groq.com/hey-elon-its-time-to-cease-de-grok/
I'll act as official mediator. Conclusion: both should change their name
Pretty silly to name your company a common word directly related to the product, then get upset at others using that same word for their product. It’s like if Grindr made angle grinders then got mad at a different company releasing an angle grinder they called “Grinder”.
Re: Thefastest.ai
#19Couple of things: 1. Filtering by model should be enabled by default. Mixtral-8x7b-instruct on Perplexity is almost as fast as the 7B Llama 2 on fireworks, but are quite different in sizes. 2. Pricing is a very important factor that is not included. 3. Overall service reliability should also be an important signal.
Can you describe what you'd like to see for #1? We currently show everything, but let people filter via the UI or URL param, e.g., https://thefastest.ai/?mf=3-70
Re: Thefastest.ai
#20Groq with llama3 70b is so fast and good enough for what we do (source code stuff) that it’s really quite painful to work with most others now. We replaced most our internal integrations with this and everything is great so far. I guess they will be bought soon?