Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Countless.dev – A website to compare every AI model: LLMs, TTSs, STTs

countless.dev

Post reply on HN
Print view View original

71–80 of 82 posts

Re: Show HN: Countless.dev – A website to compare every AI model: LLMs, TTSs, STTs

#71

Post by rtsil »

botro wrote: post #45
ursaguild wrote: post #10

I like the idea of more comparisons of models. Are there plans to add independent analyses of these models or is it only an aggregation of input limits? How do you see this differing from or adding to other analyses such as: https://artificialanalysis.ai https://huggingface.co/spaces/TTS-AGI/TTS-Arena https://huggingface.co/spaces/hf-audio/open_asr_leaderboard https://huggingface.co/spaces/TIGER-Lab/GenAI-Arena Great…

I made https://aimodelreview.com/ to compare the outputs of LLMs over a variety of prompts and categories, allowing a side by side comparison between them. I ran each prompt 4 times for different temperature values and that's available as a toggle. I was going to add reviews on each model but ran out of steam. Some users have messaged me saying the comparisons are still helpful to them in getting a sense of how diffe…

I can confirm, it's still very helful, thank you!

Re: Show HN: Countless.dev – A website to compare every AI model: LLMs, TTSs, STTs

#72

Post by refulgentis »

gtirloni wrote: post #29

Tangent question: is there anything better on the desktop than ChatGPT's native client? I find it too simple to organize chats but I'm having a hard time evaluating the dozen or so apps (most are disguise for some company's API service). Any recommendations? macOS/Linux compatibility preferred.

Telosnex: every platform, native. Also, has web. Anthropic, OpenAI, Mistral, Groq, Gemini, and any local LLM on literally every platform. and you can bring your own API keys, and the best search available. Pay as you go, with everything at cost if you pay $10/month. Otherwise, free. Everythings stored in simple JSON.

Re: Show HN: Countless.dev – A website to compare every AI model: LLMs, TTSs, STTs

#73

Post by vivzkestrel »

ursaguild wrote: post #10

I like the idea of more comparisons of models. Are there plans to add independent analyses of these models or is it only an aggregation of input limits? How do you see this differing from or adding to other analyses such as: https://artificialanalysis.ai https://huggingface.co/spaces/TTS-AGI/TTS-Arena https://huggingface.co/spaces/hf-audio/open_asr_leaderboard https://huggingface.co/spaces/TIGER-Lab/GenAI-Arena Great…

now imagine going one step further and actually running a prompt across every AI model and showing you the best answer and the AI model that generated it

Re: Show HN: Countless.dev – A website to compare every AI model: LLMs, TTSs, STTs

#74

Post by alternatex »

vivzkestrel wrote: post #73
ursaguild wrote: post #10

I like the idea of more comparisons of models. Are there plans to add independent analyses of these models or is it only an aggregation of input limits? How do you see this differing from or adding to other analyses such as: https://artificialanalysis.ai https://huggingface.co/spaces/TTS-AGI/TTS-Arena https://huggingface.co/spaces/hf-audio/open_asr_leaderboard https://huggingface.co/spaces/TIGER-Lab/GenAI-Arena Great…

now imagine going one step further and actually running a prompt across every AI model and showing you the best answer and the AI model that generated it

Who decides what the best answer is?

Re: Show HN: Countless.dev – A website to compare every AI model: LLMs, TTSs, STTs

#75

Post by vivzkestrel »

alternatex wrote: post #74
vivzkestrel wrote: post #73

Earlier quoted context omitted.

now imagine going one step further and actually running a prompt across every AI model and showing you the best answer and the AI model that generated it

Who decides what the best answer is?

the user who runs the prompt?

Re: Show HN: Countless.dev – A website to compare every AI model: LLMs, TTSs, STTs

#77

Post by adrianomartins »

botro wrote: post #45
ursaguild wrote: post #10

I like the idea of more comparisons of models. Are there plans to add independent analyses of these models or is it only an aggregation of input limits? How do you see this differing from or adding to other analyses such as: https://artificialanalysis.ai https://huggingface.co/spaces/TTS-AGI/TTS-Arena https://huggingface.co/spaces/hf-audio/open_asr_leaderboard https://huggingface.co/spaces/TIGER-Lab/GenAI-Arena Great…

I made https://aimodelreview.com/ to compare the outputs of LLMs over a variety of prompts and categories, allowing a side by side comparison between them. I ran each prompt 4 times for different temperature values and that's available as a toggle. I was going to add reviews on each model but ran out of steam. Some users have messaged me saying the comparisons are still helpful to them in getting a sense of how diffe…

Hey, this is pretty insightful! Wonder if, in the course of researching to build this website you reached any conclusions as to what’s the AI assistant currently ahead.

Re: Show HN: Countless.dev – A website to compare every AI model: LLMs, TTSs, STTs

#78

Post by victoriawu »

It’s indeed quite intuitive to see the details of each AI model, but it feels a bit overwhelming with too much information.

I wonder if adding a chatbot might be a good idea. Users could ask specific questions based on their needs, and the bot could recommend the most suitable model. Perhaps this would add more value.

Re: Show HN: Countless.dev – A website to compare every AI model: LLMs, TTSs, STTs

#80

Post by ahmetd »

ProofHouse wrote: post #52

These are hard to keep updated. I find they usually fall off. It would be cool to have one, but honestly, this one already doesn't even have 4o and pro on it which if it was being maintained, it obviously would. Updating a table shouldn't take days. It's like a one minute event.

the reason 4o and pro doesn't exist is because they aren't available via API yet!

the website is updated, don't worry :)

Post reply on HN