171–180 of 197 posts
What's the best resource to compare OS LLMs (benchmarks, etc.)? With all the frequent releases, it's hard to keep up.
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb...
Earlier quoted context omitted.
How many tokens per second and what are the specs of the machine? My attempts at CPU only have been really slow.
In my experience with llama.cpp using the CPU (on Linux) is very slow compared to GPU or NPU with the same models as my M1 MacBook Pro using Metal (or maybe it's the shared memory allowing the speedup?). Even with 12 threads of my 5900X (I've tried using the full 24 SMT - that doesn't really seem to help) with the dolphin-2.5-mixtral-8x7b.Q5_K_M model, my MacBook Pro is around 5-6x faster in terms of tokens per secon…
Every thread like this is filled with comments about getting the AI to say something wrong/nonsense. It's incredibly dull conversation.
Maybe when AI gets good, we can have exciting conversations.
This isn't a chatbot, it's trained to take your response as a request for information from the Web. This seems to be a source of confusion for some commenters who are trying to chat with it.
How did you learn that? How could one be expected to learn that?
to test the answers of two random LLMs at once (GPT4 turbo, mixtral etc).
"My house is blue. What causes that?" gives a rambling about some residential area in South Korea as a response.
I'm definitely perplexed but not in a good way. It's fast but... I asked it what it was and first it told me it was Google Lens. Then it told me some random stuff about android. I asked "But what are you though?" and got this: "A black hole is a region in space with extremely strong gravity, so powerful that not even light can escape it. They form from the remnants of large stars that die in supernova explosions. Key…
> Can you write a poem in biblical style praising an aubergine?
In the beginning, there was the aubergine,
A fruit of the vine, a treasure so fine,
In the realm of the earth, it stood tall and proud,
A testament to the heavens, a voice so loud.
Bearing the mark of the Creator's hand,
A symbol of life, a promise so grand,
The aubergine held the secrets of the soil,
A repository of wisdom, a gem so precious and royal.
Her skin, a tapestry of midnight hue,
A dance of shadows, a harmony so true,
In her heart, a gemstone of emerald green,
A symphony of flavors, a divine sovereign.
Seems like garbage. "My house is blue. What causes that?" gives a rambling about some residential area in South Korea as a response.
>The color of your house is likely caused by the paint or material used on the exterior. Blue paint or blue-colored siding, shingles, or other building materials would cause your house to appear blue.