11–20 of 137 posts
Newb question. If the big boys are crawling, scraping, stealing the whole of the entire internet to train their models — how are these OS alternatives aiming to outperform them? Is it as simple as... ALSO crawl, scrape, steal the whole of the entire internet?
Newb question. If the big boys are crawling, scraping, stealing the whole of the entire internet to train their models — how are these OS alternatives aiming to outperform them? Is it as simple as... ALSO crawl, scrape, steal the whole of the entire internet?
That's more or less what people were doing back in 2023 - crawling everything and dumping as much data in as possible.
It's not a great strategy to build a best-in-class model though, as a lot of the internet is junk. The SolidGoldMagikarp/davidjl bug is the kind of thing that happens if you crawl all of https://www.reddit.com/r/counting/ for example: https://simonwillison.net/2023/Jun/8/gpt-tokenizers/#glitch-...
These days model training labs are more selective about what they train on. Most of the game of training a great model comes down to selectively training your data. They still use a lot of unlicensed data but it's a bit more sophisticated than just dumping in everything they can find.
Does anyone have any good simple prompts for testing new "reasoning" models like this one? "Count the letter Rs in the word strawberry" is a bit dull! I'm trying this one locally using Ollama and the smallest quantized GGUF version (769MB) I could find - https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5... - I ran it like this: ollama run hf.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF:IQ3_XXS He…
[0] or rather models closer to saturation, which is a function of model params and amount of training
Does anyone have any good simple prompts for testing new "reasoning" models like this one? "Count the letter Rs in the word strawberry" is a bit dull! I'm trying this one locally using Ollama and the smallest quantized GGUF version (769MB) I could find - https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5... - I ran it like this: ollama run hf.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF:IQ3_XXS He…
% ollama run hf.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF:F32
pulling manifest
pulling 84159ad584aa... 100% 7.1 GB
pulling 8aa4c0321ccd... 100% 493 B
pulling c737442a210a... 100% 170 B
pulling ed76df87b934... 100% 193 B
verifying sha256 digest
writing manifest
success
>>> Count the letter Rs in the word strawberry
Okay, so I need to count how many times the letter 'r'
appears in the word "strawberry." Hmm, let's break this down
step by step. First, I should probably spell out each letter
of the word to make sure I don't miss any 'r's.
Starting with "strawberry." Let me write it out: S, T, R, A,
W, B, E, R, F, U, R, Y? Wait, maybe I'm not spelling it
correctly. Actually, let's count each letter properly.
The word is spelled as follows:
S T R A W B E R F U R Y. Wait, no, that might be longer than
needed. Let me write it out more accurately:
The full word is "strawberry." So breaking it down:
1. S
2. T
3. R
4. A
5. W
6. B
7. E
8. R
9. F
10. U
11. R
12. Y
ollama run hf.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF:F16
Newb question. If the big boys are crawling, scraping, stealing the whole of the entire internet to train their models — how are these OS alternatives aiming to outperform them? Is it as simple as... ALSO crawl, scrape, steal the whole of the entire internet?
No, fine tuning doesn't require that and models are using synthetic data sets now, for like 2 years as in, the huge models did the crawling and then the next models had conversations with the huge models oversimplified but basically the scraping ship has sailed, artists/writers will never be satisfied, and other companies bragging about using whatever aspirational goal post of licensed material are just doing it for…
Does anyone have any good simple prompts for testing new "reasoning" models like this one? "Count the letter Rs in the word strawberry" is a bit dull! I'm trying this one locally using Ollama and the smallest quantized GGUF version (769MB) I could find - https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5... - I ran it like this: ollama run hf.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF:IQ3_XXS He…
The negative quality impact of quantization is more pronounced for smaller models [0], so I'm surprised this tiny quant works at all. [0] or rather models closer to saturation, which is a function of model params and amount of training
Newb question. If the big boys are crawling, scraping, stealing the whole of the entire internet to train their models — how are these OS alternatives aiming to outperform them? Is it as simple as... ALSO crawl, scrape, steal the whole of the entire internet?
Does anyone have any good simple prompts for testing new "reasoning" models like this one? "Count the letter Rs in the word strawberry" is a bit dull! I'm trying this one locally using Ollama and the smallest quantized GGUF version (769MB) I could find - https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5... - I ran it like this: ollama run hf.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF:IQ3_XXS He…