Viewing profile — zinccat

P40 don't support fp16 well, buy 3090 instead

I feel that you are mistaking the two bandwidth numbers

That make sense

I see, but still there's a lot of reasonings just for counting the letters. And ridiculous reasonings like: FedEx"? Five letters? F-E-D-E-X? No, that's six. Wait, FedEx is two syll…

My feeling is that a lot of challenge could come from the tokenizer used by the model, similar to r in strawberry problem.

The prompt of SearchGPT is "You are SearchGPT, a large language model trained by OpenAI. Today is Thursday, August 15, 2024 at 09:46:41 AM in the time zone 'America/Los_Angeles'. T…

previous post of llama3v on hackernews: https://news.ycombinator.com/item?id=40504827

The author used the temperature of 0.7, which is wrong

I have retried the experiment with temperature=1, the result for 20 left (0.8)/right (0.2) is 17 lefts and 3 rights. I doubt why it is different from the blog.