> Prompt: Which is larger, .9 or .11? > Result: .9 is larger than .11 we've broken the semver barrier!
[deleted]
g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains
121–130 of 158 posts
Re: g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains
#122Earlier quoted context omitted.
That answer seems to conflict with "in the future we'd like to give users more control over the thinking time". I've gotten mini to think harder by asking it to, but it didn't make a better answer. Though now I've run out of usage limits for both of them so can't try any more…
I'm not convinced there isn't more going on behind the scenes but influencing test-time compute via prompt is a pretty universal capability.
not in a way that it is effectively used - in real life all of the papers using CoT compare against a weak baseline and the benefits level off extremely quickly.
nobody except for recent deepmind research has shown test time scaling like o1
Re: g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains
#123This is not even remotely close and very silly. A ChainOfThought in a loop. TreeOfThoughts is a more sophisticated method, see - https://arxiv.org/pdf/2305.10601 The clue we all had with OpenAI for a long time that this was a search through a tree, they hired Noam Brown, and his past work all hinted towards that. Q , is obviously a search on a tree like A . So take something like CoT, build out a tree, search for the…
Came here hoping to find this. You will not unlock "o1-like" reasoning by making a model think step by step. This is an old trick that people were using on GPT3 in 2020. If it were that simple, it wouldn't have taken OpenAI so long to release it. Additionally, some of the prompt seems counterproductive: >Be aware of your limitations as an llm and what you can and cannot do. The LLM doesn't have a good idea of its lim…
you’re wrong and stating things confidently without the evidence to back it up.
alignment is a tough problem and aligning long reasoning sequences to correct answer is also a tough problem. collecting high quality CoT from experts is another tough problem. they started this project in october, more than plausible it could take this time
Re: g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains
#124o1’s innovation is not Chain-of-Thought. It’s teaching the model to do CoT well (from massive amounts of human feedback) instead of just pretending to. You’ll never get o1 performance just from prompt engineering.
OpenAI is of course going to claim what they've done is very special and hard to replicate. They're a for-profit company and they want to harm the competition any way they can. If they were just doing prompt engineering and multiple inferences they'd definitely want to keep that a competitive secret and send all the open source devs off in random directions, or keep them guessing, rather than telling them which way t…
nobody has shown CoT scaling like this except deepmind, it is very obviously a result of their alignment pipeline not just prompting.
Re: g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains
#125This is not even remotely close and very silly. A ChainOfThought in a loop. TreeOfThoughts is a more sophisticated method, see - https://arxiv.org/pdf/2305.10601 The clue we all had with OpenAI for a long time that this was a search through a tree, they hired Noam Brown, and his past work all hinted towards that. Q , is obviously a search on a tree like A . So take something like CoT, build out a tree, search for the…
Another serious advantage of a tree search is parallelism.
Re: g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains
#126Earlier quoted context omitted.
That's not a big problem since it will understand it, and if they already fine tuned the model to work with that prompt it'd get harder to change.
I just don't think Apple would release something like this. They're the company that laser engraves their screws because of their attention to detail.
Which apple screws are laser engraved?
Re: g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains
#127Earlier quoted context omitted.
They mention reinforcement learning, so I guess they used some sort of Monte Carlo tree search (the same algorithm used for AlphaGo). In this case, the model would explore several chain of thoughts during training, but only output a single chain during inference (as the sibling comment suggests).
as someone who works in this field, this comment is obviously uninformed even about old public research trends
Care to elaborate?
Your comment would be a lot more useful if it included a little why. Otherwise it’s just teasing readers and at the same time smearing the author without anything to back it up.
Re: g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains
#128>In all-caps to improve prompt compliance by emphesizing the importance of the instruction This kind of thing is still so funny to me. I wonder if the first guy who gets AGI to work will do it by realizing that he can improve LLM reliability over some threshold by telling it in all caps that his pet's life depends on the answer.
always interesting to me the number of people who try to turn an LLM into AGI by assuming it’s an AGI (i.e. via some fancy prompt)
Re: g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains
#129o1’s innovation is not Chain-of-Thought. It’s teaching the model to do CoT well (from massive amounts of human feedback) instead of just pretending to. You’ll never get o1 performance just from prompt engineering.
OpenAI is of course going to claim what they've done is very special and hard to replicate. They're a for-profit company and they want to harm the competition any way they can. If they were just doing prompt engineering and multiple inferences they'd definitely want to keep that a competitive secret and send all the open source devs off in random directions, or keep them guessing, rather than telling them which way t…
> and they want to harm the competition any way they can.
That's an incredibly cynical choice of phrasing.
Of course they don't want to help the competition, that's what a competition is. The competition isn't helping OpenAI either.
Re: g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains
#130[dead]