Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Confirmed: Reflection 70B's official API is a wrapper for Sonnet 3.5

old.reddit.com

Post reply on HN
Print view View original

21–30 of 70 posts

Re: Confirmed: Reflection 70B's official API is a wrapper for Sonnet 3.5

#22

Post by ga6840 »

scosman wrote: post #6

Context: someone announced a Llama 3.1 70B fine tune with incredible benchmark results a few days ago. It's been a dramatic ride: - The weight releases were messed up: released Lora for Llama 3.0, claiming it was a 3.1 fine tune - Evals initially didn't meet expectations when run on released weights - The evals starting performing near/at SOTA when using a hosted endpoint - Folks are finding clever ways to see what m…

Who is Sahil Chaudhary? Why he doesn't announce such a great advancement himself? Why Matt Shumer first announces it only because -- according to a later claim on X.com -- he trusted Sahil, does that mean Matt is unable to participate most of the progress? Then why announce a breakthrough without mentioning he was not fully involved to a level he can verify the result in the first place?

Re: Confirmed: Reflection 70B's official API is a wrapper for Sonnet 3.5

#23

Post by seszett »

ricardobeat wrote: post #21

Looks like old.reddit.com is now also putting everything behind a login prompt. Archive is unable to fetch the post. Any other way to read this?

It's because the link is wrong (and is interpreted as someone wanted to post something, which obviously needs login) but one comment provides the good one:

https://old.reddit.com/r/LocalLLaMA/comments/1fc98fu/confirm...

Re: Confirmed: Reflection 70B's official API is a wrapper for Sonnet 3.5

#24

Post by [deleted] »

scosman wrote: post #6

Context: someone announced a Llama 3.1 70B fine tune with incredible benchmark results a few days ago. It's been a dramatic ride: - The weight releases were messed up: released Lora for Llama 3.0, claiming it was a 3.1 fine tune - Evals initially didn't meet expectations when run on released weights - The evals starting performing near/at SOTA when using a hosted endpoint - Folks are finding clever ways to see what m…

[deleted]

Re: Confirmed: Reflection 70B's official API is a wrapper for Sonnet 3.5

#25

Post by jazzyjackson »

ga6840 wrote: post #22
scosman wrote: post #6

Context: someone announced a Llama 3.1 70B fine tune with incredible benchmark results a few days ago. It's been a dramatic ride: - The weight releases were messed up: released Lora for Llama 3.0, claiming it was a 3.1 fine tune - Evals initially didn't meet expectations when run on released weights - The evals starting performing near/at SOTA when using a hosted endpoint - Folks are finding clever ways to see what m…

Who is Sahil Chaudhary? Why he doesn't announce such a great advancement himself? Why Matt Shumer first announces it only because -- according to a later claim on X.com -- he trusted Sahil, does that mean Matt is unable to participate most of the progress? Then why announce a breakthrough without mentioning he was not fully involved to a level he can verify the result in the first place?

One more reason not to pay attention to things that only seem to exist on x.com

Re: Confirmed: Reflection 70B's official API is a wrapper for Sonnet 3.5

#26

Post by jazzyjackson »

zozbot234 wrote: post #16

Okay, let's think this through step by step. Isn't 'reflection thinking' a pretty well known technique in the AI prompt field? So this model was supposed to be so much better... why, exactly? It makes very little sense to me. Is it just about separating the "reflections/chain of thoughts" from the "final output" via specific tags?

Supposedly was not just prompted to use reflection, but fine tuned on synthetic data demonstrating how to use the tokens to reason, what self correction looks like etc

Re: Confirmed: Reflection 70B's official API is a wrapper for Sonnet 3.5

#30

Post by elwypea »

esperent wrote: post #29
loop22 wrote: post #5

A much better summary is this Twitter/X thread: https://x.com/RealJosephus/status/1832904398831280448

How does one read this without a Twitter account? I only see one post.

https://xcancel.com/RealJosephus/status/1832904398831280448
Post reply on HN