Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open-R1: an open reproduction of DeepSeek-R1

huggingface.co

Post reply on HN
Print view View original

191–200 of 246 posts

Re: Open-R1: an open reproduction of DeepSeek-R1

#191

Post by ChrisMarshallNY »

icetank wrote: post #118
catmanjan wrote: post #81

Earlier quoted context omitted.

>far more impact and reach. Absurd, AI has had zero impact in the everyday life of most of the population of Earth, in fact the biggest impact has been upon the wallets of speculators

I can tell you from personal experience that chatgpt is a game changer in universities and schools. Close to 100% of students use chatgpt to study. I know in our university pretty much everyone that attends exams uses chatgpt to study. Chatgpt is arguably more valuable then Wikipedia and Google for studies.

There was a posting, some time ago, about someone complaining that their young, primary-school-age sister was using ChatGPT to an absurd degree. I'm not sure that's a bad thing. She'll probably be one of the Thought Leaders, of Generation AI.

I think that ML will have a really big impact on almost everyone, in every developed (and maybe developing, as well) nation.

We need to keep in mind that ML is still very much in its infancy. We haven't even seen the specialized models that will probably revolutionize almost every knowledge-based vocation. What we've seen so far, has been relatively primitive all-purpose "generate buzz" models.

Also, don't expect the US (and many other nations) to take this lying down. Competition can be a good thing. Someone referred to this as the "Sputnik Moment" for AI.

It's going to be exciting, and probably rather scary. Keep your hands inside the vehicle at all times, and don't feed the lions.

Re: Open-R1: an open reproduction of DeepSeek-R1

#192

Post by diggan »

dgfitz wrote: post #189
diggan wrote: post #176

Earlier quoted context omitted.

> But ChatGPT is just a glorified Wikipedia/Google It really isn't, unless something really majorly changed recently. Neither of those you can query for something you don't know about. Lets say you want to find the meaning of a joke related to cars, Spain, politicians and a fascist, how you'd use Wikipedia and Google to find the specific joke I'm thinking about? ChatGPT been really helpful (to me at least) to find ne…

https://letmegooglethat.com/?q=+find+the+meaning+of+a+joke+r... Second result. The first is this post.

Wow, the 90s came back to visit us at HN :) So funni.

Did quick scroll through the results, none of them seem to find the correct joke (none of the links even include "Spain" for me). Try again :)

For the record, this is what I see: https://i.imgur.com/XdsBGfM.png (no links to HN?)

Re: Open-R1: an open reproduction of DeepSeek-R1

#193

Post by DeflectedFlux »

alchemist1e9 wrote: post #171
DeflectedFlux wrote: post #150

About the training data, cant the datasets from the Tulu3 Model by the Allen Institute be used? They claim that they have used a fully open source training dataset.

My gut says a lot of attention needs to be given to building a community that focuses on open and reliable access to clean training data. If a collective/coop of individuals and organizations with storage and network capacity could collaborate with each other to archive and index deduplicated training data that would be huge. Perhaps this is already happening. I was looking at Red Pajama last year as an example. Some…

Thats an awesome idea, didnt know Red Pajama yet.

Re: Open-R1: an open reproduction of DeepSeek-R1

#194

Post by voidUpdate »

diggan wrote: post #190
voidUpdate wrote: post #188

Earlier quoted context omitted.

Every time I ask chatgpt, I get a different answer. Copilot refused to answer me. Not sure LLMs are the answer you're looking for here

I just tried it myself with ChatGPT o1 and with Claude's Sonnet 3.5, Sonnet got it after two messages, o1 after 4. If you're unable to reproduce, maybe tune the prompt a bit? I'm not sure what to tell you, all I can tell you that I'm able to figure out stuff a lot faster today than I was 2-3 years ago, thanks to LLMs. Additional hints that might help; the joke involves a car and possibly a space program.

I ran it 10 times with the extra information, and each time got a different result. I don't know if any of them were the specific joke you were after, I get the feeling it was just making them up on the spot. None of them are even funny

Re: Open-R1: an open reproduction of DeepSeek-R1

#195

Post by sunshine-o »

pitched wrote: post #115
sunshine-o wrote: post #111

Now that things are really getting wild in the LLM space and people are just running anything that come it seems I did a quick search on the thead model of hosting you own LLM. I didn't find much, starting with llama.ccp which is just reminding you to sandbox and isolate everything if running untrusted models. I feel we are back in the Windows 95 / early Internet era when people would just run anything without caring…

You’ll want to use something trusted like Ollama to run the model. The model itself is just data though, like a video file. That doesn’t mean it can’t be crafted to use a bug in Ollama to launch an exploit but it’s a lot safer than you make it sound.

Ok, but I am really curious about this and maybe my mental model is wrong:

- llama.cpp or ollama can be seen as runtime systems,

- there is no security model regarding the execution documented in both of those projects,

- of course the models are just data but so are most things that have been used as an attack vector on computers. For example your web browser or image viewer have a lot of countermeasures to protect the system from malicious image files.

I am surprised that security of operating systems, programming languages, VMs or web browsers have been a focus point forever but nobody seems to really care about security when executing those LLMs.

Re: Open-R1: an open reproduction of DeepSeek-R1

#196

Post by boroboro4 »

anshumankmr wrote: post #179
bottled_poe wrote: post #117

Earlier quoted context omitted.

It will be very interesting to see if they can reproduce a similar model on the shoestring budget claimed by Deepseek.

but deepseek hasn't claimed the figure touted by everyone for this particular R1 model, cause that 5.6mn was apparently for Deepseek's coder model

5.6mn figure is for base Deepseek V3 model. Both instruction and reasoning tuning of it has neglectable cost in comparison with it.

Re: Open-R1: an open reproduction of DeepSeek-R1

#197

Post by [deleted] »

danielbln wrote: post #148
liendolucas wrote: post #143

Earlier quoted context omitted.

Yeah, and when I was in high school everyone used to refer to Encarta. > I know in our university pretty much everyone that attends exams uses chatgpt to study. And they shouldn't be doing that. They are wrong. Students should be reading suggested bibliography and spending long hours with an open book in a table instead of being lazy and abuse a tech that is yet in its infancy when learning concepts. Studying with a…

You sound like our teachers back in the day, warning us to not use Wikipedia because "everyone can write stuff there!!". The kids will be fine.

[deleted]

Re: Open-R1: an open reproduction of DeepSeek-R1

#199

Post by diggan »

voidUpdate wrote: post #194
diggan wrote: post #190

Earlier quoted context omitted.

I just tried it myself with ChatGPT o1 and with Claude's Sonnet 3.5, Sonnet got it after two messages, o1 after 4. If you're unable to reproduce, maybe tune the prompt a bit? I'm not sure what to tell you, all I can tell you that I'm able to figure out stuff a lot faster today than I was 2-3 years ago, thanks to LLMs. Additional hints that might help; the joke involves a car and possibly a space program.

I ran it 10 times with the extra information, and each time got a different result. I don't know if any of them were the specific joke you were after, I get the feeling it was just making them up on the spot. None of them are even funny

Here is an example of Sonnet finding the right joke after two messages: https://i.imgur.com/nKvS2cW.png

It seems to be censored with US puritan morality (like most US models), but I think that's besides the point (just like if the joke is "even funny" or not), as it did find the correct joke at least.

Re: Open-R1: an open reproduction of DeepSeek-R1

#200

Post by fedeb95 »

sunshine-o wrote: post #111

Now that things are really getting wild in the LLM space and people are just running anything that come it seems I did a quick search on the thead model of hosting you own LLM. I didn't find much, starting with llama.ccp which is just reminding you to sandbox and isolate everything if running untrusted models. I feel we are back in the Windows 95 / early Internet era when people would just run anything without caring…

that is correct, until someone using it into production gets burnt.
Post reply on HN