Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Tongyi DeepResearch – open-source 30B MoE Model that rivals OpenAI DeepResearch

tongyi-agent.github.io

Post reply on HN
Print view View original

101–110 of 156 posts

Re: Tongyi DeepResearch – open-source 30B MoE Model that rivals OpenAI DeepResearch

#101

Post by Imustaskforhelp »

sumo43 wrote: post #36

I made a 4B Qwen3 distill of this model (and a synthetic dataset created with it) a while back. Both can be found here: https://huggingface.co/flashresearch

Can you please create a huggingface space or something similar, I am not sure about the state of huggingface but I would love to be able to try it out in a browser or something similar if possible as I am really curious and I just love qwen3 4b as they were one of the models which work even on my intel integrated gpu graphics card at a really impressive rate and they were really nice the last time I tried but this looks even more cooler/practical.

I had once an idea of using something like qwen4 or some pre-trained AI model just to do a (to censor or not to) idea after the incidents of mecha-hitler. I thought if there was some extremely cheap model which could detect that it is harmful that the AI models of Grok itself couldn't recognize, it would've been able to prevent the absolute advertising/ complete disaster that happened.

What are your thoughts on it? I would love to see an Qwen 4B of something similar if possible if you or anyone is up to the challenge or any small LLM's in generals. I just want to know if this idea fundamentally made sense or not.

Another idea was to use it for routing purposes similar to what chatgpt does but I am not sure about that now really but I still think that it maybe worth it but this routing idea I had was before chatgpt had implemented it, so now after it implemented, we are gonna find some more data/insights about if its good or not/ worth it, so that's nice.

Re: Tongyi DeepResearch – open-source 30B MoE Model that rivals OpenAI DeepResearch

#102

Post by seanmcdirmid »

ninetyninenine wrote: post #50

Is China dominating the US in terms of AI? Given that they currently have a model that beats the best models at all formal quantitative benchmarks? What is the state of AI in China? My personal feeling is that it doesn't dominate the zeitgeist in China as it does in the US and despite this because of the massive amount of intellectual capital they have just a small portion of their software engineering talent working…

America continues to dominate in amount of money spent on AI resources but China has more value in the human and hardware resources it brings to bare.

China is also more willing to deploy AI apps that Americans would hesitate on, although I'm not sure I've seen much of it so far outside of Shenzhen cyberpunk clips. Let's see how this plays out in a decade.

Re: Tongyi DeepResearch – open-source 30B MoE Model that rivals OpenAI DeepResearch

#104

Post by oofbey »

VladVladikoff wrote: post #96

Recently I gave a list of 300 links to deep research and asked it to go through each one to analyze a certain question about them. Repeatedly it would take shortcuts and not actually do the full list. Is this caused by a context window limits? Or maybe Open AI limits request size? Is it possible to not run into these types of limits with locally hosted models?

I’ve also had extremely poor luck getting any LLM agent to go through a long list of repetitive tasks. Don’t know why. I’d guess it’s because they’re trained for transactional responses, and thus are horrible at repute anything.

Re: Tongyi DeepResearch – open-source 30B MoE Model that rivals OpenAI DeepResearch

#105

Post by sigmarule »

aliljet wrote: post #5

Sunday morning, and I find myself wondering how the engineering tinkerer is supposed to best self-host these models? I'd love to load this up on the old 2080ti with 128gb of vram and play, even slowly. I'm curious what the current recommendation on that path looks like. Constraints are the fun part here. I know this isn't the 8x Blackwell Lamborghini, that's the point. :)

The Framework Desktop runs this perfectly well, and for just about $2k.

Re: Tongyi DeepResearch – open-source 30B MoE Model that rivals OpenAI DeepResearch

#106

Post by TACIXAT »

tbruckner wrote: post #34

Has anyone found these deep research tools useful? In my experience, they generate really bland reports don't go much further than summarization of what a search engine would return.

I have used Gemini's 2.5 Pro deep research probably about 10 times. I love it. Most recently was reviewing PhD programs in my area then deep diving into faculty research areas.

Re: Tongyi DeepResearch – open-source 30B MoE Model that rivals OpenAI DeepResearch

#107

Post by cindyllm »

Imustaskforhelp wrote: post #99
zurfer wrote: post #8

It makes me wonder if we'll see an explosion of purpose trained LLMs because we hit diminishing returns on invest with pre training or if it takes a couple of months to fold these advantages back into the frontier models. Given the size of frontier models I would assume that they can incorporate many specializations and the most lasting thing here is the training environment. But there is probably already some tradeo…

> But there is probably already some tradeoff, as GPT 3.5 was awesome at chess and current models don't seem trained extensively on chess anymore. Wow, I am so curious, can you provide me the source I am so interested in a chess LLM's benchmark as someone who occasionally plays chess. I have thought about creating things like these but it would be very interesting to find the best model at chess which isn't stockfish…

[dead]

Re: Tongyi DeepResearch – open-source 30B MoE Model that rivals OpenAI DeepResearch

#108

Post by barrell »

criemen wrote: post #80
zurfer wrote: post #8

It makes me wonder if we'll see an explosion of purpose trained LLMs because we hit diminishing returns on invest with pre training or if it takes a couple of months to fold these advantages back into the frontier models. Given the size of frontier models I would assume that they can incorporate many specializations and the most lasting thing here is the training environment. But there is probably already some tradeo…

> or if it takes a couple of months to fold these advantages back into the frontier models. Right now, I believe we're seeing that the big general-purpose models outperform approximately everything else. Special-purpose models (essentially: fine tunes) of smaller models make sense when you want to solve a specific task at lower cost/lower latency, and you transfer some/most of the abilities in that domain from a bigg…

> If/when frontier model development speed slows down

You do not believe that this has already started? It seems to me that we’re well into a massive slowdown

Re: Tongyi DeepResearch – open-source 30B MoE Model that rivals OpenAI DeepResearch

#110

Post by bigyabai »

Imustaskforhelp wrote: post #101
sumo43 wrote: post #36

I made a 4B Qwen3 distill of this model (and a synthetic dataset created with it) a while back. Both can be found here: https://huggingface.co/flashresearch

Can you please create a huggingface space or something similar, I am not sure about the state of huggingface but I would love to be able to try it out in a browser or something similar if possible as I am really curious and I just love qwen3 4b as they were one of the models which work even on my intel integrated gpu graphics card at a really impressive rate and they were really nice the last time I tried but this lo…

> What are your thoughts on it?

You don't really need an entire LLM to do this - lightweight encoder models like BERT are great at sentiment analysis. You feed it an arbitrary string of text, and it just returns a confidence value from 0.0 to 1.0 that it matches the characteristics you're looking for.

Post reply on HN