Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hy4 preview

tencent.com

Post reply on HN
Print view View original

41–50 of 252 posts

Re: Hy4 preview

#41

Post by kennywinker »

dakolli wrote: post #30
Zigurd wrote: post #17

Is anyone here working on a problem for which current generation LLMs are inadequate, but that could possibly be solved by the next release of a first tier LLM? Or is it like bicycles? Unless your problem is named Tadej, you don't need a $13,000 bike.

I get buy with very cheap models and actually using my brain, you don't need these SOTA models. China will definitely win this AI 'war'

If the models stay open, it seems like everybody but anthropic/openai wins. i literally can’t see a downside. We can post-train the models to know about tienanmen square.

Re: Hy4 preview

#42

Post by andybak »

Demiurge wrote: post #39
spacebanana7 wrote: post #27

Earlier quoted context omitted.

I want to be able to generate my own Simlilirian movie by dumping the content of a book into an LLM. Both animated and live action results would be acceptable. Unfortunately most existing LLMs lack the capability to maintain context across tens of thousands of frames.

That sounds like an interesting challenge. Have you seriously considered solving it? Because in about 10 seconds I came up with a process that should work, provided enough compute power. Simply model the traditional film making process by starting with a script, character stories. Design your world, then design the storyboard, and all the scenes. Create a list of all the visual elements that need to be replicated bet…

I'm getting a Poe's Law feeling. I'm genuinely unsure about whether this post is a stone cold parody or not. I think I need to turn off the internet and go to bed.

EDIT: Your username doesn't help, either.

Re: Hy4 preview

#43

Post by nozzlegear »

tokai wrote: post #19
Zigurd wrote: post #17

Is anyone here working on a problem for which current generation LLMs are inadequate, but that could possibly be solved by the next release of a first tier LLM? Or is it like bicycles? Unless your problem is named Tadej, you don't need a $13,000 bike.

A spanish rock solved that problem for free.

¿Como?

Re: Hy4 preview

#44

Post by simonw »

> [...] Let's maybe add a helmet? It could improve riding theme, but may obscure head. Maybe a small cycling cap or helmet? The user didn't ask; can add red helmet? Might be cute. But pelican with big beak; a helmet might obscure. Better maybe no.

> Maybe add sunglasses? no.

> Maybe add water? no.

https://tools.simonwillison.net/markdown-svg-renderer#url=ht...

Re: Hy4 preview

#45

Post by kennywinker »

mirekrusin wrote: post #37
petcat wrote: post #24

> Tencent has released and open-sourced Tencent Hy4 preview, a next-generation large language model with 770B total parameters and 49B active parameters, and a context window exceeding 1M tokens. There are no open source models, at least not useful ones (yet) [0]. Open weight is not the same as open source. The current "open weight" models are just opaque binary blobs you can run on your own computer instead of throu…

You can open source dataset without all the details how it was assembled. Models are lossy compressed datasets you can pick up and amend (fine tune / continue training / alter) according to license they were released under. Hy4 is released under OSI approved Apache License 2.0.

Parent poster is technically right - open “source” implies the source used to make something is open. The model source is training data and code, not just weights.

But the reality is, the weights are a useful artifact that you can use to create derivative works. So, dismissing it as a photoshop binary is as technically wrong as calling it open source.

Re: Hy4 preview

#46

Post by Bolwin »

dakolli wrote: post #32
martinald wrote: post #7

Earlier quoted context omitted.

I wrote about this a couple of weeks ago. It's actually often the biggest cost and it tends to be hidden away on most platforms! https://martinalderson.com/posts/watch-out-for-cache-read-co... Btw I still haven't came across any decent model that is Seems like a bit of an opportunity for someone to take - drop cache read costs significantly.

That's because Deepseek invented the paradigm of prompt caching, they are the SOTA when it comes these techniques. Despite them open sourcing all their research, nobody beats them. edit: I do wish openrouter would let you sort providers by Cache Hit % and Cache cost. These are the only things that matter to me at this point when choosing a provider.

Cache hit % on openrouter is not a good metric, it's mainly driven by openrouter's own provider juggling than the providers themselves

Re: Hy4 preview

#47

Post by dakolli »

minimaxir wrote: post #40
dakolli wrote: post #32

Earlier quoted context omitted.

That's because Deepseek invented the paradigm of prompt caching, they are the SOTA when it comes these techniques. Despite them open sourcing all their research, nobody beats them. edit: I do wish openrouter would let you sort providers by Cache Hit % and Cache cost. These are the only things that matter to me at this point when choosing a provider.

You can click the table headers to sort Ascending/Descending.

You can sort by the cost cache cose, but you cannot by cache hit %. You have to click on the provider and see what their cache hit % is. A provider could have a super low cache cost, but a 50% cache hit percentage, making the cheap price of cache read's meaningless.

Re: Hy4 preview

#48

Post by kakadu »

simonw wrote: post #44

> [...] Let's maybe add a helmet? It could improve riding theme, but may obscure head. Maybe a small cycling cap or helmet? The user didn't ask; can add red helmet? Might be cute. But pelican with big beak; a helmet might obscure. Better maybe no. > Maybe add sunglasses? no. > Maybe add water? no. https://tools.simonwillison.net/markdown-svg-renderer#url=ht...

[flagged]

Re: Hy4 preview

#50

Post by phyrex »

kakadu wrote: post #48
simonw wrote: post #44

> [...] Let's maybe add a helmet? It could improve riding theme, but may obscure head. Maybe a small cycling cap or helmet? The user didn't ask; can add red helmet? Might be cute. But pelican with big beak; a helmet might obscure. Better maybe no. > Maybe add sunglasses? no. > Maybe add water? no. https://tools.simonwillison.net/markdown-svg-renderer#url=ht...

[flagged]

Nah, keep it up. I just come to the reviews for the pelican!
Post reply on HN