Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hy4 preview

tencent.com

Post reply on HN
Print view View original

71–80 of 255 posts

Re: Hy4 preview

#71

Post by ralusek »

Bolwin wrote: post #46
dakolli wrote: post #32

Earlier quoted context omitted.

That's because Deepseek invented the paradigm of prompt caching, they are the SOTA when it comes these techniques. Despite them open sourcing all their research, nobody beats them. edit: I do wish openrouter would let you sort providers by Cache Hit % and Cache cost. These are the only things that matter to me at this point when choosing a provider.

Cache hit % on openrouter is not a good metric, it's mainly driven by openrouter's own provider juggling than the providers themselves

> Cache hit %

I thought you had to actively manage caches, do you not?

Re: Hy4 preview

#72

Post by Zigurd »

jiggawatts wrote: post #55
Zigurd wrote: post #17

Is anyone here working on a problem for which current generation LLMs are inadequate, but that could possibly be solved by the next release of a first tier LLM? Or is it like bicycles? Unless your problem is named Tadej, you don't need a $13,000 bike.

This is the exact same type of comment I heard about computer hardware upgrades for three decades in a row. “Very few people actually require a Pentium workstation, a 486 is perfectly adequate for the majority” The logical fallacy is taking an extant distribution of “product capability” that is priced to fit what the market will bear and assuming the “next upgrade” simply tacks on a little bit more to the right hand…

Intel didn't just surf some natural wave of demand for higher power personal computers. Intel found new needs for powerful PCs, especially in gaming, and they put a lot of marketing and industry relations dollars behind PC gaming.

In other words. PC users didn't figure out that they could buy super powerful PCs and play games on them, that was a carefully managed market transition.

What is going to do the same for LLMs?

Re: Hy4 preview

#73

Post by RobotCaleb »

spacebanana7 wrote: post #27
Zigurd wrote: post #17

Is anyone here working on a problem for which current generation LLMs are inadequate, but that could possibly be solved by the next release of a first tier LLM? Or is it like bicycles? Unless your problem is named Tadej, you don't need a $13,000 bike.

I want to be able to generate my own Simlilirian movie by dumping the content of a book into an LLM. Both animated and live action results would be acceptable. Unfortunately most existing LLMs lack the capability to maintain context across tens of thousands of frames.

How would a computer generated video be live action?

Re: Hy4 preview

#74

Post by redox99 »

minimaxir wrote: post #2

Hy4 apparently has ludicrous traction on OpenRouter already ( https://openrouter.ai/tencent/hy4-preview ), with trillions of tokens processed in a couple days: more than GLM 5.3 in a week. That said, it's relatively cheap with a 5% cache cost when everyone is still doing 10%/20% cache costs, so Hy4 may be more compelling.

It's very likely tencent games those stats, buying their own tokens.

Re: Hy4 preview

#75

Post by jonplackett »

kakadu wrote: post #48
simonw wrote: post #44

> [...] Let's maybe add a helmet? It could improve riding theme, but may obscure head. Maybe a small cycling cap or helmet? The user didn't ask; can add red helmet? Might be cute. But pelican with big beak; a helmet might obscure. Better maybe no. > Maybe add sunglasses? no. > Maybe add water? no. https://tools.simonwillison.net/markdown-svg-renderer#url=ht...

[flagged]

If I had to choose between more or less pelicans, I’d prefer more pelicans.

Re: Hy4 preview

#76

Post by aforwardslash »

Demiurge wrote: post #39
spacebanana7 wrote: post #27

Earlier quoted context omitted.

I want to be able to generate my own Simlilirian movie by dumping the content of a book into an LLM. Both animated and live action results would be acceptable. Unfortunately most existing LLMs lack the capability to maintain context across tens of thousands of frames.

That sounds like an interesting challenge. Have you seriously considered solving it? Because in about 10 seconds I came up with a process that should work, provided enough compute power. Simply model the traditional film making process by starting with a script, character stories. Design your world, then design the storyboard, and all the scenes. Create a list of all the visual elements that need to be replicated bet…

On that topic, check higgsfield cinema studio 4; they already provide amazing tech for the cinematic experience, somewhat similar to what you are describing.

Re: Hy4 preview

#77

Post by LtWorf »

mirekrusin wrote: post #37
petcat wrote: post #24

> Tencent has released and open-sourced Tencent Hy4 preview, a next-generation large language model with 770B total parameters and 49B active parameters, and a context window exceeding 1M tokens. There are no open source models, at least not useful ones (yet) [0]. Open weight is not the same as open source. The current "open weight" models are just opaque binary blobs you can run on your own computer instead of throu…

You can open source dataset without all the details how it was assembled. Models are lossy compressed datasets you can pick up and amend (fine tune / continue training / alter) according to license they were released under. Hy4 is released under OSI approved Apache License 2.0.

So windows is open source because the binaries are a lossy compression of the original source?

Re: Hy4 preview

#78

Post by hgoel »

Zigurd wrote: post #17

Is anyone here working on a problem for which current generation LLMs are inadequate, but that could possibly be solved by the next release of a first tier LLM? Or is it like bicycles? Unless your problem is named Tadej, you don't need a $13,000 bike.

Scientific physics simulations - even the frontier models just engage in rationalization of obviously unphysical results instead of understanding the system. They have the rote knowledge but fail to apply it unless their hand is held through the process.

Re: Hy4 preview

#80

Post by ekianjo »

kurante wrote: post #59
simonw wrote: post #44

> [...] Let's maybe add a helmet? It could improve riding theme, but may obscure head. Maybe a small cycling cap or helmet? The user didn't ask; can add red helmet? Might be cute. But pelican with big beak; a helmet might obscure. Better maybe no. > Maybe add sunglasses? no. > Maybe add water? no. https://tools.simonwillison.net/markdown-svg-renderer#url=ht...

Is the broken English an optimization or a byproduct of the model being developed in China?

Saving tokens
Post reply on HN