Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hy4 preview

tencent.com

Post reply on HN
Print view View original

31–40 of 252 posts

Re: Hy4 preview

#31

Post by ezst »

Zigurd wrote: post #17

Is anyone here working on a problem for which current generation LLMs are inadequate, but that could possibly be solved by the next release of a first tier LLM? Or is it like bicycles? Unless your problem is named Tadej, you don't need a $13,000 bike.

I saw a laptop earlier in the train that I asked ChatGPT, Claude and Gemini what it was, providing a brand, screen size and ports description. Gemini could never figure it out, Claude and ChatGPT eventually did, after multiple rounds of indirection, giving completely wrong answers (there was a perfect match for the problem statement, they all explored alternatives first). LLMs are (probably) amazing at things I don't care about, and still suck at the mundane stuff you would have the marketing tell you they excel at.

Re: Hy4 preview

#32

Post by dakolli »

martinald wrote: post #7
minimaxir wrote: post #2

Hy4 apparently has ludicrous traction on OpenRouter already ( https://openrouter.ai/tencent/hy4-preview ), with trillions of tokens processed in a couple days: more than GLM 5.3 in a week. That said, it's relatively cheap with a 5% cache cost when everyone is still doing 10%/20% cache costs, so Hy4 may be more compelling.

I wrote about this a couple of weeks ago. It's actually often the biggest cost and it tends to be hidden away on most platforms! https://martinalderson.com/posts/watch-out-for-cache-read-co... Btw I still haven't came across any decent model that is Seems like a bit of an opportunity for someone to take - drop cache read costs significantly.

That's because Deepseek invented the paradigm of prompt caching, they are the SOTA when it comes these techniques. Despite them open sourcing all their research, nobody beats them.

edit: I do wish openrouter would let you sort providers by Cache Hit % and Cache cost. These are the only things that matter to me at this point when choosing a provider.

Re: Hy4 preview

#33

Post by lopatin »

Zigurd wrote: post #17

Is anyone here working on a problem for which current generation LLMs are inadequate, but that could possibly be solved by the next release of a first tier LLM? Or is it like bicycles? Unless your problem is named Tadej, you don't need a $13,000 bike.

I asked a current generation LLM to make me $1k a week and it hasn't so far.

Re: Hy4 preview

#34

Post by pixelesque »

usernomdeguerre wrote: post #10

is it just me or are the bar charts in the blog post strange? Higher numbers don't seem to correspond correctly to their actual height?

Looks okay to me.

The first column has both the Hy4 and Hy3 scores overlaid on one another (Hy4 is darker blue and the taller one), with both scores written below the top of the respective bar - maybe you're seeing that?

Re: Hy4 preview

#35

Post by mirekrusin »

fastball wrote: post #21

I wish model providers would stop committing chart crimes in their releases. - if you're gonna order the rest of the bar chart by rank, order your model accordingly. - if you're gonna highlight a winner in a table of benchmarks, don't highlight your entire model row in the table. Etc etc

Read websites through llm.

Re: Hy4 preview

#36

Post by noir_lord »

realo wrote: post #16
tokai wrote: post #11

Earlier quoted context omitted.

>dont do Capitalism like the rest of the AI field Like lobbying the US president to harm their competitors?

I would suggest "lobbying" is not the correct word to describe all the corruption going on in the current USA administration cesspool.

lobbying/legalised bribery hard to say where one ends and another begins at times.

Re: Hy4 preview

#37

Post by mirekrusin »

petcat wrote: post #24

> Tencent has released and open-sourced Tencent Hy4 preview, a next-generation large language model with 770B total parameters and 49B active parameters, and a context window exceeding 1M tokens. There are no open source models, at least not useful ones (yet) [0]. Open weight is not the same as open source. The current "open weight" models are just opaque binary blobs you can run on your own computer instead of throu…

You can open source dataset without all the details how it was assembled.

Models are lossy compressed datasets you can pick up and amend (fine tune / continue training / alter) according to license they were released under.

Hy4 is released under OSI approved Apache License 2.0.

Re: Hy4 preview

#38

Post by tekacs »

Zigurd wrote: post #17

Is anyone here working on a problem for which current generation LLMs are inadequate, but that could possibly be solved by the next release of a first tier LLM? Or is it like bicycles? Unless your problem is named Tadej, you don't need a $13,000 bike.

Yes, lots – I think that folks will hopefully discover more of these as they scale up their ambition, now that LLMs make a lot of previously difficult things far easier.

Re: Hy4 preview

#39

Post by Demiurge »

spacebanana7 wrote: post #27
Zigurd wrote: post #17

Is anyone here working on a problem for which current generation LLMs are inadequate, but that could possibly be solved by the next release of a first tier LLM? Or is it like bicycles? Unless your problem is named Tadej, you don't need a $13,000 bike.

I want to be able to generate my own Simlilirian movie by dumping the content of a book into an LLM. Both animated and live action results would be acceptable. Unfortunately most existing LLMs lack the capability to maintain context across tens of thousands of frames.

That sounds like an interesting challenge. Have you seriously considered solving it? Because in about 10 seconds I came up with a process that should work, provided enough compute power. Simply model the traditional film making process by starting with a script, character stories. Design your world, then design the storyboard, and all the scenes. Create a list of all the visual elements that need to be replicated between all the scenes. Then you have to built prompts and reference art of the objects, faces, people. Make sure to do multiple takes of each scene, and have the vLLM critique and analyze the performances and technicalities. Should work?

I think, also, like in the traditional film makers career, this process should be built iteratively, start with a fast food commercial, then do a music video, then you can probably do a short film. Continue to improve the process, and one day I’m sure the LLM film studio can make you any movie you want, provided you have enough tokens.

Re: Hy4 preview

#40

Post by minimaxir »

dakolli wrote: post #32
martinald wrote: post #7

Earlier quoted context omitted.

I wrote about this a couple of weeks ago. It's actually often the biggest cost and it tends to be hidden away on most platforms! https://martinalderson.com/posts/watch-out-for-cache-read-co... Btw I still haven't came across any decent model that is Seems like a bit of an opportunity for someone to take - drop cache read costs significantly.

That's because Deepseek invented the paradigm of prompt caching, they are the SOTA when it comes these techniques. Despite them open sourcing all their research, nobody beats them. edit: I do wish openrouter would let you sort providers by Cache Hit % and Cache cost. These are the only things that matter to me at this point when choosing a provider.

You can click the table headers to sort Ascending/Descending.
Post reply on HN