Live data from Hacker News

How Fast Does Claude, Acting as a User Space IP Stack, Respond to Pings?

dunkels.com

11–20 of 70 posts

Re: How Fast Does Claude, Acting as a User Space IP Stack, Respond to Pings?

#11
post #2

That's why LLM will eventually be used only for initial interaction between the user in their language, to prepare the data to a specialized model. Imagine face recognition to work like a text chat, where the PC gets the frame from the camera and writes in the chat: "Who's that? Here's the RGB888 image in hex: ...".

That's actually how vision language models already work, pretty much.

Re: How Fast Does Claude, Acting as a User Space IP Stack, Respond to Pings?

#12
post #2

That's why LLM will eventually be used only for initial interaction between the user in their language, to prepare the data to a specialized model. Imagine face recognition to work like a text chat, where the PC gets the frame from the camera and writes in the chat: "Who's that? Here's the RGB888 image in hex: ...".

Do you know that MoE is a thing?

Re: How Fast Does Claude, Acting as a User Space IP Stack, Respond to Pings?

#13
post #2

That's why LLM will eventually be used only for initial interaction between the user in their language, to prepare the data to a specialized model. Imagine face recognition to work like a text chat, where the PC gets the frame from the camera and writes in the chat: "Who's that? Here's the RGB888 image in hex: ...".

That's actually how vision language models already work, pretty much.

Huh? The images are tokenized in the same way language is and it’s just fed into one single model. Not multiple smaller expert models.

Image gets rasterized into smaller pieces (eg 4x4 pixels) and each of those is assigned a token, similarly how text is broken up into tokens. And the whole thing is fed into a single model.

Re: How Fast Does Claude, Acting as a User Space IP Stack, Respond to Pings?

#14
post #2

That's why LLM will eventually be used only for initial interaction between the user in their language, to prepare the data to a specialized model. Imagine face recognition to work like a text chat, where the PC gets the frame from the camera and writes in the chat: "Who's that? Here's the RGB888 image in hex: ...".

Do you know that MoE is a thing?

The experts in MoEs aren't specialized in any meaningful task sense. From level of what we would think as tasks MoEs are selected essentially arbitrarily per token and per block.

Re: How Fast Does Claude, Acting as a User Space IP Stack, Respond to Pings?

#16

Earlier quoted context omitted.

Do you know that MoE is a thing?

The experts in MoEs aren't specialized in any meaningful task sense. From level of what we would think as tasks MoEs are selected essentially arbitrarily per token and per block.

It’s unsupervised, yes, but “unspecialized in any meaningful task sense” is incorrect, that’s the whole point. It’s just not in the sense of “this is a legal expert, this is a software developer”.

Re: How Fast Does Claude, Acting as a User Space IP Stack, Respond to Pings?

#17
post #7

Perhaps one day, all network services will be provided by LLMs natively. Truly, that would be a day in the future.

You could read about that in 1992 "A Fire Upon the Deep" by Vernor Vinge. There is prompt injection in communication, in the book certain protocols for information communication can not be deterministic so if someone is too smart you get hacked.

Re: How Fast Does Claude, Acting as a User Space IP Stack, Respond to Pings?

#19

Earlier quoted context omitted.

That's actually how vision language models already work, pretty much.

Huh? The images are tokenized in the same way language is and it’s just fed into one single model. Not multiple smaller expert models. Image gets rasterized into smaller pieces (eg 4x4 pixels) and each of those is assigned a token, similarly how text is broken up into tokens. And the whole thing is fed into a single model.

Yes I'm saying

> Imagine face recognition to work like a text chat, where the PC gets the frame from the camera and writes in the chat: "Who's that? Here's the RGB888 image in hex: ...".

that's p much how it works.

Post reply on HN