11–20 of 28 posts
The speed people are just creating wrappers or minor changes and using words like "disruptive", "game-changing", "democratising " just feel so inflated and boring at this point.
I hope this gets very soon into the next phase of the hype cycle[1], so the we can talk about something else. [1] https://en.wikipedia.org/wiki/Gartner_hype_cycle
So what? TGI also supports this.
It's very hard to filter blatant self-promotion and marketing jargon from actual innovation (which goes at a much slower pace) these days. The speed people are just creating wrappers or minor changes and using words like "disruptive", "game-changing", "democratising " just feel so inflated and boring at this point. I hope this gets very soon into the next phase of the hype cycle[1], so the we can talk about something…
[flagged]
[flagged]
I was a bit surprised by this: > For example, suppose you prompt with a sentence "What is the capital of California: ", it would take ten forward pass iterations to get back the full response of ["S", "a", "c", "r", “a”, "m", "e", "n", "t", "o"] From the content I have been reading trying to understand LLMs, I thought that the output was a token and not a string of chars. What am I missing here?
LLMs use a vocabulary of statistically chosen tokens. GPT 3 vocab, for instance, splits Sacramento into three tokens-
Sac - 38318
rament - 15141
o - 78
There is a rule of thumb that about every four letters in English text becomes a token but that's just the average.
California is a single token (25284). As is Canada (17940). And so on.
It's very hard to filter blatant self-promotion and marketing jargon from actual innovation (which goes at a much slower pace) these days. The speed people are just creating wrappers or minor changes and using words like "disruptive", "game-changing", "democratising " just feel so inflated and boring at this point. I hope this gets very soon into the next phase of the hype cycle[1], so the we can talk about something…
To be fair, the overhead of running LLMs at scale -- the cost per interaction -- is the limiting factor for commercial deployments. Efficiency is an enormous advantage.