Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The Token Compression Illusion: Why I'm Skeptical of RTK

mroczek.dev

Post reply on HN
Print view View original

1–10 of 121 posts

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#4

Post by lackoftactics »

SubiculumCode wrote: post #3

I feel like what is needed is not compression, but aggressive context management with subagents.

I am the author the text.

What do you mean by aggresive context management with subagents? Would you add a lopp that would trim the context?

Both of those tasks seem even more difficult

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#5

Post by lackoftactics »

breadislove wrote: post #2

slop complaining about other slop

thank you, author here. I will stay civil here and focus on the rtk as that was the goal of article.

So do you think rtk cli is ai slop? I had some suspicions looking at their repo and number of issues and their style. The prettier issue with running successfully while binary wasn't even installed was quite entertaining

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#6

Post by minraws »

SubiculumCode wrote: post #3

I feel like what is needed is not compression, but aggressive context management with subagents.

so burn more tokens to save more tokens, so that we can spend more on X token but save on Y tokens?

not the question is which X tokens and which Y tokens? and since the output is non-deterministic how do you validate this?

LLMs aren't random and that enforces something that people are too dumb to realize that random-ness could be normally distributed but LLMs have no reason to be normally distributed or follow any sort of curve of understanding.

They are non-deterministic but with bias so their output might be just be worse with T' transformation for the class of problems A is solving but work great for B. or vice versa.

You can't reproducibly test LLMs and that allows all sorts of benchmarks to exist which can make any model look good or bad as much as we want. Enlightening stuff.

Not much different from sociological or psychological sciences where with enough bias in data you can prove anything.

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#7

Post by grey-area »

lackoftactics wrote: post #5
breadislove wrote: post #2

slop complaining about other slop

thank you, author here. I will stay civil here and focus on the rtk as that was the goal of article. So do you think rtk cli is ai slop? I had some suspicions looking at their repo and number of issues and their style. The prettier issue with running successfully while binary wasn't even installed was quite entertaining

Did you use an LLM for the blog post? it reads like it in places.

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#9

Post by lackoftactics »

grey-area wrote: post #7
lackoftactics wrote: post #5

Earlier quoted context omitted.

thank you, author here. I will stay civil here and focus on the rtk as that was the goal of article. So do you think rtk cli is ai slop? I had some suspicions looking at their repo and number of issues and their style. The prettier issue with running successfully while binary wasn't even installed was quite entertaining

Did you use an LLM for the blog post? it reads like it in places.

I have raycast shortcut for fix grammar, it might done more damage than adding a, an, the or changing tenses.
Post reply on HN