Live data from Hacker News

The Token Compression Illusion: Why I'm Skeptical of RTK

mroczek.dev

11–20 of 121 posts

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#11

I feel like what is needed is not compression, but aggressive context management with subagents.

I am the author the text. What do you mean by aggresive context management with subagents? Would you add a lopp that would trim the context? Both of those tasks seem even more difficult

I believe they mean aggressive delegation to minimize context bloat in the coordinating agent.

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#12

Earlier quoted context omitted.

I am the author the text. What do you mean by aggresive context management with subagents? Would you add a lopp that would trim the context? Both of those tasks seem even more difficult

I believe they mean aggressive delegation to minimize context bloat in the coordinating agent.

that would make more sense, trimming context with subagents sounds like an overkill

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#13

I feel like what is needed is not compression, but aggressive context management with subagents.

Use the right tool for the job.

If you need a piece of information that is buried somewhere, or a high-level summary/distillation of a larger body of info, then subagents may be the right tool for the job.

If you need all the gathered context for later use (i.e. distilled context is insufficient), then subagents probably are not the right tool for the job.

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#14
post #10
post #8

Am I the only one that thought RTK was Real-Time Kinematics used for precision with satellite navigation?

No. I clicked here for the same reason.

I might have picked better title, but they are literally called rtk https://github.com/rtk-ai/rtk

and it stands for Rust Token Killer

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#15
I've been trying out RTK and it seems kinda alright. I doubt it's saving much, but the quality of the work feels similar.

But if it's making a dent in token usage (which I have not personally measured), then that's great.

I had to add some system prompt instructions to Pi to help it work (GPT 5.5 initially got confused when `git status` looked different than expected). The Claude Code extension appears to do a proper job of informing the agent about the unexpected shape of the output without any extra work on my part.

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#16
I feel like the state of the art is baked into the compaction logic, and I've had a lot of problems with compaction (absent other prompting) losing key bits of state.

https://github.com/toon-format/toon is another interesting one, and I feel like it takes on a much more achievable goal - reduce whitespace and verbosity of JSON, not overall context compression.

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#17
> 1. Gamified Savings vs. Your Actual API Bill

Tool use output represents a large amount of my output. I'll take 3.7M tokens saved on 3.9M tokens of input. Tokens saved are tokens saved.

> 3. Where Are the Accuracy Benchmarks?

As a user of RTK, it would be nice to see accuracy benchmarks. However, I've seen no evidence of the model missing anything critical as a result of the compression. As part of their design philosophy they are very strict about preserving correctness to the point that if a filter fails they fall back to raw output. For my most frequently used commands I've inspected the source, was happy with what I saw, they've earned my trust thus far.

> The day git, cargo, npm, or grep updates its terminal formatting by a few spaces or changes an error layout, RTK's regex and parsing filters will break. And returning to the silent failure trap, it won't throw an explicit error; it will fail quietly, feeding corrupted or partial text to your agent.

Again, any filter that fails simply falls back to the raw output. One of their core pillars is avoiding this exact scenario you described. RTK should never feed corrupted or partial text to an agent.

Your concerns are fair but I'd like to see your criticism backed up with evidence. Have you used RTK? Have you found evidence that they are failing to preserve correctness?

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#18

I feel like what is needed is not compression, but aggressive context management with subagents.

Use the right tool for the job. If you need a piece of information that is buried somewhere, or a high-level summary/distillation of a larger body of info, then subagents may be the right tool for the job. If you need all the gathered context for later use (i.e. distilled context is insufficient), then subagents probably are not the right tool for the job.

if your corebase requires a million tokens, then youre probably going to break more than you fix

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#19

I've been trying out RTK and it seems kinda alright. I doubt it's saving much, but the quality of the work feels similar. But if it's making a dent in token usage (which I have not personally measured), then that's great. I had to add some system prompt instructions to Pi to help it work (GPT 5.5 initially got confused when `git status` looked different than expected). The Claude Code extension appears to do a proper…

so how do you justify it's usage if it's not saving much and the work feels similiar. They have 664 issues open and some of them are quite funny, the tools are called and return success even though they aren't even installed.

My take is that handling so many versions and so many different tools shouldn't be the work of any single repo. The responsibility should be either on coding agent to compress or best case scenario people who are responsible for cli tool

Re: The Token Compression Illusion: Why I'm Skeptical of RTK

#20

I feel like the state of the art is baked into the compaction logic, and I've had a lot of problems with compaction (absent other prompting) losing key bits of state. https://github.com/toon-format/toon is another interesting one, and I feel like it takes on a much more achievable goal - reduce whitespace and verbosity of JSON, not overall context compression.

Personally, I find compaction to be unreliable, which forces me to rely heavily on session-specific planning documents and inter-agent handoff messages.
Post reply on HN