Live data from Hacker News

Show HN: A MitM proxy to see what your LLM tools are sending

github.com

31–40 of 128 posts

Re: Show HN: A MitM proxy to see what your LLM tools are sending

#31
As someone who just set up mitmproxy to do something very similar, I wish this would've been a plugin/add-on instead of a standalone thing.

I know and trust mitmproxy. I'm warier and less likely to use a new, unknown tool that has such broad security/privacy implications. Especially these days with so many vibe-coded projects being released (no idea if that's the case here, but it's a concern I have nonetheless).

Re: Show HN: A MitM proxy to see what your LLM tools are sending

#32

As someone who just set up mitmproxy to do something very similar, I wish this would've been a plugin/add-on instead of a standalone thing. I know and trust mitmproxy. I'm warier and less likely to use a new, unknown tool that has such broad security/privacy implications. Especially these days with so many vibe-coded projects being released (no idea if that's the case here, but it's a concern I have nonetheless).

Agee! This was a fun project that I build because it is so hard to understand what "really" is in you context window... What do you mean by plugin/add-on? Add-on to what? Thinking of what to add to it next... Maybe security would be a good direction, or at least visibility of what is happening to the proxy's traffic.

Re: Show HN: A MitM proxy to see what your LLM tools are sending

#34
post #27
post #4

This is great. When I work with AI on large, tricky code bases I try to do a collaboration where it hands off things to me that may result in large number of tokens (excess tool calls, unprecise searches, verbose output, reading large files without a range specified, etc.). This will help narrow down exactly which to still handle manually to best keep within token budgets. Note: "yourusername" in install git clone in…

I've been trying to get token usage down by instructing Claude to stop being so verbose (saying what it's going to do beforehand, saying what it just did, spitting out pointless file trees) but it ignores my instructions. It could be that the model is just hard to steer away from doing that... or Anthropic want it to waste tokens so you burn through your usage quickly.

Simply assert that :

you are a professional (insert concise occupation).

Be terse.

Skip the summary.

Give me the nitty-gritty details.

You can send all that using your AI client settings.

Re: Show HN: A MitM proxy to see what your LLM tools are sending

#35
post #32

As someone who just set up mitmproxy to do something very similar, I wish this would've been a plugin/add-on instead of a standalone thing. I know and trust mitmproxy. I'm warier and less likely to use a new, unknown tool that has such broad security/privacy implications. Especially these days with so many vibe-coded projects being released (no idea if that's the case here, but it's a concern I have nonetheless).

Agee! This was a fun project that I build because it is so hard to understand what "really" is in you context window... What do you mean by plugin/add-on? Add-on to what? Thinking of what to add to it next... Maybe security would be a good direction, or at least visibility of what is happening to the proxy's traffic.

Addon to mitmproxy: https://docs.mitmproxy.org/stable/addons/overview/

Re: Show HN: A MitM proxy to see what your LLM tools are sending

#36

Nice work! I'm sure the data gleaned here is illuminating for many users. I'm surprised that there isn't a stronger demand for enterprise-wide tools like this. Yes, there are a few solutions, but when you contrast the new standard of "give everyone at the company agentic AI capabilities" with the prior paradigm of strong data governance (at least at larger orgs), it's a stark difference. I think we're not far from th…

Yes, I was just thinking about how, as engineers, we're trained to document every thought that has ever crossed our minds, for liability and future reference. Yet once an LLM is done with its task, the "hit by a bus" scenario takes place immediately.

Re: Show HN: A MitM proxy to see what your LLM tools are sending

#37
Pretty slick. I've been wanting something like this that gets stored with a hash that is stored in the corresponding code change commit message. It'd be good for postmortems of unnoticed hallucinations, and might even be useful to "revive" the agent and see if it can help debug the problem it created.

Re: Show HN: A MitM proxy to see what your LLM tools are sending

#39
lmao WTAF is this?

build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/build/lib/sherlock

Re: Show HN: A MitM proxy to see what your LLM tools are sending

#40
post #32

Earlier quoted context omitted.

Agee! This was a fun project that I build because it is so hard to understand what "really" is in you context window... What do you mean by plugin/add-on? Add-on to what? Thinking of what to add to it next... Maybe security would be a good direction, or at least visibility of what is happening to the proxy's traffic.

Addon to mitmproxy: https://docs.mitmproxy.org/stable/addons/overview/

What would you think of simply using an http relay for all providers? Would that make you feel better secutity wise? also could extend the tool to change the context you are sending and make it more granular to what you want/need...
Post reply on HN