Live data from Hacker News

Focus and Context and LLMs

taras.glek.net

41–50 of 51 posts

Re: Focus and Context and LLMs

#41
post #38

Earlier quoted context omitted.

I'm sorry, I really can't follow any of this. No two lines of this seem to go together. "The politicians"?

The many of your friends who are into radicalism or futurism The link: fly.io/blog/ YOU re-all-nuts/ (XD)

Sorry, not getting me any closer to understanding this. The post took something like a month to put together.

Re: Focus and Context and LLMs

#42

I don't know why software engineers think that LLM coding ability is purpose made for them to use, and because it sort of sucks at it, it therefore useless... It's like listening to professional translators endlessly lament about translation software and all it's short comings and pitfalls, while totally missing that the software is primarily used for property managers wanting to ask the landscapers to cut the grass…

> LLMs are excellent at Writing hint: Your last paragraph stands well on its own. Especially if this is, in fact, your actual experience. Nothing in that paragraph requires the negativity or inaccuracies of the preceding two paragraphs. There should be a name for the human tendency (we have all done/do it) to weigh down good points with unnecessary and often inaccurate contrast/competition.

I struggle with this a lot so thanks for the hint. I don't entirely agree that good points stand on their own. It's often easy to anticipate the criticism to your point. When arguments are text-based and responses have a tendency to span hours or days, it can be useful to short circuit the argument by just calling out the anticipated criticism. This of course can sometimes lead to comments such as yours, where we go off into a meta side-argument. Or, if you anticipate badly, you unintentionally put even more focus on the anticipated criticism than your original point.

Re: Focus and Context and LLMs

#43

Has the author tried Claude Code? It’s the first useful “agent” (LLM in a loop + tools) that I’ve tried. IME it is hard to explain why it’s better than e.g. Aider or Cursor, but once you try it you’ll migrate your workflow pretty quickly.

> IME it is hard to explain why it’s better than e.g. Aider or Cursor i have cursor through work but i am tempted to shell out $100 because of this hype. is it better than using claude models in cursor?

You could always just try it out via a normal Anthropic API key. Probably would be around $3-10 for greenfield implementation of a non-trivial project. "/cost" to see as you go.

Re: Focus and Context and LLMs

#44
post #41

Earlier quoted context omitted.

The many of your friends who are into radicalism or futurism The link: fly.io/blog/ YOU re-all-nuts/ (XD)

Sorry, not getting me any closer to understanding this. The post took something like a month to put together.

No problem, it's probably just my schizo talking.

It's just that... Framing your post in terms of the opinions of devs that you personally know, and not those of the AI-assistance community at large* resolved your issue with ofjcihen. for me (only, it seems :().

*explicitly including e.g., Lisp, Haskell (radical futurists?),

& (dare I mention) SwiftUI devs

Re: Focus and Context and LLMs

#46

What are some startups that help precisely with “feeding the LLM the right context” ?

Not a startup, and doesnt help you still have to choose, but I paid 200usd for RepoPrompt (macOs app)

its a very niche app, and havent used it as much since buying it, but there's that https://repoprompt.com/

Re: Focus and Context and LLMs

#47
post #13

This article is knocking down a very expansive claim that most serious (ie: not vibe-coding) developers aren't making. Their point is that LLM agents have not yet reached the point where they can finish a complicated job end-to-end, and that if you want to do a completely hands-off project, where only the LLM generates any code, it takes a lot of prompting effort to accomplish. This seems true, right now! But in buil…

I think more specifically, if you don't have strong guidance to the LLM on how a project is organized and where things should go, things go pretty far off the rails.

I tried to have an LLM fully write a Python library for me. I wrote an extensive, detailed requirements doc, and it looked close enough that I accepted the code. But as I read through it more closely, I realized it was duplicating code in confusing ways, and overall it took longer than just getting the bones down myself, first.

Some coding agents are now more actively indexing code, I think that should help with this problem

Re: Focus and Context and LLMs

#48

Earlier quoted context omitted.

> LLMs are excellent at Writing hint: Your last paragraph stands well on its own. Especially if this is, in fact, your actual experience. Nothing in that paragraph requires the negativity or inaccuracies of the preceding two paragraphs. There should be a name for the human tendency (we have all done/do it) to weigh down good points with unnecessary and often inaccurate contrast/competition.

I struggle with this a lot so thanks for the hint. I don't entirely agree that good points stand on their own. It's often easy to anticipate the criticism to your point. When arguments are text-based and responses have a tendency to span hours or days, it can be useful to short circuit the argument by just calling out the anticipated criticism. This of course can sometimes lead to comments such as yours, where we go…

> It's often easy to anticipate the criticism to your point.

You can head off a lot of criticism by not making your point competitive with other reasonable points. I.e. additive to understanding, not subtractive.

Otherwise, you are actually creating the competition between points that you wanted to avoid. And creating your own distractions from your own point.

Re: Focus and Context and LLMs

#49

The article summed itself up as 'Context is everything". But the article itself also makes the point that a human assistant was also necessary. That's gonna be my take away.

I agree. And the real lede was buried here IMO: > This is the single most impressive code-gen project I’ve seen so far. I did not think this was possible yet. To get that sort of acclaim, a human had to build an embedded programming language from scratch to get to that point. And even with all that effort, the agent itself took $631 and 119 hours to complete the task. I actually don't think this is a knock on the ide…

Do you have any of those examples handy by chance? Curious to check them out. And agreed! While coding has become a commodity - programming is still as alive as ever.

Re: Focus and Context and LLMs

#50
post #49

Earlier quoted context omitted.

I agree. And the real lede was buried here IMO: > This is the single most impressive code-gen project I’ve seen so far. I did not think this was possible yet. To get that sort of acclaim, a human had to build an embedded programming language from scratch to get to that point. And even with all that effort, the agent itself took $631 and 119 hours to complete the task. I actually don't think this is a knock on the ide…

Do you have any of those examples handy by chance? Curious to check them out. And agreed! While coding has become a commodity - programming is still as alive as ever.

Absolutely agree with that last sentiment. Recently I came across a project by a former google engineer called Dyad: https://github.com/dyad-sh/dyad

This is built to be a lovable/bolt alternative and is definitely on the early side in terms of total capability and reliability. But once you start digging through the source you realize how much engineering actually went into building it. Not just chaining prompts together in a dart throwing exercise and praying for a good result.

This is much closer to the "turnkey" solution vertical I mentioned in my earlier commentary, since its meant to generically build any web app, but there's a few applied concepts that are shared with the promptyped approach used in the HTTP/2 server (though not as sophisticated when compared to the category theory / type theory approach).

I think it's a good example to work backwards from though, if you peel the onion a bit you realize how much more tightly you could scope this for more bespoke projects.

Post reply on HN