Live data from Hacker News

Thesis: Interesting work is less amenable to the use of AI

remark.ing

61–70 of 111 posts

Re: Thesis: Interesting work is less amenable to the use of AI

#61
post #60

I feel much more confident that I can take on a project in a domain that im not very familiar with. Ive been digging into llvm ir and I had not prior experience with it. ChatGPT is a much better guide to getting started than the documentation, which is very low quality.

Careful - if you’re not familiar with the domain how are you going to spot when the LLM gives you suboptimal or even outright wrong answers?

Re: Thesis: Interesting work is less amenable to the use of AI

#62
post #60

I feel much more confident that I can take on a project in a domain that im not very familiar with. Ive been digging into llvm ir and I had not prior experience with it. ChatGPT is a much better guide to getting started than the documentation, which is very low quality.

Careful - if you’re not familiar with the domain how are you going to spot when the LLM gives you suboptimal or even outright wrong answers?

Testing

Re: Thesis: Interesting work is less amenable to the use of AI

#63
While I didn't agree with the "junior developer" analogy in the past, I am finding that it is beginning to be a bit more like that. The new Codex tool from OpenAI feels a lot more like this. It seems to work best if you already have a few examples of something that you want to do and now want to add another. My tactic is to spell it out very clearly in the prompt and really focus on having it consistently implement another similar thing with a narrow scope. Because it takes quite a while, I will usually just fix any issues myself as opposed to asking it to fix them. I'm still experimenting but I think a well crafted spec / AGENTS.md file begins to become quite important. For me, this + regular ChatGPT interactions are much more valuable than synchronous / Windsurf / Cursor style usage. I'd prefer to review a more meaningful PR than a million little diffs synchronously.

Re: Thesis: Interesting work is less amenable to the use of AI

#64

I have gotten much more value out of AI tools by focusing on the process and not the product. By this I mean that I treat it as a loosely-defined brainstorming tool that expands my “zone of knowledge”, and not as a way to create some particular thing. In this way, I am infinitely more tolerant of minor problems in the output, because I’m not using the tool to create a specific output, I’m using it to enhance the thin…

I think it's a U-shaped utility curve where abstract planning is on one side (your comment) and the chore implementation is on the other.

Your role is between the two: deciding on the architecture, writing the top-level types, deciding on the concrete system design.

And then AI tools help you zoom in and glue things together in an easily verifiable way.

I suspect that people who still haven't figured out how to make use of LLMs, assuming it's not just resentful performative complaining which it probably is, are expecting it to do it all. Which never seemed very engineer-minded.

Re: Thesis: Interesting work is less amenable to the use of AI

#66
post #60

I feel much more confident that I can take on a project in a domain that im not very familiar with. Ive been digging into llvm ir and I had not prior experience with it. ChatGPT is a much better guide to getting started than the documentation, which is very low quality.

Good luck with that.

I have been exploring local AI tools for coding (ollama + aider) with a small stock market simulator (~200 lines of python).

First I tried making the AI extract the dataclasses representing events to a separated file. It decided to extract some extra classes, leave behind some others, and delete parts of the code.

Then I tried to make it explain one of the actors called LongVol_player_v1, around 15 lines of code. It successfully concluded it does options delta hedging, but it jumped to the conclusion that it calculates the implied volatility. I set it as a constant, because I'm simulating specific interactions between volatility players and option dealers. It hasn't caught yet the bug where the vol player buys 3000 options but accounts only for 2000.

When asking for improvements, it is obsessed with splitting the initialization and the execution.

So far I wasted half of Saturday trying to make the machine do simple refactors. Refactors I could do myself in half of an hour.

I'm yet to see the wonders of AI.

Re: Thesis: Interesting work is less amenable to the use of AI

#67

I have gotten much more value out of AI tools by focusing on the process and not the product. By this I mean that I treat it as a loosely-defined brainstorming tool that expands my “zone of knowledge”, and not as a way to create some particular thing. In this way, I am infinitely more tolerant of minor problems in the output, because I’m not using the tool to create a specific output, I’m using it to enhance the thin…

I think it's a U-shaped utility curve where abstract planning is on one side (your comment) and the chore implementation is on the other. Your role is between the two: deciding on the architecture, writing the top-level types, deciding on the concrete system design. And then AI tools help you zoom in and glue things together in an easily verifiable way. I suspect that people who still haven't figured out how to make…

You don’t empathize with the humane opinion “why bother?” I like to program so it resonates. I’m fortunate to enjoy my work so why would I want to stop doing what I enjoy?

Re: Thesis: Interesting work is less amenable to the use of AI

#69
post #68

I have found it fascinating how AI has forced me to reflect on what I actually do at work and whether it has value or not.

Those kinds of thought processes are the kinds that produce value.

Deciding what to build and how to build it is often harder than building.

What LLMs of today do is basically super-autocomplete. It's a continuation of the history of programming automation: compilers, more advanced compilers, IDEs, code generators, LINTers, autocomplete, codeinsight, etc.

Re: Thesis: Interesting work is less amenable to the use of AI

#70
post #60

I feel much more confident that I can take on a project in a domain that im not very familiar with. Ive been digging into llvm ir and I had not prior experience with it. ChatGPT is a much better guide to getting started than the documentation, which is very low quality.

Good luck with that. I have been exploring local AI tools for coding (ollama + aider) with a small stock market simulator (~200 lines of python). First I tried making the AI extract the dataclasses representing events to a separated file. It decided to extract some extra classes, leave behind some others, and delete parts of the code. Then I tried to make it explain one of the actors called LongVol_player_v1, around…

Could you link the repo and prompts? What you described seems like the type of thing I’ve done before with no issue so you may have an interesting code base that is presenting some issues for the LM.
Post reply on HN