Live data from Hacker News

Ask HN: What hacks/tips do you use to make AI work better for you?

news.ycombinator.com

31–40 of 108 posts

Re: Ask HN: What hacks/tips do you use to make AI work better for you?

#31

Earlier quoted context omitted.

We re-trained or let go everyone that does not want to or cannot be a client facing consultant ; with our in house builder, we don't need fulltime devs anymore. It's 'productive' as in much higher profit margins with less people. We are in the custom ERP space.

Thanks for the reply. I would like to explore this more if you are willing. Do you consider yourself a “developer”? What is your title at said company? Do you write code for yourself or for this business? Who determined and what criteria define who “cannot be a client facing consultant”? What is an “in house builder”? What were these “fulltime devs” that you said “you don’t need anymore” doing before these llms? Do y…

> Do you consider yourself a “developer”? What is your title at said company?

Yes , for the past 40 years. And CTO/co-founder.

> Do you write code for yourself or for this business?

I have been writing DSL, code generators and other tooling for the past around 20 years for this company. Before that I did the same thing for educational software (also my company).

> Who determined and what criteria define who “cannot be a client facing consultant”?

They did; some people just don't like sitting with clients noting down very dry formulae and business rules.

> What is an “in house builder”?

Our in-house tooling which uses AI to create the software.

> What were these “fulltime devs” that you said “you don’t need anymore” doing before these llms?

Building LoB apps, bugifxing, maintaining, translating Excel or business rules to (Java) code.

> Do your customers know you swapped from human workers to llms? Are they comfortable with this transition?

Yes, they like it; faster (sometimes immediate results) and easier to track; no black box; just people sitting next to you.

> How did this change result in “much higher profit margins”?

Very high fees for these consultants but now they do 'all the work'; in total they make more hours than they did before, however much less than they did as programmers. But the fees are such a multiply that the end result is larger profits.

> When you say “with less people” did you just give multiple peoples’ workloads to a single dev or did the devs you retained ask for more work?

Yes, 1 consultant now does that work and can manage more.

> What do you use an llm for in the ERP space?

Feed it specs which get translated to software. This is not the type of 'he mate, get me a logistics system in german'; the specs are detailed and in the technical format we also use to write code ourselves the past 20+ years.

> Why would clients use you if they could just use the llm?

See above, we have a lot of know-how and code built in. That's why we cannot really sell this product either as no-one will get useful stuff out of it without training.

Re: Ask HN: What hacks/tips do you use to make AI work better for you?

#32

Earlier quoted context omitted.

> I am a developer with >25 of professional experience. I am unable to get these things to do anything useful. I am a developer with >25 of professional experience. I was able to do useful things with these tools from day one of trying. This puzzles me so much every time reading such. Either I am more stupid than average and I just think the results are more useful then I can come up with, or maybe I have a knack for…

LLMs have dramatically different results depending on the domain. Getting LLMs to help me learn typescript is a joy, getting them to help me fix distributed consensus problems in my fully bespoke codebase make them look worse than useless. Some people will find them amazing, some will find them a net negative. Although finding truly zero use for them makes it hard for me to believe that this person really tried with…

> getting them to help me fix distributed consensus problems in my fully bespoke codebase make them look worse than useless.

Often the complex context of such problem is more clear in your head than you can write down. No wonder the LLM cannot solve it, it has not the right info on the problem. But if you then suggest to it: what if it had to do with this or that race condition since service A does not know the end time of service Z, it can often come up with different search strategies to find that out.

Re: Ask HN: What hacks/tips do you use to make AI work better for you?

#33

I’m exhausted by these types of posts. I am a developer with >25 of professional experience. I am unable to get these things to do anything useful. I’ve tried: different models, limiting my scope, breaking it down to small tasks, prompt “engineering”; and am still getting less than useless results. I say less than useless, because I will then additionally waste time debugging or slamming my head against the wall the…

Start small and you might see the value. I find ai useless to produce code for me. But if I'm stuck on naming a variable or a complex object it's a great brainstorming tool. Almost like a very complex thesaurus.

And if I need to write a shell script that's good enough for a single one-off job, well, shell script is far from my native programming language, so it'll do a better job than I will

Re: Ask HN: What hacks/tips do you use to make AI work better for you?

#34

I’m exhausted by these types of posts. I am a developer with >25 of professional experience. I am unable to get these things to do anything useful. I’ve tried: different models, limiting my scope, breaking it down to small tasks, prompt “engineering”; and am still getting less than useless results. I say less than useless, because I will then additionally waste time debugging or slamming my head against the wall the…

I'm always stumped by comments like this. I'm at a point where ~70% of my code is AI-written, and the majority of the remaining is mostly because it would take too much time to provide enough context to the tool/LLM of choice for it to be able to produce the code I need.

Given the right context and the right choice of model/tools, I think ~90-95% of the code I write could be generated. And this is not for doing trivial CRUD; I work on a production app with 8 other people.

I'm really curious if you could give examples of problems that you tried and failed to use these tools for?

Re: Ask HN: What hacks/tips do you use to make AI work better for you?

#36
If AI doesn't understand something I assume it's too clever, even if I do get the AI to figure it out I won't understand it in a month and other devs won't understand it at all unless I somehow convince them to read the code(Like as if that's going to happen!).

I think it's definitely improved my own code, because it's like always working with a pair programmer, who represents a very average developer with insane typing speed. I think you kind of subconscious pick up the style like you would learn a literary style by reading books.

With Codeium what usually works is writing a prompt inline as a very descriptive comment.

For a non critical piece of a personal project, I think this section is the most impressive thing I've gotten AI to do:

``` float getFilterBlendConstant(float tc, float sps){ return 1.0f - exp(-1.0f / (tc * sps)); } float fastGetApproxFilterBlendConstant(float tc, float sps){ return 1.0f - (tc * sps) / (tc * sps + 1.0f); } ```

Re: Ask HN: What hacks/tips do you use to make AI work better for you?

#38

I’m exhausted by these types of posts. I am a developer with >25 of professional experience. I am unable to get these things to do anything useful. I’ve tried: different models, limiting my scope, breaking it down to small tasks, prompt “engineering”; and am still getting less than useless results. I say less than useless, because I will then additionally waste time debugging or slamming my head against the wall the…

> I am a developer with >25 of professional experience. I am unable to get these things to do anything useful. I am a developer with >25 of professional experience. I was able to do useful things with these tools from day one of trying. This puzzles me so much every time reading such. Either I am more stupid than average and I just think the results are more useful then I can come up with, or maybe I have a knack for…

> or are you smarter than those results?

“Smarter than” are your words. I’ve just yet to get any real utility from them.

> When I read such comments I ask myself, do you even use stackoverflow

I find this a strange comparison.

I’ve yet to see people replacing employees with “stack overflow” or M$FT shoe horning “stack overflow” into their flagship product or former NSA members joining the board of “stack overflow” or billions in funding pouring into “stack overflow” or constant posts to HN asking “how do you use ‘stack overflow’ to improve productivity?”.

Re: Ask HN: What hacks/tips do you use to make AI work better for you?

#39
post #34

I’m exhausted by these types of posts. I am a developer with >25 of professional experience. I am unable to get these things to do anything useful. I’ve tried: different models, limiting my scope, breaking it down to small tasks, prompt “engineering”; and am still getting less than useless results. I say less than useless, because I will then additionally waste time debugging or slamming my head against the wall the…

I'm always stumped by comments like this. I'm at a point where ~70% of my code is AI-written, and the majority of the remaining is mostly because it would take too much time to provide enough context to the tool/LLM of choice for it to be able to produce the code I need. Given the right context and the right choice of model/tools, I think ~90-95% of the code I write could be generated. And this is not for doing trivi…

Two recent examples.

Please link to your history when you get one of these things to build my example so I can see how you managed to do it.

First, a friend without technical knowledge wanted to query an API using SQL. (At a previous firm he learned how to write “SELECT * FROM … WHERE …” statements.)

He asked one of these llms to do this, that he paid a premium for, and it suggested installing VSCode and writing an extension to ingest an API and to query it with python.

I am unfamiliar with VSCode so I’m unsure if this is even feasible, but after 3 days of trying to get it to work, he asked me, and I set up a python environment for him, and wrote a 5 line script to allow him to query the data ingested from the API into SQLite.

For me, the last time I tried, I asked one to write me a container solution using Docker that allowed for live coding of a Clojure project. I wanted it to give me solutions for each: deps.edn and lein.

I wasted hours, because it always felt “just around the corner”, trying to get it to output anything of use for either paradigm then when I abandoned the llm I quickly found, via a web search, a blog post someone wrote that did exactly what I asked, for a lein project of their own, and I just changed it to work for my project, and then again for the deps.edn version on my own.

Re: Ask HN: What hacks/tips do you use to make AI work better for you?

#40
post #5

Curious how people interact with LLMs besides just going to chat.com/Claude directly. I've been trying aichat but not sure yet if it's worth it, especially given the token pricing vs the flat fee structure on the website.

aider: https://aider.chat/docs/install.html
Post reply on HN