Live data from Hacker News

What will LLM-powered software look like in the medium-term future?

vishnumenon.com

91–100 of 219 posts

Re: What will LLM-powered software look like in the medium-term future?

#91

Earlier quoted context omitted.

I think I would have felt this way when I was younger. But after writing code for over twenty years, I'm very happy to let computers do the boring half of the thinking, so that I can think about more interesting things. It is not intellectually stimulating for me to think about what the syntax for a dict comprehension is, or what exactly I'm supposed to do to map over the values of an array in javascript without scre…

That's what's been so striking for me -- the stuff that is fun and playful for me I get to do; and a bunch of stuff that I hated I can now offload, with the net result that I get to work at the level of abstraction that is most interesting and most human, vs acting like a human robot trying to unearth documentation, API examples, etc. There's no question about this being the right way to use it for me, but I wonder i…

Yeah, I've said a bunch that I'm worried about people starting out from scratch. So much of what I do after I get responses from LLMs is best described as "taste", but how would I have developed that taste without the years of slogging through?

But I also think this is probably just a classic geezer's concern about kids being on my lawn, and it will probably work out just fine for these youths :)

Re: What will LLM-powered software look like in the medium-term future?

#92

Earlier quoted context omitted.

I think I would have felt this way when I was younger. But after writing code for over twenty years, I'm very happy to let computers do the boring half of the thinking, so that I can think about more interesting things. It is not intellectually stimulating for me to think about what the syntax for a dict comprehension is, or what exactly I'm supposed to do to map over the values of an array in javascript without scre…

It takes programming back to the pseudocode experience, but now the computer can fill in all the code bits really well about 75% of the time

Yeah, 75% seems a bit high, but it's a high enough percentage to be extremely useful to me.

Re: What will LLM-powered software look like in the medium-term future?

#93

> I don’t believe that natural language is an adequate medium for conveying instructions with the precision required for many applications. Not clear to me if the author actually uses LLMs to do meaningful work, or is speculating about how they might be used. I've written about 2500 lines of F# for the first time in the past 1.5 weeks using ChatGPT-4 to guide me. It has been an constant back and forth, iterative proc…

To this day i am still wondering what kind of code people write that chatgpt can possibly help with. All my attempts lead to garbage and i would spend more time fixing the output of the chat bot than writing the actual code. It does help with some documentation. But even that has glitches.

Treat it like your rubber duck.

Re: What will LLM-powered software look like in the medium-term future?

#94

> I don’t believe that natural language is an adequate medium for conveying instructions with the precision required for many applications. Not clear to me if the author actually uses LLMs to do meaningful work, or is speculating about how they might be used. I've written about 2500 lines of F# for the first time in the past 1.5 weeks using ChatGPT-4 to guide me. It has been an constant back and forth, iterative proc…

Bit of an aside, but I wonder if the rise of LLMs will lead to new programming languages being much slower to be adopted. Like you said, you might have given up on F# without ChatGPT assistance, and the main way ChatGPT is able to help with F# is because of all of the example code it's been trained on. If developers rely more and more on LLM aid, then a new language without strong LLM support might be a dealbreaker t…

The crazy thing that a lot of people don’t realize is that all of that data generalizes to anything new you can throw at it. As long as there’s enough space in the prompt to provide documentation it can do it on the fly but you could also fine tune the model on the new info.

Re: What will LLM-powered software look like in the medium-term future?

#95
post #83

I'll tell you my vision which is kinda long term - like 20-30 year from now on. I think the future is that everyone will have their own personalized AI assistant on their phone. Internet as it is will be mostly useless because only robots will be able to wade through the generated shit ocean and the next generation will see it as the current see the TV - unimportant old boring low-entropy data which is not entertaini…

For a bit there it didn’t sound too bad!

Re: What will LLM-powered software look like in the medium-term future?

#96
post #90

Earlier quoted context omitted.

I disagree. Chatgpt is helpful here because f# is a paradigm shift for this otherwise experienced programmer. The programmer probably knows juuussstt enough f# to guide the llm.

I mean why is f# the goal, and could we write a better f# with the use of AI. As an example, why not write in f# and let an 'AI-compiler' optimise the code... The AI-compiler could then make sure all the code is type safe, add in manual memory management to avoid the pitfalls of garbage collection, add memory safety etc - all the hard bits. And then if we gave the AI-compiler those sort of responsibilities, then we c…

This doesn’t require AI, it requires higher-level languages than we have that can express intent more directly.

Re: What will LLM-powered software look like in the medium-term future?

#97

Earlier quoted context omitted.

Bit of an aside, but I wonder if the rise of LLMs will lead to new programming languages being much slower to be adopted. Like you said, you might have given up on F# without ChatGPT assistance, and the main way ChatGPT is able to help with F# is because of all of the example code it's been trained on. If developers rely more and more on LLM aid, then a new language without strong LLM support might be a dealbreaker t…

The crazy thing that a lot of people don’t realize is that all of that data generalizes to anything new you can throw at it. As long as there’s enough space in the prompt to provide documentation it can do it on the fly but you could also fine tune the model on the new info.

Which is what Phind tries (and mostly succeeds) in doing. LLM + Search Engine is way smarter than just LLM.

Re: What will LLM-powered software look like in the medium-term future?

#98
post #72

Earlier quoted context omitted.

Try asking chatgpt for some ideas.

Unironically, I've done this sort of thing. Not too impressed with the results though.

Ideas are probably the last thing humans will delegate to AI. We have needs and wants that Ideas help us meet, AI only sets priorities in a reactive way.

Re: What will LLM-powered software look like in the medium-term future?

#99
post #95
post #83

I'll tell you my vision which is kinda long term - like 20-30 year from now on. I think the future is that everyone will have their own personalized AI assistant on their phone. Internet as it is will be mostly useless because only robots will be able to wade through the generated shit ocean and the next generation will see it as the current see the TV - unimportant old boring low-entropy data which is not entertaini…

For a bit there it didn’t sound too bad!

You'll be a God, but a God who has to look at ads all the time, and your angels will... also be ads.

Re: What will LLM-powered software look like in the medium-term future?

#100
post #83

I'll tell you my vision which is kinda long term - like 20-30 year from now on. I think the future is that everyone will have their own personalized AI assistant on their phone. Internet as it is will be mostly useless because only robots will be able to wade through the generated shit ocean and the next generation will see it as the current see the TV - unimportant old boring low-entropy data which is not entertaini…

An LLM/AI companion based on your ledger, that grows and evolves with you, acting as a sort of Socratic daimon, a psychologic twin, assistant, advisor, and sparring partner. Like a journal that talks back and thinks with you. It'd need to be only personally accessible and safe/private. Biometric access and local running could solve this.
Post reply on HN