Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

What will LLM-powered software look like in the medium-term future?

vishnumenon.com

Post reply on HN
Print view View original

41–50 of 219 posts

Re: What will LLM-powered software look like in the medium-term future?

#41

Post by dleeftink »

mediumsmart wrote: post #24
geuis wrote: post #13

Ok. I appreciate they didn't use Medium as a blog post. There's a lot of good engineering knowledge currently locked behind the Medium "sign in" interface. It's dumb and stupid. But just to voice an opinion, please kill the lengthy paragraph levels of fluff in blog posts. I don't want to say my opinion is influenced by shitty blog recipes and research papers, but it is. So stop it. Just say what you need to say in bu…

You nailed it. In 2027 the AI is going to write the fluff for the Author and then extract the bullet points for the reader - Everybody saves time, winwin. and for some there will be a "please elaborate" command of course

One man's fluff is another man's.. recommendation algorithm?

Re: What will LLM-powered software look like in the medium-term future?

#42

Post by alluro2 »

I was hoping for some clever ideas about direction of software / UIs, and new use-cases for LLMs / AI, since for now I'm still struggling and have a lack of vision, it seems.

For example, I work on developing a logistics management and route optimization platform. If I try to envision new features that could be unlocked through AI or just LLMs, I basically get nothing back from my feeble brain, that I would fit into this category. E.g. - automate incident handling (e.g. driver broke down, handle redirection of other driver, handover of goods, reoptimize routes) - but the implementation would be just a decision tree based on a couple of toggles and parameters - no AI there? Other things that come to mind - we already use ML for prediction of travel times and service durations - it's a known space, that I refuse to call AI.

Apart from serving as an alternative and sometimes more efficient interface for data queries through NLP (e.g. "tell me which customers I had margin lower than 20% on, due to long loading times and mispackaged goods" - even then, all the data already needs to be there in appropriate shape, and it's just replacing a couple of clicks), I really fail to see new use-cases / features that the current state / hype for AI / LLMs unlocks.

Am I just lacking vision? Are there opportunities I'm grossly overlooking?

Re: What will LLM-powered software look like in the medium-term future?

#43

Post by totallywrong »

My guess is that LLMs will become an absolutely incredible tool, to the point of being indispensable, for software developers. This demographic is highly biased and often magnify their usefulness based on that. For everyone else, they will continue to be an advanced search engine / copywriting assistant.

Re: What will LLM-powered software look like in the medium-term future?

#45

Post by CharlieDigital »

jaynetics wrote: post #6

> Even if an LLM could provide me with a recipe that perfectly suits what I’m looking for, I wouldn’t want to give up the experience of using a recipe search engine and browsing through a large collection of recipes. Even if an LLM could provide me with restaurant recommendations based on my preferences, I’d still seek out a map-based UX for exploring the variety present in my vicinity. The desire to replace all UX w…

> I guess the question is: how much of our web or software use is leisurely browsing

I think the author's sentiment here is different. There's a personal subjectiveness when it comes to things like recipes. It could come down to the presentation (photos, narrative), an added ingredient in one that piques your interest and curiosity (a chili recipe with dark cocoa powder?!), or other subjective difference that is experienced differently by each of us.

The other aspect is mental bookmarking or "what ifs". Maybe I'll try this recipe this time, but I might come across other recipes I want to try some other time or I'll find an author that I really vibe with. That process of discovery is lost with LLMs today

Re: What will LLM-powered software look like in the medium-term future?

#46

Post by lysecret »

ryanjshaw wrote: post #38

> I don’t believe that natural language is an adequate medium for conveying instructions with the precision required for many applications. Not clear to me if the author actually uses LLMs to do meaningful work, or is speculating about how they might be used. I've written about 2500 lines of F# for the first time in the past 1.5 weeks using ChatGPT-4 to guide me. It has been an constant back and forth, iterative proc…

Ah haha I am going through the exact same experience but picked up F# about 4 months ago and ChatGpt has been an absolute godsend. There is a whole category of blockers in learning that have been eliminated.

Re: What will LLM-powered software look like in the medium-term future?

#47

Post by depletedgherkin »

ryanjshaw wrote: post #38

> I don’t believe that natural language is an adequate medium for conveying instructions with the precision required for many applications. Not clear to me if the author actually uses LLMs to do meaningful work, or is speculating about how they might be used. I've written about 2500 lines of F# for the first time in the past 1.5 weeks using ChatGPT-4 to guide me. It has been an constant back and forth, iterative proc…

Bit of an aside, but I wonder if the rise of LLMs will lead to new programming languages being much slower to be adopted.

Like you said, you might have given up on F# without ChatGPT assistance, and the main way ChatGPT is able to help with F# is because of all of the example code it's been trained on. If developers rely more and more on LLM aid, then a new language without strong LLM support might be a dealbreaker to widespread adoption. They'll only have enough data once enough hobbyists have published a lot of open-source code using the language.

On the other hand, this could also leading to slowing adoption of new frontend frameworks, which could be a plus, since a lot of people don't like how fast-moving that field can be.

Re: What will LLM-powered software look like in the medium-term future?

#48

Post by forward-slashed »

tarasglek wrote: post #26

@vishnumenon, thanks for writing this up. I might do a followup blog on this, for now here is a comment :) This article is close to my heart as I've been working on craftcraft.org with similar perspective. 1. Chat UX Consolidation: I agree that having crappy chat UIs everywhere is very suboptimal. Perhaps having a complete UX as a component is another solution here. We took many months to get http://chatcraft.org fro…

Really good stuff, but some minor things: your url doesn't work; went to your twitter profile, and it seems you meant https://chatcraft.org? Also, you are un-dm-able on twitter. (I am @eating_entropy if you want to talk more)

Re: What will LLM-powered software look like in the medium-term future?

#49

Post by kordlessagain »

j-a-a-p wrote: post #40

My prediction: knowledge will start to be reformatted into an LLM directly and knowledge providers will stop publishing it otherwise. Thus the chat interface will both improve and protect knowledge access once the traditional formats are not published anymore. This will come together with the downfall of search, a prime driver why so much knowledge was published on the web. Search will start to drown in an explosion…

Models still need to search. Tuning and reference augmented generation go hand in hand.

Re: What will LLM-powered software look like in the medium-term future?

#50

Post by gumballindie »

ryanjshaw wrote: post #38

> I don’t believe that natural language is an adequate medium for conveying instructions with the precision required for many applications. Not clear to me if the author actually uses LLMs to do meaningful work, or is speculating about how they might be used. I've written about 2500 lines of F# for the first time in the past 1.5 weeks using ChatGPT-4 to guide me. It has been an constant back and forth, iterative proc…

To this day i am still wondering what kind of code people write that chatgpt can possibly help with. All my attempts lead to garbage and i would spend more time fixing the output of the chat bot than writing the actual code. It does help with some documentation. But even that has glitches.
Post reply on HN