Live data from Hacker News

The Leverage of LLMs for Individuals

mazzzystar.github.io

181–190 of 311 posts

Re: The Leverage of LLMs for Individuals

#181
post #164

Earlier quoted context omitted.

As if injections weren’t bad enough, they’re now done with intent.

Intent worries me less! It’s the PHP days all over again - lots of new coders (good thing!), copying insecure code (VERY bad thing!), and it won’t end well.

Yes... The last time this happened we got Facebook and the world is still recovering from that

Re: The Leverage of LLMs for Individuals

#182
post #43

Earlier quoted context omitted.

The beauty of abstraction, though, is that it liberates a person from needing to worry about lower-level complexities. The same should be true for LLMs. It shouldn’t need to know your entire system. Start a new thread with judiciously restricted context when you move on to the next task.

I'm sure you could get code that would work going this route, but I'm worried about the code base growing to have lots of duplication and it generally just growing into a mess without any standard patterns and it would become a nightmare to maintain if that's the case.

That will always be an issue and, moreover, always has been an issue — not only with code one obtains from other humans through forums, stack overflow, and blog posts — but also with code written entirely by oneself.

Code we get from an LLM, or someone else's fallible wetware, or our own fallible wetware, all need thoughtful consideration prior to committing.

Re: The Leverage of LLMs for Individuals

#183

> More importantly, it gives me the courage to dream and attempt things beyond my current abilities. This is one of the small things that GPT has pushed me to do. I'm an experienced programmer and grew up playing video games, but I am not a game developer. I've dabbled over the years but can't build anything outside of a tutorial. The other day, using GPT I went through and made a Pixel Dungeon clone using Phaser (Ja…

Given the token count limits on input and output, I've been wondering how folks work on these long-running projects? Is it just not a problem, or are there some tactics? I find in trying to build up lengthy outputs that it starts truncating or leaving out things from way before.

Re: The Leverage of LLMs for Individuals

#184
post #7

Learning something with GTP-4 is so much more fun than using google/Stack Overflow. It's like having a tutor that knows your code and gives you hints and solutions based on your actual project. It's a real game changer for learning

I've been trying to do it to some extent but I can't say it's been enjoyable (granted most of it has been GPT-3). It's more like a tutor that never calls out your mistakes and gaps. Anything you ask, it comes up with an affirmative answer, I try the answer and it ends up being a hallucination.

At this point, i am in a place where GPT gives me good solutions that might not work vs having to go through all the noise Googling stuff to find a working solution.

But it is great just to learn different concepts at a high level. Helps me clear my mind when coming up with designs

Re: The Leverage of LLMs for Individuals

#185

> More importantly, it gives me the courage to dream and attempt things beyond my current abilities. This is one of the small things that GPT has pushed me to do. I'm an experienced programmer and grew up playing video games, but I am not a game developer. I've dabbled over the years but can't build anything outside of a tutorial. The other day, using GPT I went through and made a Pixel Dungeon clone using Phaser (Ja…

Heck yeah, cool! Similar experience here too. In only a few hours I got a basic working custom JavaScript space shooter going, and I've since started a Whac-a-Mole style game.

GPT explaining it along the way and allowing me to have a reasonable conversation with it when something isn't working as-expected has been a rewarding and fun learning experience.

Re: The Leverage of LLMs for Individuals

#186
post #87

I am happy that so many people get to experience the feeling me and other software engineers feel when we write code. OpenAI democratize some of this feeling and now people that never knew how to code can experience the rush of creating something new using code. In a world where a lot of AI Researchers that develop these amazing models are slowed down by their lack of "normal" engineering skills I think it's very app…

People who use ChatGPT to spit out code as a method of learning software engineering are going to be seriously deficient in fundamentals like performance. I've already worked with way too many engineers who copy/paste code without understanding what it does.

I've seen similar results with teams I work with. The strongest engineers who can spot the deficiencies or errors in LLM generated code generally get a huge productivity boost, as they can compare the "shape" of the output to what they would expect for a given problem.

The junior devs, lacking the experience that provides the context or knowledge to analyze the "shape", let all manner of minor and major issues from the generated code slip past.

I really notice this particularly with say less popular frameworks or code libraries, where many LLM code generators appear much more likely to hallucinate invalid code. I see similar issues with DSLs too, where the LLM starts to just guess at the DSL syntax. I really hate when an engineer new to a framework just goes to the LLM first, without at least spending a little time learning the framework for the task.

All said, I suspect these code generation tools will get good enough that the rate of errors goes down enough it maybe won't matter in the longer term.

Re: The Leverage of LLMs for Individuals

#187
The podfind example in the article is a tailwind page fronting itunes search API.

The big question here feels like: how should AI do retrieval? 'Generate an interface to hit existing DB' is probably one of the answers, I suspect this use case will grow.

Separate question, should it take a few hundred lines of html + js to provide this? Can low-boilerplate DSLs make humans and LLM codegen better at delivering on these asks

Re: The Leverage of LLMs for Individuals

#188
post #113
post #40

There's a long gap from: I built a podcast search website to: Staying in any company right now is a negative return. We humans are too easily impressed by tricks, and are too willing to extrapolate them to fantasy land. GPT can certainly accomplish an impressive variety of small tasks. Whether it can build large-scale systems that will power tomorrow's world is uncharted territory. Can you build something meaningful,…

Despite the novelty and excitement, the profit potential for AI generated applications and content isn't particularly strong. If you can make something using AI, so can everyone else. You work at a company to make money. Using AI doesn't magically allow you to do that. If you have the ability to make a profitable company, AI may help, but it's not a business plan.

> If you can make something using AI, so can everyone else

The idea / creativity is hence the key. Novel ideas don't occur to everyone.

Re: The Leverage of LLMs for Individuals

#189
post #18

Earlier quoted context omitted.

You need to pay for ChatGPT Plus, or sign up for their API (there’s a waitlist).

FWIW, I got API access quite quickly. Applied March 20, got access March 27. My application was only some 2 line bullshit, their example for "why do you want access" rewritten.

Strange. I applied April 6th and still don't have access

Re: The Leverage of LLMs for Individuals

#190

> More importantly, it gives me the courage to dream and attempt things beyond my current abilities. This is one of the small things that GPT has pushed me to do. I'm an experienced programmer and grew up playing video games, but I am not a game developer. I've dabbled over the years but can't build anything outside of a tutorial. The other day, using GPT I went through and made a Pixel Dungeon clone using Phaser (Ja…

I'm thinking about doing this without any game dev experience as well. All I need is access to GPT4 now...
Post reply on HN