Live data from Hacker News

The Leverage of LLMs for Individuals

mazzzystar.github.io

61–70 of 311 posts

Re: The Leverage of LLMs for Individuals

#61

Earlier quoted context omitted.

Yup. We're back to the real problems that matter in sdev -- thinking about the problem, breaking it down, scoping things. Let an LLM do the grunt-work of writing the code, sure.

I agree, but I'm worried about where that leaves junior devs - what are the entry level jobs for coders in a post-LLM future?

Assuming it actually happens, how different is it from a ton of other things? Hpw many rote sysadmin or paralegal tasks of 20 years ago still need basically a warm body to do them?

Re: The Leverage of LLMs for Individuals

#62
post #7

Learning something with GTP-4 is so much more fun than using google/Stack Overflow. It's like having a tutor that knows your code and gives you hints and solutions based on your actual project. It's a real game changer for learning

I'm leveraging this to build https://codeamigo.dev . Basically it's learn to code, but with an AI assistant. The main reason people drop off of coding tutorials or stop learning is when they see their first error message. I'm already seeing people get un-stuck by using the AI as an assistant, this tech (GPT) is going to completely revolutionize learning.

Check out the new StarChat model by hugging face, might be useful for your project

Re: The Leverage of LLMs for Individuals

#63

The confusion in terms called out here (and even demonstrated) is probably not to OpenAI's benefit and I am surprised they haven't spent more effort in trying to correct that. ChatGPT is a website that lets you do chat completion [1] against LLM models, and it exposes some extra functions like plug-ins if you are lucky enough to be white listed for them. GPT 3.5 and GPT 4 are the actual models. Someone telling you th…

Similarily, reminds me of "bitcoin" the currency and "Bitcoin" the protocol.

Re: The Leverage of LLMs for Individuals

#64

Earlier quoted context omitted.

FWIW, I got API access quite quickly. Applied March 20, got access March 27. My application was only some 2 line bullshit, their example for "why do you want access" rewritten.

I applied March 16 and I'm still waiting.

Huh, that’s weird. I thought it was simply generally quick. Did you already have a paid account?

Re: The Leverage of LLMs for Individuals

#65

Has anyone been able to use it to effectively build more than a green field poc? It's absolutely great for that, but it's been a little clunky when trying to iterate when the context gets too large or when trying to add stuff to am existing system.

Yes. You need to really focus on decomposing your problem and use like "there is" "it is" and "it has" to describe the overall system instead of relying on it remembering everything. Which honestly makes code more organized and easier to read.

Re: The Leverage of LLMs for Individuals

#66

Has anyone been able to use it to effectively build more than a green field poc? It's absolutely great for that, but it's been a little clunky when trying to iterate when the context gets too large or when trying to add stuff to am existing system.

And of course, each project will eventually no longer be green field.

While it can help you understand code blocks, I'm not sure that it can help you understand an application as a whole.

I don't know that it can help discover edge-case types of bugs and suggest fixes. For example, the types of problems which crop up when system meets reality.

The can see this leading to a lot of spaghetti coded projects.

Re: The Leverage of LLMs for Individuals

#67
> More importantly, it gives me the courage to dream and attempt things beyond my current abilities.

This is one of the small things that GPT has pushed me to do. I'm an experienced programmer and grew up playing video games, but I am not a game developer. I've dabbled over the years but can't build anything outside of a tutorial.

The other day, using GPT I went through and made a Pixel Dungeon clone using Phaser (JavaScript game engine). It was such a delight. Together we got the game to a working state before I started to change some of the fundamental design, and then GPT started hallucinating pretty badly. When that happened, I stopped for the night, and then just started new focused conversations to add or change a feature, putting in the relevant code. It's turn-based, with simple AI, enemy monsters, fog of war, line of sight, and a victory/losing condition.

Being able to build this in a couple of days is an absolute game-changer, pun intended. I can only imagine the riches of experiences we will have as people are unblocked on skills and can pursue an idea.

Re: The Leverage of LLMs for Individuals

#68
post #59
post #7

Learning something with GTP-4 is so much more fun than using google/Stack Overflow. It's like having a tutor that knows your code and gives you hints and solutions based on your actual project. It's a real game changer for learning

And this is what you might say while you're learning. As you gain more experience, you realize that there's a wide range of solutions with some spectrum of a fit to your situation. A given solution may fall down in certain cases. What I love you Stack Overflow, is the context which comes with it. You get replies on a given proposed solution which point out where the solution may fail.

GPT4 absolutely does the same thing if you ask it to. Tell it to suggest approaches and discuss pros and cons and future pitfalls and it does, which makes sense because it is in part stack overflow.

Re: The Leverage of LLMs for Individuals

#69
post #41

Earlier quoted context omitted.

GPT-4 is still limited to 25 queries/3 hours and that is likely why it took longer.

Every 3 hours. But also, if you have API access you can use the OpenAI playground to query GPT-4 as much as you want. Sure, you pay a cost (per token), but if you're willing to front the bill you can move pretty quickly.

The API rate limit is 40k tokens per minute (I’ve hit it with a personal project).

Re: The Leverage of LLMs for Individuals

#70

AI tools are absolutely useless once you get past any initial stage in a software development cycle They just can't comprehend what needs to be done even if all that's required are 2 lines of code However, we keep seeing posts from people who don't know html or how to create a chrome extension paternalizing about how we can be much more productive with AI tools. Last I heard a CEO was demanding dev increased producti…

This sounds to me like you have no idea how to properly integrate LLMs into your workflow. Just because they’re not useful for changing large code bases doesn’t mean they can’t be valuable. A few examples of things I’ve used LLMs for:

Writing bash scripts to automate various parts my workflow

Quickly interpreting complex regex

Tutoring me on how to use poorly documented APIs

Proof reading important emails

Everything copilot, writing java docs, auto completing all the cases in a switch statement, etc.

Post reply on HN