Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The Leverage of LLMs for Individuals

mazzzystar.github.io

Post reply on HN
Print view View original

41–50 of 311 posts

Re: The Leverage of LLMs for Individuals

#41

Post by pugio »

bronco21016 wrote: post #27
usrusr wrote: post #12

“48 hours of conversation with GPT-4“ Heh, sounds like a novel form of torture. The author probably means 48 hours total over a (much) longer time, and it had all been an enjoyable ride of turbocharged learning and discovery, but that's not how it reads to my eyes.

GPT-4 is still limited to 25 queries/3 hours and that is likely why it took longer.

Every 3 hours. But also, if you have API access you can use the OpenAI playground to query GPT-4 as much as you want. Sure, you pay a cost (per token), but if you're willing to front the bill you can move pretty quickly.

Re: The Leverage of LLMs for Individuals

#42

Post by anotherpaulg »

I have also been using GPT as a force multiplier for my coding, especially in areas where I'm less comfortable like frontend.

I put together a tool called `aider` for chatting with GPT-4 about code, having it make changes and keeping track of it all in git. It's feeling like a very nice workflow.

@mazzystar you might want to give it a try if you have GPT-4 api access:

https://github.com/paul-gauthier/aider

Re: The Leverage of LLMs for Individuals

#43

Post by pohl »

bostonsre wrote: post #33

Has anyone been able to use it to effectively build more than a green field poc? It's absolutely great for that, but it's been a little clunky when trying to iterate when the context gets too large or when trying to add stuff to am existing system.

The beauty of abstraction, though, is that it liberates a person from needing to worry about lower-level complexities. The same should be true for LLMs. It shouldn’t need to know your entire system. Start a new thread with judiciously restricted context when you move on to the next task.

Re: The Leverage of LLMs for Individuals

#44

Post by jstx1 »

bostonsre wrote: post #33

Has anyone been able to use it to effectively build more than a green field poc? It's absolutely great for that, but it's been a little clunky when trying to iterate when the context gets too large or when trying to add stuff to am existing system.

It's nice for guidance when you start a project but you quickly run into problems if you want to rely on it entirely. I tried to use it to build a small library which implements an established algorithm from scratch where I can guide it and give it feedback but I'm not writing any code, only copying and pasting and relaying any errors back to it so it can correct itself - it doesn't do great, it loses track of its own implementation of things and suggests inconsistent code.

Still useful for many other use cases, just not for "write my entire project for me and I'll only copy and paste" yet

Re: The Leverage of LLMs for Individuals

#45

Post by jmiskovic »

TeMPOraL wrote: post #37
Karunamon wrote: post #24

The confusion in terms called out here (and even demonstrated) is probably not to OpenAI's benefit and I am surprised they haven't spent more effort in trying to correct that. ChatGPT is a website that lets you do chat completion [1] against LLM models, and it exposes some extra functions like plug-ins if you are lucky enough to be white listed for them. GPT 3.5 and GPT 4 are the actual models. Someone telling you th…

> Someone telling you that they did something cool with ChatGPT probably means GPT 3. The confusion is that ChatGPT is using GPT-3.5 by default, but if you pay the $20/month subscription price, you can switch it over to GPT-4 (with query limits). Usually, when someone is telling you they did something really cool with ChatGPT, they're actually using GPT-4. An extra layer of confusion is the API access: GPT-3.5-turbo…

Correcting the correction of a correction: The chat interface is no longer using GPT-3.5, since May 3rd. What is the default model called? I have no idea. The release notes page [1] calls it ChatGPT model, the bottom of chat interface calls it "ChatGPT May 3 version".

Also people usually call out when they use GPT-4, but in the end you can only assume and be wrong 50% of time.

[1] https://help.openai.com/en/articles/6825453-chatgpt-release-...

Re: The Leverage of LLMs for Individuals

#46

Post by btbuildem »

pohl wrote: post #43
bostonsre wrote: post #33

Has anyone been able to use it to effectively build more than a green field poc? It's absolutely great for that, but it's been a little clunky when trying to iterate when the context gets too large or when trying to add stuff to am existing system.

The beauty of abstraction, though, is that it liberates a person from needing to worry about lower-level complexities. The same should be true for LLMs. It shouldn’t need to know your entire system. Start a new thread with judiciously restricted context when you move on to the next task.

Yup. We're back to the real problems that matter in sdev -- thinking about the problem, breaking it down, scoping things. Let an LLM do the grunt-work of writing the code, sure.

Re: The Leverage of LLMs for Individuals

#47

Post by Semaphor »

jstx1 wrote: post #18
smeagull wrote: post #16

Earlier quoted context omitted.

Yeah, but how do you get access to 4?

You need to pay for ChatGPT Plus, or sign up for their API (there’s a waitlist).

FWIW, I got API access quite quickly. Applied March 20, got access March 27. My application was only some 2 line bullshit, their example for "why do you want access" rewritten.

Re: The Leverage of LLMs for Individuals

#48

Post by plondon514 »

pugio wrote: post #39
plondon514 wrote: post #29

Earlier quoted context omitted.

I'm leveraging this to build https://codeamigo.dev . Basically it's learn to code, but with an AI assistant. The main reason people drop off of coding tutorials or stop learning is when they see their first error message. I'm already seeing people get un-stuck by using the AI as an assistant, this tech (GPT) is going to completely revolutionize learning.

Looks very cool. I am also working heavily in this space (using AI to help learning). One minor point: In your demo, you state that "Today, almost 50% of code is written by AI, so why shouldn't you learn how to code with AI?" Citation? I thought this might be true of developers using Copilot (based on their recent publications), but even that seems a bit of a stretch. I guess you could claim this because it's so easy…

Thanks for checking it out!

"Today, GitHub Copilot is behind an average of 46 percent of a developers' code across all programming languages -- and in Java, that number jumps to 61 percent." - https://visualstudiomagazine.com/articles/2023/02/15/copilot...

Re: The Leverage of LLMs for Individuals

#50

Post by hallway_monitor »

plondon514 wrote: post #48
pugio wrote: post #39

Earlier quoted context omitted.

Looks very cool. I am also working heavily in this space (using AI to help learning). One minor point: In your demo, you state that "Today, almost 50% of code is written by AI, so why shouldn't you learn how to code with AI?" Citation? I thought this might be true of developers using Copilot (based on their recent publications), but even that seems a bit of a stretch. I guess you could claim this because it's so easy…

Thanks for checking it out! "Today, GitHub Copilot is behind an average of 46 percent of a developers' code across all programming languages -- and in Java, that number jumps to 61 percent." - https://visualstudiomagazine.com/articles/2023/02/15/copilot...

This tracks since 90% of all Java code is boilerplate.
Post reply on HN