Live data from Hacker News

The Leverage of LLMs for Individuals

mazzzystar.github.io

31–40 of 311 posts

Re: The Leverage of LLMs for Individuals

#33
Has anyone been able to use it to effectively build more than a green field poc? It's absolutely great for that, but it's been a little clunky when trying to iterate when the context gets too large or when trying to add stuff to am existing system.

Re: The Leverage of LLMs for Individuals

#34

Has anyone been able to use it to effectively build more than a green field poc? It's absolutely great for that, but it's been a little clunky when trying to iterate when the context gets too large or when trying to add stuff to am existing system.

> Has anyone been able to use it to effectively build more than a green field poc? It's absolutely great for that, but it's been a little clunky when trying to iterate when the context gets too large or when trying to add stuff to am existing system.

I'd like to see that too. Just this morning I got it to generate a whole lot of boilerplate. Then it appeared to get dementia: forgot which language the boilerplate was for, when I reminded it it then started creating type aliases for no reason, when I reminded it that the previous snippet (which was the first part of a single long snippet) didn't need those types, it switched languages again.

Very difficult once you get a long enough conversation going (something like 5 prompts in and it starts going haywire in random places).

Re: The Leverage of LLMs for Individuals

#35

Has anyone been able to use it to effectively build more than a green field poc? It's absolutely great for that, but it's been a little clunky when trying to iterate when the context gets too large or when trying to add stuff to am existing system.

I use AI to help my productivity while coding a lot. I handle the big system, it spits out code for me where i know what i want but don’t know the libraries/syntax.

Re: The Leverage of LLMs for Individuals

#36

This post reminded me that I’m still somewhat surprised ChatGPT-like systems did not arise out of China first due to their massive investment funds for AI and their base of stem talent. Once they catch-up their censors will have a super power and people will have their writings censored before they hit submit. Will be an interesting decade.

IMO China is a "long-term country". LLM does not lead to General Intelligence. While the former is profitable (financially and socially), the latter is the holy grail.

Time will name the winner.

Re: The Leverage of LLMs for Individuals

#37

The confusion in terms called out here (and even demonstrated) is probably not to OpenAI's benefit and I am surprised they haven't spent more effort in trying to correct that. ChatGPT is a website that lets you do chat completion [1] against LLM models, and it exposes some extra functions like plug-ins if you are lucky enough to be white listed for them. GPT 3.5 and GPT 4 are the actual models. Someone telling you th…

> Someone telling you that they did something cool with ChatGPT probably means GPT 3.

The confusion is that ChatGPT is using GPT-3.5 by default, but if you pay the $20/month subscription price, you can switch it over to GPT-4 (with query limits). Usually, when someone is telling you they did something really cool with ChatGPT, they're actually using GPT-4.

An extra layer of confusion is the API access: GPT-3.5-turbo and GPT-4 models are both optimized to be used in chat, which is somewhat different than earlier text completion models. Because of it, people using GPT-3.5 or GPT-4 via API access (possibly with one of the "alternative ChatGPT frontends"), will often also say they're using "ChatGPT". This is almost, but not completely accurate - the actual ChatGPT contains a bunch of hidden "features" (hidden prompt, extra moderation), that are mostly detrimental to the output/experience you get.

Re: The Leverage of LLMs for Individuals

#38

Has anyone been able to use it to effectively build more than a green field poc? It's absolutely great for that, but it's been a little clunky when trying to iterate when the context gets too large or when trying to add stuff to am existing system.

I see limited context and the lack of sandbox dev environment is the main obstacle on way to have more sophisticated usage and faster feedback loop. The value would be greater if it could know everything about the code base, business requirements, related documentation, and, it could even avoid a lot mistakes by simple running type checks and the tests and correct itself before giving the answer.

Re: The Leverage of LLMs for Individuals

#39
post #7

Learning something with GTP-4 is so much more fun than using google/Stack Overflow. It's like having a tutor that knows your code and gives you hints and solutions based on your actual project. It's a real game changer for learning

I'm leveraging this to build https://codeamigo.dev . Basically it's learn to code, but with an AI assistant. The main reason people drop off of coding tutorials or stop learning is when they see their first error message. I'm already seeing people get un-stuck by using the AI as an assistant, this tech (GPT) is going to completely revolutionize learning.

Looks very cool. I am also working heavily in this space (using AI to help learning).

One minor point: In your demo, you state that "Today, almost 50% of code is written by AI, so why shouldn't you learn how to code with AI?"

Citation? I thought this might be true of developers using Copilot (based on their recent publications), but even that seems a bit of a stretch. I guess you could claim this because it's so easy to generate LOTS of code with an AI model. How much of that code is used, though? Really 50% of ALL code written now?

Re: The Leverage of LLMs for Individuals

#40
There's a long gap from:

  I built a podcast search website
to:

  Staying in any company right now is a negative return.
We humans are too easily impressed by tricks, and are too willing to extrapolate them to fantasy land.

GPT can certainly accomplish an impressive variety of small tasks. Whether it can build large-scale systems that will power tomorrow's world is uncharted territory.

Can you build something meaningful, substantial, robust out of statistical knowledge, without real reasoning behind?

If you believe it's possible, where's everyone's array of profitable, newly-founded ventures? Or at least have you automated your job away yet?

Post reply on HN