Live data from Hacker News

The Leverage of LLMs for Individuals

mazzzystar.github.io

261–270 of 311 posts

Re: The Leverage of LLMs for Individuals

#261
post #256

Earlier quoted context omitted.

> Tutoring me on how to use poorly documented APIs Good luck with that. GPT-4 is _incredibly_ bad at Metal (most under-documented GPU api I've ever worked with), but more importantly it's _even worse_ at Vulkan, which is complete opposite - it's meticulously documented. The stuff LLMs are good at is the stuff that a lot of people use and talk about all the time, in public. There's just not a lot of public discussion…

It has an 8kb (or 32kb if you are lucky) context. Try giving it the relevant documentation examples before asking a question.

the point the grandparent was making was that GPT-4 can teach you how to use an under-documented API. that means the relevant docs are either sparse or non-existent, otherwise there wouldn't be a need to ask GPT-4 in the first place.

Re: The Leverage of LLMs for Individuals

#262

Has anyone been able to use it to effectively build more than a green field poc? It's absolutely great for that, but it's been a little clunky when trying to iterate when the context gets too large or when trying to add stuff to am existing system.

I've used ChatGPT-4 to create new components in a larger game of mine. I provided an example class that does something similar and an interface and it flawlessly created a new component the way that I would have with the new functionality, in like 10 seconds. I've also used it to create new functionality in the game, but those were mostly isolated features. Like I implemented controller rumble support yesterday in ab…

BTW, turns out changing to CullClockwise for the RasterizerState made the graph show up again, so the order of the vertices were in the opposite order, which it also noted and provided the corrected code for it (basically just reversing the order of vertices), so I could set it back to the default of CounterClockwise again.

Now on to curved corners!

Re: The Leverage of LLMs for Individuals

#263
post #257
post #249

Earlier quoted context omitted.

I'll be really impressed the day models can generate code by just grokking the language spec and documentation.

It can do that now. Has an 8kb (or 32kb) context. You might need to do a bit of work preparing a concise description and language examples.

Does anyone have any blog posts that elaborate on this?

Re: The Leverage of LLMs for Individuals

#264

> More importantly, it gives me the courage to dream and attempt things beyond my current abilities. This is one of the small things that GPT has pushed me to do. I'm an experienced programmer and grew up playing video games, but I am not a game developer. I've dabbled over the years but can't build anything outside of a tutorial. The other day, using GPT I went through and made a Pixel Dungeon clone using Phaser (Ja…

release it !

Re: The Leverage of LLMs for Individuals

#265
post #154

Earlier quoted context omitted.

> If you believe it's possible, where's everyone's array of profitable, newly-founded ventures? Or at least have you automated your job away yet? Come on now. GPT 4 is not even out for two months. API access is not yet widely available. Legal questions are preventing many conservative players from adoption. How fast do you think progress propagates?

On top of no generally available API, GPT-4 in ChatGPT is really damn slow right now. Unless you have a special deal (Microsoft) the only performant option is 3.5-turbo. In my experience for coding and text summarization it’s totally fine with a limited benefit from GPT-4, which is more impressive at higher order reasoning and planning.

Interestingly (or not), Perplexity's GPT-4 chatbot is noticeably faster than ChatGPT-4 for me. I don't find its implementation quite as helpful, though, which is weird I think?

Re: The Leverage of LLMs for Individuals

#266
post #7

Learning something with GTP-4 is so much more fun than using google/Stack Overflow. It's like having a tutor that knows your code and gives you hints and solutions based on your actual project. It's a real game changer for learning

I'm leveraging this to build https://codeamigo.dev . Basically it's learn to code, but with an AI assistant. The main reason people drop off of coding tutorials or stop learning is when they see their first error message. I'm already seeing people get un-stuck by using the AI as an assistant, this tech (GPT) is going to completely revolutionize learning.

Your website looks nice, but I don't like this statement: "Today's developers didn't learn C before learning Python [...]" Makes me feel like I am a "yesterday's developer" and that it is bad thing.

Re: The Leverage of LLMs for Individuals

#267
post #146

> More importantly, it gives me the courage to dream and attempt things beyond my current abilities. This is one of the small things that GPT has pushed me to do. I'm an experienced programmer and grew up playing video games, but I am not a game developer. I've dabbled over the years but can't build anything outside of a tutorial. The other day, using GPT I went through and made a Pixel Dungeon clone using Phaser (Ja…

I’ve been using it a lot for programming, but I also have a security background and it will often generate insecure code. I’ll point it out and tell it to fix and it will. So be careful if you don’t want AI-generated sql intentions!

> So be careful if you don’t want AI-generated sql intentions!

Maybe we should try including something like this in the system prompt:

"Remember that SQL is language with a grammar, not an unstructured string. Don't do stupid things. Obey the LangSec principles. Never ever glue code in strings together. Plaintext code is not code, it's a serialization format for code. Use appropriate parsed representation for all operations. Never work in plaintext space, when you should be working in AST-space."

Replace "SQL" with any other sub-language that's interacting with user input.

Re: The Leverage of LLMs for Individuals

#268

> More importantly, it gives me the courage to dream and attempt things beyond my current abilities. This is one of the small things that GPT has pushed me to do. I'm an experienced programmer and grew up playing video games, but I am not a game developer. I've dabbled over the years but can't build anything outside of a tutorial. The other day, using GPT I went through and made a Pixel Dungeon clone using Phaser (Ja…

I am software engineer and I have certainly attempted use GPT for coding with mixed results. But what I am really impressed using it for writing. I am writing the story of my abusive upbringing with a mental ill mother. I am not a writer, but this thing is awesome because I can ask it to give me prompts and it is jogging my memory more and more then I can give it rough outlines and thoughts and it will organize it in…

I use GPT-4 for coding and technical tasks every day, its abilities to make ideas a reality which would otherwise take me days or weeks is astonishing.

I wanted to try to make real-world terrain in Unity - GPT-4 guided me to the USGS's LiDAR data, took me step-by-step through creating a mesh from a point cloud, and created several scripts to edit and filter the mesh programmatically.

There are some caveats and many dead-end conversation branches - GPT-4 seems to know 'about' more libraries than it actually knows how to use, so certain library choices tend to produce erroneous code.

GPT-4 sometimes picks a poor method, for example conflicting methods of moving an object in a single script, but can usually resolve the issue when notified.

Dozens of hours fiddling with technical details saved.

Re: The Leverage of LLMs for Individuals

#269
post #256

Earlier quoted context omitted.

It has an 8kb (or 32kb if you are lucky) context. Try giving it the relevant documentation examples before asking a question.

the point the grandparent was making was that GPT-4 can teach you how to use an under-documented API. that means the relevant docs are either sparse or non-existent, otherwise there wouldn't be a need to ask GPT-4 in the first place.

No, that wasn’t my point. You don’t need docs, just feed in the raw source code. GPT4 can make sense of code without documentation.

Re: The Leverage of LLMs for Individuals

#270
post #203

I feel we have been given a very valuable tool. I think the most sublte aspect for personal use is the freedom from having to ask seemingly stupid questions. It turns out there are a lot of interesting things on this earth. While a good education can prepare you for a lot, nobody knows everything. Asking seemingly stupid questions can be an issue for some. I have tried to cultivate this ability during my lifetime, an…

> freedom from having to ask seemingly stupid questions With almost no risk of receiving a rude answer
Post reply on HN