Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Command line functions around OpenAI

kadekillary.work

Post reply on HN
Print view View original

171–180 of 316 posts

Re: Command line functions around OpenAI

#171

Post by therealdrag0 »

daveslash wrote: post #163
ChrisBland wrote: post #61

Writing code is the basic 101 of our industry. Anyone can write a loop or an if statement. With todays computing power, for most applications even poorly written code will run and will execute quite fast. What makes someone a 10x (and i hate that term) is the ability to take requirements, or better yet, a vague idea given to them by the business and turn that into software that benefits the end user and makes the com…

RE>> Anyone can write a loop or an if statement. I had an intern a few years ago -- recent college grad in CompSci. I tried my best to lightly mentor him. One day I was talking about the diff between a compiled language and scripting, mentioned REPL. To demonstrate REPL, I opened up both the windows CMD prompt and the Chrome Developer tools. I mentioned that with a REPL like the Chrome Tools, it's trivial to do FizzB…

Insane to be able to graduate like that..

Re: Command line functions around OpenAI

#172

Post by xnx »

Clubber wrote: post #40
xnx wrote: post #37

I didn't believe in 10x developers until I met a 0.1x developer.

I would argue there are -1x developers because regular developers have to go back and fix/refactor/rewrite the code later, thus create a net negative. I've always been curious what people feel the baseline of a 10x is (i.e. 1x). Is it a fresh developer out of college or what?

Great point. Maybe it's relative if everyone thinks they are a 1x developer.

Re: Command line functions around OpenAI

#173

Post by usrbinbash »

Okay, let's talk about a theoretical figure, called the "1000x novelist", a very productive author who uses advanced AI to write novels really fast. Clearly super productive, because novels get written so very fast.

Now, here is a question:

George R.R. Martin has been writing on the 6th book of "Game of Thrones", titled "The Winds of Winter" (TWoW) for over 10 years. It still isn't finished.

What do you think, which will sell more copies: TWoW, or all novels of the 1000x novelist combined?

Re: Command line functions around OpenAI

#174

Post by shagie »

synergy20 wrote: post #160
shagie wrote: post #116

Earlier quoted context omitted.

> is there a way for shell script to maintain context session somehow? Feed the output of the previous prompt back into itself. If you look at https://platform.openai.com/playground/p/default-chat?model=... you will see that the prompt for the next line is all of the previous generation conversation. This can consume tokens at an accelerating rate.

"Human: you seem to remember the context of the chat, how many context you keep, the most recent previous output, or a few conversations AI: I generally remember the last few conversations and I'm also capable of keeping context in longer conversations." I don't think there is a way to feed context back to the script efficiently, maybe need a local database or a queue of certain length to sustain the subject. To mimi…

ChatGPT feeds the context of the conversation back into itself. When it hits max tokens, it then summarizes the conversation to feed back into itself. This is one of the things where ChatGPT can start losing track of what it was talking about if that summary doesn't have key things in it or missummrizes the conversation.

For

    The following is a conversation with an AI assistant. The assistant is helpful, creative, clever, and very friendly.

    Human: Hello, who are you?
    AI: I am an AI created by OpenAI. How can I help you today?
    Human: I am fine.  Working hard.
It will then add in some text in line:

    The following is a conversation with an AI assistant. The assistant is helpful, creative, clever, and very friendly.

    Human: Hello, who are you?
    AI: I am an AI created by OpenAI. How can I help you today?
    Human: I am fine.  Working hard.
    AI: That's great to hear! Do you need any assistance with anything?
    Human: How many peks are in a bushel?
This is 93 tokens.

And then I get:

    The following is a conversation with an AI assistant. The assistant is helpful, creative, clever, and very friendly.

   Human: Hello, who are you?
   AI: I am an AI created by OpenAI. How can I help you today?
   Human: I am fine.  Working hard.
   AI: That's great to hear! Do you need any assistance with anything?
   Human: How many peks are in a bushel?
   AI: A bushel contains 8 US (or 32 UK) pecks. Is there anything else I can help you with?
Human:

And then...

    The following is a conversation with an AI assistant. The assistant is helpful, creative, clever, and very friendly.

    Human: Hello, who are you?
    AI: I am an AI created by OpenAI. How can I help you today?
    Human: I am fine.  Working hard.
    AI: That's great to hear! Do you need any assistance with anything?
    Human: How many peks are in a bushel?
    AI: A bushel contains 8 US (or 32 UK) pecks. Is there anything else I can help you with?
    Human: What produces does that measure?
    AI: A bushel is a dry measure used for measuring fruits, vegetables, and other grain products.
    Human:
You will see each time it is feeding in the entire chat history as part of the prompt. That is how you maintain the context of the chat.

To do this as part of a command line interface, yep - it would need something like .gpthistory which gets fed in to each message... though this eats tokens.

You can see some of this in the playground if you look at the 'view code' button at the top.

Re: Command line functions around OpenAI

#175

Post by ericmcer »

roenxi wrote: post #10

Being efficient at writing code can barely make someone a 5x engineer. A team of people who write code effectively is easy to do. Hyperproductivity in software is all about deciding what problems to tackle. Richard Hipp isn't worried about chipotle restaurant orders in golang, he's worried about how to store data reliably. That isn't a coding puzzle that ChatGTP is likely to help with. Either ChatGTP can do the whole…

The most direct example of this to me is in video games, there are 10s of thousands of failed games with amazing art and coding behind them, but then weekend projects like Flappy bird, Vampire Survivors and Wordle make it big. They just were lucky enough to find the right angle, a team of 100 PHDs working 10X as long would find less success.

Re: Command line functions around OpenAI

#176

Post by [deleted] »

therealdrag0 wrote: post #171
daveslash wrote: post #163

Earlier quoted context omitted.

RE>> Anyone can write a loop or an if statement. I had an intern a few years ago -- recent college grad in CompSci. I tried my best to lightly mentor him. One day I was talking about the diff between a compiled language and scripting, mentioned REPL. To demonstrate REPL, I opened up both the windows CMD prompt and the Chrome Developer tools. I mentioned that with a REPL like the Chrome Tools, it's trivial to do FizzB…

Insane to be able to graduate like that..

[deleted]

Re: Command line functions around OpenAI

#177

Post by sillysaurusx »

usrbinbash wrote: post #173

Okay, let's talk about a theoretical figure, called the "1000x novelist", a very productive author who uses advanced AI to write novels really fast. Clearly super productive, because novels get written so very fast. Now, here is a question: George R.R. Martin has been writing on the 6th book of "Game of Thrones", titled "The Winds of Winter" (TWoW) for over 10 years. It still isn't finished. What do you think, which…

The latter, of course. That’d be like pitting an army of Stephen Kings against him.

Their net worths show it: $65M for Martin vs $450M for King.

Re: Command line functions around OpenAI

#178

Post by surgical_fire »

angarg12 wrote: post #151
roenxi wrote: post #10

Being efficient at writing code can barely make someone a 5x engineer. A team of people who write code effectively is easy to do. Hyperproductivity in software is all about deciding what problems to tackle. Richard Hipp isn't worried about chipotle restaurant orders in golang, he's worried about how to store data reliably. That isn't a coding puzzle that ChatGTP is likely to help with. Either ChatGTP can do the whole…

I discussed my experience using ChatGPT in HN before and I was accused of being skeptical. But it isn't true at all, I think LLMs are a wonderful tool that will change software development. However I'm not worried about losing my job. As you say, I find the act of writing code is hardly the bottleneck to my productivity. One of the best case scenarios, LLMs become the ultimate high level language. In that case, Softw…

> As you say, I find the act of writing code is hardly the bottleneck to my productivity.

When people claim ChatGPT can replace software engineers because it can sort of code is always puzzling to me. 20 years into this career, and writing code is only a minor part of my day-to-day activities.

A part I do enjoy doing, but still minor part nonetheless.

> What if you design an organization so that coding is the bottleneck? How transformative would LLMs be?

The funny thing is that although ChatGPT has been an amazing coding assistant tool, it can't meaningfully write code beyond boilerplate to me. I use it more as search engine on steroids, rather than actually relying on the code it writes.

A few times it even got into a hallucination loop going through different flavors of uncompilable code when I asked "how to do X using library Y", and refining the question was getting nowhere.

ChatGPT is an amazing tool that provides me value beyond the 20 bucks per month I pay. But still has far too many limitations. It's sort of funny to see people LARPing that it will kill knowledge jobs in the near term.

Re: Command line functions around OpenAI

#179

Post by saulpw »

Alex3917 wrote: post #146
bckr wrote: post #131

Earlier quoted context omitted.

Say more

Usually the person with the ability to create the best products and services is the one with the deepest reservoir of background knowledge and aesthetic taste that they can apply to a given problem. So, for example, someone who can productively spend 100 hours working on a blog post is probably going to get win out against someone who can only productively spend 5 hours working a blog post on the same topic. And give…

Unfortunately the person who only spends 1 hour working on a blog post, but can spend 100 hours cranking out 100 blog posts, wins out. See Simon Willison, for example.

Re: Command line functions around OpenAI

#180

Post by novaRom »

brundolf wrote: post #161
roenxi wrote: post #10

Being efficient at writing code can barely make someone a 5x engineer. A team of people who write code effectively is easy to do. Hyperproductivity in software is all about deciding what problems to tackle. Richard Hipp isn't worried about chipotle restaurant orders in golang, he's worried about how to store data reliably. That isn't a coding puzzle that ChatGTP is likely to help with. Either ChatGTP can do the whole…

I think code-generation is a red herring. I'm more interested in things like: - Explanation/research ("how does this work?") - Code analysis ("tell me if you think you see any bugs, refactoring suggestions, etc in this sprawling legacy codebase") Things that feed into the developer's thought process instead of crudely trying to execute on what it wants

Unfortunately, LLMs are still prone to make facts up, and very persuasively. In fact, most of non-trivial topics I tried have required double-/triple- checking, so it's sometimes not really productive to use chatGPT.

You are correct that I made an error in my previous response.

I apologize for the confusion I may have caused in my previous response

I appreciate you bringing this to my attention.

I apologize, thank you for your attention to detail!

Post reply on HN