What's up in the Python community? – April 2023 • Hacker News Board

Re: What's up in the Python community? – April 2023

#61

Post by axutio » Sat, Apr 29, 2023, 11:12 PM UTC

Spivak wrote: post #47

axutio wrote: post #29

Earlier quoted context omitted.

Is this a setup you've already built? Could you outline what you've glued together for this bot?

Oh sure! So the OCR is a statically linked build of tesseract based on [1] and pytesseract [2] which is a super thin wrapper but easier than writing it yourself. The I stole/modified the prompt from [3] to get the bot to write Python programs that do date calculations. Then I used [4] to take the output in case the Llm didn't use the format I asked. I run the Python code it generates in a rootless container that uses…

This is amazing, thank you for sharing!

Re: What's up in the Python community? – April 2023

#62

Post by ineedasername » Sat, Apr 29, 2023, 11:47 PM UTC

int_19h wrote: post #59

ineedasername wrote: post #45

Earlier quoted context omitted.

Any particular project that's prebuilt to not throw "out of ram" errors for it? I just want to play around with things without the restrictions ChatGPT. The OpenAI API is much less restrictive but can get pricey fast if I want quality above the lowest tier, at least for hobbyist purposes. I ran up a $10 charge in a few hours-- that's what I had budgeted for playing with a new "toy". It get's very tedious prompt engin…

What do you mean by "quality above the lowest tier"? ChatGPT-3.5 is the cheapest of their models right now, and it's also generally the best of all the 3.x ones, although the older GPT-3 models can sometimes beat it on non-task-oriented stuff (like long compositions).

>"What do you mean by "quality above the lowest tier"?

OpenAI's API allows you to choose different models in the GPT3 series. Cost increases with quality. AFAIK GPT3.5 corresponds to their davinci-03 model, and it's the most expensive one to use.

Re: What's up in the Python community? – April 2023

#63

Post by int_19h » Sun, Apr 30, 2023, 2:23 AM UTC

ineedasername wrote: post #62

int_19h wrote: post #59

Earlier quoted context omitted.

What do you mean by "quality above the lowest tier"? ChatGPT-3.5 is the cheapest of their models right now, and it's also generally the best of all the 3.x ones, although the older GPT-3 models can sometimes beat it on non-task-oriented stuff (like long compositions).

>"What do you mean by "quality above the lowest tier"? OpenAI's API allows you to choose different models in the GPT3 series. Cost increases with quality. AFAIK GPT3.5 corresponds to their davinci-03 model, and it's the most expensive one to use.

That's the thing - "cost increases with quality" is not really true anymore. When they released gpt-3.5-turbo in the API, it was massively cheaper than all their older stuff, but it generally produces better output. OTOH text-davinci-003 is the older GPT-3.5 model that is not fine-tuned for chat (which is where much of task solving capability of ChatGPT seems to be coming from).