New models and developer products

Post by torginus » Tue, Nov 07, 2023, 7:30 AM UTC

awestroke wrote: post #457

torginus wrote: post #446

Earlier quoted context omitted.

I'm sorry, what breakthrough feature did we see here? - Code interpreter, function calling were already possible on any sufficiently advanced LLM that could follow instructions well enough to output tokens in a rigidly parseable format, which could then be fed into a parser, and its output fed back to the LLM. It was clunky to do with online APIs like ChatGPT, but still eminently possible. - Custom chatbots were easy…

You're completely ignoring image analysis.

Post by stavros » Tue, Nov 07, 2023, 7:58 AM UTC

minimaxir wrote: post #4

Most of the products announced (and the price cuts) appear to be more about increasing lock-in to the OpenAI API platform, which is not surprising given increased competition in the space. The GPTs/GPT Agents and Assistants demos in particular showed that they are a black box within a black box within a black box that you can't port anywhere else. I'm mixed on the presentation and will need to read the fine print on…

Post by stavros » Tue, Nov 07, 2023, 8:04 AM UTC

anotherpaulg wrote: post #419

anotherpaulg wrote: post #330

Earlier quoted context omitted.

My open source ai coding tool aider is unique in that it is designed to work with existing code bases. You can jump into an existing git repo and start aaking for changes, new features, etc. https://github.com/paul-gauthier/aider It helps gpt understand larger code bases by building a "repository map" based on analyzing the abstract syntax tree of all the code in the repo. This is all built using tree-sitter, the sam…

Related to the OpenAI announcement, I've been able to generate some preliminary code editing evaluations of the new GPT models. OpenAI is enforcing very low rate limits on the new GPT-4 model. I will update the results as quickly my rate limit allows. https://news.ycombinator.com/item?id=38172621 Also, aider now supports these new models, including `gpt-4-1106-preview` with the massive 128k context window. https://gi…

Post by flaviolivolsi » Tue, Nov 07, 2023, 8:05 AM UTC

doubtfuluser wrote: post #442

With the assistant API, am I wrong or is it now much cheaper to actually use the API instead of the web Interface? $20 would cover a lot of interactions with the API, and since it’s now also doing truncation / history augmentation the API would have pretty much the same functionality. Thoughts?

Post by stavros » Tue, Nov 07, 2023, 8:10 AM UTC

lucubratory wrote: post #279

MagicMoonlight wrote: post #240

Earlier quoted context omitted.

It’s insane because it makes no sense. When you read a book you don’t remember the last 100,000 words. It’s so wildly inefficient to do it that way.

Huh? By the time you finish reading a book you've forgotten the book?