Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

New models and developer products

openai.com

Post reply on HN
Print view View original

551–560 of 561 posts

Re: New models and developer products

#551

Post by random_cynic »

torginus wrote: post #446
openquery wrote: post #378

If I had no contact with society from the 29th of November 2022 (the day before ChatGPT was released according to Wikipedia) and came back today to see the OpenAI keynote I would have lost my mind. The progress and usefulness of these products is absolutely incredible.

I'm sorry, what breakthrough feature did we see here? - Code interpreter, function calling were already possible on any sufficiently advanced LLM that could follow instructions well enough to output tokens in a rigidly parseable format, which could then be fed into a parser, and its output fed back to the LLM. It was clunky to do with online APIs like ChatGPT, but still eminently possible. - Custom chatbots were easy…

Lmao there are always these sort edgy keyboard warriors. If all of that was possible somebody else would have built it and we would not have the AI race today nor would NVIDIA shares skyrocket.

Re: New models and developer products

#552

Post by civilitty »

karmasimida wrote: post #471
estreeper wrote: post #292

Earlier quoted context omitted.

For embeddings specifically, there are multiple open source models that outperform OpenAI’s best model (text-embedding-ada-002) that you can see on the MTEB Leaderboard [1] > embedding-based approach will be cheaper and faster, but worse result than full text I’m not sure results would be worse, I think it depends on the extent to which the models are able to ignore irrelevant context, which is a problem [2]. Using r…

> on the MTEB Leaderboard The point isn't about leaderboard. With increasing context length, the question is on whether we need embeddings or not. With longer context length, embeddings is no longer a necessity, and it lowers its value.

For more trivial use cases, sure, but not for harder stuff like working with US law and precedent.

The US Code is on the order of tens of millions of tokens and I shudder to think how many billions of tokens make up all the judicial opinions that set or interpreted precedent.

Re: New models and developer products

#553

Post by throw03172019 »

StanAngeloff wrote: post #472
throw03172019 wrote: post #244

Earlier quoted context omitted.

This sounds amazing. Would you be willing to share your code? Thanks!

I run this[0] on Google Colab. The way I have it set up is to encode the meeting minutes to .ogg, push them to Google Drive, then adjust the script to tell it how many speakers there were and the topic of conversation. The `initial_prompt` really helps the model especially if you are talking about brand names, etc. that it may not know how to correctly transcribe. I've added a comment at the bottom of the Gist with s…

Wow, thanks so much for the in depth answer. This looks really great, I can’t wait to give it a try.

Re: New models and developer products

#554

Post by simonw »

danShumway wrote: post #538
btbuildem wrote: post #524

Earlier quoted context omitted.

The version above was really simplified. You need to iterate a little to get something that's too hard to break. Try this: https://chat.openai.com/share/7d091da1-729b-4678-98fe-def4f9...

I've seen this happen in these conversations too; a solution gets proposed, it gets bypassed, another solution gets proposed that manages to block the specific prompt, it gets bypassed, another solution gets proposed, and so on. And the eventual claim ends up being, "well, it's not easy but it's clearly possible ", even though nothing has actually been demonstrated that shows that it is possible. To try and shortcut…

That's a great explanation, especially "Applications occasionally have holes that are accessed using novel attacks, but it is possible to secure an interface in such a way that 100% of known attacks will not affect it." - that's fundamental to the challenge of prompt injection compared to other attacks like XSS and SQL injection.

The thing where people propose a solution, someone shows a workaround, they propose a new solution etc is something I've started calling "prompt injection Whack-A-Mole". I tend to bow out after the first two rounds!

Re: New models and developer products

#555

Post by asaddhamani »

toyg wrote: post #508
asaddhamani wrote: post #474

Earlier quoted context omitted.

I'd built a bot to use ChatGPT from Telegram (this was before the ChatGPT API), and currently building a tool to help make writing easier ( https://www.penpersona.com ). This is the API. Apart from that, it's pretty much replaced 80% of my search engine usage, I can ask it to collate reviews for a product from reddit and other sites, get the critical reception of a book, etc. You don't have to go and read long posts…

> currently building a tool to help make writing easier That's cool! > it's pretty much replaced 80% of my search engine usage That's not cool. That's how you end up relying on nonexisting sources or other hallucinations.

> That's not cool. That's how you end up relying on nonexisting sources or other hallucinations.

I have integrated a search engine plugin and a web browsing plugin, which means I don't have to do the search, for example I can ask it to compare the battery life of 3 phones, it'll do 3 searches, might open couple of reddit threads too, then give me the info that I need. It's miles ahead of the current experience with search engines.

Re: New models and developer products

#556

Post by qingcharles »

cubefox wrote: post #480
freedomben wrote: post #426

Earlier quoted context omitted.

The singularity is near is a great book. Hilarious that you read that for the second time and then got out and saw chat gpt! I love kurzweil but his estimates of timeline are often pretty over optimistic, so I'd be really wondering.

On Metaculus the arrival for weakly general AI was predicted for 2045 two years ago. Now it's at 2026. https://www.metaculus.com/questions/3479/date-weakly-general...

I would concur with those dates now.

When I read the book the first time about three years ago I thought "2045" is about right.

When I saw DALL-E 2 I thought "2030".

When I saw GPT4 I thought "2026".

Re: New models and developer products

#557

Post by Workaccount2 »

w-m wrote: post #284
throw2321 wrote: post #268

Earlier quoted context omitted.

I've been thinking about this for a while now, wrt two points: 1. This will be the end of traditional SWEs and the rise of the age of debuggers, human debuggers who spend their days setting up breakpoints and figuring bugs in a sea of LLM generated code. 2. Hiring will switch from using Leetcode questions to "pull out your debugger and figure out what's wrong with this code".

What makes you think the LLM couldn’t run a debugging session from the content of a JIRA ticket and the whole code base + documentation?

Nobody wants to face the potential that their skills are going to greatly decrease in value.

Re: New models and developer products

#558

Post by s3p »

faeriechangling wrote: post #51
minimaxir wrote: post #4

Most of the products announced (and the price cuts) appear to be more about increasing lock-in to the OpenAI API platform, which is not surprising given increased competition in the space. The GPTs/GPT Agents and Assistants demos in particular showed that they are a black box within a black box within a black box that you can't port anywhere else. I'm mixed on the presentation and will need to read the fine print on…

It's a good strategy. For me, avoiding the moat means either a big drop in quality and just ending up in somebody elses moat, or a big drop in quality and a lot more money spent. I've looked into it and maybe the most practical end-to-end system for owning my own LLM is to run a couple of 3090s on a consumer motherboard at substantial running cost to keep them up 24/7 and that's not powerful enough to cut it and rath…

This isn't subsidized. OpenAI makes money on their API and ChatGPT pricing.

Re: New models and developer products

#559

Post by stavros »

anotherpaulg wrote: post #514
stavros wrote: post #465

Earlier quoted context omitted.

I do love aider, thanks for making it! I'd like an option to stop it from writing files everywhere, though, even if that means I have no history.

Thanks for trying aider! I'd like to better understand your concern about aider's support files. If you're able, maybe file an issue and I'd be happy to try and help make it work better for you. https://github.com/paul-gauthier/aider/issues

Sure, thanks!

Re: New models and developer products

#560

Post by ukuina »

anotherpaulg wrote: post #541
ukuina wrote: post #539

Earlier quoted context omitted.

Any plans to open support up for other languages that tree-sitter supports?

Aider supports the repo map for bunch of languages already, see below. Is there one in particular you need that is missing? https://github.com/paul-gauthier/aider/tree/main/aider/queri...

Perl5, please!
Post reply on HN