New models and developer products • Hacker News Board

Re: New models and developer products

#191

Post by minimaxir » Mon, Nov 06, 2023, 8:49 PM UTC

danenania wrote: post #183

minimaxir wrote: post #132

Earlier quoted context omitted.

The function calling is JSON Schema support but extremely poorly marketed. I am planning on writing a blog post about it.

Yeah I'm not sure I see the point of "JSON mode", in its current iteration at least, considering function calling already does this more effectively. I suppose it could help to make simpler API calls and save some prompt tokens, but it would definitely need schema support to really be useful.

It makes it a bit easier to parse returned tabular data, anyways.

I'll be curious to see if it can handle outputting nested data without prompting.

Re: New models and developer products

#192

Post by razodactyl » Mon, Nov 06, 2023, 8:49 PM UTC

danielmarkbruce wrote: post #180

coder543 wrote: post #126

Earlier quoted context omitted.

The person I replied to had decided to compare Mistral to what was launched, so I went along with their comparison and showed how I have been unsatisfied with it. But, these open models can certainly be fun to play with. Regardless, where did you find 1.8T for GPT-4 Turbo? The Turbo model is the one with the 128K context size, and the Turbo models tend to have a much lower parameter count from what people can tell. N…

It's an order of magnitude comparison. Let's just agree it's 100x-300x more parameters, and let's assume the open ai folks are pretty smart and have a sense for the optimal number of tokens to train on.

This definitely. Andrej Karpathy himself mentions tuned weight initialisation in one of his lectures. The TinyGPT code he wrote goes through it.

Additionally explanations for the raw mathematics of log likelihoods and their loss ballparks.

Interesting low-level stuff. These researchers are the best of the best working for the company that can afford them working on the best models available.

Re: New models and developer products

#193

Post by dnadler » Mon, Nov 06, 2023, 8:49 PM UTC

rictic wrote: post #47

topicseed wrote: post #23

Earlier quoted context omitted.

It was but most of that functionality was within the "function calling", not really within the assistant as a top 10 of Paris sights isn't really that crazy. Plotting these on a map is the key part which is still your own code, not GPT-based.

Turning an airline receipt pdf into a well structured function call is very nice.

This might also be a bit easier than it seems. I've done similar (though not nearly as nice of a UI) with `unstructured`.

Re: New models and developer products

#194

Post by airstrike » Mon, Nov 06, 2023, 8:50 PM UTC

pclmulqdq wrote: post #107

ebiester wrote: post #59

Earlier quoted context omitted.

I don't understand the lock-in argument here. Yes, if a competitor comes in there will be switching cost as everything is re-learned. However, from a code perspective, it is a function of the key and a relatively small API. New regulations outstanding, what is stoping someone from moving from OpenAI to Anthropic (for example) other than the cost of learning how to effectively utilize Anthropic for your use case? Open…

[flagged]

> Please don't post insinuations about astroturfing, shilling, brigading, foreign agents, and the like. It degrades discussion and is usually mistaken. If you're worried about abuse, email hn@ycombinator.com and we'll look at the data.

https://news.ycombinator.com/newsguidelines.html

Re: New models and developer products

#195

Post by riku_iki » Mon, Nov 06, 2023, 8:52 PM UTC

make3 wrote: post #187

riku_iki wrote: post #162

Earlier quoted context omitted.

> - vectorDB startups -> don't need embeddings anymore they don't provide embedings, but storage and query engines for embeddings, so still very relevant > - file processing startups -> don't need to process files anymore curious what is that exactly?.. > - vertical ai agent startups -> GPT marketplace sure, those startups will be selling their agents on marketplace

they definitely do provide embeddings, https://openai.com/blog/new-models-and-developer-products-an... ctrl+f retrieval, "... won't need to ... compute or store embeddings"

I mean embeddingsDB startups don't provide embeddings. They provide databases which allows to store and query computed embeddings (e.g. computed by ChatGPT), so they are complimentary services.

Re: New models and developer products

#196

Post by [deleted] » Mon, Nov 06, 2023, 8:52 PM UTC

ianbicking wrote: post #37

modeless wrote: post #12

Whisper V3 is released! https://github.com/openai/whisper/commit/c5d42560760a05584c1... Looks like it's just a new checkpoint for the large model. It would be nice to have updates for the smaller models too. But it'll be easy to integrate with anything using Whisper V2. I'm excited to add it to my local voice AI ( https://www.microsoft.com/store/apps/9NC624PBFGB7 ) I assume ChatGPT voice has been using Whisper V3 and…

Do you also get those hallucinations just on silence? I kind of wonder if they had a bunch of training data of video with transcripts, but some of the video/audio was truncated and the transcript still said the last speech, and so now it thinks silence is just another way of signing off from a TV program. IMHO the bottleneck on voice now is all the infrastructure around it. How do you detect speech starting and stopp…

[deleted]

Re: New models and developer products

#197

Post by tyree731 » Mon, Nov 06, 2023, 8:53 PM UTC

bluck wrote: post #164

Copyright Shield > OpenAI is committed to protecting our customers with built-in copyright safeguards in our systems. Today, we’re going one step further and introducing Copyright Shield—we will now step in and defend our customers, and pay the costs incurred, if you face legal claims around copyright infringement. This applies to generally available features of ChatGPT Enterprise and our developer platform. So essen…

I am not a lawyer, but this doesn't seem quite "free". Note that they aren't indemnifying customers for any consequences of said legal claims, meaning that customers would seem to bare the full brunt of those consequences should there be a credible copyright infringement claim.

Re: New models and developer products

#198

Post by layer8 » Mon, Nov 06, 2023, 8:53 PM UTC

The TTS seems really nice, though still relatively expensive, and probably limited to English (?). I can’t wait until that level of TTS will become available basically for free, and/or self-hosted, with multi-language support, and ubiquitous on mobile and desktop.

Re: New models and developer products

#199

Post by danielmarkbruce » Mon, Nov 06, 2023, 8:55 PM UTC

gwern wrote: post #103

> We’re also launching a feature to return the log probabilities for the most likely output tokens generated by GPT-4 Turbo and GPT-3.5 Turbo in the next few weeks, which will be useful for building features such as autocomplete in a search experience. This is very surprising to me. Are they not worried about people not just training on GPT-4 outputs to steal the model capabilities, but doing full blown logit knowled…

I thought the same thing.... My guess is they did a lot of analysis and decided it would be safe enough to do? "most likely" might be literally a handful and cover little of the entire distribution % wise?

Re: New models and developer products

#200

Post by ShakataGaNai » Mon, Nov 06, 2023, 8:55 PM UTC

bluck wrote: post #164

Copyright Shield > OpenAI is committed to protecting our customers with built-in copyright safeguards in our systems. Today, we’re going one step further and introducing Copyright Shield—we will now step in and defend our customers, and pay the costs incurred, if you face legal claims around copyright infringement. This applies to generally available features of ChatGPT Enterprise and our developer platform. So essen…

For large-scale usage, it doesn't matter what the devs want. If the lawyers show up and say "We can't use this technology because we're probably going to get sued for copyright infringement", it's dead in the water.

It's a logical "feature" for them to offer this "shield" as it significantly mitigates one of the large legal concerns to date. It doesn't make the risks fully go away, but if someone else is going to step up and cover the costs, then it could be worthwhile.

For large enterprises, IP is a big deal, probably the single biggest concern. They'll spend years and billions of dollars attempting to protect it, cough sco/oracle cough, right or wrong.