431–440 of 561 posts
The 128k context window GPT-4 Turbo model looks unreal. Seems like Anthropic's day of reckoning is here?
Anthropic doesn't care about consumer products. Their CEO believes that the company with the best LLM by 2026 will be too far ahead for anyone else to catch up.
Every day this video ages more and more poorly [1]. categories of startups that will be affected by these launches: - vectorDB startups -> don't need embeddings anymore - file processing startups -> don't need to process files anymore - fine tuning startups -> can fine tune directly from the platform now, with GPT4 fine tuning coming - cost reduction startups -> they literally lowered prices and increased rate limits…
If you want to be a start-up using AI, you have to be in another industry with access to data and a market that OpenAI/MS/Google can't or won't touch. Otherwise you end up eaten like above.
Earlier quoted context omitted.
My open source ai coding tool aider is unique in that it is designed to work with existing code bases. You can jump into an existing git repo and start aaking for changes, new features, etc. https://github.com/paul-gauthier/aider It helps gpt understand larger code bases by building a "repository map" based on analyzing the abstract syntax tree of all the code in the repo. This is all built using tree-sitter, the sam…
Related to the OpenAI announcement, I've been able to generate some preliminary code editing evaluations of the new GPT models. OpenAI is enforcing very low rate limits on the new GPT-4 model. I will update the results as quickly my rate limit allows. https://news.ycombinator.com/item?id=38172621 Also, aider now supports these new models, including `gpt-4-1106-preview` with the massive 128k context window. https://gi…
Earlier quoted context omitted.
Is it the same as avoiding AWS because they will take your software and run it themselves to steal your clients?
This hasn't happened often, but it has happened. Elastic search for example. Also dynamo db.
AWS took an open source project (Elastic) and forked it. They did not take an AWS customer's code.
Earlier quoted context omitted.
How many GBs worth of logits would you need to reverse engineer their model? Also, if it’s a conglomerate of models that they’re using, you’d end up in a blind alley.
Considering how well simply reusing GPT-3.5/4 outputs has worked to juice rival model performance, at least in relatively narrow benchmarking, I dunno how many GBs it'd take, but probably not that many, and it's a straightforward easy way to turn money into performance at a much lower cost than buying a few thousand more H100s.
The most sinister interpretation is that the logits are a red herring. People who are tied up in stealing them aren’t free to do actual rival work.
Whisper V3 is released! https://github.com/openai/whisper/commit/c5d42560760a05584c1... Looks like it's just a new checkpoint for the large model. It would be nice to have updates for the smaller models too. But it'll be easy to integrate with anything using Whisper V2. I'm excited to add it to my local voice AI ( https://www.microsoft.com/store/apps/9NC624PBFGB7 ) I assume ChatGPT voice has been using Whisper V3 and…
Earlier quoted context omitted.
Yes, nowhere in the text today was there any assertion that Turbo produces (eg) source code at the same level of coherence and consistently high quality as GPT4.
Altman did specifically say it’s a “better model” than GPT4, but that’s “better” is vague enough that it might not actually be in terms of accuracy.
Earlier quoted context omitted.
> Assistants demos in particular showed that they are a black box within a black box within a black box that you can't port anywhere else. I'd argue the opposite. The new "Threads" interface in the OpenAI admin section lets you see exactly how it's interpreting input/output specifically to address the black box effect. Source: https://platform.openai.com/docs/api-reference/runs/listRunS... tells you exactly how it's…
I agree that some parts of the process now seem more like “open”, but there is definitely a lot more magic in the new processing. Namely, threads can have an arbitrary length, and OpenAI automatically handles context window management for you. Their API now also handles retrieval of information from raw files, so you don’t need to worry about embeddings. Lastly, you don’t even need any sort of database to keep track…
As for lock in, agreed completely.