Any ETA on when will the new GPT4 turbo release out of preview. I really want to use it in my production app but 100 RTD limit is prohibiting that, I guess they will remove it once out of preview.
New models and developer products
511–520 of 561 posts
Re: New models and developer products
#512In the keynote @sama claimed GPT-4-turbo was superior to the older GPT-4. Have any benchmarks or other examples been shown? I am curious to see how much better it is, if it all. I remember when 3.5 got its turbo version there was some controversy on whether it was really better or not.
My early benchmarking seems to show that it's somewhat better for coding.
Re: New models and developer products
#513Earlier quoted context omitted.
> This type of post is actually more disruptive than the post you're replying to. As is yours. The author of that comment has contact information in their information, why not unicast them?
https://en.wikipedia.org/wiki/Paradox_of_tolerance > The paradox of tolerance states that if a society's practice of tolerance is inclusive of the intolerant, intolerance will ultimately dominate, eliminating the tolerant and the practice of tolerance with them. Karl Popper described it as the seemingly self-contradictory idea that, in order to maintain a tolerant society, the society must retain the right to be into…
> To answer your question more succinctly, because the poster isn't the only person who will read these comments.
I would bet the poster you replied to had the same intent.
Re: New models and developer products
#514Earlier quoted context omitted.
Related to the OpenAI announcement, I've been able to generate some preliminary code editing evaluations of the new GPT models. OpenAI is enforcing very low rate limits on the new GPT-4 model. I will update the results as quickly my rate limit allows. https://news.ycombinator.com/item?id=38172621 Also, aider now supports these new models, including `gpt-4-1106-preview` with the massive 128k context window. https://gi…
I do love aider, thanks for making it! I'd like an option to stop it from writing files everywhere, though, even if that means I have no history.
Thanks for trying aider! I'd like to better understand your concern about aider's support files. If you're able, maybe file an issue and I'd be happy to try and help make it work better for you.
Re: New models and developer products
#515Earlier quoted context omitted.
My open source ai coding tool aider is unique in that it is designed to work with existing code bases. You can jump into an existing git repo and start aaking for changes, new features, etc. https://github.com/paul-gauthier/aider It helps gpt understand larger code bases by building a "repository map" based on analyzing the abstract syntax tree of all the code in the repo. This is all built using tree-sitter, the sam…
How do you manage token limits when sending large amounts of code structure to OpenAI?
Aider has a "token budget" for the repository map (--map-tokens, default of 1k). It analyzes the AST of all the code in the repo, the call graph, etc... and uses a graph optimization algorithm to select the most relevant parts of the repo map that will fit in the budget.
There's some more detail in the recent writeup about the new tree-sitter based repo map that was linked in my comment above.
Re: New models and developer products
#516Earlier quoted context omitted.
> depends on how much developers are willing to […] getting locked onto their platform. I mean.. the lock in risks have been known with every new technology since forever now, and not just the risk but the actual costs are very real. People still buy HP printers with InkDRM and companies willingly write petabytes of data into AWS that they can’t even afford to egress at current prices. To be clear, I despise this bus…
Combination of 1) short-term business thinking (save $1 today = $1 more of EPS) and 2) fear of competition building AI products and taking share. thus rush to use first usable platform (e.g. openAI). Psychology and FOMO plays interesting role in walking directly into a snake pit.
100%.I was even gonna add to my comment that these psychological biases seem to particularly affect business people, but omitted to stay on point. I don’t think like that, but I also can’t say what works better on average, so I’ll try to stay humble.
Also, with AI there’s not really a “roll your own” option as with Cloud – the barrier of entry is gigantic, which obviously the VCs love, because as we all know they don’t like having to compete on price & quality on an open market.
Re: New models and developer products
#517Earlier quoted context omitted.
Or, alternatively, copyright risk is a major concern for real customers, and this is a major step forward in addressing that. Not everything needs to be so cynical. What’s good for investors can be good for users as well.
You’re talking about the issue as if it weren’t your posts, your pictures, or content of artists you are into. This isn’t a ”copyright risk“, it’s a Silicon Valley corporation getting away with declaring copyright just… obsolete.
> This isn’t a ”copyright risk“, it’s a Silicon Valley corporation getting away with declaring copyright just… obsolete.
While this does not fully represent my views on what's a very complex issue, since you phrased it like this, I feel compelled to say: about damn time someone did it.
Re: New models and developer products
#518Earlier quoted context omitted.
They are my content, actually, from the last ~15 years of being on the internet. I don't care about it personally, and even if I did it is really obviously fair use so even if I find it objectionable I don't get to actually legally compel someone to stop.
What on earth is fair use about a public company deriving its whole valuation from the processing of content taken from the internet without any regard for licensing, or robots.txt rules?? The technology is cool, I get it. But saying ”I don’t mind, they can use my content“ is on par with ”I don’t need privacy, I have nothing to hide“ in terms of statement quality.
Approximately all of that content becomes significantly more useful to society when fed into blender and released as ChatGPT, as long as the latter is generally available, and even accounting for it being for-profit, and any near-term consequences of propping up an SV company. By significantly I mean orders of magnitude, and that's going by the most naive take method of dividing utility flowing from ChatGPT by the size of training data.
So yeah, it may not be ideal, it's also of general public interest so much, that bringing up copyright seems... of poor taste.
(Curiously, I don't feel the same about image models. Perhaps that's because image models compete with current work of real artists. LLMs, at this point, don't meaningfully compete with anyone whose copyright their training possibly infringed.)
Re: New models and developer products
#519That map/travel demo was insane. Trying to find the demo again.
Yep I feel like they solved the problem that Apple never managed to solve with Siri: How to interface it with apps. Seems like this was an LLM-hard problem
Yes and no. Neither Apple nor Google even tried it properly. "[Siri|Ok Google], use ${brand 1} to ${brand 2} in ${brand 3}" isn't an integration - it's just an insidious form of brand advertising.
Re: New models and developer products
#520Earlier quoted context omitted.
Does it boggle anyone else's mind that ChatGPT was released less than a year ago? It definitely feels like it was around lot longer than that.
And there's people (most people) who aren't using it
what's really crazy to me is how fast it became mundane, this technology is still mind blowing to me but most people no longer seem impressed.