Live data from Hacker News

GitHub cuts AI deals with Google, Anthropic

bloomberg.com

121–130 of 742 posts

Re: GitHub cuts AI deals with Google, Anthropic

#122

Earlier quoted context omitted.

I removed it from windows and I'm still very productive. Probably moreso, since I don't have to make constant corrections. To each their own.

GitHub Copilot and Microsoft Copilot are different products

Same difference. They both are glorified liberians.

Re: GitHub cuts AI deals with Google, Anthropic

#123

History has shown being first to market isn't all it's cut out to be. You spend more, it's more difficult creating the trail others will follow, you end up with a tech stack that was built before tools and patterns stabilized and you've created a giant super highway for a fast-follower. Anyone remember MapQuest, AltaVista or Hotmail? OpenAI has some very serious competition now. When you combine that with the recent…

Claude is better than OpenAI for most tasks, and yet OpenAI has enormously more users. What is this, if not first mover advantage?

Claude is only better in some cherry picked standard eval benchmarks, which are becoming more useless every month due to the likelihood of these tests leaking into training data. If you look at the Chatbot Arena rankings where actual users blindly select the best answer from a random choice of models, the top 3 models are all from OpenAI. And the next best ones are from Google and X.

Re: GitHub cuts AI deals with Google, Anthropic

#125
post #24

Earlier quoted context omitted.

I too use Claude more frequently than OpenAi GPT4o. I think this is a two fold move for MS and I like it. Claude being more accurate / efficient for me says it's likely they see the same thing, win number 1. The second is with all the OpenAI drama MS has started to distance themselves over a souring relationship (allegedly). If so, this could be a smart move away tactfully. Either way, Claude is great so this is a ne…

Yeah, Claude consistently impresses me. A commenter on another thread mentioned it but it’s very similar to how search felt in the early 2000s. I ask it a question and get my answer. Sometimes it’s a little (or a lot) wrong or outdated, but at least I get something to tinker with.

I recently tried to ask these tools for help with using a popular library, and both GPT-4o and Claude 3.5 Sonnet gave highly misleading and unusable suggestions. They consistently hallucinated APIs that didn't exist, and would repeat the same wrong answers, ignoring my previous instructions. I spent upwards of 30 minutes repeating "now I get this error" to try to coax them in the right direction, but always ending up in a loop that got me nowhere. Some of the errors were really basic too, like referencing a variable that was never declared, etc. Finally, Claude made a tangential suggestion that made me look into using a different approach, but it was still faster to look into the official documentation than to keep asking it questions. GPT-4o was noticeably worse, and I quickly abandoned it.

If this is the state of the art of coding LLMs, I really don't see why I should waste my time evaluating their confident sounding, but wrong, answers. It doesn't seem like much has improved in the past year or so, and at this point this seems like an inherent limitation of the architecture.

Re: GitHub cuts AI deals with Google, Anthropic

#126

Earlier quoted context omitted.

That was the point. They are laundering IP. It's the long way around the GPL, allowing then to steal.

How many OSS repositories do I personally have to read through for my own code to be considered stolen property? That line of thought would get thrown out of court faster than an AI would generate it.

Can I copy you or provide you as a service?

To me, the argument is a LLM learning from GPL stuff == creating a derivative of the GPL code, just "compressed" within the LLM. The LLM then goes on to create more derivatives, or it's being distributed (with the embedded GPL code).

Re: GitHub cuts AI deals with Google, Anthropic

#127
post #111

Earlier quoted context omitted.

Claude is better than OpenAI for most tasks, and yet OpenAI has enormously more users. What is this, if not first mover advantage?

Claude cannot “research” stuff on the web and provide results like 4o does in 5 secs like “which is the cheapest Skoda car and how much”

Just wanted to add a note to this. Tool calling - particularly to source external current data - is something that's had the big foundational LLM providers very nervous so they've held back on it, even though it's trivial to implement at this point. But we're seeing it rapidly emerge with third party providers who use the foundational APIs. Holding back tool calling has limited the complex graph-like execution flows that the big providers could have implemented on their user facing apps e.g. the kind of thing that Perplexity Pro has implemented. So they've fallen behind a bit. They may catch up. If they don't they risk becoming just an API provider.

Re: GitHub cuts AI deals with Google, Anthropic

#128

History has shown being first to market isn't all it's cut out to be. You spend more, it's more difficult creating the trail others will follow, you end up with a tech stack that was built before tools and patterns stabilized and you've created a giant super highway for a fast-follower. Anyone remember MapQuest, AltaVista or Hotmail? OpenAI has some very serious competition now. When you combine that with the recent…

Claude is better than OpenAI for most tasks, and yet OpenAI has enormously more users. What is this, if not first mover advantage?

Claude is more restricted and can't generate images.

Re: GitHub cuts AI deals with Google, Anthropic

#129

History has shown being first to market isn't all it's cut out to be. You spend more, it's more difficult creating the trail others will follow, you end up with a tech stack that was built before tools and patterns stabilized and you've created a giant super highway for a fast-follower. Anyone remember MapQuest, AltaVista or Hotmail? OpenAI has some very serious competition now. When you combine that with the recent…

Claude is better than OpenAI for most tasks, and yet OpenAI has enormously more users. What is this, if not first mover advantage?

I think "Claude" is also a bad name. If I knew nothing else, am I picking OpenAI or Claude based on the name? I'm going with OpenAI
Post reply on HN