Live data from Hacker News

GitHub cuts AI deals with Google, Anthropic

bloomberg.com

131–140 of 742 posts

Re: GitHub cuts AI deals with Google, Anthropic

#131

Can we change the title to “GitHub _signs_ deals with Google, Anthropic” ? The original got me thinking it already had deals it was getting out of

To "cut a deal" is a common (American?) English idiom meaning to "make a deal".

But agree that it's better to avoid using idioms on a site that has many visitors for whom English is not their first language.

Re: GitHub cuts AI deals with Google, Anthropic

#132
post #3

This is pretty exciting. I'm a copilot user at work, but also have access to Claude. I'm more inclined to use Claude for difficult coding problems or to review my work as I've just grown more confident in its abilities over the last several months.

The speed with which AI models are improving blows my mind. Humans quickly normalize technological progress, but it's staggering to reflect on our progress over just these two years .

I wonder how long people will still protest in these threads that "It doesn't know anything! It's just an autocomplete parrot!"

Because.. yea, it is. However.. it keeps expanding, it keeps getting more useful. Yea people and especially companies are using it for things which it has no business being involved in.. and despite that it keeps growing, it keeps progressing.

I do find the "stochastic parrot" comments slowly dwindle in number and volume with each significant release, though.

Still, i find it weirdly interesting to see a bunch of people be both right and "wrong" at the same time. They're completely right, and yet it's like they're also being proven wrong in the ways that matter.

Very weird space we're living in.

Re: GitHub cuts AI deals with Google, Anthropic

#133
post #128

Earlier quoted context omitted.

Claude is better than OpenAI for most tasks, and yet OpenAI has enormously more users. What is this, if not first mover advantage?

Claude is more restricted and can't generate images.

I asked Claude a physics question about bullet trajectory and it refused to answer. Restricted too far imo.

Re: GitHub cuts AI deals with Google, Anthropic

#134
post #111

Earlier quoted context omitted.

Claude is better than OpenAI for most tasks, and yet OpenAI has enormously more users. What is this, if not first mover advantage?

Claude cannot “research” stuff on the web and provide results like 4o does in 5 secs like “which is the cheapest Skoda car and how much”

This is what I use phind for.

Re: GitHub cuts AI deals with Google, Anthropic

#135
post #75

Earlier quoted context omitted.

The speed with which AI models are improving blows my mind. Humans quickly normalize technological progress, but it's staggering to reflect on our progress over just these two years .

Yes! I'm much more inclined to write one-off scripts for short manual tasks as I can usually get AI to get something useful very fast. For example, last week I worked with Claude to write a script to get a sense of how many PRs my company had that included comprehensive testing. This was borderline best done as a manual task previously, now I just ask Claude to write a short bash script that uses the GitHub CLI to do…

I rarely use LLMs for tasks but i love it for exploring spaces i would otherwise just ignore. Like writing some random bash script isn't difficult at all, but it's also so fiddly that i just don't care to do it. It's nice to just throw a bot at it and come back later. Loosely speaking.

Still i find very little use from LLMs in this front, but they do come in handy randomly.

Re: GitHub cuts AI deals with Google, Anthropic

#136

Earlier quoted context omitted.

Yes, because transfer learning works. A specialized model for X will be subsumed by a general model for X/Y/Z as it becomes better at Y/Z. This is why models which learn other languages become better at English. Custom models still have use cases, e.g. situations requiring cheaper or faster inference. But ultimately The Bitter Lesson holds -- your specialized thing will always be overtaken by throwing more compute at…

> This is why models which learn other languages become better at English. Do you have a source for that, I'd love to learn more!

Evaluating cross-lingual transfer learning approaches in multilingual conversational agent models[1]

Cross-lingual transfer learning for multilingual voice agents[2]

Large Language Models Are Cross-Lingual Knowledge-Free Reasoners[3]

An Empirical Study of Cross-Lingual Transfer Learning in Programming Languages[4]

That should get you started on transfer learning re. languages, but you'll have more fun personally picking interesting papers over reading a random yahoo's choices. The fire hose of papers is nuts, so you'll never be left wanting.

[1] https://www.amazon.science/publications/evaluating-cross-lin...

[2] https://www.amazon.science/blog/cross-lingual-transfer-learn...

[3] https://arxiv.org/pdf/2406.16655v1

[4] https://arxiv.org/pdf/2310.16937v2

Re: GitHub cuts AI deals with Google, Anthropic

#137

History has shown being first to market isn't all it's cut out to be. You spend more, it's more difficult creating the trail others will follow, you end up with a tech stack that was built before tools and patterns stabilized and you've created a giant super highway for a fast-follower. Anyone remember MapQuest, AltaVista or Hotmail? OpenAI has some very serious competition now. When you combine that with the recent…

Claude is better than OpenAI for most tasks, and yet OpenAI has enormously more users. What is this, if not first mover advantage?

[flagged]

Re: GitHub cuts AI deals with Google, Anthropic

#138

Earlier quoted context omitted.

Claude is better than OpenAI for most tasks, and yet OpenAI has enormously more users. What is this, if not first mover advantage?

Claude is only better in some cherry picked standard eval benchmarks, which are becoming more useless every month due to the likelihood of these tests leaking into training data. If you look at the Chatbot Arena rankings where actual users blindly select the best answer from a random choice of models, the top 3 models are all from OpenAI. And the next best ones are from Google and X.

Bullshit. Claude 3.5 Sonnet owns the competition according to the most useful benchmark: operating a robot body in the real world. No other model comes close.

Re: GitHub cuts AI deals with Google, Anthropic

#139

Earlier quoted context omitted.

Claude is better than OpenAI for most tasks, and yet OpenAI has enormously more users. What is this, if not first mover advantage?

Claude is only better in some cherry picked standard eval benchmarks, which are becoming more useless every month due to the likelihood of these tests leaking into training data. If you look at the Chatbot Arena rankings where actual users blindly select the best answer from a random choice of models, the top 3 models are all from OpenAI. And the next best ones are from Google and X.

3.5 Sonnet, ime, is dramatically better at coding than 4o. o1-preview may be better, but it's too slow.

Re: GitHub cuts AI deals with Google, Anthropic

#140

Earlier quoted context omitted.

Claude is better than OpenAI for most tasks, and yet OpenAI has enormously more users. What is this, if not first mover advantage?

Claude is only better in some cherry picked standard eval benchmarks, which are becoming more useless every month due to the likelihood of these tests leaking into training data. If you look at the Chatbot Arena rankings where actual users blindly select the best answer from a random choice of models, the top 3 models are all from OpenAI. And the next best ones are from Google and X.

I don't pay any attention to leaderboards. I pay for both Claude and ChatGPT and use them both daily for anything from Python coding to the most random questions I can think of. In my experience Claude is better (much better) that ChatGPT in almost all use cases. Where ChatGPT shines is the voice assistant - it still feels almost magical having a "human-like" conversation with the AI agent.
Post reply on HN