Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GitHub cuts AI deals with Google, Anthropic

bloomberg.com

Post reply on HN
Print view View original

191–200 of 742 posts

Re: GitHub cuts AI deals with Google, Anthropic

#191

Post by mattwad »

pseudosavant wrote: post #80
campbel wrote: post #3

This is pretty exciting. I'm a copilot user at work, but also have access to Claude. I'm more inclined to use Claude for difficult coding problems or to review my work as I've just grown more confident in its abilities over the last several months.

I use both Claude and ChatGPT/GPT-4o a lot. Claude, the model, definitely is 'better' than GPT-4o. But OpenAI provides a much more capable app in ChatGPT and an easier development platform. I would absolutely choose to use Claude as my model with ChatGPT if that happened (yes, I know it won't). ChatGPT as an app is just so far ahead: code interpreter, web search/fetch, fluid voice interaction, Custom GPTs, image gene…

Have you tried using Cursor with Claude embedded? I can't go back to anything else, it's very nice having the AI embedded in the IDE and it just knows all the files i am working with. Cursor can use GPT-4o too if you want

Re: GitHub cuts AI deals with Google, Anthropic

#192

Post by ben_w »

darepublic wrote: post #177
state_less wrote: post #114

Earlier quoted context omitted.

Old style Google search is dead, folks just haven’t closed the casket yet. My index queries are down ~90%. In the future, we’ll look back at LLMs as a major turning point in how people retrieve and consume information.

I still prefer it over using llm. And I would be doubtful that llm search has major benefits over Google search imo

Depends what you want it for.

Right now, I find each tool better at different things.

If I can only describe what I want but don't know key words, LLM are the only solution.

If I need citations, LLMs suck.

Re: GitHub cuts AI deals with Google, Anthropic

#193

Post by logicchains »

benreesman wrote: post #173
pseudosavant wrote: post #80

Earlier quoted context omitted.

I use both Claude and ChatGPT/GPT-4o a lot. Claude, the model, definitely is 'better' than GPT-4o. But OpenAI provides a much more capable app in ChatGPT and an easier development platform. I would absolutely choose to use Claude as my model with ChatGPT if that happened (yes, I know it won't). ChatGPT as an app is just so far ahead: code interpreter, web search/fetch, fluid voice interaction, Custom GPTs, image gene…

It’s all a dice game with these things, you have to watch them closely or they start running you (with bad outcomes). Disclaimers aside: Sonnet is better in the small, by a lot. It’s sharply up from idk, three months ago or something when it was still an attractive nuisance. It still tops out at “Best SO Answer”, but it hits that like 90%+. If it involves more than copy paste, sorry folks, it’s still just really fuck…

>If it involves more than copy paste, sorry folks, it’s still just really fucking good copy paste.

Are you sure you're using Claude 3.5 Sonnet? In my experience it's absolutely capable of writing entire small applications based off a detailed spec I give it, which don't exist on GitHub or Stack Overflow. It makes some mistakes, especially for underspecified things, but generally it can fix them with further prompting.

Re: GitHub cuts AI deals with Google, Anthropic

#195

Post by Fairburn »

1 point by Fairburn 0 minutes ago | prev | next | edit | delete [–]

I have no doubts that Claude is serviceable from a coders perspective. But for me, as a paid user, I became tired of being told that I have to slow down and then be cut off while actively working on a product. When Anthropic addresses this, Ill add it back to my tools.

Re: GitHub cuts AI deals with Google, Anthropic

#196

Post by drcode »

rogerkirkness wrote: post #146
sigmoid10 wrote: post #123

Earlier quoted context omitted.

Claude is only better in some cherry picked standard eval benchmarks, which are becoming more useless every month due to the likelihood of these tests leaking into training data. If you look at the Chatbot Arena rankings where actual users blindly select the best answer from a random choice of models, the top 3 models are all from OpenAI. And the next best ones are from Google and X.

Claude 3.5 Sonnet (New) is meaningfully better than ChatGPT GPT4o or o1.

my experience is that o1 is still slightly better for coding, sonnet new is better for analyzing data, and most other tasks besides coding

Re: GitHub cuts AI deals with Google, Anthropic

#197

Post by logicchains »

mensetmanusman wrote: post #180
a_wild_dandan wrote: post #155

Earlier quoted context omitted.

The "statistical parrot" parrots have been demonstrably wrong for years (see e.g. LeCun et al[1]). It's just harder to ignore reality with hundreds of millions of people now using incredible new AI tools. We're approaching "don't believe your lying eyes" territory. Deniers will continue pretending that LLMs are just an NFT-level fad or bubble or whatever. The AI revolution will continue to pass them by. More's the pi…

A trillion dimensional stochastic parrot is still a stochastic parrot. If these systems showed understanding we would notice. No one is denying that this form of intelligence is useful.

I don't know how you can say they lack understanding of the world when in pretty much any standardised test designed to measure human intelligence they perform better than the average human. They only thing that don't understand is touch because they're not trained on that, but they can already understand audio and video.

Re: GitHub cuts AI deals with Google, Anthropic

#198

Post by TeMPOraL »

pseudosavant wrote: post #80
campbel wrote: post #3

This is pretty exciting. I'm a copilot user at work, but also have access to Claude. I'm more inclined to use Claude for difficult coding problems or to review my work as I've just grown more confident in its abilities over the last several months.

I use both Claude and ChatGPT/GPT-4o a lot. Claude, the model, definitely is 'better' than GPT-4o. But OpenAI provides a much more capable app in ChatGPT and an easier development platform. I would absolutely choose to use Claude as my model with ChatGPT if that happened (yes, I know it won't). ChatGPT as an app is just so far ahead: code interpreter, web search/fetch, fluid voice interaction, Custom GPTs, image gene…

> ChatGPT as an app is just so far ahead: code interpreter, web search/fetch, fluid voice interaction, Custom GPTs, image generation, and memory. It isn't close.

Funny thing, TypingMind was ahead of them for over a year, implementing those features on top of the API, without trying to mix business model with engineering[0]. It's only recently that ChatGPT webapp got more polished and streamlined, but TypingMind's been giving you all those features for every LLM that can handle it. So, if you're looking for ChatGPT-level frontend to Anthropic models, this is it.

ChatGPT shines on mobile[1] and I still keep my subscription for that reason. On desktop, I stick to TypingMind and being able to run the same plugins on GPT-4o and Claude 3.5 Sonnet, and if I need a new tool, I can make myself one in five minutes with passing knowledge of JavaScript[2]; no need to subscribe to some Gee Pee Tee.

Now, I know I sound like a shill, I'm not. I'm just a satisfied user with no affiliation to the app or the guy that made it. It's just that TypingMind did the bloodingly stupid obvious thing to do with the API and tool support (even before the latter was released), and continues to do the obvious things with it, and I'm completely confused as to why others don't, or why people find "GPTs" novel. They're not. They're a simple idea, wrapped in tons of marketing bullshit that makes it less useful and delayed its release by half a year.

--

[0] - "GPTs", seriously. That's not a feature, that's just system prompt and model config, put in an opaque box and distributed on a marketplace for no good reason.

[1] - Voice story has been better for a while, but that's a matter of integration - OpenAI putting together their own LLM and (unreleased) voice model in a mobile app, in a manner hardly possible with the API their offered, vs. TypingMind being a webapp that uses third party TTS and STT models via "bring your own API key" approach.

[2] - I made https://docs.typingmind.com/plugins/plugins-examples#db32cc6... long before you could do that stuff with ChatGPT app. It's literally as easy as it can possibly be: https://git.sr.ht/~temporal/typingmind-plugins/tree. In particular, this one is more representative - https://git.sr.ht/~temporal/typingmind-plugins/tree/master/i... - PlantUML one is also less than 10 lines of code, but on top of 1.5k lines of DEFLATE implementation in JS I plain copy-pasted from the interwebz because I cannot into JS modules.

Re: GitHub cuts AI deals with Google, Anthropic

#199

Post by nonfamous »

sprkv5 wrote: post #107
poincaredisk wrote: post #87

Earlier quoted context omitted.

Copilot can choke on my AGPL code on GitHub, that was used for training their proprietary models. I'm still salty about this, sadly looks like the world has largely moved on.

Yet Google and Anthropic wanted in on the huge data that GitHub has to offer. It seems the world has not moved on just yet.

The Claude terms of service [1] apparently preclude Anthropic or AWS using GitHub user data for training:

GitHub Copilot uses Claude 3.5 Sonnet hosted on Amazon Web Services. When using Claude 3.5 Sonnet, prompts and metadata are sent to Amazon's Bedrock service, which makes the following data commitments: Amazon Bedrock doesn't store or log your prompts and completions. Amazon Bedrock doesn't use your prompts and completions to train any AWS models and doesn't distribute them to third parties.

[1] https://docs.github.com/en/copilot/using-github-copilot/usin...

Re: GitHub cuts AI deals with Google, Anthropic

#200

Post by devmor »

mensetmanusman wrote: post #180
a_wild_dandan wrote: post #155

Earlier quoted context omitted.

The "statistical parrot" parrots have been demonstrably wrong for years (see e.g. LeCun et al[1]). It's just harder to ignore reality with hundreds of millions of people now using incredible new AI tools. We're approaching "don't believe your lying eyes" territory. Deniers will continue pretending that LLMs are just an NFT-level fad or bubble or whatever. The AI revolution will continue to pass them by. More's the pi…

A trillion dimensional stochastic parrot is still a stochastic parrot. If these systems showed understanding we would notice. No one is denying that this form of intelligence is useful.

No you don’t understand, if i put a billion billion trillion monkeys on typewriters, they’re actually now one super intelligent monkey because they’re useful now!

We just need more monkeys and it will be the same as a human brain.

Post reply on HN