Live data from Hacker News

Claude 3 model family

anthropic.com

681–690 of 723 posts

Re: Claude 3 model family

#681

This part continues to bug me in ways that I can't seem to find the right expression for: > Previous Claude models often made unnecessary refusals that suggested a lack of contextual understanding. We’ve made meaningful progress in this area: Opus, Sonnet, and Haiku are significantly less likely to refuse to answer prompts that border on the system’s guardrails than previous generations of models. As shown below, the…

The sense of entitlement is epic. You're offended are you? Are you offended that Photoshop won't let you edit images of money too? Its not your model. You didn't spend literally billions of dollars developing it. So you can either use it according to the terms of the people who developed it (like literally any commercially available software ever) or not use it at all.

Ooh i want to edit money images that sounds fun

Re: Claude 3 model family

#682

This part continues to bug me in ways that I can't seem to find the right expression for: > Previous Claude models often made unnecessary refusals that suggested a lack of contextual understanding. We’ve made meaningful progress in this area: Opus, Sonnet, and Haiku are significantly less likely to refuse to answer prompts that border on the system’s guardrails than previous generations of models. As shown below, the…

You don't think that if the hammer company had a way (that cost them almost nothing) to make sure that the hammer its never used to attack human beings they wouldn't add such feature? I think many would, if anything by pressure of their local goverment or even the competition ("our hammers can't hurt your baby on accident like those other companies!") , but its impossible to add such feature to hammer; so maybe the l…

Actually you kind of could. If you imagine making a normal hammer slightly more squishy, thats pretty similar to what they’re doing with llms. If the squishy hammer hits a person’s head, it’ll do less damage, but it’s also worse for nails.

Re: Claude 3 model family

#683
post #555
post #410

Earlier quoted context omitted.

LLMs are intuitive computing algorithms, which means they only mimic the subconscious faculties of our brain. You’re referencing the need for careful systematic logical self-aware thinking, which is a great point! You’re absolutely right that LLMs can only loosely approximate it on their own, and not that well. Luckily, we figured out how to write programs to mimic that part of the brain in the 70s ;)

> Luckily, we figured out how to write programs to mimic that part of the brain in the 70s What’s this in reference to?

The field of Symbolic Artificial Intelligence which is still (for now…) a majority of what is taught in American AI courses IME. It’s also the de facto technical translation of Cognitive Science. There’s a long debate between the two “camps”, which were called the neats (Turing, Minsky, McCarthy, etc) and the scruffies (the people behind ML).

The scruffies spent decades being shit on by the other camp as being lazy and simple-minded (due to a perception of “brute forcing” problems), only to find more success than most of them had ever imagined. I think anyone who says they were confident that ML-based NLP models could one day not only predict text, but also perform intuition, is either a revisionist or a prophet.

The whole Neat field got kinda stuck when we translated the low hanging fruit to symbolic algorithms (Simon & Newell’s Problem Solving being the most interesting IMO), but we had no way to test them. As another commenter alluded to, these systems lacked any “intuitive”(aka subconscious, fuzzy, approximate) faculties, so their high-level strategies could never work in the messy real world, mostly because it’s pretty impossible to definitively tell what information is relevant and what information isn’t to any given problem. This is called the problem of contextual “attention and selection”, and the problem more generally “the frame problem”.

Now that we have systems that mimic human subconscious intuition AND systems that mimic human self conscious reason, of course the next step is… declare complete victory and abandon the latter group forever as trash, apparently.

This is all a super biased take from someone who only got into this specific debate last year, tho I promise I do have some relevant credentials and have been working full time on this for close to a year. I strongly believe that LLMs are about to unlock the first (true) Cognitive Revolution.

Re: Claude 3 model family

#684

Earlier quoted context omitted.

To be fair, the search engine monopoly has done a pretty good job of making that information quite difficult to actually find. Not impossible, but much more difficult than you might assume.

https://wikileaks.org/gifiles/attach/130/130179_Secrets_of_M... seems to be a cookbook, but I'm no chemist. took me a couple of minutes via Google.

That in 2024 it takes 120 seconds to locate a website is an embarrassing joke.

Re: Claude 3 model family

#685

Earlier quoted context omitted.

> it is impossible to use a nuke without negatively affecting other people Should I be allowed to own C4 explosives and machine guns? Because I can use C4 explosives in a way that doesn't harm other people by simply detonating it on my private property. I am confused about what the limiting principle is supposed to be here. Do we just allow people to have access to technology of arbitrary power as long as there exist…

Yes you should be allowed to own C4 and machine guns. And you can. Because you can use them in a way that doesnt hurt other people, we as a society allow that.

owning and using are different. try that on the DC Mall and see how well it goes buddy

Re: Claude 3 model family

#686
post #585

Earlier quoted context omitted.

This is a weird demand to have in my opinion. You have plenty of applications on your computer and they only do what they were designed for. You can't ask a note taking app (even if it's open soured) to do video editing, unless you modify the code.

My note taking app has never refused my input of a swear word.

I've had to work around keyboards on phones that try. How is that different? Given enough trying, you could get what you want from the LLM too, they're just better at directing you than the shitty keyboard app.

Re: Claude 3 model family

#687
post #546

Earlier quoted context omitted.

I find it incredibly hard to believe we stumbled upon an efficient architecture that requires nothing but more compute not 10 years after the AI winter thawed. That's incredibly optimistic to the point of blind hope. What is your background and what makes you think we've somehow already figured everything out?

I have been working on architectures in this field for almost a decade now and I've seen firshand how things have changed. It might seem hard to believe if you have been to university ~10 years ago and only know the state of deep learning from the early revolutions back then, but we are in a totally different era now. With the transformer, we now have a true general-purpose, efficiently scalable, end-to-end different…

and yet SamA says it's actual trillions of dollars in entirely new compute capacity to reach the next level. hmmm. to believe him or you... so hard to decide.

Re: Claude 3 model family

#688
post #683
post #555

Earlier quoted context omitted.

> Luckily, we figured out how to write programs to mimic that part of the brain in the 70s What’s this in reference to?

The field of Symbolic Artificial Intelligence which is still (for now…) a majority of what is taught in American AI courses IME. It’s also the de facto technical translation of Cognitive Science. There’s a long debate between the two “camps”, which were called the neats (Turing, Minsky, McCarthy, etc) and the scruffies (the people behind ML). The scruffies spent decades being shit on by the other camp as being lazy a…

Thanks! Do you recommendany good reads about this?

Re: Claude 3 model family

#689

Earlier quoted context omitted.

Hi Simon, Big fan of your work with the LLM tool. I have a cool use for it that I wanted to share with you (on mac). First, I created a quick action in Automator that recieves text. Then I put together this script with the help of ChaptGPT: escaped_args="" for arg in "$@"; do escaped_arg=$(printf '%s\n' "$arg" | sed "s/'/'\\\\''/g") escaped_args="$escaped_args '$escaped_arg'" done result=$(/Users/XXXX/Library/Python/…

Does someone know a similar tool like Automator on Linux for this particular use case?

So one of the ways how it can be done is: In linux (at least in gnome) it's possible to bind any app or script to a custom global hotkey, plus xclip has access to the currently selected text and zenity can be used to display the result. So it's possible to do it just using bash script bound to a global hotkey.

Re: Claude 3 model family

#690

Earlier quoted context omitted.

The sense of entitlement is epic. You're offended are you? Are you offended that Photoshop won't let you edit images of money too? Its not your model. You didn't spend literally billions of dollars developing it. So you can either use it according to the terms of the people who developed it (like literally any commercially available software ever) or not use it at all.

Fairly rich coming from an account where all it does is call others hacks.

Oh, I though this was hacker news?
Post reply on HN